ETSI TS 102 250-3 V1.4.1 (2008-12)

Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in GSM and 3G networks; Part 3: Typical procedures for Quality of Service measurement equipment

RTS/STQ-00123m

General Information

• Status: Published
• Publication Date: 16-Dec-2008
• Technical Committee: STQ MOBILE - STQ Mobile
• Current Stage: 12 - Completion
• Due Date: 04-Dec-2008
• Completion Date: 17-Dec-2008

Standards Content (Sample)

ETSI TS 102 250-3 V1.4.1 (2008-12)
Technical Specification


Speech and multimedia Transmission Quality (STQ);
QoS aspects for popular services in GSM and 3G networks;
Part 3: Typical procedures for Quality of Service
measurement equipment

---------------------- Page: 1 ----------------------
2 ETSI TS 102 250-3 V1.4.1 (2008-12)



Reference
RTS/STQ-00123m
Keywords
3G, GSM, network, QoS, service, speech
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2008.
All rights reserved.

TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
ETSI

---------------------- Page: 2 ----------------------
3 ETSI TS 102 250-3 V1.4.1 (2008-12)
Contents
Intellectual Property Rights.6
Foreword.6
Introduction .7
1 Scope.8
2 References.8
2.1 Normative references.8
2.2 Informative references.8
3 Definitions and abbreviations.9
3.1 Definitions.9
3.2 Abbreviations.9
4 Goal of measurement.10
5 Classification of services.10
5.1 Classification guidelines.10
5.2 General structure of service descriptions.11
6 General aspects for all types of services.11
6.1 Set-up and control .11
6.2 Phase and result classification.11
6.2.1 Phase and result classification for direct services .12
6.2.2 Phase and result classification for store-and-forward services .13
7 Telephony measurements.13
7.1 General aspects.13
7.1.1 Transaction definition and transaction types.13
7.1.2 Parameter overview.14
7.1.2.1 Additional considerations.14
7.1.3 Additional transaction result definitions .14
7.1.4 Content quality.15
7.1.5 Verification of usable two-way connection .15
7.2 Speech telephony.15
7.2.1 Transaction definition and transaction types for speech telephony .15
7.2.2 Parameter overview for speech telephony .16
7.2.3 Additional transaction results for speech telephony .16
7.2.4 Content quality for speech telephony.16
7.2.5 Verification of usable two-way connection for speech telephony .16
7.2.6 Void.16
7.2.7 Transaction definition and transaction types for video telephony .16
7.2.8 Parameter overview for video telephony .16
7.2.9 Additional transaction result definitions for video telephony.17
7.2.10 Content quality for video telephony .17
7.2.11 Verification of usable two-way connection for video telephony .17
8 Store-and-forward services measurement .17
8.1 General aspects.17
8.1.1 Transaction phase and parameter overview .18
8.1.2 Additional transaction result definitions .18
8.1.3 Content quality for Store-and-Forward Services .18
8.1.3.1 SMS.18
8.1.3.2 MMS.18
8.1.3.3 e-Mail.19
8.2 SMS measurements .19
8.2.1 General aspects of SMS measurements .19
8.2.2 Transaction definitions and transaction types for SMS .19
8.2.3 Testing mode for SMS-MT.20
ETSI

---------------------- Page: 3 ----------------------
4 ETSI TS 102 250-3 V1.4.1 (2008-12)
8.2.4 Testing mode for SMS-MO .20
8.2.5 Transaction phase and parameter overview for SMS.20
8.2.6 Possible transaction results for SMS.20
8.2.7 Content quality for SMS .21
8.3 MMS.21
8.3.1 General aspects of MMS measurements.21
8.3.2 Transaction definitions and transaction types for MMS .21
8.3.3 Transaction phase and parameter overview for MMS .22
8.3.4 Additional transaction result definitions for MMS .22
8.3.5 Content quality for MMS.22
8.4 E-Mail.23
8.4.1 Transaction definitions and transaction types for E-Mail .23
8.4.1.1 Standardized E-Mail Content.23
8.4.2 Transaction scenarios.23
8.4.2.1 End-to-End scenario.23
8.4.2.2 Download scenario.24
8.4.3 Protocols.24
8.4.4 Push function.25
8.4.5 Support for header download.25
8.4.6 Timeout.25
8.4.7 Further mandatory requirements.25
8.4.7.1 Guard times.26
8.4.8 Further optional requirements.26
8.4.9 Test sequence for End-to-End scenario .26
8.4.10 Test sequence for Download scenario .30
9 Data measurements.33
9.1 Common aspects.33
9.1.1 Transaction definition and transaction types for data measurements.33
9.1.2 Server types.33
9.1.3 Test data content .34
9.1.4 Transaction phase and parameter overview .34
9.1.4.1 General.34
9.1.4.2 Packet-switched access.35
9.1.4.3 Circuit-switched access.35
9.1.5 Possible transaction results .35
9.1.6 Content quality.36
9.2 FTP.36
9.2.1 Transaction definition and transaction types for FTP.36
9.2.2 Transaction phase and parameter overview for FTP.36
9.2.3 Possible transaction results for FTP.36
9.2.4 Content quality for FTP .36
9.2.5 Content integrity for FTP.36
9.3 HTTP.36
9.3.1 Transaction definition and transaction types for HTTP.36
9.3.2 Transaction phase and parameter overview for HTTP.36
9.3.3 Possible transaction results for HTTP.37
9.3.4 Content quality for HTTP .37
9.3.5 Content integrity for HTTP.37
9.4 E-mail.37
9.4.1 Transaction definition and transaction types for E-mail .37
9.4.2 Transaction phase and parameter overview for E-mail.37
9.4.3 Possible transaction results for E-mail.37
9.4.4 Content quality for E-mail .37
9.4.5 Content integrity for E-mail.37
9.5 WAP.38
9.5.1 Transaction definition and transaction types for WAP .38
9.5.2 Transaction phase and parameter overview for WAP.38
9.5.3 Possible transaction results for WAP.39
9.5.4 Content quality for WAP .39
9.5.5 Content integrity for WAP.39
9.6 Streaming Video.40
ETSI

---------------------- Page: 4 ----------------------
5 ETSI TS 102 250-3 V1.4.1 (2008-12)
9.6.1 Transaction definition and transaction types for streaming video .40
9.6.2 Transaction phase and parameter overview for streaming video.40
9.6.3 Possible transaction results for Streaming Video.40
9.6.4 Content quality for Streaming Video.40
9.6.5 Content integrity for Streaming video .40
History .41

ETSI

---------------------- Page: 5 ----------------------
6 ETSI TS 102 250-3 V1.4.1 (2008-12)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia
Transmission Quality (STQ).
NOTE: Version 2.1.1 of the present document was published with a wrong version number. Please note that the
present version 1.4.1 has been re-published to correct this and therefore superceeds the previous versions
V1.1.1, V1.2.1 and 2.1.1 which have been withdrawn to avoid confusion.
The present document is part 3 of a multi-part deliverable covering the QoS aspects for popular services in GSM and
3G networks, as identified below:
Part 1: "Identification of Quality of Service aspects";
Part 2: "Definition of Quality of Service parameters and their computation";
Part 3: "Typical procedures for Quality of Service measurement equipment";
Part 4: "Requirements for Quality of Service measurement equipment";
Part 5: "Definition of typical measurement profiles";
Part 6: "Post processing and statistical methods";
Part 7: "Network Based Quality of Service Measurements".
Part 1 identifies QoS aspects for popular services in GSM and 3G networks. For each service chosen QoS indicators are
listed. They are considered to be suitable for the quantitatively characterization of the dominant technical QoS aspects
as experienced from the end-customer perspective.
Part 2 defines QoS parameters and their computation for popular services in GSM and 3G networks. The technical QoS
indicators, listed in part 1, are the basis for the parameter set chosen. The parameter definition is split into two parts: the
abstract definition and the generic description of the measurement method with the respective trigger points. Only
measurement methods not dependent on any infrastructure provided are described in the present document. The
harmonized definitions given in the present document are considered as the prerequisites for comparison of QoS
measurements and measurement results.
Part 3 describes typical procedures used for QoS measurements over GSM, along with settings and parameters for such
measurements.
Part 4 defines the minimum requirements of QoS measurement equipment for GSM and 3G networks in the way that
the values and trigger-points needed to compute the QoS parameter as defined in part 2 can be measured following the
procedures defined in part 3. Test-equipment fulfilling the specified minimum requirements, will allow to perform the
proposed measurements in a reliable and reproducible way.
Part 5 specifies test profiles which are required to enable benchmarking of different GSM or 3G networks both within
and outside national boundaries. It is necessary to have these profiles so that when a specific set of tests are carried out
then customers are comparing "like for like" performance.
ETSI

---------------------- Page: 6 ----------------------
7 ETSI TS 102 250-3 V1.4.1 (2008-12)
Part 6 describes procedures to be used for statistical calculations in the field of QoS measurement of GSM and 3G
networks using probing systems.
Part 7 describes the methodology to be used to get statistical samples that could be representative of the population of
all existent calls so the statistical inferences made from the data collected by test calls are statistically correct and the
error margin could be calculated.
Introduction
All the defined quality of service parameters and their computations are based on field measurements. That indicates
that the measurements were made from customers point of view (full End-to-end perspective, taking into account the
needs of testing).
It is assumed that the end customer can handle his mobile and the services he wants to use (operability is not evaluated
at this time). For the purpose of measurement it is assumed that:
• the service is available and not barred for any reason;
• routing is defined correctly without errors;
• the target subscriber equipment is ready to answer the call;
• voice quality values measured should only be employed by calls ended successfully for statistical analysis;
• need to define similar for video calls;
• however, measured values from calls ended unsuccessfully (e.g. dropped) should be available for additional
evaluations and therefore, must be stored;
• further preconditions may apply when reasonable.
ETSI

---------------------- Page: 7 ----------------------
8 ETSI TS 102 250-3 V1.4.1 (2008-12)
1 Scope
The present document describes typical procedures used for QoS measurements on mobile communication networks,
e.g. GSM or UMTS, along with settings and parameters for such measurements.
Where possible existing ITU-T or ETSI definition are referenced. In some cases ITU-T or ETSI definitions do not exist
or are considered as too generic, then a more service and mobile network specific definition is chosen.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific.
• For a specific reference, subsequent revisions do not apply.
• Non-specific reference may be made only to a complete document or a part thereof and only in the following
cases:
- if it is accepted that it will be possible to use all future changes of the referenced document for the
purposes of the referring document;
- for informative references.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
For online referenced documents, information sufficient to identify and locate the source shall be provided. Preferably,
the primary source of the referenced document should be cited, in order to ensure traceability. Furthermore, the
reference should, as far as possible, remain valid for the expected life of the document. The reference shall include the
method of access to the referenced document and the full network address, with the same punctuation and use of upper
case and lower case letters.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are indispensable for the application of the present document. For dated
references, only the edition cited applies. For non-specific references, the latest edition of the referenced document
(including any amendments) applies.
[1] ITU-T Recommendation P.56: "Objective measurement of active speech level".
[2] ETSI TS 102 250-1: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 1: Identification of Quality of Service criteria".
[3] ETSI TS 102 250-2: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 2: Definition of Quality of Service parameters
and their computation".
2.2 Informative references
The following referenced documents are not essential to the use of the present document but they assist the user with
regard to a particular subject area. For non-specific references, the latest version of the referenced document (including
any amendments) applies.
[i.1] IETF RFC 3501: "Internet message access protocol - version 4rev1".
[i.2] IETF RFC 2177: "IMAP4 IDLE command".
ETSI

---------------------- Page: 8 ----------------------
9 ETSI TS 102 250-3 V1.4.1 (2008-12)
[i.3] IETF RFC 2821: "Simple Mail Transfer Protocol".
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
A party: in direct transactions, the party initiating the transaction (calling party)
NOTE: In store-and-forward transactions, the party sending content.
B party: in direct transactions, the termination or counterpart of a transaction
NOTE: In store-and-forward transactions, the party receiving content.
content: entirety of information transferred within a transaction, seen from the user's perspective
NOTE: In case of services requiring entrance procedures (e.g. server login with FTP), information flow to
achieve the state of being able to transfer actual user data is not counted as content.
EXAMPLE: Single SMS in SMS service; single multimedia message consisting of video, audio, and text
components in MMS service.
direct transaction: real-time tra
...