SIST-V ETSI/EG 202 057-2 V1.3.2:2011

SLOVENSKI STANDARD
SIST-V ETSI/EG 202 057-2 V1.3.2:2011
01-julij-2011
.DNRYRVWSUHQRVDJRYRUDLQYHþSUHGVWDYQLKYVHELQ674'HILQLFLMHLQPHULWYH
SDUDPHWURY4R6NLVHQDQDãDMRQDXSRUDEQLNDGHO*RYRUQDWHOHIRQLMD

IDNVLPLOHVNXSLQHSRGDWNRYQHVWRULWYHSUHNPRGHPRYLQVWRULWYHNUDWNLKVSRURþLO

2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

The present document may be made available in more than one electronic version or in print. In any case of existing or

perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).

In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive

Users of the present document should be aware that the document may be subject to revision or change of status.

Information on the current status of this and other ETSI documents is available at

If you find errors in the present document, please send your comment to one of the following services:

DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered

3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.

GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.

Intellectual Property Rights ................................................................................................................................ 5

Foreword ............................................................................................................................................................. 5

1 Scope ........................................................................................................................................................ 7

2 References ................................................................................................................................................ 7

2.1 Normative references ......................................................................................................................................... 7

2.2 Informative references ........................................................................................................................................ 8

3 Definitions and abbreviations ................................................................................................................... 9

3.1 Definitions .......................................................................................................................................................... 9

3.2 Abbreviations ................................................................................................................................................... 11

4 General considerations ........................................................................................................................... 12

4.1 Services covered ............................................................................................................................................... 12

4.2 Use of the parameters ....................................................................................................................................... 12

4.3 Reporting for different classes of customers .................................................................................................... 12

4.4 Non standard levels of QoS .............................................................................................................................. 13

4.5 Reporting for directly - and indirectly-serviced customers .............................................................................. 13

4.6 Data processing issues ...................................................................................................................................... 13

4.7 Data collection period ...................................................................................................................................... 13

4.8 Sampling and test calls ..................................................................................................................................... 14

4.9 Comparability of measurements ....................................................................................................................... 14

4.10 Publication of QoS parameters ......................................................................................................................... 14

5 QoS parameters for voice, data and fax services accessed via the PTN and SMS ................................. 14

5.1 Unsuccessful call ratio ...................................................................................................................................... 16

5.1.1 Definition .................................................................................................................................................... 16

5.1.2 Application ................................................................................................................................................. 16

5.1.3 Measurement and statistics ......................................................................................................................... 16

5.1.4 Further considerations................................................................................................................................. 17

5.2 Call set up time ................................................................................................................................................. 18

5.2.1 Definition .................................................................................................................................................... 18

5.2.2 Application ................................................................................................................................................. 18

5.2.3 Measurement and statistics ......................................................................................................................... 18

5.2.4 Further considerations................................................................................................................................. 19

5.3 Speech connection quality ................................................................................................................................ 20

5.3.1 General considerations ................................................................................................................................ 20

5.3.2 Evaluation methods..................................................................................................................................... 21

5.3.2.1 Methods based on intrusive measurements ........................................................................................... 21

5.3.2.2 Methods based on non-intrusive measurements .................................................................................... 22

5.3.2.3 Methods based on the usage of the E model ......................................................................................... 22

5.3.3 Practical Implementation of parametrical model ........................................................................................ 23

5.3.3.1 Results ................................................................................................................................................... 24

5.3.3.2 Further considerations ........................................................................................................................... 24

5.3.4 Application ................................................................................................................................................. 24

5.4 Fax connection quality ..................................................................................................................................... 24

5.4.1 Definition .................................................................................................................................................... 24

5.4.2 Application ................................................................................................................................................. 25

5.4.3 Measurement and statistics ......................................................................................................................... 25

5.5 Data rate of dial-up access to the Internet ........................................................................................................ 25

5.5.1 Definition .................................................................................................................................................... 25

5.5.2 Application ................................................................................................................................................. 26

5.5.3 Measurement and statistics ......................................................................................................................... 26

5.5.4 Further considerations................................................................................................................................. 26

5.6 Short Message Service (SMS) QoS parameters ............................................................................................... 27

5.6.1 Successful SMS Ratio ................................................................................................................................. 27

5.6.1.1 Definition .............................................................................................................................................. 27

5.6.1.2 Application ............................................................................................................................................ 27

5.6.1.3 Measurement and statistics ................................................................................................................... 27

5.6.1.4 Further considerations ........................................................................................................................... 28

5.6.2 Completion Rate for SMS ........................................................................................................................... 28

5.6.2.1 Definition .............................................................................................................................................. 28

5.6.2.2 Application ............................................................................................................................................ 28

5.6.2.3 Measurement and statistics ................................................................................................................... 28

5.6.3 End-to-End delivery time for SMS ............................................................................................................. 28

5.6.3.1 Definition .............................................................................................................................................. 28

5.6.3.2 Application ............................................................................................................................................ 29

5.6.3.3 Measurement and statistics ................................................................................................................... 29

Annex A: Combination of weekly or monthly results ......................................................................... 30

Annex B: Further explanation of "X % of" ........................................................................................ 31

Annex C: Decision about the success of a call attempt ....................................................................... 32

Annex D: Relationship between the accuracy of the estimator of the unsuccessful call ratio

and the number of calls to be observed ............................................................................... 34

D.1 Theory .................................................................................................................................................... 34

D.2 Guidance ................................................................................................................................................. 36

Annex E: Method of calculating the number of observations required for measures of time ........ 38

Annex F: Standardized test chart for fax connection quality ............................................................ 39

Annex G: Guidance on the selection of representative samples and test calls .................................. 42

G.1 Specific considerations for determining measurement locations and their distribution for voice

quality measurements ............................................................................................................................. 42

Annex H: Application examples of measurement location determination ........................................ 45

H.1 Example for France ................................................................................................................................ 45

H.2 Example for Switzerland ........................................................................................................................ 47

Annex I: Calculation of the Design figure of merit for speech quality ............................................ 49

I.1 The reference terminals .......................................................................................................................... 49

I.2 The network performance characteristics ............................................................................................... 49

I.2.1 Questions for fixed operators ........................................................................................................................... 50

I.2.2 Questions for mobile operators ........................................................................................................................ 52

I.2.3 Treatment of echo ............................................................................................................................................. 56

I.3 Calculating the end-to-end performance ................................................................................................ 56

I.4 Terminals ................................................................................................................................................ 58

Annex J: Bibliography .......................................................................................................................... 59

History .............................................................................................................................................................. 60

IPRs essential or potentially essential to the present document may have been declared to ETSI. The information

pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found

in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in

respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web

Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee

can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web

This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality

The present document is part 2 of a multi-part deliverable covering Speech and multimedia Transmission Quality

(STQ); User related QoS parameter definitions and measurements, as identified below:

EG 202 057-1 [i.5] contains general user related QoS parameter definitions and measurement methods that can be

EG 202 057-2 (the present document) contains user related QoS parameter definitions and measurement methods for

voice, Group 3 fax, modem data services and SMS accessed via the public telecommunication network. The data

parameters are specified for the case where an ITU-T Recommendations V.90 [i.24] and V.92 [i.25], compliant modem

EG 202 057-3 [i.6] contains user related QoS parameter definitions and measurement methods specific to public land

EG 202 057-4 [i.7] contains user related QoS parameter definitions and measurement methods specific to Internet

The present document takes into account as far as practicable the following eight principles:

1) QoS parameters should be easily understood by the public, and be useful and important to them.

2) All parameters are applicable at the network termination point (where appropriate).

3) Where measurements are possible they should be made on the customer's premises, using in-service lines.

NOTE: Literally principles 2 and 3 imply that all measurements should be carried out at the NTP, which would

require co-operation by users and be excessively intrusive, as it would require many visits to the premises

of users. Measurements at the subscriber side of the local exchange (e.g. at the MDF or other possible

connection point/distribution frame in the access network) generally give an adequate representation of

the quality that would be perceived at the NTP for the parameters defined in the present document, and so

this approach is used because it is more practicable and meets the underlying objectives of these

4) To be as realistic as possible, real traffic rather than test calls should be used as a basis of the measurements,

5) Parameters should be capable of verification by independent organizations. This verification might be made by

6) The accuracy of QoS values should be set to a level consistent with measurement methods being as simple as

7) The parameters are designed for both statistical and individual application. The statistical values should be

derived by the application of a simple statistical function to the individual values. The statistical function

should be specified in this multi-part deliverable. This multi-part deliverable should also contain guidelines on

8) The statistical functions should be designed so QoS figures from different service providers can be compared

The present document contains definitions and measurement methods for a range of user perceivable Quality of Service

(QoS) parameters. The purpose of these parameters is to define objective and comparable measures of the QoS

delivered to users/customers for use by users/customers. The present document applies to any telecommunication

The present document is intended to provide a menu from which individual items can be selected. There is no

The QoS parameters are related primarily to services and service features and not to the technology used to provide the

services. Therefore the parameters should be capable of use when the services are provided on new technologies such as

IP and ATM or other packet switched technologies as well as on circuit switched technologies.

The establishment of target values for QoS is beyond the scope of the present document. The QoS parameters listed in

the present document are also not intended to assess the complete QoS of a telecommunication service. The present

document provides a set of QoS parameters that covers specific user related QoS aspects rather than a complete list of

QoS parameters. This set has been chosen to address areas where monitoring of QoS is likely to be most worthwhile,

If stakeholders wish to examine other QoS aspects they are recommended to follow the general approach of the present

document - as far as practicable - as a basis for the development of definitions and measurement methods for new

The set of QoS parameters is designed to be understood by the users of various telecommunications services. Sub-sets

of these parameters can be selected for use in different circumstances. For example a specific parameter might be

relevant for many users in some countries or markets but the same parameter might not be of relevance in others.

Therefore stakeholders - users, customers, regulators, service providers, network operators and other parties interested

in the use of QoS parameters - should decide in co-operation, which parameters and which measures should be used in

• The degree to which the parameters will provide a reliable comparison of performance.

References are either specific (identified by date of publication and/or edition number or version number) or

non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the

Referenced documents which are not found to be publicly available in the expected location might be found at

NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee

The following referenced documents are necessary for the application of the present document.

The following referenced documents are not necessary for the application of the present document but they assist the

[i.1] ETSI EG 201 769: "Speech Processing, Transmission and Quality Aspects (STQ); QoS parameter

definitions and measurements; Parameters for voice telephony service required under the ONP

[i.2] ETSI ETS 300 905: "Digital cellular telecommunications system (Phase 2+) (GSM); Teleservices

[i.3] ETSI EN 300 659 (all parts) : "Access and Terminals (AT); Analogue access to the Public

Switched Telephone Network (PSTN); Subscriber line protocol over the local loop for display

[i.4] ETSI EG 201 377-1: "Speech processing, Transmission and Quality aspects (STQ); Specification

and measurement of speech transmission quality; Part 1: Introduction to objective comparison

[i.5] ETSI EG 202 057-1: "Speech Processing, Transmission and Quality Aspects (STQ); User related

[i.6] ETSI EG 202 057-3: "Speech Processing, Transmission and Quality Aspects (STQ); User related

QoS parameter definitions and measurements; Part 3: QoS parameters specific to Public Land

[i.7] ETSI EG 202 057-4: "Speech Processing, Transmission and Quality Aspects (STQ); User related

[i.8] ETSI TR 101 949: "Speech Processing, Transmission and Quality Aspects (STQ); QoS parameter

definitions and measurements for use in network-to-network narrowband interconnection".

[i.9] ETSI TS 102 250-6: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects

for popular services in GSM and 3G networks; Part 6: Post processing and statistical methods".

[i.10] Directive 98/10/EC of the European Parliament and of the Council of 26 February 1998 on the

application of open network provision (ONP) to voice telephony and on universal service for

[i.11] ITU-T Recommendation E.180: "Technical characteristics of tones for the telephone service".

[i.14] ITU-T Recommendation E.452: "Facsimile modem speed reductions and transaction time".

[i.15] ITU-T Recommendation E.453: "Facsimile image quality as corrupted by transmission-induced

[i.16] ITU-T Recommendation E.800: "Terms and definitions related to quality of service and network

[i.17] ITU-T Recommendation G.107: "The E-model, a computational model for use in transmission

[i.18] ITU-T Recommendation P.862.1: "Mapping function for transforming P.862 raw result scores to

[i.19] ITU-T Recommendation P.862.2: "Wideband extension to Recommendation P.862 for the

[i.20] ITU-T Recommendation G.109: "Definition of categories of speech transmission quality".

[i.21] ITU-T Recommendation T.4: "Standardization of Group 3 facsimile terminals for document

[i.22] ITU-T Recommendation I.210: "Principles of telecommunication services supported by an ISDN

[i.23] ITU-T Recommendation T.22: "Standardized test charts for document facsimile transmissions".

[i.24] ITU-T Recommendation V.90: "A digital modem and analogue modem pair for use on the Public

Switched Telephone Network (PSTN) at data signalling rates of up to 56 000 bit/s downstream

[i.26] ITU-T Recommendation Q.850: "Usage of cause and location in the Digital Subscriber Signalling

[i.27] ITU-T Recommendation P.862: "Perceptual evaluation of speech quality (PESQ): An objective

method for end-to-end speech quality assessment of narrow-band telephone networks and speech