ETSI TS 102 250-5 V2.5.1 (2019-11)

Speech and multimedia Transmission Quality (STQ); QoS aspects for popular services in mobile networks; Part 5: Definition of typical measurement profiles

RTS/STQ-00224-5m

General Information

• Status: Published
• Publication Date: 11-Nov-2019
• Technical Committee: STQ MOBILE - STQ Mobile
• Current Stage: 12 - Completion
• Due Date: 09-Nov-2019
• Completion Date: 12-Nov-2019

Standards Content (Sample)

ETSI TS 102 250-5 V2.5.1 (2019-11)






TECHNICAL SPECIFICATION
Speech and multimedia Transmission Quality (STQ);
QoS aspects for popular services in mobile networks;
Part 5: Definition of typical measurement profiles

---------------------- Page: 1 ----------------------
2 ETSI TS 102 250-5 V2.5.1 (2019-11)



Reference
RTS/STQ-00224-5m
Keywords
group call, QoS, SDS, TETRA
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
The present document can be downloaded from:
http://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying
and microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2019.
All rights reserved.

DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its Members.

3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and
of the oneM2M Partners.
®
GSM and the GSM logo are trademarks registered and owned by the GSM Association.
ETSI

---------------------- Page: 2 ----------------------
3 ETSI TS 102 250-5 V2.5.1 (2019-11)
Contents
Intellectual Property Rights . 4
Foreword . 4
Modal verbs terminology . 4
Introduction . 4
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definition of terms, symbols and abbreviations . 7
3.1 Terms . 7
3.2 Symbols . 7
3.3 Abbreviations . 7
4 Measurement profiles . 8
4.1 Overview - Classification of measurement environments . 8
4.2 Service profiles . 9
4.2.1 Telephony . 9
4.2.1.1 Overview - Speech Telephony . 9
4.2.1.2 Video Telephony . 10
4.2.1.3 Group Call . 10
4.2.2 Messaging Services. 10
4.2.2.1 {SMS | SDS} . 10
4.2.2.2 Void. 11
4.2.2.3 MMS . 11
4.2.3 Data services . 12
4.2.3.1 Circuit switched . 12
4.2.3.2 Packet switched . 12
4.2.3.2.1 Service-independent timeout values . 12
4.2.3.2.2 Service-dependent timeout values . 12
4.3 Usage Profiles for Data Sessions . 14
4.3.1 Overview - Web browsing using HTTP . 14
4.3.2 E-Mail access . 15
4.3.3 File Transfer using FTP . 15
Annex A (informative): Reference {SMS | SDS} . 16
Annex B (informative): Content integrity checking . 17
B.1 HTTP . 17
B.2 FTP . 18
B.3 MMS. 18
Annex C (informative): Transfer times versus used data rate and content size . 19
Annex D (informative): Bibliography . 20
History . 21

ETSI

---------------------- Page: 3 ----------------------
4 ETSI TS 102 250-5 V2.5.1 (2019-11)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (https://ipr.etsi.org/).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
Foreword
This Technical Specification (TS) has been produced by ETSI Technical Committee Speech and multimedia
Transmission Quality (STQ).
The present document is part 5 of a multi-part deliverable. Full details of the entire series can be found in part 1 [5].
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
Introduction
All the defined quality of service parameters and their computations are based on field measurements. That indicates
that the measurements were made from user's point of view (full end-to-end perspective, taking into account the needs
of testing).
It is assumed that the end user can handle his mobile and the services he wants to use (operability is not evaluated at this
time). For the purpose of measurement it is assumed:
• that the service is available and not barred for any reason;
• routing is defined correctly without errors; and
• the target subscriber equipment is ready to answer the call.
Further preconditions may apply when reasonable.
The present document describes a set of typical measurement profiles which are precisely defined to allow for
comparability between different measurements, possibly performed by different parties.
ETSI

---------------------- Page: 4 ----------------------
5 ETSI TS 102 250-5 V2.5.1 (2019-11)
It is necessary to have these profiles so that when a specific set of measurements are carried out then users are
comparing "like for like" performance.
ETSI

---------------------- Page: 5 ----------------------
6 ETSI TS 102 250-5 V2.5.1 (2019-11)
1 Scope
The present document specifies test profiles which are required to enable benchmarking of different mobile networks
both within and outside national boundaries. It is necessary to have these profiles so that when a specific set of tests is
carried out then users are comparing "like for like" performance.
All timeouts (as part of the profiles) given in the present document are examples from proven experience. It should be
noted that most timeouts given in the present document do, with respect to failure ratios as defined in ETSI
TS 102 250-2 [1], have a direct impact on measurement results. A timeout value might for example directly relate to the
stop trigger point in the sense of the timeout reached event being the point in time where a certain state has not been
reached.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] ETSI TS 102 250-2: "Speech and multimedia Transmission Quality (STQ); QoS aspects for
popular services in mobile networks; Part 2: Definition of Quality of Service parameters and their
computation".
[2] ETSI TS 124 008 (V9.6.0): "Digital cellular telecommunications system (Phase 2+); Universal
Mobile Telecommunications System (UMTS); LTE; Mobile radio interface Layer 3 specification;
Core network protocols; Stage 3 (3GPP TS 24.008 version 9.6.0 Release 9)".
[3] IETF RFC 3481: "TCP over Second (2.5G) and Third (3G) Generation Wireless Networks".
[4] ETSI EN 300 392-2: "Terrestrial Trunked Radio (TETRA); Voice plus Data (V+D); Part 2: Air
Interface (AI)".
[5] ETSI TS 102 250-1: "Speech and multimedia Transmission Quality (STQ); QoS aspects for
popular services in mobile networks; Part 1: Assessment of Quality of Service".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI TR 102 505: "Speech and multimedia Transmission Quality (STQ); Development of a
Reference Web page".
ETSI

---------------------- Page: 6 ----------------------
7 ETSI TS 102 250-5 V2.5.1 (2019-11)
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
1 kByte: 1 024 Byte
1 MByte: 1 024 kByte
session: continuous usage of a given service, e.g. a speech call or a data session
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
AMR Adaptive Multi-Rate
BCP Best Current Practice
DL Down Link
DNS Domain Name Server
FQDN Fully Qualified Domain Name
FTP File Transfer Protocol
GPRS General Packet Radio Service
GR GPRS Register
GSM Global System for Mobile communications
HLR Home Location Register
HTML Hypertext Markup Language
HTTP Hyper Text Transfer Protocol
IE Information Element
IMAP Internet Messaging Access Protocol
IP Internet Protocol
MD5 Message-Digest algorithm 5
MMS Multimedia Messaging Service
MO Mobile Originated
MOC Mobile Originated Call
MT Mobile Termination
PDP Pack Data Protocol
PEP Performance Enhancement Proxy
PLMN Public Land Mobile Network
POP3 Post Office Protocol version 3
PSD Packet Switched Data
QoE Quality of Experience
QoS Quality of Service
SDS Short Data Service
SGSN Serving GPRS Support Node
SMS Short Message Service
SMTP Simple Mail Transfer Protocol
TCP Transmission Control Protocol
TCP/IP Transmission Control Protocol/Internet Protocol
TETRA TErrestrial Trunked RAdio
UDP User Datagram Protocol
UE User Equipment
UL Up Link
UMTS Universal Mobile Telecommunication System
ETSI

---------------------- Page: 7 ----------------------
8 ETSI TS 102 250-5 V2.5.1 (2019-11)
VT Video Telephony
WAP Wireless Application Protocol
XML Extensible Markup Language
4 Measurement profiles
4.1 Overview - Classification of measurement environments
Measurement profiles are required to enable benchmarking of different networks both within and outside national
boundaries. It is necessary to have these profiles so that when a specific set of tests is carried out then users are
comparing "like for like" performance.
It is recognized that many factors will affect comparability:
• number of sessions;
• sessions duration;
• time between sessions;
• demanded QoS settings for data services;
• protocol settings (like TCP/IP settings for data services or AMR-settings for speech services);
• usage profile during the session;
• fixed network test equipment like test servers for data sessions;
• user profile stored in the HLR or the GR;
• geographic location;
• type of location (indoor, hotspot, city, suburban, rural, train, etc.);
• speed when mobile;
• type of vehicle;
• type of antenna;
• handset type;
• handset hardware and firmware version;
• service being tested and limitations of service;
• network configuration;
• mobile users' population density.
For the points mentioned above where there is no recommendation or requirement in the present document, the settings
experienced by a regular user of the service under test in the network under test shall be used as a guideline.
As far as possible all particular values, e.g. timeout values, are named preserving the name of the respective Quality of
Service parameters as defined in ETSI TS 102 250-2 [1].
For interpretation and comparability of test results it is important to know in which measurement environment the tests
were performed. The environment classifications described below shall be used. Since the type of the measurement
locations may be interpreted differently, the particular understanding of the location type determining a category shall
be described in the results report.
ETSI

---------------------- Page: 8 ----------------------
9 ETSI TS 102 250-5 V2.5.1 (2019-11)
Table 1: Stationary Tests
Category Location Type Additional information
S1O: airports/railway stations/shopping centres and malls business districts and outdoor measurement
exhibition areas
S1I: airports/railway stations/shopping centres and malls business districts and indoor measurements
exhibition areas

Table 2: Drive Tests/Walk Tests
Category Location Type Additional information
D1: Train Measurements
D2: Urban Areas (medium cities)
D3: Highways
D4: Rural Areas (country roads)
D5: Large cities
W1: Walk Tests (indoor measurements)
W2: Walk Tests (outdoor measurements)
NOTE: Drive tests may be performed by in car using external antenna with an appropriate attenuation.

4.2 Service profiles
4.2.1 Telephony
4.2.1.1 Overview - Speech Telephony
Clause 4.2 describes recommended service profiles used for testing.
The service profiles defined for telephony might be applicable for different scenarios, e.g. mobile-to-mobile or
mobile-to-fixed, and the respective results should not be compared directly, if so.
To achieve comparable statistics when performing a benchmark, there should be no fixed pause between calls. Instead,
a fixed call window is defined in which one single call has to be performed. If the call fails or drops, the next call
attempt shall only be made when the next call window arrives.
A minimum pause interval between two call attempts should be applied to prevent unintentionally taking into account
network related problems between connection release and the next establishment (e.g. signalling in the PSD or mobility
management) for respective QoS parameter calculation. If, on the other hand, scenarios like calling back immediately
after a dropped call are to be tested, and where such problems do have an impact on the user experience, the pause
interval should be set to a representative value.
For speech telephony the following call durations shall be used:
• CD1: 10 seconds for call setup testing;
• CD2: 120 seconds for typical tests, default call duration for PLMN;
• CD3: 300 seconds for stability tests;
• CD4: 60 seconds for typical tests, default call duration for TETRA individual calls.
Call Window: Call duration + 30 seconds, (for the setup and release phases) + 30 seconds (for the minimum pause
interval), for the default call duration CD2 this results in 180 seconds call window.
Timeout values:
• Telephony {Service Non-Accessibility | Setup Time} Timeout: 20 seconds.
ETSI

---------------------- Page: 9 ----------------------
10 ETSI TS 102 250-5 V2.5.1 (2019-11)
4.2.1.2 Video Telephony
Video Telephony should be tested in mobile-to-mobile scenarios. The following call durations shall be used:
• CD1: 10 seconds for call setup testing;
• CD2: 120 seconds for typical tests, default call duration;
• CD3: 300 seconds for stability tests.
Call Window: Call duration + 30 seconds (for the setup and release phases) + 30 seconds (for minimum pause
interval), for the default call duration CD2 this results in 180 seconds call window.
Timeout values:
• VT Service {Non-Accessibility | Access Time} Timeout: 20 seconds;
• VT Audio/Video Setup {Failure Ratio | Time} Timeout: 30 seconds.
4.2.1.3 Group Call
Group Calls should be tested in mobile-to-mobile(s) scenarios. The following call durations shall be used:
• CD1: 20 seconds for typical tests, default call duration;
• CD2: 60 seconds for stability tests.
Call Window: Call duration + 20 seconds (for the setup and release phases), + 20 seconds (for minimum pause
interval), for the default call duration CD1 this results in 60 seconds call window.
Timeout values:
• Group Call Service Non-Accessibility Timeout: 5 seconds.
4.2.2 Messaging Services
4.2.2.1 {SMS | SDS}
For all messaging services it is important that the recipient of a message is not interrupted by the next message while
retrieving the previous one. For this reason it is important that the interval between sending two messages is larger than
the 95 % percentile of the end-to-end duration, unless measures are taken to avoid this kind of interference.
It should be noted, that mobility of either the sender of a message or the receiver of a message or both of a message can
have an impact on the results. Therefore it is recommended that measurements are not only performed stationary, but
also with mobility of one or both participants. In all cases the used scenario has to be stated.
{SMS | SDS} should be tested in mobile-to-mobile scenarios and without concatenation. Thus the user data should be
chosen in a way that it will fit into a single message.
The interval between two consecutive {SMS | SDS} shall be 60 seconds.
The transmission window of measurements shall be 175 seconds.
Timeout-values:
• {SMS | SDS} Service Non-Accessibility Timeout: 20 seconds;
• {SMS | SDS} Completion Failure Ratio Timeout: 30 seconds;
• {SMS | SDS} Receive Confirmation Failure Ratio Timeout: 60 seconds;
ETSI

---------------------- Page: 10 ----------------------
11 ETSI TS 102 250-5 V2.5.1 (2019-11)
• {SMS | SDS} Consumed Confirmation Failure Ratio Timeout: 60 seconds.
NOTE: It is assumed that in automated measurement systems the consumed confirmation (if enabled) will be
generated immediately after the reception and therefore, the same timeout values for receive and
consumed confirmation apply.
4.2.2.2 Void
4.2.2.3 MMS
MMS should be tested end-to-end. That means a MMS sent by A-Party should be received by B-Party using also a
mobile phone. The advantage of this testing is, that the MO direction at A-Party and the MT direction at B-Party can be
measured. Both directions together are the end-to-end parameters described in ETSI TS 102 250-2 [1].
The following MMS sizes shall be used:
• MMS1: 2 kByte;
• MMS2: 28 kByte;
• MMS3: 90 kByte.
If the MMS is not delivered at the destination after the MMS end-to-end Failure Ratio Timeout, the MMS delivery is
considered failed. MMS delivered after this time is not taken into account for end-to-end delay, but into end-to-end
failure ratio.
Timeouts for MMS over GPRS:
The timeouts for MMS Send, Retrieval and end-to-end Failure are dependent on the MMS size. For GPRS all MMS
uploads with less than 5 kbits and all MMS downloads with less than 10 kbits are considered to be cut-off.
MMS Send Failure Ratio (MO) Timeout:  (195 + Size[kByte] × 8 × 2/10) [seconds].
MMS Retrieval Failure Ratio (MT) Timeout: (195 + Size[kByte] × 8 × 1/10) [seconds].
The fixed part of 195 seconds incorporate the time for PDP context activation and WAP activation and shall be used as
a whole, i.e. the single timeouts for PDP context and WAP activation shall not be considered.
MMS end-to-end Delivery Failure Ratio Timeout: (590 + Size[kByte] × 8 × 2/10 + Size[kByte] × 8 × 1/10) [seconds].
The fixed part of 590 seconds incorporate the time for PDP context activations, WAP activations and notification and a
security margin. It shall be regarded as a whole, i.e. the single timeouts shall not be considered.
MMS Notification Failure Ratio Timeout: 120 seconds.
Timeouts for MMS over UMTS:
• The timeouts for MMS Send, Retrieval and End-to-end Failure are dependent on the MMS size.
• The respective required minimum upload and download data rate is for further study.
• MMS Send Failure Ratio (MO) Timeout: for further study.
• MMS Retrieval Failure Ratio (MT) Timeout: for further study.
• MMS end-to-end Delivery Failure Ratio Timeout: for further study.
• MMS Notification Failure Ratio Timeout: 120 seconds.
ETSI

---------------------- Page: 11 ----------------------
12 ETSI TS 102 250-5 V2.5.1 (2019-11)
4.2.3 Data services
4.2.3.1 Circuit switched
Circuit switched data services shall be tested for 100 % MOC. Call duration shall be either 300 seconds or is defined by
the usage profile used during the data session. The pause interval between call attempts shall be 30 seconds. The usage
profile used during the data session is defined in clause 4.3.
4.2.3.2 Packet switched
4.2.3.2.1 Service-independent timeout values
Packet switched data services shall be tested for 100 % MOC sessions. Session duration shall be either 300 seconds or
is defined by the usage profile used during the data session. The pause interval between session setup attempts shall be
30 seconds. The usage profile used during the data session is defined in clause 4.3.
NOTE: In order to ensure comparable results in benchmark testing (on changing access technologies) the number
of measurements per time on the compared channels should be equal (by using test windows or regular
intermediate results) or the individual measurements should be appropriately weighted in the aggregation.
Service-independent timeout values:
• Attach Timeout: 75 seconds.
It might occur that the user equipment sends more than one attach request towards the SGSN, since retries are
necessary. A maximum of four retries are possible (timer T3310 expires after 15 seconds for each attempt, see ETSI
TS 124 008 [2].
• PDP Context Activation Timeout for GSM and 3G networks: 150 seconds.
It might occur that the user equipment sends more than one PDP context activation request towards the SGSN, since
retries are necessary. A maximum of four retries are possible (timer T3380 expires after 30 seconds for each attempt,
see ETSI TS 124 008 [2]).
• PDP Context Activation Timeout for TETRA networks: 120 seconds.
The timer PDP_ACTIVATE_WAIT timer expires after 30 seconds for each attempt, see clause 28.5.1.1 of ETSI
EN 300 392-2 [4]. Note that the number of retries "RETRY_ACTIVATION = 3" is fixed in clause 28.5.2 of [4].
Therefore the timeout interval for the PDP context activation procedure is 120 seconds, i.e. if the PDP context
activation procedure was not completed after 120 seconds it is considered as failure.
4.2.3.2.2 Service-dependent timeout values
Timeout values for an FTP (ULandDL) service are:
• Service Accessibility Timeout: 150 seconds + IP-Service Access Timeout.
• Setup Time Timeout:  150 seconds + IP-Service Access Timeout.
• IP-Service Access Timeout: 30 seconds.
• Data Transfer Cut-off Timeout:
- Over GPRS:
 UL: File size[kByte] × 8 × 2/19;
 DL: File size[kByte] × 8 × 1/10.
- Over UMTS:
 ULandDL: File size[kByte] × 8 × 1/50.
ETSI

---------------------- Page: 12 ----------------------
13 ETSI TS 102 250-5 V2.5.1 (2019-11)
- Dual mode: The average between the timeout over GPRS and UMTS shall be considered.
Timeout values for an HTTP service are:
• Service Accessibility Timeout: 150 seconds + IP-Service Access Timeout.
• Setup Time Timeout:  150 seconds + IP-Service Access Timeout.
• IP-Service Access Timeout: 30 seconds.
• Data Transfer Cut-off Timeout:
- Over GPRS:
 UL: File size[kByte] × 8 × 2/10;
 DL: File size[
...