ETSI TR 102 779 V1.1.1 (2009-03)

Speech and multimedia Transmission Quality (STQ); Multi-component KPI

DTR/STQ-00128m

General Information

• Status: Published
• Publication Date: 01-Mar-2009
• Technical Committee: STQ MOBILE - STQ Mobile
• Current Stage: 12 - Completion
• Due Date: 14-Jan-2009
• Completion Date: 02-Mar-2009

Standards Content (Sample)

ETSI TR 102 779 V1.1.1 (2009-03)
Technical Report


Speech and multimedia Transmission Quality (STQ);
Multi-component KPI

�

---------------------- Page: 1 ----------------------
2 ETSI TR 102 779 V1.1.1 (2009-03)



Reference
DTR/STQ-00128m
Keywords
3G, GSM, network, QoS, service
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2009.
All rights reserved.

TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI

---------------------- Page: 2 ----------------------
3 ETSI TR 102 779 V1.1.1 (2009-03)
Contents
Intellectual Property Rights . 4
Foreword . 4
Introduction . 4
1 Scope . 5
2 References . 5
2.1 Normative references . 5
2.2 Informative references . 5
3 Abbreviations . 6
4 MCKPI general concept . 6
4.1 MCKPI framework . 6
4.2 MCKPI basics . 7
5 MCKPI technical aspects . 7
5.1 MCKPI validity . 7
5.2 MCKPI methodologies . 9
5.3 Extending MCKPI to non-seamless tests . 9
6 Summary and conclusion . 9
Annex A: Details on statistical validity . 10
History . 11

ETSI

---------------------- Page: 3 ----------------------
4 ETSI TR 102 779 V1.1.1 (2009-03)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Technical Report (TR) has been produced by ETSI Technical Committee Speech and multimedia Transmission
Quality (STQ).
Introduction
QoS testing, if done properly, requires considerable resources in time and personnel and is therefore costly.
Consequently, efforts to increase productivity are an important part of technical evolution in this field.
There are some constants defining in the framework in which any such evolution has to work. The first and most
important one is the requirement of testing from the customer's perspective. The second and equally important
requirement is to provide statistical relevance, so to say the "quality of quality measurements".
Since, as operational experience shows, the dominant factor in cost of measurements is the time spent on these
measurements, efforts focus on the question on how the time per data sample can be reduced, assuming that the number
of data points should not be reduced to maintain statistical validity of results.
The requirement of testing from the customer's point of view restricts the space in which solutions can be found. Test
cases cannot be modified arbitrarily; activities have still to reflect typical customer behaviour.
A possible solution is therefore multiple use of collected data. This is mainly based on the fact that today's popular data
services (ftp, http, e-mail) all are internet-based which means that internet access is common to them.
NOTE: The concept of MCKPI is of course not limited to internet-based services or re-use of QoS data for
internet access. The present document will, for practical as well as for didactical reasons, restrict itself on
this issue.
The basic idea of MCKPI is now to use data collected in one type of test for KPI of another test also.
This is best explained with an example. Assume the following sequence of testing:
• Internet access (Attach, PDP context activation).
• ftp download.
• http web site download.
and calculating the TS 102 250-2 [i.1] KPI suite using the Internet access results both for ftp and http KPI.
From the above example it becomes clear that MCKPI is not only an operation in the mathematical domain of data
processing; the advantage in terms of cost reduction for QoS measurements only materializes if the way tests are run is
changed.
Such a far-reaching change in methodology and data processing needs, of course, careful consideration. The present
document attempts to contribute to this consideration by providing facts, insights and discussion material on statistical
and methodological aspects on MCKPI.
ETSI

---------------------- Page: 4 ----------------------
5 ETSI TR 102 779 V1.1.1 (2009-03)
1 Scope
The present document discusses the concept of multi-component QoS KPI , their methods and validity rules.
The term Multi-component KPI (MCKPI) describes a KPI generated not from a single, continuous test case, but
combined from results of different tests.
The motive to use MCKPI is to reduce cost and/or increase yield of measurement campaigns.
Aspects treated in the present document include:
• MCKPI concept and types.
• Statistical validity of MCKPI.
• Practical examples.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or non-
specific.
• For a specific reference, subsequent revisions do not apply.
• Non-specific reference may be made only to a complete document or a part thereof and only in the following
cases:
- if it is accepted that it will be possible to use all future changes of the referenced document for the
purposes of the referring document;
- for informative references.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are indispensable for the application of the present document. For dated
references, only the edition cited applies. For non-specific references, the latest edition of the referenced document
(including any amendments) applies.
Not applicable.
2.2 Informative references
The following referenced documents are not essential to the use of the present document but they assist the user with
regard to a particular subject area. For non-specific references, the latest version of the referenced document (including
any amendments) applies.
[i.1] ETSI TS 102 250-2: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 2: Definition of Quality of Service parameters
and their computation".
ETSI

---------------------- Page: 5 ----------------------
6 ETSI TR 102 779 V1.1.1 (2009-03)
3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
DNS Domain Name Server
KPI Key Performance Indicator
NOTE: Quality of Service parameter.
MCKPI Multi-Component KPI
PDP Packet Data Protocol
PDPCA PDP Context Acquisition
4 MCKPI general concept
4.1 MCKPI framework
Many services in mobile communications have very similar structures if viewed from an end-to-end, macroscopic event
flow perspective. For example, usage of all internet-based packet data services starts with obtaining network access
(Attach), followed by principal packet data service access (PDP Context Activation) and in most cases also basic
Internet access (e.g. DNS URL resolution).
From an "measurement effort" optimization point of view, the question arises if measurement results of such common
elements obtained with one type of service can be re-used to provide results for another type of service, without actually
measuring them.
For example, consider the following sequence:
• Service access (which may consist itself of several sub-phases).
• ftp test.
• http test.
and then using the service access results for generating both end-to-end KPI for ftp and htt
...