SIST-V ETSI/EG 202 057-4 V1.2.1:2009
(Main)Speech Processing, Transmission and Quality Aspects (STQ) - User related QoS parameter definitions and measurements - Part 4: Internet access
Speech Processing, Transmission and Quality Aspects (STQ) - User related QoS parameter definitions and measurements - Part 4: Internet access
The present document contains definitions and measurement methods for a range of user perceivable Quality of Service (QoS) parameters. The purpose of these parameters is to define objective and comparable measures of the QoS delivered to users/customers for use by users/customers. The present document applies to any telecommunication service however some parameters may have a limited application. The present document is intended to provide a menu from which individual items can be selected. There is no obligation to use any or all of the parameters. The QoS parameters are related primarily to services and service features and not to the technology used to provide the services. Therefore the parameters should be capable of use when the services are provided on new technologies such as IP and ATM or other packet switched technologies as well as on circuit switched technologies. The establishment of target values for QoS is outside the scope of the present document. The QoS parameters listed in the present document are also not intended to assess the complete QoS of a telecommunication service. The present document provides a set of QoS parameters that covers specific user related QoS aspects rather than a complete list of QoS parameters. This set has been chosen to address areas where monitoring of QoS is likely to be most worthwhile, i.e. the areas that are most likely to be affected by any QoS problems. If stakeholders wish to examine other QoS aspects they are recommended to follow the general approach of the present document - as far as practicable - as a basis for the development of definitions and measurement methods for new specific QoS parameters. The set of QoS parameters is designed to be understood by the users of various telecommunications services. Sub-sets of these parameters can be selected for use in different circumstances. For example a specific parameter might be relevant for many users in some countries or markets but the same parameter might not be of relevance in others. Therefore stakeholders - users, customers, regulators, service providers, network operators and other parties interested in the use of QoS parameters - should decide in co-operation, which parameters should be used in their particular situation. This decision should take account of:
- The precise purpose for which they will be used.
- The general level of quality achieved by most operators.
- The degree to which the parameters will provide a reliable comparison of performance.
- The cost of measuring and reporting each parameter.
The parameters defined in the present document are applicable to any kind of Internet access independently of the underlying technology.
Vidiki obdelave, prenosa in kakovosti govora (STQ) - Definicije in meritve parametrov QoS, ki se nanašajo na uporabnika - 4. del: Internetni dostop
General Information
Standards Content (Sample)
Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
ETSI Guide
Speech Processing, Transmission and Quality Aspects (STQ);
User related QoS parameter definitions and measurements;
Part 4: Internet access
2 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
Reference
REG/STQ-00101-4
Keywords
internet, QoS
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 2008.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
ETSI
3 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
Contents
Intellectual Property Rights.5
Foreword.5
Introduction .6
1 Scope.7
2 References.7
2.1 Normative references.8
2.2 Informative references.8
3 Definitions and abbreviations.9
3.1 Definitions.9
3.2 Abbreviations.10
4 General considerations .11
4.1 Scope.11
4.1.1 Understanding of the term "Internet access".11
4.1.2 Internet accesses covered.11
4.2 Use of the parameters .12
4.3 Parameters and measurement issues.12
4.3.1 Real traffic monitoring versus test calls.13
4.3.2 Measurement.14
4.4 Data collection issues .15
4.4.1 Reporting for different classes of customers.15
4.4.2 Non standard levels of QoS .15
4.4.3 Data processing.15
4.4.4 Data collection period.15
4.5 Comparability of measurements.15
4.6 Publication of QoS parameters.16
5 QoS parameters for Internet access .16
5.1 Login time.17
5.1.1 Definition.17
5.1.2 Application.17
5.1.3 Measurement and statistics .17
5.2 Data transmission speed achieved .17
5.2.1 Definition.17
5.2.2 Application.17
5.2.3 Measurement and statistics .17
5.3 Unsuccessful data transmission ratio.18
5.3.1 Definition.18
5.3.2 Application.18
5.3.3 Measurement and statistics .18
5.4 Successful log-in ratio .18
5.4.1 Definition.18
5.4.2 Application.19
5.4.3 Measurement and statistics .19
5.5 Delay (one way transmission time) .19
5.5.1 Definition.19
5.5.2 Application.19
5.5.3 Measurement and statistics .19
Annex A (normative): Reference connection.20
Annex B (normative): Measurement set-up .21
Annex C (normative): Guidance on the determination of representative test calls .24
ETSI
4 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
Annex D (normative): Specification of test file.27
Annex E (normative): Combination of weekly or monthly results.28
Annex F (normative): Guidance on technical performance aspects of Internet accesses:
Delay, packet loss and jitter.29
F.1 QoS versus network performance .29
F.2 Implications of delay, packet loss and jitter .29
F.2.1 Delay.29
F.2.2 Jitter.30
F.2.3 Packet loss.30
F.2.4 Performance considerations for different applications .30
F.3 Further information .32
Annex G (normative): Further explanation of "X % of".33
Annex H (informative): Performance targets .34
Annex I (informative): Bibliography.36
History .37
ETSI
5 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech Processing, Transmission and Quality
Aspects (STQ), and is now submitted for the ETSI standards Membership Approval Procedure.
The present document is part 4 of a multi-part deliverable covering Speech Processing, Transmission and Quality
Aspects (STQ); User related QoS parameter definitions and measurements, as identified below:
Part 1: "General";
Part 2: "Voice telephony, Group 3 fax, modem data services and SMS";
Part 3: "QoS parameters specific to Public Land Mobile Networks (PLMN)";
Part 4: "Internet access".
EG 202 057-1 [10] contains general user related QoS parameter definitions and measurement methods that can be
applied to any service as well as user related QoS parameter definitions and measurement methods for voice, data and
fax services accessed via the public telecommunications network.
EG 202 057-2 [11] contains user related QoS parameter definitions and measurement methods for voice, modem data,
fax services and SMS accessed via the public telecommunications network. The data parameters are specified for the
case where a V.9x series modem is used since this kind of modem is in common use.
EG 202 057-3 [12] contains user related QoS parameter definitions and measurement methods specific to public land
mobile telecommunication networks (PLMN).
EG 202 057-4 (the present document) contains user related QoS parameter definitions and measurement methods
specific to Internet access.
The present document takes into account as far as practicable the following eight principles:
1) QoS parameters should be easily understood by the public, and be useful and important to them.
2) All parameters are applicable at the network termination point (where appropriate).
3) Where measurements are possible they should be made on the customer's premises, using in-service lines.
NOTE: Literally principles 2 and 3 imply that all measurements are carried out at the NTP. However, the NTP in
PLMNs is not precisely defined. Other methods are used to achieve an adequate representation of the
quality that would be perceived at the NTP for the parameters defined in the present document.
4) To be as realistic as possible, real traffic rather than test calls should be used as a basis of the measurements,
wherever possible.
5) Parameters should be capable of verification by independent organizations. This verification might be made by
direct measurements or by audit of service provider's measurements.
6) The accuracy of QoS values should be set to a level consistent with measurement methods being as simple as
possible with costs as low as possible.
ETSI
6 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
7) The parameters are designed for both statistical and individual application. The statistical values should be
derived by the application of a simple statistical function to the individual values. The statistical function
should be specified in this multi-part deliverable. This multi-part deliverable should also contain guidelines on
how statistically significant samples should be selected.
8) The statistical functions should be designed so QoS figures from different service providers can be compared
easily by users and in particular consumers.
Introduction
The present document provides definitions and measurement methods for various QoS parameters for Internet access.
The parameters were developed on the basis of the user's Quality of Service criteria identified in the TR 102 276 [9].
ETSI
7 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
1 Scope
The present document contains definitions and measurement methods for a range of user perceivable Quality of Service
(QoS) parameters. The purpose of these parameters is to define objective and comparable measures of the QoS
delivered to users/customers for use by users/customers. The present document applies to any telecommunication
service however some parameters may have a limited application.
The present document is intended to provide a menu from which individual items can be selected. There is no
obligation to use any or all of the parameters.
The QoS parameters are related primarily to services and service features and not to the technology used to provide the
services. Therefore the parameters should be capable of use when the services are provided on new technologies such as
IP and ATM or other packet switched technologies as well as on circuit switched technologies.
The establishment of target values for QoS is outside the scope of the present document. The QoS parameters listed in
the present document are also not intended to assess the complete QoS of a telecommunication service. The present
document provides a set of QoS parameters that covers specific user related QoS aspects rather than a complete list of
QoS parameters. This set has been chosen to address areas where monitoring of QoS is likely to be most worthwhile,
i.e. the areas that are most likely to be affected by any QoS problems.
If stakeholders wish to examine other QoS aspects they are recommended to follow the general approach of the present
document - as far as practicable - as a basis for the development of definitions and measurement methods for new
specific QoS parameters.
The set of QoS parameters is designed to be understood by the users of various telecommunications services. Sub-sets
of these parameters can be selected for use in different circumstances. For example a specific parameter might be
relevant for many users in some countries or markets but the same parameter might not be of relevance in others.
Therefore stakeholders - users, customers, regulators, service providers, network operators and other parties interested
in the use of QoS parameters - should decide in co-operation, which parameters should be used in their particular
situation. This decision should take account of:
• The precise purpose for which they will be used.
• The general level of quality achieved by most operators.
• The degree to which the parameters will provide a reliable comparison of performance.
• The cost of measuring and reporting each parameter.
The parameters defined in the present document are applicable to any kind of Internet access independently of the
underlying technology.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or non-
specific.
• For a specific reference, subsequent revisions do not apply.
• Non-specific reference may be made only to a complete document or a part thereof and only in the following
cases:
- if it is accepted that it will be possible to use all future changes of the referenced document for the
purposes of the referring document;
- for informative references.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
ETSI
8 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
For online referenced documents, information sufficient to identify and locate the source shall be provided. Preferably,
the primary source of the referenced document should be cited, in order to ensure traceability. Furthermore, the
reference should, as far as possible, remain valid for the expected life of the document. The reference shall include the
method of access to the referenced document and the full network address, with the same punctuation and use of upper
case and lower case letters.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are indispensable for the application of the present document. For dated
references, only the edition cited applies. For non-specific references, the latest edition of the referenced document
(including any amendments) applies.
[1] ETSI TS 102 250-5: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 5: Definition of typical measurement profiles".
[2] ETSI TS 102 250-6: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 6: Post processing and statistical methods".
[3] ITU-T Recommendation G.1010: "End-user multimedia QoS categories".
[4] ITU-T Recommendation G.1020: "Performance parameter definitions for quality of speech and
other voiceband applications utilizing IP networks".
[5] ITU-T Recommendation Y.1540: "Internet protocol data communication service - IP packet
transfer and availability performance parameters".
[6] ITU-T Recommendation Y.1541: "Network performance objectives for IP-based services".
[7] IETF RFC 792: "Internet Control Message Protocol".
[8] ITU-T Recommendation I.350: "General aspects of quality of service and network performance in
digital networks, including ISDNs".
2.2 Informative references
The following referenced documents are not essential to the use of the present document but they assist the user with
regard to a particular subject area. For non-specific references, the latest version of the referenced document (including
any amendments) applies.
[9] ETSI TR 102 276: "User Group; Users' Quality of Service Criteria for Internet Access in Europe".
[10] ETSI EG 202 057-1: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 1: General".
[11] ETSI EG 202 057-2: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 2: Voice telephony, Group 3 fax, modem data
services and SMS".
[12] ETSI EG 202 057-3: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 3: QoS parameters specific to Public Land
Mobile Networks (PLMN)".
ETSI
9 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
NOTE: Since the purpose of the present document is to formulate definitions for QoS parameters, these
definitions are given in the main body of the text and are not repeated here.
authentication: process of verifying a claimed identity to ensure that the stated identity of a user is correct
authorization: process of determining if the presenter of certain credentials is authorized to access a resource or make
use of a service
call: generic term to describe the establishment, utilization, and release of a connection (bearer path) or data flow
email: messages automatically passed from one computer user to another, often through computer networks and/or via
modems over telephone lines
File Transfer Protocol (FTP): protocol that allows users to copy files between their local system and any system they
can reach on the network
host: computer that provides client stations with access to files and printers as shared resources to a computer network
Internet: computer network consisting of a worldwide network of computer networks that use the TCP/IP network
protocols to facilitate data transmission and exchange
Internet access: making available of facilities and/or services for the purpose of providing an access to the public
Internet in order to provide a user with access to services or resources of the Internet
NOTE 1: The Internet access can be separated in two parts, the physical and the logical access.
The physical access provides a connection form the user's premises to, but not including, the POP
(normally a dial-up circuit or broadband link or leased line) whereas the logical access consist of the
setting up of an account that later on enables the user by a login process with the ability to access to the
services and resources of the Internet (normally by assigning an IP address).
NOTE 2: The physical and logical access may be provided by different service providers.
NOTE 3: The function of the physical access may be provided by several interconnected networks.
Internet Access Provider (IAP): organization that provides users with an Internet access
Internet Protocol (IP): main internetworking protocol used in the Internet. Used in conjunction with the Transfer
Control Protocol (TCP) to form TCP/IP
IP address: four-byte number uniquely defining each host on the Internet, usually written in dotted-decimal notation
with periods separating the bytes
EXAMPLE: 217.111.27.1 for IP Version 4.
login process: multi-step process which includes both authentication and authorization as well as other system start-up
tasks in order to provide a user with access to services or resources
public Internet: part of the Internet that is available to the general public
NOTE: The access is normally provided by Internet access and Internet service providers.
ETSI
10 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
physical access provider: organization that arranges the provision of physical access from the user's premises to the
POP
NOTE 1: Excluding, the POP.
NOTE 2: Usually a dial-up circuit or an ADSL link or leased line are used.
NOTE 3: The function of the physical access provider may be provided by several interconnected networks.
Public Telecommunications Network (PTN): telecommunications network used wholly or partly for the provision of
publicly available telecommunications services
router: device which forwards packets between networks
NOTE: The forwarding decision is based on network layer information and routing tables, often constructed by
routing protocols. An IP router forwards data based on IP source and destination addresses.
stakeholder: party having an interest in the level of quality of a service
telecommunications: technical process of sending, transmitting and receiving any kind of message in the form of signs,
voice, images or sounds by means of telecommunications systems
telecommunication services: provision of telecommunications and the provision of other additional services that are
closely related to the provision of telecommunications like e.g. billing, directory services
telecommunications systems: technical equipment or systems capable of sending, transmitting, switching, receiving,
steering or controlling as messages identifiable electromagnetic signals
user: individuals, including consumers, or organizations using or requesting publicly available telecommunications
services
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
DSL Digital Subscriber Line
FQDN Fully Qualified Domain Name
FTP File Transfer Protocol
GPRS General Packet Radio Service
GSM Global System for Mobile communications
IAP Internet Access Provider
ICMP Internet Control Message Protocol
IP Internet Protocol
kbit/s kilobit per second
NTP Network Termination Point
OS Operating System
PC Personal Computer
PING Packet InterNet Groper
PLMN Public Land Mobile Network
POP Point Of Presence
PTN Public Telecommunications Network
QoS Quality of Service
SMS Short Message Service
UMTS Universal Mobile Telecommunications System
WLAN Wireless Local Area Network
xDSL generic Digital Subscriber Line
ETSI
11 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
4 General considerations
4.1 Scope
4.1.1 Understanding of the term "Internet access"
Unlike to other (traditional) telecommunication services the Internet access - as it is used in these days - consists of
different connections and services that have to be available in combination in order to allow for a functional Internet
access. All these different connections and services can be understood as separate telecommunication services with their
own QoS aspects. However, the quality of services as perceived by the user accessed via the Internet like e.g. web
browsing and email will be influenced by the quality of each single element of the end-to-end connection/service.
Furthermore the term "Internet access" is not only understood by the naive user as an access in the real meaning of the
word, i.e. the provision of a physical connection and being able to establish connections to other parts or accesses of the
network. The user understands Internet access as having access to (end-to-end) services that rely on the transport
mechanisms of the Internet. This is because for most users the pure (physical) access to the internet is of no practical
use; only if the user gains access via e.g. web browsing to information and applications available on servers he can use
the "Internet".
However, from a technical point of view the (end-to-end) services/applications are offered independently to the
(physical) Internet access. This is also reflected in the fact that in many cases end users may need to have two contracts
in order to have full Internet access: one for an access to the PTN in order to get a physical connection to an IAP and
another one with an IAP/ISP in order to access services provided via the Internet.
In order to use the Internet, the user needs first to have access to the Internet (via the public PTN or via dedicated
broadband accesses). Technically spoken, he must be able to have access to the transport mechanisms of the Internet,
i.e. having access to IP layer transmission. This provides him with the ability to connect to other entities of the Internet
(IP based network). From there on the user may access advanced services that involve higher layers (above the IP layer)
of communication. These services may be offered totally independent of the physical access. Thus Internet access can
be understood as a (transportation) platform to access advanced services.
Therefore the term Internet access should primarily be understood as physical and logical access to the core of the
Internet, i.e. the access includes all functionalities that are needed to enable the user to establish connections to other
entities within the Internet and engage advanced services. All issues beyond that basic understanding of an Internet
access are highly dependent on the specific end-to-end service used and therefore should be subject to additional service
specific considerations.
4.1.2 Internet accesses covered
The present document provides QoS and network performance parameters for assessing the quality of Internet access as
perceived by the user. The purpose of the parameters is to inform the user on the transmission performance of the
assessed Internet access.
The term Internet access includes the physical access between the user's terminal equipment and the access to the
network of the IAP who is providing the end user with access to the Public Internet itself. The scope of the parameters
is limited to the Internet access itself, i.e. the connection between end user and IAP and the availability and reliability of
the access. The quality of end-to-end services accessed via this connection is outside the scope of the present document.
Internet access is normally not provided by a single service or network provider as it is possible in the case of other
telecommunication services like telephony services. The Internet access consists of a combination of different
connections and services.
The user gains access to the Public Internet via a suitable terminal equipment e.g. a PC that can be connected to the
PTN. The Internet access itself is normally provided by an IAP. The connection between the terminal equipment and
the IAP is established via a transit network. In most cases this will be the PTN, but it may also be a LAN or WLAN.
The overall quality of the Internet access is a combination of the performance of each element of this connection.
Annex A provides an reference scenario for the Internet access and illustrates the application of the QoS parameters.
ETSI
12 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
The parameters are in principle applicable for any kind of Internet access technologies. This includes the following
access types:
• fixed narrowband access technologies like modem dial-up/ISDN connections;
• fixed broadband access (DSL, cable modem);
• wireless access technologies like WLAN, GSM, GPRS and UMTS.
NOTE: Although it is stated here that the measurement methods defined in the present document can be applied
in principle to any access technologies including wireless, care should be taken when applying the
measurement methods. The proposed measurement methods are focused access technologies for the
provision of Internet access at fixed locations. The measurement set-up does not take into account effects
due to a moving user as it is the case with wireless accesses. Thus the QoS parameters can only be applied
to Internet accesses with wireless technologies when they are provided at a fixed location.
The definitions and measurement methods of the parameters were elaborated primarily in order to assess QoS aspects of
"standard", i.e. typical accesses. Therefore mainly common aspects and technologies were considered and are reflected
in the present parameters. In principle the parameters may also be used for the investigation of special or non-standard
telecommunication services but further enhancements/additions to the definitions and measurements methods may be
necessary. Depending on the set of parameters used by the stakeholders the scope of the services covered may vary.
In many cases the provider of Internet access services may depend on other providers for part of the service. An
example is an IAP who is offering access to Internet services but does not provide the access from and to the NTP. In
such cases the provider of the service to the customer is responsible for all elements for which it receives payment from
the customer. In order to provide satisfactory QoS, this service provider will need to ensure that adequate QoS is
provided by the other interconnected service providers. QoS figures for the responsible service provider will reflect both
its own capability and that of the interconnected service providers.
4.2 Use of the parameters
The parameters may be used for various purposes including:
• Specifying the level of quality of service in customer telecommunication service contracts or in the description
or terms and conditions of the service by stakeholders.
• Comparing the quality of service of different service providers.
• Comparing the quality of service aspects of different service offers.
• Preparing long term studies on the quality of service aspects of a specific service.
4.3 Parameters and measurement issues
Quality of Service as perceived by the user is affected by operational and technical aspects. The QoS parameters listed
in this part of the Guide are covering aspects that are related to the network performance of connections set up via
Internet accesses. In other words the parameters cover the technical connection based quality aspects when the Internet
access is in use. Operational Aspects like e.g. supply time, billing and customer relations are dealt with in Part 1 of the
Guide.
Users are often interested in specific network performance parameters, i.e. delay, jitter, packet loss. These parameters
however cannot directly be related to the quality a user will perceive. One always has to take into account the specific
service that is in use. Some services may react very sensitive to variations or degradation of this parameters whereas
other services can compensate them very well. Therefore there are no specific QoS parameters in the present document
that provide separate statistics for theses parameters themselves. Instead of doing so in annex F basic information on the
influence of these parameters on the user perceived quality is given.
The QoS parameters defined in the present document are designed in order to assess the quality of an Internet access
that is understood as being the connection between an end user and an IAP which allows the end user accessing to the
core of Internet and use this access in order to get access to and/or make use of more advanced services that rely on the
Internet Protocol.
ETSI
13 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
Thus the basic functions an Internet access must provide is to allow for establishing IP connections. Besides that the end
user is also interested in the reliability and availability of the access. Some basic transmission characteristics of the
connection between the UNI and the IAP are also important because the performance of the services the end user may
use are affected and limited by the performance of these parameters.
The QoS parameters to be measured include the performance of end user equipment as well as equipment at the IAP
side of the connection. The influence of the terminal equipment on the resulting quality of the connection is significant.
4.3.1 Real traffic monitoring versus test calls
Network performance related parameters are measured either by using test calls or by monitoring real traffic (or by a
combination of both). Both methods have their advantages and disadvantages.
Real traffic monitoring is on the one hand a low cost alternative but on the other hand the measuring party has no
influence on the connection details (termination, services, end equipment etc.) and therefore reproducibility is affected
and results may be less reliable. Whereas test call measurements are more complex and expensive but on the other hand
they are reproducible, i.e. it is exactly known what is measured.
It is up to the measuring party to decide which approach should be taken in order to establish the required statistics. In
the following list several aspects of the different measurement approaches that have to be considered are given.
The approach of test calls has the following advantages:
• It measures the network from an external point as would be seen by the user and so does not depend on any
correct functioning of the network to enable a measurement to be made.
• The same test system can be used to compare results for different networks and so the comparability of results
at the same point and time is high, although the results are not necessarily highly representative of the
performance of the whole network.
This approach however has the following disadvantages:
• The test configurations (i.e. the terminal and its method of use) are not indicative of how users actually handle
their terminals.
• In order to obtain adequate accuracy (representing a whole network) for comparison purposes, a large number
of samples is needed.
• It is difficult to set up test plans that are representative of users' behaviour in both location and timing and thus
not be necessarily be representative of the performance of the whole network. Normally the number of test
connections is rather low compared to real traffic monitoring, therefore the representativity of test calls is very
important.
The real traffic monitoring approach is based on the use of signalling and transmission characteristic related information
that can be gathered in the gateways and routers of the network. This approach has the following advantages:
• It includes the effects of all calls, and so provides better comparability of congestion and network failures.
• It takes account of changes in terminal equipment and the actual performance achieved by real terminals used
by real users.
This approach however has the following disadvantages:
• It does only measure the performance of actual transmissions and thus failures and faults concerning the
physical access to the network may not be covered.
• It depends on software algorithms in the routers and gateways, and the algorithms of different manufacturers
may differ and there may be differences between algorithms in different versions of the same software. Thus
the measurement results may not be reliable and additional effort must be spent in the interpretation of the raw
data.
• Τerminal related effects are unknown, so it may be impossible to distinguish between network/access related
faults and terminal/user related ones.
ETSI
14 Final draft ETSI EG 202 057-4 V1.2.0 (2008-05)
• Τhe distribution of terminating NTPs/destinations is unknown prior to the measurement. Thus depending on
the geographic coverage of the measurements long observation times may be needed in order to achieve a fair
distribution and collection of enough calls for a secure statistical basis.
• Signalling information may not be used in accordance with the standards and it may be impossible to find out
what each network section is using since routing tables may be altered frequently.
For both measurement methods additional information has to be known and preparation time to be spent prior to the
actual measurements. For test calls a precise measurement plan has to be set-up in order to establish a reliable statistical
basis. Real traffic monitoring has to rely on several assumptions (e.g. set-up of routers and gateways in other networks,
distribution of terminating NTPs, kind of terminals involved, traffic distribution) that have to be checked first. In
practice this will be done on a sample based examination.
If the measurements are performed by a party other than the access network provider, special care must be taken that all
relevant information concerning the access is known (signalling system, set-up of switches, tones, etc.).
In principle both methods or a combination of them can be used in order to assess the quality of an Internet access based
on the parameters defined in the present document.
4.3.2 Measurement
Even though the parameters can in principle be measured by using either real traffic monitoring or test calls, the
measurement methods defined here are all based on a test call scenario. For the time being there is no known real traffic
measurement scenario that could be used to assess the quality of an Internet access and provide comparable QoS
statistics. This is for further study.
The basic measurement set-up consists of a Test-PC and a Test-Server with specified software and hardware. Test calls
have to be established between the Test-PC and Test-Server and measurements must be made for the respective QoS
parameters given in clause 5. Also the necessary number of test calls and their distribution must be defined.
The measurement set-up is given by the following annexes:
• Annex B: Measurement set-up.
• Annex C: Guidance on the determination of representative test calls.
• Annex D: Specification of a test file.
Specific measurement conditions for the respective parameters are dealt with in clause 5.
The reference configuration given in annex B is based on test calls and the test-server is located as near as possible to
the gateway providing the interconnection between access network and IAP network. Thus the measurements will not
take into account the influence of the IAP network itself (defined between this gateway and the gateway interconnecting
with the Internet) on the QoS offered to the user. Therefore the parameters will measure the qua
...
ETSI Guide
Speech Processing, Transmission and Quality Aspects (STQ);
User related QoS parameter definitions and measurements;
Part 4: Internet access
2 ETSI EG 202 057-4 V1.2.1 (2008-07)
Reference
REG/STQ-00101-4
Keywords
internet, QoS
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 2008.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
ETSI
3 ETSI EG 202 057-4 V1.2.1 (2008-07)
Contents
Intellectual Property Rights.5
Foreword.5
Introduction .6
1 Scope.7
2 References.7
2.1 Normative references.8
2.2 Informative references.8
3 Definitions and abbreviations.9
3.1 Definitions.9
3.2 Abbreviations.10
4 General considerations .11
4.1 Scope.11
4.1.1 Understanding of the term "Internet access".11
4.1.2 Internet accesses covered.11
4.2 Use of the parameters .12
4.3 Parameters and measurement issues.12
4.3.1 Real traffic monitoring versus test calls.13
4.3.2 Measurement.14
4.4 Data collection issues .15
4.4.1 Reporting for different classes of customers.15
4.4.2 Non standard levels of QoS .15
4.4.3 Data processing.15
4.4.4 Data collection period.15
4.5 Comparability of measurements.15
4.6 Publication of QoS parameters.16
5 QoS parameters for Internet access .16
5.1 Login time.17
5.1.1 Definition.17
5.1.2 Application.17
5.1.3 Measurement and statistics .17
5.2 Data transmission speed achieved .17
5.2.1 Definition.17
5.2.2 Application.17
5.2.3 Measurement and statistics .17
5.3 Unsuccessful data transmission ratio.18
5.3.1 Definition.18
5.3.2 Application.18
5.3.3 Measurement and statistics .18
5.4 Successful log-in ratio .18
5.4.1 Definition.18
5.4.2 Application.19
5.4.3 Measurement and statistics .19
5.5 Delay (one way transmission time) .19
5.5.1 Definition.19
5.5.2 Application.19
5.5.3 Measurement and statistics .19
Annex A (normative): Reference connection.20
Annex B (normative): Measurement set-up .21
Annex C (normative): Guidance on the determination of representative test calls .24
ETSI
4 ETSI EG 202 057-4 V1.2.1 (2008-07)
Annex D (normative): Specification of test file.27
Annex E (normative): Combination of weekly or monthly results.28
Annex F (normative): Guidance on technical performance aspects of Internet accesses:
Delay, packet loss and jitter.29
F.1 QoS versus network performance .29
F.2 Implications of delay, packet loss and jitter .29
F.2.1 Delay.29
F.2.2 Jitter.30
F.2.3 Packet loss.30
F.2.4 Performance considerations for different applications .30
F.3 Further information .32
Annex G (normative): Further explanation of "X % of".33
Annex H (informative): Performance targets .34
Annex I (informative): Bibliography.36
History .37
ETSI
5 ETSI EG 202 057-4 V1.2.1 (2008-07)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech Processing, Transmission and Quality
Aspects (STQ).
The present document is part 4 of a multi-part deliverable covering Speech Processing, Transmission and Quality
Aspects (STQ); User related QoS parameter definitions and measurements, as identified below:
Part 1: "General";
Part 2: "Voice telephony, Group 3 fax, modem data services and SMS";
Part 3: "QoS parameters specific to Public Land Mobile Networks (PLMN)";
Part 4: "Internet access".
EG 202 057-1 [i.2] contains general user related QoS parameter definitions and measurement methods that can be
applied to any service as well as user related QoS parameter definitions and measurement methods for voice, data and
fax services accessed via the public telecommunications network.
EG 202 057-2 [i.3] contains user related QoS parameter definitions and measurement methods for voice, modem data,
fax services and SMS accessed via the public telecommunications network. The data parameters are specified for the
case where a V.9x series modem is used since this kind of modem is in common use.
EG 202 057-3 [i.4] contains user related QoS parameter definitions and measurement methods specific to public land
mobile telecommunication networks (PLMN).
EG 202 057-4 (the present document) contains user related QoS parameter definitions and measurement methods
specific to Internet access.
The present document takes into account as far as practicable the following eight principles:
1) QoS parameters should be easily understood by the public, and be useful and important to them.
2) All parameters are applicable at the network termination point (where appropriate).
3) Where measurements are possible they should be made on the customer's premises, using in-service lines.
NOTE: Literally principles 2 and 3 imply that all measurements are carried out at the NTP. However, the NTP in
PLMNs is not precisely defined. Other methods are used to achieve an adequate representation of the
quality that would be perceived at the NTP for the parameters defined in the present document.
4) To be as realistic as possible, real traffic rather than test calls should be used as a basis of the measurements,
wherever possible.
5) Parameters should be capable of verification by independent organizations. This verification might be made by
direct measurements or by audit of service provider's measurements.
6) The accuracy of QoS values should be set to a level consistent with measurement methods being as simple as
possible with costs as low as possible.
ETSI
6 ETSI EG 202 057-4 V1.2.1 (2008-07)
7) The parameters are designed for both statistical and individual application. The statistical values should be
derived by the application of a simple statistical function to the individual values. The statistical function
should be specified in this multi-part deliverable. This multi-part deliverable should also contain guidelines on
how statistically significant samples should be selected.
8) The statistical functions should be designed so QoS figures from different service providers can be compared
easily by users and in particular consumers.
Introduction
The present document provides definitions and measurement methods for various QoS parameters for Internet access.
The parameters were developed on the basis of the user's Quality of Service criteria identified in the TR 102 276 [i.1].
ETSI
7 ETSI EG 202 057-4 V1.2.1 (2008-07)
1 Scope
The present document contains definitions and measurement methods for a range of user perceivable Quality of Service
(QoS) parameters. The purpose of these parameters is to define objective and comparable measures of the QoS
delivered to users/customers for use by users/customers. The present document applies to any telecommunication
service however some parameters may have a limited application.
The present document is intended to provide a menu from which individual items can be selected. There is no
obligation to use any or all of the parameters.
The QoS parameters are related primarily to services and service features and not to the technology used to provide the
services. Therefore the parameters should be capable of use when the services are provided on new technologies such as
IP and ATM or other packet switched technologies as well as on circuit switched technologies.
The establishment of target values for QoS is outside the scope of the present document. The QoS parameters listed in
the present document are also not intended to assess the complete QoS of a telecommunication service. The present
document provides a set of QoS parameters that covers specific user related QoS aspects rather than a complete list of
QoS parameters. This set has been chosen to address areas where monitoring of QoS is likely to be most worthwhile,
i.e. the areas that are most likely to be affected by any QoS problems.
If stakeholders wish to examine other QoS aspects they are recommended to follow the general approach of the present
document - as far as practicable - as a basis for the development of definitions and measurement methods for new
specific QoS parameters.
The set of QoS parameters is designed to be understood by the users of various telecommunications services. Sub-sets
of these parameters can be selected for use in different circumstances. For example a specific parameter might be
relevant for many users in some countries or markets but the same parameter might not be of relevance in others.
Therefore stakeholders - users, customers, regulators, service providers, network operators and other parties interested
in the use of QoS parameters - should decide in co-operation, which parameters should be used in their particular
situation. This decision should take account of:
• The precise purpose for which they will be used.
• The general level of quality achieved by most operators.
• The degree to which the parameters will provide a reliable comparison of performance.
• The cost of measuring and reporting each parameter.
The parameters defined in the present document are applicable to any kind of Internet access independently of the
underlying technology.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or non-
specific.
• For a specific reference, subsequent revisions do not apply.
• Non-specific reference may be made only to a complete document or a part thereof and only in the following
cases:
- if it is accepted that it will be possible to use all future changes of the referenced document for the
purposes of the referring document;
- for informative references.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
ETSI
8 ETSI EG 202 057-4 V1.2.1 (2008-07)
For online referenced documents, information sufficient to identify and locate the source shall be provided. Preferably,
the primary source of the referenced document should be cited, in order to ensure traceability. Furthermore, the
reference should, as far as possible, remain valid for the expected life of the document. The reference shall include the
method of access to the referenced document and the full network address, with the same punctuation and use of upper
case and lower case letters.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are indispensable for the application of the present document. For dated
references, only the edition cited applies. For non-specific references, the latest edition of the referenced document
(including any amendments) applies.
[1] ETSI TS 102 250-5: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 5: Definition of typical measurement profiles".
[2] ETSI TS 102 250-6: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 6: Post processing and statistical methods".
[3] ITU-T Recommendation G.1010: "End-user multimedia QoS categories".
[4] ITU-T Recommendation G.1020: "Performance parameter definitions for quality of speech and
other voiceband applications utilizing IP networks".
[5] ITU-T Recommendation Y.1540: "Internet protocol data communication service - IP packet
transfer and availability performance parameters".
[6] ITU-T Recommendation Y.1541: "Network performance objectives for IP-based services".
[7] IETF RFC 792: "Internet Control Message Protocol".
[8] ITU-T Recommendation I.350: "General aspects of quality of service and network performance in
digital networks, including ISDNs".
2.2 Informative references
The following referenced documents are not essential to the use of the present document but they assist the user with
regard to a particular subject area. For non-specific references, the latest version of the referenced document (including
any amendments) applies.
[i.1] ETSI TR 102 276: "User Group; Users' Quality of Service Criteria for Internet Access in Europe".
[i.2] ETSI EG 202 057-1: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 1: General".
[i.3] ETSI EG 202 057-2: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 2: Voice telephony, Group 3 fax, modem data
services and SMS".
[i.4] ETSI EG 202 057-3: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 3: QoS parameters specific to Public Land
Mobile Networks (PLMN)".
ETSI
9 ETSI EG 202 057-4 V1.2.1 (2008-07)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
NOTE: Since the purpose of the present document is to formulate definitions for QoS parameters, these
definitions are given in the main body of the text and are not repeated here.
authentication: process of verifying a claimed identity to ensure that the stated identity of a user is correct
authorization: process of determining if the presenter of certain credentials is authorized to access a resource or make
use of a service
call: generic term to describe the establishment, utilization, and release of a connection (bearer path) or data flow
email: messages automatically passed from one computer user to another, often through computer networks and/or via
modems over telephone lines
File Transfer Protocol (FTP): protocol that allows users to copy files between their local system and any system they
can reach on the network
host: computer that provides client stations with access to files and printers as shared resources to a computer network
Internet: computer network consisting of a worldwide network of computer networks that use the TCP/IP network
protocols to facilitate data transmission and exchange
Internet access: making available of facilities and/or services for the purpose of providing an access to the public
Internet in order to provide a user with access to services or resources of the Internet
NOTE 1: The Internet access can be separated in two parts, the physical and the logical access.
The physical access provides a connection form the user's premises to, but not including, the POP
(normally a dial-up circuit or broadband link or leased line) whereas the logical access consist of the
setting up of an account that later on enables the user by a login process with the ability to access to the
services and resources of the Internet (normally by assigning an IP address).
NOTE 2: The physical and logical access may be provided by different service providers.
NOTE 3: The function of the physical access may be provided by several interconnected networks.
Internet Access Provider (IAP): organization that provides users with an Internet access
Internet Protocol (IP): main internetworking protocol used in the Internet. Used in conjunction with the Transfer
Control Protocol (TCP) to form TCP/IP
IP address: four-byte number uniquely defining each host on the Internet, usually written in dotted-decimal notation
with periods separating the bytes
EXAMPLE: 217.111.27.1 for IP Version 4.
login process: multi-step process which includes both authentication and authorization as well as other system start-up
tasks in order to provide a user with access to services or resources
public Internet: part of the Internet that is available to the general public
NOTE: The access is normally provided by Internet access and Internet service providers.
ETSI
10 ETSI EG 202 057-4 V1.2.1 (2008-07)
physical access provider: organization that arranges the provision of physical access from the user's premises to the
POP
NOTE 1: Excluding, the POP.
NOTE 2: Usually a dial-up circuit or an ADSL link or leased line are used.
NOTE 3: The function of the physical access provider may be provided by several interconnected networks.
Public Telecommunications Network (PTN): telecommunications network used wholly or partly for the provision of
publicly available telecommunications services
router: device which forwards packets between networks
NOTE: The forwarding decision is based on network layer information and routing tables, often constructed by
routing protocols. An IP router forwards data based on IP source and destination addresses.
stakeholder: party having an interest in the level of quality of a service
telecommunications: technical process of sending, transmitting and receiving any kind of message in the form of signs,
voice, images or sounds by means of telecommunications systems
telecommunication services: provision of telecommunications and the provision of other additional services that are
closely related to the provision of telecommunications like e.g. billing, directory services
telecommunications systems: technical equipment or systems capable of sending, transmitting, switching, receiving,
steering or controlling as messages identifiable electromagnetic signals
user: individuals, including consumers, or organizations using or requesting publicly available telecommunications
services
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
DSL Digital Subscriber Line
FQDN Fully Qualified Domain Name
FTP File Transfer Protocol
GPRS General Packet Radio Service
GSM Global System for Mobile communications
IAP Internet Access Provider
ICMP Internet Control Message Protocol
IP Internet Protocol
kbit/s kilobit per second
NTP Network Termination Point
OS Operating System
PC Personal Computer
PING Packet InterNet Groper
PLMN Public Land Mobile Network
POP Point Of Presence
PTN Public Telecommunications Network
QoS Quality of Service
SMS Short Message Service
UMTS Universal Mobile Telecommunications System
WLAN Wireless Local Area Network
xDSL generic Digital Subscriber Line
ETSI
11 ETSI EG 202 057-4 V1.2.1 (2008-07)
4 General considerations
4.1 Scope
4.1.1 Understanding of the term "Internet access"
Unlike to other (traditional) telecommunication services the Internet access - as it is used in these days - consists of
different connections and services that have to be available in combination in order to allow for a functional Internet
access. All these different connections and services can be understood as separate telecommunication services with their
own QoS aspects. However, the quality of services as perceived by the user accessed via the Internet like e.g. web
browsing and email will be influenced by the quality of each single element of the end-to-end connection/service.
Furthermore the term "Internet access" is not only understood by the naive user as an access in the real meaning of the
word, i.e. the provision of a physical connection and being able to establish connections to other parts or accesses of the
network. The user understands Internet access as having access to (end-to-end) services that rely on the transport
mechanisms of the Internet. This is because for most users the pure (physical) access to the internet is of no practical
use; only if the user gains access via e.g. web browsing to information and applications available on servers he can use
the "Internet".
However, from a technical point of view the (end-to-end) services/applications are offered independently to the
(physical) Internet access. This is also reflected in the fact that in many cases end users may need to have two contracts
in order to have full Internet access: one for an access to the PTN in order to get a physical connection to an IAP and
another one with an IAP/ISP in order to access services provided via the Internet.
In order to use the Internet, the user needs first to have access to the Internet (via the public PTN or via dedicated
broadband accesses). Technically spoken, he must be able to have access to the transport mechanisms of the Internet,
i.e. having access to IP layer transmission. This provides him with the ability to connect to other entities of the Internet
(IP based network). From there on the user may access advanced services that involve higher layers (above the IP layer)
of communication. These services may be offered totally independent of the physical access. Thus Internet access can
be understood as a (transportation) platform to access advanced services.
Therefore the term Internet access should primarily be understood as physical and logical access to the core of the
Internet, i.e. the access includes all functionalities that are needed to enable the user to establish connections to other
entities within the Internet and engage advanced services. All issues beyond that basic understanding of an Internet
access are highly dependent on the specific end-to-end service used and therefore should be subject to additional service
specific considerations.
4.1.2 Internet accesses covered
The present document provides QoS and network performance parameters for assessing the quality of Internet access as
perceived by the user. The purpose of the parameters is to inform the user on the transmission performance of the
assessed Internet access.
The term Internet access includes the physical access between the user's terminal equipment and the access to the
network of the IAP who is providing the end user with access to the Public Internet itself. The scope of the parameters
is limited to the Internet access itself, i.e. the connection between end user and IAP and the availability and reliability of
the access. The quality of end-to-end services accessed via this connection is outside the scope of the present document.
Internet access is normally not provided by a single service or network provider as it is possible in the case of other
telecommunication services like telephony services. The Internet access consists of a combination of different
connections and services.
The user gains access to the Public Internet via a suitable terminal equipment e.g. a PC that can be connected to the
PTN. The Internet access itself is normally provided by an IAP. The connection between the terminal equipment and
the IAP is established via a transit network. In most cases this will be the PTN, but it may also be a LAN or WLAN.
The overall quality of the Internet access is a combination of the performance of each element of this connection.
Annex A provides an reference scenario for the Internet access and illustrates the application of the QoS parameters.
ETSI
12 ETSI EG 202 057-4 V1.2.1 (2008-07)
The parameters are in principle applicable for any kind of Internet access technologies. This includes the following
access types:
• fixed narrowband access technologies like modem dial-up/ISDN connections;
• fixed broadband access (DSL, cable modem);
• wireless access technologies like WLAN, GSM, GPRS and UMTS.
NOTE: Although it is stated here that the measurement methods defined in the present document can be applied
in principle to any access technologies including wireless, care should be taken when applying the
measurement methods. The proposed measurement methods are focused access technologies for the
provision of Internet access at fixed locations. The measurement set-up does not take into account effects
due to a moving user as it is the case with wireless accesses. Thus the QoS parameters can only be applied
to Internet accesses with wireless technologies when they are provided at a fixed location.
The definitions and measurement methods of the parameters were elaborated primarily in order to assess QoS aspects of
"standard", i.e. typical accesses. Therefore mainly common aspects and technologies were considered and are reflected
in the present parameters. In principle the parameters may also be used for the investigation of special or non-standard
telecommunication services but further enhancements/additions to the definitions and measurements methods may be
necessary. Depending on the set of parameters used by the stakeholders the scope of the services covered may vary.
In many cases the provider of Internet access services may depend on other providers for part of the service. An
example is an IAP who is offering access to Internet services but does not provide the access from and to the NTP. In
such cases the provider of the service to the customer is responsible for all elements for which it receives payment from
the customer. In order to provide satisfactory QoS, this service provider will need to ensure that adequate QoS is
provided by the other interconnected service providers. QoS figures for the responsible service provider will reflect both
its own capability and that of the interconnected service providers.
4.2 Use of the parameters
The parameters may be used for various purposes including:
• Specifying the level of quality of service in customer telecommunication service contracts or in the description
or terms and conditions of the service by stakeholders.
• Comparing the quality of service of different service providers.
• Comparing the quality of service aspects of different service offers.
• Preparing long term studies on the quality of service aspects of a specific service.
4.3 Parameters and measurement issues
Quality of Service as perceived by the user is affected by operational and technical aspects. The QoS parameters listed
in this part of the Guide are covering aspects that are related to the network performance of connections set up via
Internet accesses. In other words the parameters cover the technical connection based quality aspects when the Internet
access is in use. Operational Aspects like e.g. supply time, billing and customer relations are dealt with in Part 1 of the
Guide.
Users are often interested in specific network performance parameters, i.e. delay, jitter, packet loss. These parameters
however cannot directly be related to the quality a user will perceive. One always has to take into account the specific
service that is in use. Some services may react very sensitive to variations or degradation of this parameters whereas
other services can compensate them very well. Therefore there are no specific QoS parameters in the present document
that provide separate statistics for theses parameters themselves. Instead of doing so in annex F basic information on the
influence of these parameters on the user perceived quality is given.
The QoS parameters defined in the present document are designed in order to assess the quality of an Internet access
that is understood as being the connection between an end user and an IAP which allows the end user accessing to the
core of Internet and use this access in order to get access to and/or make use of more advanced services that rely on the
Internet Protocol.
ETSI
13 ETSI EG 202 057-4 V1.2.1 (2008-07)
Thus the basic functions an Internet access must provide is to allow for establishing IP connections. Besides that the end
user is also interested in the reliability and availability of the access. Some basic transmission characteristics of the
connection between the UNI and the IAP are also important because the performance of the services the end user may
use are affected and limited by the performance of these parameters.
The QoS parameters to be measured include the performance of end user equipment as well as equipment at the IAP
side of the connection. The influence of the terminal equipment on the resulting quality of the connection is significant.
4.3.1 Real traffic monitoring versus test calls
Network performance related parameters are measured either by using test calls or by monitoring real traffic (or by a
combination of both). Both methods have their advantages and disadvantages.
Real traffic monitoring is on the one hand a low cost alternative but on the other hand the measuring party has no
influence on the connection details (termination, services, end equipment etc.) and therefore reproducibility is affected
and results may be less reliable. Whereas test call measurements are more complex and expensive but on the other hand
they are reproducible, i.e. it is exactly known what is measured.
It is up to the measuring party to decide which approach should be taken in order to establish the required statistics. In
the following list several aspects of the different measurement approaches that have to be considered are given.
The approach of test calls has the following advantages:
• It measures the network from an external point as would be seen by the user and so does not depend on any
correct functioning of the network to enable a measurement to be made.
• The same test system can be used to compare results for different networks and so the comparability of results
at the same point and time is high, although the results are not necessarily highly representative of the
performance of the whole network.
This approach however has the following disadvantages:
• The test configurations (i.e. the terminal and its method of use) are not indicative of how users actually handle
their terminals.
• In order to obtain adequate accuracy (representing a whole network) for comparison purposes, a large number
of samples is needed.
• It is difficult to set up test plans that are representative of users' behaviour in both location and timing and thus
not be necessarily be representative of the performance of the whole network. Normally the number of test
connections is rather low compared to real traffic monitoring, therefore the representativity of test calls is very
important.
The real traffic monitoring approach is based on the use of signalling and transmission characteristic related information
that can be gathered in the gateways and routers of the network. This approach has the following advantages:
• It includes the effects of all calls, and so provides better comparability of congestion and network failures.
• It takes account of changes in terminal equipment and the actual performance achieved by real terminals used
by real users.
This approach however has the following disadvantages:
• It does only measure the performance of actual transmissions and thus failures and faults concerning the
physical access to the network may not be covered.
• It depends on software algorithms in the routers and gateways, and the algorithms of different manufacturers
may differ and there may be differences between algorithms in different versions of the same software. Thus
the measurement results may not be reliable and additional effort must be spent in the interpretation of the raw
data.
• Τerminal related effects are unknown, so it may be impossible to distinguish between network/access related
faults and terminal/user related ones.
ETSI
14 ETSI EG 202 057-4 V1.2.1 (2008-07)
• Τhe distribution of terminating NTPs/destinations is unknown prior to the measurement. Thus depending on
the geographic coverage of the measurements long observation times may be needed in order to achieve a fair
distribution and collection of enough calls for a secure statistical basis.
• Signalling information may not be used in accordance with the standards and it may be impossible to find out
what each network section is using since routing tables may be altered frequently.
For both measurement methods additional information has to be known and preparation time to be spent prior to the
actual measurements. For test calls a precise measurement plan has to be set-up in order to establish a reliable statistical
basis. Real traffic monitoring has to rely on several assumptions (e.g. set-up of routers and gateways in other networks,
distribution of terminating NTPs, kind of terminals involved, traffic distribution) that have to be checked first. In
practice this will be done on a sample based examination.
If the measurements are performed by a party other than the access network provider, special care must be taken that all
relevant information concerning the access is known (signalling system, set-up of switches, tones, etc.).
In principle both methods or a combination of them can be used in order to assess the quality of an Internet access based
on the parameters defined in the present document.
4.3.2 Measurement
Even though the parameters can in principle be measured by using either real traffic monitoring or test calls, the
measurement methods defined here are all based on a test call scenario. For the time being there is no known real traffic
measurement scenario that could be used to assess the quality of an Internet access and provide comparable QoS
statistics. This is for further study.
The basic measurement set-up consists of a Test-PC and a Test-Server with specified software and hardware. Test calls
have to be established between the Test-PC and Test-Server and measurements must be made for the respective QoS
parameters given in clause 5. Also the necessary number of test calls and their distribution must be defined.
The measurement set-up is given by the following annexes:
• Annex B: Measurement set-up.
• Annex C: Guidance on the determination of representative test calls.
• Annex D: Specification of a test file.
Specific measurement conditions for the respective parameters are dealt with in clause 5.
The reference configuration given in annex B is based on test calls and the test-server is located as near as possible to
the gateway providing the interconnection between access network and IAP network. Thus the measurements will not
take into account the influence of the IAP network itself (defined between this gateway and the gateway interconnecting
with the Internet) on the QoS offered to the user. Therefore the parameters will measure the quality of the connection
between the end-user and its IAP access server (i.e. the test server). This quality is not the quality the user will perceive
when he actually will access Internet services via this access since the quality of t
...
SLOVENSKI STANDARD
01-april-2009
Vidiki obdelave, prenosa in kakovosti govora (STQ) - Definicije in meritve
parametrov QoS, ki se nanašajo na uporabnika - 4. del: Internetni dostop
Speech Processing, Transmission and Quality Aspects (STQ) - User related QoS
parameter definitions and measurements - Part 4: Internet access
Ta slovenski standard je istoveten z: EG 202 057-4 Version 1.2.1
ICS:
33.040.35 Telefonska omrežja Telephone networks
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
ETSI Guide
Speech Processing, Transmission and Quality Aspects (STQ);
User related QoS parameter definitions and measurements;
Part 4: Internet access
2 ETSI EG 202 057-4 V1.2.1 (2008-07)
Reference
REG/STQ-00101-4
Keywords
internet, QoS
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 2008.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
ETSI
3 ETSI EG 202 057-4 V1.2.1 (2008-07)
Contents
Intellectual Property Rights.5
Foreword.5
Introduction .6
1 Scope.7
2 References.7
2.1 Normative references.8
2.2 Informative references.8
3 Definitions and abbreviations.9
3.1 Definitions.9
3.2 Abbreviations.10
4 General considerations .11
4.1 Scope.11
4.1.1 Understanding of the term "Internet access".11
4.1.2 Internet accesses covered.11
4.2 Use of the parameters .12
4.3 Parameters and measurement issues.12
4.3.1 Real traffic monitoring versus test calls.13
4.3.2 Measurement.14
4.4 Data collection issues .15
4.4.1 Reporting for different classes of customers.15
4.4.2 Non standard levels of QoS .15
4.4.3 Data processing.15
4.4.4 Data collection period.15
4.5 Comparability of measurements.15
4.6 Publication of QoS parameters.16
5 QoS parameters for Internet access .16
5.1 Login time.17
5.1.1 Definition.17
5.1.2 Application.17
5.1.3 Measurement and statistics .17
5.2 Data transmission speed achieved .17
5.2.1 Definition.17
5.2.2 Application.17
5.2.3 Measurement and statistics .17
5.3 Unsuccessful data transmission ratio.18
5.3.1 Definition.18
5.3.2 Application.18
5.3.3 Measurement and statistics .18
5.4 Successful log-in ratio .18
5.4.1 Definition.18
5.4.2 Application.19
5.4.3 Measurement and statistics .19
5.5 Delay (one way transmission time) .19
5.5.1 Definition.19
5.5.2 Application.19
5.5.3 Measurement and statistics .19
Annex A (normative): Reference connection.20
Annex B (normative): Measurement set-up .21
Annex C (normative): Guidance on the determination of representative test calls .24
ETSI
4 ETSI EG 202 057-4 V1.2.1 (2008-07)
Annex D (normative): Specification of test file.27
Annex E (normative): Combination of weekly or monthly results.28
Annex F (normative): Guidance on technical performance aspects of Internet accesses:
Delay, packet loss and jitter.29
F.1 QoS versus network performance .29
F.2 Implications of delay, packet loss and jitter .29
F.2.1 Delay.29
F.2.2 Jitter.30
F.2.3 Packet loss.30
F.2.4 Performance considerations for different applications .30
F.3 Further information .32
Annex G (normative): Further explanation of "X % of".33
Annex H (informative): Performance targets .34
Annex I (informative): Bibliography.36
History .37
ETSI
5 ETSI EG 202 057-4 V1.2.1 (2008-07)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech Processing, Transmission and Quality
Aspects (STQ).
The present document is part 4 of a multi-part deliverable covering Speech Processing, Transmission and Quality
Aspects (STQ); User related QoS parameter definitions and measurements, as identified below:
Part 1: "General";
Part 2: "Voice telephony, Group 3 fax, modem data services and SMS";
Part 3: "QoS parameters specific to Public Land Mobile Networks (PLMN)";
Part 4: "Internet access".
EG 202 057-1 [i.2] contains general user related QoS parameter definitions and measurement methods that can be
applied to any service as well as user related QoS parameter definitions and measurement methods for voice, data and
fax services accessed via the public telecommunications network.
EG 202 057-2 [i.3] contains user related QoS parameter definitions and measurement methods for voice, modem data,
fax services and SMS accessed via the public telecommunications network. The data parameters are specified for the
case where a V.9x series modem is used since this kind of modem is in common use.
EG 202 057-3 [i.4] contains user related QoS parameter definitions and measurement methods specific to public land
mobile telecommunication networks (PLMN).
EG 202 057-4 (the present document) contains user related QoS parameter definitions and measurement methods
specific to Internet access.
The present document takes into account as far as practicable the following eight principles:
1) QoS parameters should be easily understood by the public, and be useful and important to them.
2) All parameters are applicable at the network termination point (where appropriate).
3) Where measurements are possible they should be made on the customer's premises, using in-service lines.
NOTE: Literally principles 2 and 3 imply that all measurements are carried out at the NTP. However, the NTP in
PLMNs is not precisely defined. Other methods are used to achieve an adequate representation of the
quality that would be perceived at the NTP for the parameters defined in the present document.
4) To be as realistic as possible, real traffic rather than test calls should be used as a basis of the measurements,
wherever possible.
5) Parameters should be capable of verification by independent organizations. This verification might be made by
direct measurements or by audit of service provider's measurements.
6) The accuracy of QoS values should be set to a level consistent with measurement methods being as simple as
possible with costs as low as possible.
ETSI
6 ETSI EG 202 057-4 V1.2.1 (2008-07)
7) The parameters are designed for both statistical and individual application. The statistical values should be
derived by the application of a simple statistical function to the individual values. The statistical function
should be specified in this multi-part deliverable. This multi-part deliverable should also contain guidelines on
how statistically significant samples should be selected.
8) The statistical functions should be designed so QoS figures from different service providers can be compared
easily by users and in particular consumers.
Introduction
The present document provides definitions and measurement methods for various QoS parameters for Internet access.
The parameters were developed on the basis of the user's Quality of Service criteria identified in the TR 102 276 [i.1].
ETSI
7 ETSI EG 202 057-4 V1.2.1 (2008-07)
1 Scope
The present document contains definitions and measurement methods for a range of user perceivable Quality of Service
(QoS) parameters. The purpose of these parameters is to define objective and comparable measures of the QoS
delivered to users/customers for use by users/customers. The present document applies to any telecommunication
service however some parameters may have a limited application.
The present document is intended to provide a menu from which individual items can be selected. There is no
obligation to use any or all of the parameters.
The QoS parameters are related primarily to services and service features and not to the technology used to provide the
services. Therefore the parameters should be capable of use when the services are provided on new technologies such as
IP and ATM or other packet switched technologies as well as on circuit switched technologies.
The establishment of target values for QoS is outside the scope of the present document. The QoS parameters listed in
the present document are also not intended to assess the complete QoS of a telecommunication service. The present
document provides a set of QoS parameters that covers specific user related QoS aspects rather than a complete list of
QoS parameters. This set has been chosen to address areas where monitoring of QoS is likely to be most worthwhile,
i.e. the areas that are most likely to be affected by any QoS problems.
If stakeholders wish to examine other QoS aspects they are recommended to follow the general approach of the present
document - as far as practicable - as a basis for the development of definitions and measurement methods for new
specific QoS parameters.
The set of QoS parameters is designed to be understood by the users of various telecommunications services. Sub-sets
of these parameters can be selected for use in different circumstances. For example a specific parameter might be
relevant for many users in some countries or markets but the same parameter might not be of relevance in others.
Therefore stakeholders - users, customers, regulators, service providers, network operators and other parties interested
in the use of QoS parameters - should decide in co-operation, which parameters should be used in their particular
situation. This decision should take account of:
• The precise purpose for which they will be used.
• The general level of quality achieved by most operators.
• The degree to which the parameters will provide a reliable comparison of performance.
• The cost of measuring and reporting each parameter.
The parameters defined in the present document are applicable to any kind of Internet access independently of the
underlying technology.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or non-
specific.
• For a specific reference, subsequent revisions do not apply.
• Non-specific reference may be made only to a complete document or a part thereof and only in the following
cases:
- if it is accepted that it will be possible to use all future changes of the referenced document for the
purposes of the referring document;
- for informative references.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
ETSI
8 ETSI EG 202 057-4 V1.2.1 (2008-07)
For online referenced documents, information sufficient to identify and locate the source shall be provided. Preferably,
the primary source of the referenced document should be cited, in order to ensure traceability. Furthermore, the
reference should, as far as possible, remain valid for the expected life of the document. The reference shall include the
method of access to the referenced document and the full network address, with the same punctuation and use of upper
case and lower case letters.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are indispensable for the application of the present document. For dated
references, only the edition cited applies. For non-specific references, the latest edition of the referenced document
(including any amendments) applies.
[1] ETSI TS 102 250-5: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 5: Definition of typical measurement profiles".
[2] ETSI TS 102 250-6: "Speech Processing, Transmission and Quality Aspects (STQ); QoS aspects
for popular services in GSM and 3G networks; Part 6: Post processing and statistical methods".
[3] ITU-T Recommendation G.1010: "End-user multimedia QoS categories".
[4] ITU-T Recommendation G.1020: "Performance parameter definitions for quality of speech and
other voiceband applications utilizing IP networks".
[5] ITU-T Recommendation Y.1540: "Internet protocol data communication service - IP packet
transfer and availability performance parameters".
[6] ITU-T Recommendation Y.1541: "Network performance objectives for IP-based services".
[7] IETF RFC 792: "Internet Control Message Protocol".
[8] ITU-T Recommendation I.350: "General aspects of quality of service and network performance in
digital networks, including ISDNs".
2.2 Informative references
The following referenced documents are not essential to the use of the present document but they assist the user with
regard to a particular subject area. For non-specific references, the latest version of the referenced document (including
any amendments) applies.
[i.1] ETSI TR 102 276: "User Group; Users' Quality of Service Criteria for Internet Access in Europe".
[i.2] ETSI EG 202 057-1: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 1: General".
[i.3] ETSI EG 202 057-2: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 2: Voice telephony, Group 3 fax, modem data
services and SMS".
[i.4] ETSI EG 202 057-3: "Speech Processing, Transmission and Quality Aspects (STQ); User related
QoS parameter definitions and measurements; Part 3: QoS parameters specific to Public Land
Mobile Networks (PLMN)".
ETSI
9 ETSI EG 202 057-4 V1.2.1 (2008-07)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
NOTE: Since the purpose of the present document is to formulate definitions for QoS parameters, these
definitions are given in the main body of the text and are not repeated here.
authentication: process of verifying a claimed identity to ensure that the stated identity of a user is correct
authorization: process of determining if the presenter of certain credentials is authorized to access a resource or make
use of a service
call: generic term to describe the establishment, utilization, and release of a connection (bearer path) or data flow
email: messages automatically passed from one computer user to another, often through computer networks and/or via
modems over telephone lines
File Transfer Protocol (FTP): protocol that allows users to copy files between their local system and any system they
can reach on the network
host: computer that provides client stations with access to files and printers as shared resources to a computer network
Internet: computer network consisting of a worldwide network of computer networks that use the TCP/IP network
protocols to facilitate data transmission and exchange
Internet access: making available of facilities and/or services for the purpose of providing an access to the public
Internet in order to provide a user with access to services or resources of the Internet
NOTE 1: The Internet access can be separated in two parts, the physical and the logical access.
The physical access provides a connection form the user's premises to, but not including, the POP
(normally a dial-up circuit or broadband link or leased line) whereas the logical access consist of the
setting up of an account that later on enables the user by a login process with the ability to access to the
services and resources of the Internet (normally by assigning an IP address).
NOTE 2: The physical and logical access may be provided by different service providers.
NOTE 3: The function of the physical access may be provided by several interconnected networks.
Internet Access Provider (IAP): organization that provides users with an Internet access
Internet Protocol (IP): main internetworking protocol used in the Internet. Used in conjunction with the Transfer
Control Protocol (TCP) to form TCP/IP
IP address: four-byte number uniquely defining each host on the Internet, usually written in dotted-decimal notation
with periods separating the bytes
EXAMPLE: 217.111.27.1 for IP Version 4.
login process: multi-step process which includes both authentication and authorization as well as other system start-up
tasks in order to provide a user with access to services or resources
public Internet: part of the Internet that is available to the general public
NOTE: The access is normally provided by Internet access and Internet service providers.
ETSI
10 ETSI EG 202 057-4 V1.2.1 (2008-07)
physical access provider: organization that arranges the provision of physical access from the user's premises to the
POP
NOTE 1: Excluding, the POP.
NOTE 2: Usually a dial-up circuit or an ADSL link or leased line are used.
NOTE 3: The function of the physical access provider may be provided by several interconnected networks.
Public Telecommunications Network (PTN): telecommunications network used wholly or partly for the provision of
publicly available telecommunications services
router: device which forwards packets between networks
NOTE: The forwarding decision is based on network layer information and routing tables, often constructed by
routing protocols. An IP router forwards data based on IP source and destination addresses.
stakeholder: party having an interest in the level of quality of a service
telecommunications: technical process of sending, transmitting and receiving any kind of message in the form of signs,
voice, images or sounds by means of telecommunications systems
telecommunication services: provision of telecommunications and the provision of other additional services that are
closely related to the provision of telecommunications like e.g. billing, directory services
telecommunications systems: technical equipment or systems capable of sending, transmitting, switching, receiving,
steering or controlling as messages identifiable electromagnetic signals
user: individuals, including consumers, or organizations using or requesting publicly available telecommunications
services
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
DSL Digital Subscriber Line
FQDN Fully Qualified Domain Name
FTP File Transfer Protocol
GPRS General Packet Radio Service
GSM Global System for Mobile communications
IAP Internet Access Provider
ICMP Internet Control Message Protocol
IP Internet Protocol
kbit/s kilobit per second
NTP Network Termination Point
OS Operating System
PC Personal Computer
PING Packet InterNet Groper
PLMN Public Land Mobile Network
POP Point Of Presence
PTN Public Telecommunications Network
QoS Quality of Service
SMS Short Message Service
UMTS Universal Mobile Telecommunications System
WLAN Wireless Local Area Network
xDSL generic Digital Subscriber Line
ETSI
11 ETSI EG 202 057-4 V1.2.1 (2008-07)
4 General considerations
4.1 Scope
4.1.1 Understanding of the term "Internet access"
Unlike to other (traditional) telecommunication services the Internet access - as it is used in these days - consists of
different connections and services that have to be available in combination in order to allow for a functional Internet
access. All these different connections and services can be understood as separate telecommunication services with their
own QoS aspects. However, the quality of services as perceived by the user accessed via the Internet like e.g. web
browsing and email will be influenced by the quality of each single element of the end-to-end connection/service.
Furthermore the term "Internet access" is not only understood by the naive user as an access in the real meaning of the
word, i.e. the provision of a physical connection and being able to establish connections to other parts or accesses of the
network. The user understands Internet access as having access to (end-to-end) services that rely on the transport
mechanisms of the Internet. This is because for most users the pure (physical) access to the internet is of no practical
use; only if the user gains access via e.g. web browsing to information and applications available on servers he can use
the "Internet".
However, from a technical point of view the (end-to-end) services/applications are offered independently to the
(physical) Internet access. This is also reflected in the fact that in many cases end users may need to have two contracts
in order to have full Internet access: one for an access to the PTN in order to get a physical connection to an IAP and
another one with an IAP/ISP in order to access services provided via the Internet.
In order to use the Internet, the user needs first to have access to the Internet (via the public PTN or via dedicated
broadband accesses). Technically spoken, he must be able to have access to the transport mechanisms of the Internet,
i.e. having access to IP layer transmission. This provides him with the ability to connect to other entities of the Internet
(IP based network). From there on the user may access advanced services that involve higher layers (above the IP layer)
of communication. These services may be offered totally independent of the physical access. Thus Internet access can
be understood as a (transportation) platform to access advanced services.
Therefore the term Internet access should primarily be understood as physical and logical access to the core of the
Internet, i.e. the access includes all functionalities that are needed to enable the user to establish connections to other
entities within the Internet and engage advanced services. All issues beyond that basic understanding of an Internet
access are highly dependent on the specific end-to-end service used and therefore should be subject to additional service
specific considerations.
4.1.2 Internet accesses covered
The present document provides QoS and network performance parameters for assessing the quality of Internet access as
perceived by the user. The purpose of the parameters is to inform the user on the transmission performance of the
assessed Internet access.
The term Internet access includes the physical access between the user's terminal equipment and the access to the
network of the IAP who is providing the end user with access to the Public Internet itself. The scope of the parameters
is limited to the Internet access itself, i.e. the connection between end user and IAP and the availability and reliability of
the access. The quality of end-to-end services accessed via this connection is outside the scope of the present document.
Internet access is normally not provided by a single service or network provider as it is possible in the case of other
telecommunication services like telephony services. The Internet access consists of a combination of different
connections and services.
The user gains access to the Public Internet via a suitable terminal equipment e.g. a PC that can be connected to the
PTN. The Internet access itself is normally provided by an IAP. The connection between the terminal equipment and
the IAP is established via a transit network. In most cases this will be the PTN, but it may also be a LAN or WLAN.
The overall quality of the Internet access is a combination of the performance of each element of this connection.
Annex A provides an reference scenario for the Internet access and illustrates the application of the QoS parameters.
ETSI
12 ETSI EG 202 057-4 V1.2.1 (2008-07)
The parameters are in principle applicable for any kind of Internet access technologies. This includes the following
access types:
• fixed narrowband access technologies like modem dial-up/ISDN connections;
• fixed broadband access (DSL, cable modem);
• wireless access technologies like WLAN, GSM, GPRS and UMTS.
NOTE: Although it is stated here that the measurement methods defined in the present document can be applied
in principle to any access technologies including wireless, care should be taken when applying the
measurement methods. The proposed measurement methods are focused access technologies for the
provision of Internet access at fixed locations. The measurement set-up does not take into account effects
due to a moving user as it is the case with wireless accesses. Thus the QoS parameters can only be applied
to Internet accesses with wireless technologies when they are provided at a fixed location.
The definitions and measurement methods of the parameters were elaborated primarily in order to assess QoS aspects of
"standard", i.e. typical accesses. Therefore mainly common aspects and technologies were considered and are reflected
in the present parameters. In principle the parameters may also be used for the investigation of special or non-standard
telecommunication services but further enhancements/additions to the definitions and measurements methods may be
necessary. Depending on the set of parameters used by the stakeholders the scope of the services covered may vary.
In many cases the provider of Internet access services may depend on other providers for part of the service. An
example is an IAP who is offering access to Internet services but does not provide the access from and to the NTP. In
such cases the provider of the service to the customer is responsible for all elements for which it receives payment from
the customer. In order to provide satisfactory QoS, this service provider will need to ensure that adequate QoS is
provided by the other interconnected service providers. QoS figures for the responsible service provider will reflect both
its own capability and that of the interconnected service providers.
4.2 Use of the parameters
The parameters may be used for various purposes including:
• Specifying the level of quality of service in customer telecommunication service contracts or in the description
or terms and conditions of the service by stakeholders.
• Comparing the quality of service of different service providers.
• Comparing the quality of service aspects of different service offers.
• Preparing long term studies on the quality of service aspects of a specific service.
4.3 Parameters and measurement issues
Quality of Service as perceived by the user is affected by operational and technical aspects. The QoS parameters listed
in this part of the Guide are covering aspects that are related to the network performance of connections set up via
Internet accesses. In other words the parameters cover the technical connection based quality aspects when the Internet
access is in use. Operational Aspects like e.g. supply time, billing and customer relations are dealt with in Part 1 of the
Guide.
Users are often interested in specific network performance parameters, i.e. delay, jitter, packet loss. These parameters
however cannot directly be related to the quality a user will perceive. One always has to take into account the specific
service that is in use. Some services may react very sensitive to variations or degradation of this parameters whereas
other services can compensate them very well. Therefore there are no specific QoS parameters in the present document
that provide separate statistics for theses parameters themselves. Instead of doing so in annex F basic information on the
influence of these parameters on the user perceived quality is given.
The QoS parameters defined in the present document are designed in order to assess the quality of an Internet access
that is understood as being the connection between an end user and an IAP which allows the end user accessing to the
core of Internet and use this access in order to get access to and/or make use of more advanced services that rely on the
Internet Protocol.
ETSI
13 ETSI EG 202 057-4 V1.2.1 (2008-07)
Thus the basic functions an Internet access must provide is to allow for establishing IP connections. Besides that the end
user is also interested in the reliability and availability of the access. Some basic transmission characteristics of the
connection between the UNI and the IAP are also important because the performance of the services the end user may
use are affected and limited by the performance of these parameters.
The QoS parameters to be measured include the performance of end user equipment as well as equipment at the IAP
side of the connection. The influence of the terminal equipment on the resulting quality of the connection is significant.
4.3.1 Real traffic monitoring versus test calls
Network performance related parameters are measured either by using test calls or by monitoring real traffic (or by a
combination of both). Both methods have their advantages and disadvantages.
Real traffic monitoring is on the one hand a low cost alternative but on the other hand the measuring party has no
influence on the connection details (termination, services, end equipment etc.) and therefore reproducibility is affected
and results may be less reliable. Whereas test call measurements are more complex and expensive but on the other hand
they are reproducible, i.e. it is exactly known what is measured.
It is up to the measuring party to decide which approach should be taken in order to establish the required statistics. In
the following list several aspects of the different measurement approaches that have to be considered are given.
The approach of test calls has the following advantages:
• It measures the network from an external point as would be seen by the user and so does not depend on any
correct functioning of the network to enable a measurement to be made.
• The same test system can be used to compare results for different networks and so the comparability of results
at the same point and time is high, although the results are not necessarily highly representative of the
performance of the whole network.
This approach however has the following disadvantages:
• The test configurations (i.e. the terminal and its method of use) are not indicative of how users actually handle
their terminals.
• In order to obtain adequate accuracy (representing a whole network) for comparison purposes, a large number
of samples is needed.
• It is difficult to set up test plans that are representative of users' behaviour in both location and timing and thus
not be necessarily be representative of the performance of the whole network. Normally the number of test
connections is rather low compared to real traffic monitoring, therefore the representativity of test calls is very
important.
The real traffic monitoring approach is based on the use of signalling and transmission characteristic related information
that can be gathered in the gateways and routers of the network. This approach has the following advantages:
• It includes the effects of all calls, and so provides better comparability of congestion and network failures.
• It takes account of changes in terminal equipment and the actual performance achieved by real terminals used
by real users.
This approach however has the following disadvantages:
• It does only measure the performance of actual transmissions and thus failures and faults concerning the
physical access to the network may not be covered.
• It depends on software algorithms in the routers and gateways, and the algorithms of different manufacturers
may differ and there may be differences between algorithms in different versions of the same software. Thus
the measurement results may not be reliable and additional effort must be spent in the interpretation of the raw
data.
• Τerminal related effects are unknown, so it may be impossible to distinguish between network/access related
faults and terminal/user related ones.
ETSI
14 ETSI EG 202 057-4 V1.2.1 (2008-07)
• Τhe distribution of terminating NTPs/destinations is unknown prior to the measurement. Thus depending on
the geographic coverage of the measurements long observation times may be needed in order to achieve a fair
distribution and collection of enough calls for a secure statistical basis.
• Signalling information may not be used in accordance with the standards and it may be impossible to find out
what each network section is using since routing tables may be altered frequently.
For both measurement methods additional information has to be known and preparation time to be spent prior to the
actual measurements. For test calls a precise measurement plan has to be set-up in order to establish a reliable statistical
basis. Real traffic monitoring has to rely on several assumptions (e.g. set-up of routers and gateways in other networks,
distribution of terminating NTPs, kind of terminals involved, traffic distribution) that have to be checked first. In
practice this will be done on a sample based examination.
If the measurements are performed by a party other than the access network provider, special care must be taken that all
relevant information concerning the access is known (signalling system, set-up of switches, tones, etc.).
In principle both methods or a combination of them can be used in order to assess the quality of an Internet access based
on the parameters defined in the present document.
4.3.2 Measurement
Even though the parameters can in principle be measured by using either real traffic monitoring or test calls, the
measurement methods defined here are all based on a test call scenario. For the time being there is no known real traffic
measurement scenario that could be used to assess the quality of an Internet access and provide comparable QoS
statistics
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.
Loading comments...