SIST-V ETSI/EG 202 765-3 V1.1.1:2016

SLOVENSKI STANDARD
SIST-V ETSI/EG 202 765-3 V1.1.1:2016
01-oktober-2016
.DNRYRVWSUHQRVDJRYRUDLQYHþSUHGVWDYQLKYVHELQ6740HWULNDNDNRYRVWL

VWRULWHY4R6LQ]PRJOMLYRVWLRPUHåMDWHUPHULOQHPHWRGHGHO0HWRGHPHWULNH

2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

The present document may be made available in more than one electronic version or in print. In any case of existing or

perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).

In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive

Users of the present document should be aware that the document may be subject to revision or change of status.

Information on the current status of this and other ETSI documents is available at

If you find errors in the present document, please send your comment to one of the following services:

DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered

3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.

GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.

Intellectual Property Rights ................................................................................................................................ 5

Foreword ............................................................................................................................................................. 5

Introduction ........................................................................................................................................................ 5

1 Scope ........................................................................................................................................................ 7

2 References ................................................................................................................................................ 7

2.1 Normative references ......................................................................................................................................... 7

2.2 Informative references ........................................................................................................................................ 8

3 Definitions, symbols and abbreviations ................................................................................................... 9

3.1 Definitions .......................................................................................................................................................... 9

3.2 Symbols .............................................................................................................................................................. 9

3.3 Abbreviations ................................................................................................................................................... 10

4 Performance Metrics Definitions and Measurement Methods ............................................................... 10

4.1 One Way Delay vs. IP Packet Transfer Delay .................................................................................................. 11

4.1.1 IETF Definition .......................................................................................................................................... 11

4.1.2 ITU-T Definition ........................................................................................................................................ 12

4.1.3 Comparison and Recommendations ........................................................................................................... 12

4.1.4 Active Measurement Method ...................................................................................................................... 13

4.1.5 Passive Measurement Method .................................................................................................................... 14

4.2 Round Trip Delay ............................................................................................................................................. 15

4.2.1 IETF Definition .......................................................................................................................................... 15

4.2.2 ITU-T Definition ........................................................................................................................................ 16

4.2.3 Comparison and Recommendations ........................................................................................................... 16

4.2.4 Active Measurement Method ...................................................................................................................... 16

4.2.5 Passive Measurement Method .................................................................................................................... 17

4.3 IP Packet Delay Variation vs. End-to-end 2-point IP Packet Delay Variation ................................................. 19

4.3.1 IETF Definition .......................................................................................................................................... 19

4.3.2 ITU-T Definition ........................................................................................................................................ 20

4.3.3 Comparison and Recommendations ........................................................................................................... 21

4.3.4 Active Measurement Method ...................................................................................................................... 22

4.3.5 Passive Measurement Method .................................................................................................................... 22

4.4 One Way Packet Loss vs. IP Packet Loss Ratio ............................................................................................... 22

4.4.1 IETF Definition .......................................................................................................................................... 23

4.4.2 ITU-T Definition ........................................................................................................................................ 23

4.4.3 Comparison and Recommendations ........................................................................................................... 23

4.4.4 Active Measurement Method ...................................................................................................................... 23

4.4.5 Passive Measurement Method .................................................................................................................... 24

4.5 Connectivity vs. IP Service Availability .......................................................................................................... 24

4.5.1 IETF Definition .......................................................................................................................................... 24

4.5.2 ITU-T Definition ........................................................................................................................................ 25

4.5.3 Comparison and Recommendations ........................................................................................................... 25

4.5.4 Active Measurement Method ...................................................................................................................... 26

4.5.5 Passive Measurement Method .................................................................................................................... 26

5 Other Metrics .......................................................................................................................................... 26

5.1 Data and Packet Volume .................................................................................................................................. 26

5.2 Packet Reordering ............................................................................................................................................ 27

5.3 Bandwidth Capacity, Available Bandwidth, and Utilization ............................................................................ 27

5.4 Bulk Transport Capacity .................................................................................................................................. 27

5.5 Loss Patterns .................................................................................................................................................... 27

5.6 RTCP reported metrics ..................................................................................................................................... 28

6 Overview of Network Performance Relevant Standard Bodies and Working Groups .......................... 29

6.1 IETF ................................................................................................................................................................. 29

6.1.1 IPPM (IP Performance Metrics) Working Group ....................................................................................... 29

6.1.2 IPFIX (IP Flow Information eXport) Working Group ................................................................................ 29

6.1.3 PSAMP (Packet SAMPling) Working Group ............................................................................................. 30

6.2 ITU-T ............................................................................................................................................................... 30

6.2.1 Study Group 12 (Performance and quality of service) ................................................................................ 30

6.2.2 Study Group 15 (Optical and other transport network infrastructures) ....................................................... 30

Annex A: Bibliography .......................................................................................................................... 32

History .............................................................................................................................................................. 33

IPRs essential or potentially essential to the present document may have been declared to ETSI. The information

pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found

in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in

respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web

Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee

can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web

This ETSI Guide (EG) has been produced by ETSI Technical Committee Speech and multimedia Transmission Quality

The present document is part 3 of a multi-part deliverable covering the QoS and network performance metrics and

The need to define Internet performance metrics and measurement methodologies stems from the need to compare

different measurements and to measure performance with a reproducible and unambiguous methodology, independent

from transmission technology and implementation details. Both the ITU-T Study Group 12 and the IETF IPPM

Working Group have produced such definitions (see table 1), although each with a different emphasis closely linked to

the historical background of both organizations. The ITU has its origins in telephony, while the IETF has a data

networking background. Whereas the ITU emphasizes the evaluation of a service and its quality, the IETF measures the

network and wants to provide the IT-community with an accurate, common understanding and measurement of the

In most cases this results in different terminology rather than in incompatibilities; most differences in approach and

emphasis serve the different intended use of each metric, but have no operational significance. In some cases the

terminology used by each organisations can be mapped to the other, while in some others there is only approximate

equivalence (e.g. ITU network section versus an IPPM cloud; one focuses on corresponding events while the other

measures the fate of a single packet). Other terms have no correspondence. For example, ITU-T Recommendation

I.380 [i.38] has a notion of an IP packet transfer reference event while IPPM defines "wire time".

Other differences between IETF and ITU-T metrics result from their intended application. ITU-T metrics seek to

provide a common language for providers to communicate about performance, so the ITU-T metrics do not concentrate

on performance within a single network, while the IETF focuses on performance measurement protocols and

implementation. ITU-T seeks to evaluate service and to exclude unfair use, while the IETF seeks to measure network

quantities and avoid biased measurement results. Due to their respective backgrounds, the ITU generally produces

statistical metrics geared towards a quantitative representation of the complete end-to-end user experience while the

IETF IPPM working group mainly focuses more on statistical metrics which provide a detailed technical view of

The goal of the present document is to define network performance metrics for applications sensitive to quality of

service such as Voice over IP, referring to the existing work produced by both IETF and ITU-T. The present document

highlights the differences between the two standards and provides guidelines on resolving these differences, when they

The scope of the present document is limited to IP performance metrics relevant for data transmission over IP-based

networks for use in QoS sensitive applications. For each addressed metric, the document recommends one or more

measurement methods. The document only focuses on intrinsic network QoS metrics; perceived QoS metrics applicable

The remainder of the present document is organised as follows: Clause 4 describes the definitions of the most important

performance metrics as defined by the standard bodies and methods for measuring them, and discusses the applicability

of the definitions and the differences between them. Clause 5 discusses other metrics applicable to QoS. Finally,

clause 6 gives an overview of relevant QoS measurement standards, which can be used in end to end performance

The present document provides an overview of the common metric definitions and measurement method specifications

upon which the interoperability of network performance measurement (also called QoS measurement) is based. Two

different standardisation bodies, the Internet Engineering Task Force (IETF) and the International Telecommunication

Union - Telecommunication Standardization Sector (ITU - T), have addressed this issue. The present document

• Survey the existing network performance related IETF standards and how these standards can be applied to

end-to-end network performance measurements. The scope of this work is also to discuss the relationship of

• Discuss and compare definitions of metrics used to specify and assess performance in IP networks. The

metrics addressed in the present document are those defined by the IETF IPPM working group and ITU-T

Study Group 12. Besides comparing the different definitions, the present document gives applicability

guidelines on which metric is more appropriate for a particular application, configuration or scenario.

• Define measurement methods for selected performance metrics in IP networks, addressing both active and

NOTE: All text sections in the remainder of the present document which are enclosed in quotation marks (") and

formatted in italic style denote citations taken verbatim from referenced documents.

References are either specific (identified by date of publication and/or edition number or version number) or

• Non-specific reference may be made only to a complete document or a part thereof and only in the following

- if it is accepted that it will be possible to use all future changes of the referenced document for the

Referenced documents which are not found to be publicly available in the expected location might be found at

NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee

The following referenced documents are indispensable for the application of the present document. For dated

references, only the edition cited applies. For non-specific references, the latest edition of the referenced document

The following referenced documents are not essential to the use of the present document but they assist the user with

regard to a particular subject area. For non-specific references, the latest version of the referenced document (including

[i.1] ITU-T Recommendation Y.1540: "Internet protocol data communication service - IP packet

[i.3] IETF RFC 2330: "Framework for IP Performance Metrics". V. Paxson, G. Almes, J. Mahdavi,

[i.4] IETF RFC 2678: "IPPM Metrics for Measuring Connectivity". J. Mahdavi, V. Paxson.

[i.5] IETF RFC 2679: "A One-way Delay Metric for IPPM". G. Almes, S. Kalidindi, M. Zekauskas.

[i.6] IETF RFC 2680: "A One-way Packet Loss Metric for IPPM". G. Almes, S. Kalidindi,

[i.7] IETF RFC 2681: "A Round-trip Delay Metric for IPPM". G. Almes, S. Kalidindi, M. Zekauskas.

[i.8] IETF RFC 3148: "A Framework for Defining Empirical Bulk Transfer Capacity Metrics".

[i.9] IETF RFC 3357: "One-way Loss Pattern Sample Metrics". R. Koodli, R. Ravikanth. August 2002.

[i.10] IETF RFC 3393: "IP Packet Delay Variation Metric for IP Performance Metrics (IPPM)".

[i.14] IETF RFC 4656: "A One-way Active Measurement Protocol (OWAMP)". S. Shalunov,

[i.15] IETF RFC 4737: "Packet Reordering Metrics". A. Morton, L. Ciavattone, G. Ramachandran,

[i.18] IETF RFC 5101: "Specification of the IPFIX Protocol for the Exchange of IP Traffic Flow

Information". B. Claise, S. Bryant, S. Leinen, T. Deitz, B.Trammell. January 2008.

[i.21] "IPFIX Applicability Statement". T. Zseby, E. Boschi, N.Brownlee, B. Claise. Internet-Draft, work

[i.23] ITU-T Recommendation G.1020 (07/06): "Performance parameter definitions for quality of speech

[i.24] IETF RFC 3917: "Requirements for IP Flow Information Export". J. Quittek, T. Zseby, B. Claise,

[i.29] "Reporting Metrics: Different Points of View", A. Morton, G. Ramachandran, G. Maguluri, work

NOTE: http://tools.ietf.org/html/draft-morton-ippm-reporting-metrics-02, and the derived presentation "Reporting

[i.30] IETF RFC 3611: "RTP Control Protocol Extended Reports (RTCP XR)", T. Friedman, R. Caceres,

[i.31] IETF RFC 5136: "Defining Network Capacity", P. Chimento, J. Ishac. February 2008.

[i.32] IETF RFC 2581: "TCP Congestion Control", M. Allman, V. Paxson, W. Stevens. April 1999.

[i.33] IETF RFC 5357: "A Two-Way Active Measurement Protocol (TWAMP)", K. Hedayat,

[i.34] IETF RFC 1122: "Requirements for Internet Hosts - Communication Layers", R. Braden ed.

[i.36] IETF RFC 1633: "Integrated Services in the Internet Architecture: an Overview".

[i.38] ITU-T Recommendation I.380: "Internet protocol data communication service - IP packet transfer

For the purposes of the present document, the terms and definitions given in RFC 2330 [i.3], ITU-T Recommendation

ITU-T International Telecommunication Union - Telecommunication standardisation sector

This clause provides common definitions for network performance metrics. These definitions are based, whenever

possible, on existing definitions proposed by other relevant standard bodies such as IETF or ITU-T. Note that the

different definitions of similar metrics are in most cases compatible, that is, semantically equivalent or easily

For each metric, passive and active measurement methods are defined. Note that we chose to focus on commonly used

measurement methods rather than on standards; when a standard exists, a reference is provided as well. Note also that

throughout this text we refer for each metric to active and passive measurements in the following way:

Active measurement methods inject traffic into the network and compute traffic metrics based on monitoring

the injected traffic or the response to the injected traffic. Active test traffic may perturb other traffic already

present on the network; therefore its scheduling and volume should be carefully configured. One can

distinguish active monitoring systems based on the position of sender and receiver and the observed traffic;

Passive measurements provide information about traffic in the observed network by capturing all or a selected

subset of the IP packets traversing a monitoring point. Since no test traffic is generated, passive measurements

can only be applied when the traffic of interest is already present on the network. The physical deployment of

monitoring probes in the network can be realised in different ways, depending on the metrics of interest, but

also on the network technology, e.g. via a physical line splitter, via a normal client connection in broadcast

Delay is used to measure the expected time for an IP packet to traverse the network from one host to another.