ETSI GS F5G 005 V1.1.1 (2022-03)

Fifth Generation Fixed Network (F5G) F5G High-Quality Service Experience Factors Release#1

DGS/F5G-005_QoE

General Information

• Status: Not Published
• Technical Committee: F5G - 5th Generation Fixed Network
• Current Stage: 12 - Completion
• Due Date: 22-Mar-2022
• Completion Date: 15-Mar-2022

Standards Content (Sample)

ETSI GS F5G 005 V1.1.1 (2022-03)






GROUP SPECIFICATION
Fifth Generation Fixed Network (F5G)
F5G High-Quality Service Experience Factors
Release #1
Disclaimer
The present document has been produced and approved by the Fifth Generation Fixed Network (F5G) ETSI Industry
Specification Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.

---------------------- Page: 1 ----------------------
2 ETSI GS F5G 005 V1.1.1 (2022-03)

Reference
DGS/F5G-005_QoE
Keywords
F5G, QoE, QoS

ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from:
http://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
and/or governmental rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2022.
All rights reserved.

ETSI

---------------------- Page: 2 ----------------------
3 ETSI GS F5G 005 V1.1.1 (2022-03)
Contents
Intellectual Property Rights . 5
Foreword . 5
Modal verbs terminology . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 7
3 Definition of terms, symbols and abbreviations . 7
3.1 Terms . 7
3.2 Symbols . 7
3.3 Abbreviations . 7
4 Introduction . 8
4.1 Overview of High-Quality of Experience (QoE) . 8
4.2 Structure of the present document . 9
5 Application Services and related QoE factors . 10
5.1 QoE of Typical Applications . 10
5.1.1 General Description . 10
5.1.2 QoE Factors of Typical Applications. 10
5.1.2.1 Introduction . 10
5.1.2.2 Voice . 10
5.1.2.3 High-speed Internet . 10
5.1.2.4 Web Browsi ng . 10
5.1.2.5 TV . 10
5.1.3 Generic Measurement Methodology . 10
5.1.4 Generic QoE management . 11
5.2 Cloud VR. 11
5.2.1 General Description . 11
5.2.2 Factors Affecting Cloud VR service . 11
5.2.2.1 Factors Affecting Weak-Interaction Cloud VR Service Experience . 11
5.2.2.2 Factors Affecting Strong-Interaction Cloud VR Service Experience. 13
5.2.3 Measurement Methodology . 13
5.2.4 QoE Management . 14
6 Factors impacting QoE for Networking Services . 14
6.1 Customer Premises Networks. 14
6.1.1 General Description . 14
6.1.2 QoE Factors for CPNs . 14
6.1.3 Measurement Methodology for CPNs . 15
6.1.4 QoE management for CPNs . 16
6.2 Access and Aggregation Network . 16
6.2.1 General Description . 16
6.2.2 QoE Factors for Access and Aggregation Networks . 16
6.2.2.1 Bandwidth . 16
6.2.2.2 Latency . 17
6.2.2.3 Packet Jitter . 17
6.2.2.4 Reliability . 17
6.2.2.5 Security . 17
6.2.3 Measurement Methodology . 17
6.2.3.1 End-to-end Measurements . 17
6.2.3.2 Network Telemetry . 17
6.2.4 QoE management . 17
6.2.4.1 Network Planning . 17
6.2.4.2 QoS management . 17
ETSI

---------------------- Page: 3 ----------------------
4 ETSI GS F5G 005 V1.1.1 (2022-03)
7 Mechanisms and Approaches for F5G QoE . 18
7.1 General Considerations . 18
7.2 Measurement-based QoE Assessment . 18
7.2.1 Introduction. 18
7.2.2 Measurements with simulated traffic . 19
7.2.3 Measurements of real traffic . 19
7.3 Network slicing to improve QoE . 19
7.3.1 Introduction. 19
7.3.2 F5G Underlay Network Planning . 19
7.3.3 F5G service-oriented slice modelling . 19
7.3.4 Measuring the Quality of a Network Slice . 20
7.4 AI-based QoE Assessment . 20
7.4.1 Based on Network QoS parameters . 20
7.4.2 Based on detected user behaviour . 21
7.5 Service Provider Domain oriented QoS Measurements and QoE Assessment. 21
7.5.1 Introduction. 21
7.5.2 Media application-based QoS Measurements and QoE Assessment . 22
7.5.2.1 General Description . 22
7.5.2.2 Quality Measurement Methods for Media Services over UDP/RTP . 22
7.5.2.3 Quality Measurement Methods for Media Services over TCP . 23
8 Summary of Requirements and Recommendations of F5G QoE . 26
8.1 Requirements . 26
8.2 Recommendations . 27
Annex A (informative): Example of quality monitoring for media services over UDP/RTP . 28
Annex B (informative): Example of quality monitoring for media services over TCP . 30
History . 32

ETSI

---------------------- Page: 4 ----------------------
5 ETSI GS F5G 005 V1.1.1 (2022-03)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI Web server (https://ipr.etsi.org/).
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its

Members. 3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and of the 3GPP
Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of the
®
oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This Group Specification (GS) has been produced by ETSI Industry Specification Group (ISG) Fifth Generation Fixed
Network (F5G).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.

ETSI

---------------------- Page: 5 ----------------------
6 ETSI GS F5G 005 V1.1.1 (2022-03)
1 Scope
The present document studies the end-to-end Quality of Experience (QoE) factors for services over the broadband
network. High-QoE reflects the overall performance at the service level from the perspective of the end user. The
present document analyses the general factors that impact service performance and identifies the overall high-QoE
dimensions for each service. The key services discussed in the present document are typical Internet applications and
Virtual Reality (VR). Other services and applications QoE are for further study.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
https://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] ETSI GS F5G 004: "F5G Architecture Release 1".
[2] Recommendation ITU-T Y.1540: "Internet protocol data communication service - IP packet
transfer and availability performance parameters".
[3] Recommendation ITU-T P.863: "Perceptual objective listening quality prediction".
[4] ETSI TS 103 222-1: "Speech and multimedia Transmission Quality (STQ); Reference
benchmarking, background traffic profiles and KPIs; Part 1: Reference benchmarking, background
traffic profiles and KPIs for VoIP and FoIP in fixed networks".
[5] ETSI TS 103 222-2: "Speech and multimedia Transmission Quality (STQ); Reference
benchmarking, background traffic profiles and KPIs; Part 2: Reference benchmarking and KPIs for
High speed internet".
[6] Recommendation ITU-T J.247: "Objective perceptual multimedia video quality measurement in
the presence of a full reference".
[7] IETF RFC 3357: "One-way Loss Pattern Sample Metrics".
[8] IETF RFC 768: "User Datagram Protocol".
[9] IETF RFC 3550: "RTP: A Transport Protocol for Real-Time Applications".
[10] IETF RFC 793: "Transmission Control Protocol".
[11] Recommendation ITU-T P.10: "Vocabulary for performance and quality of service".
[12] Recommendation ITU-T G.988: "ONU management and control interface (OMCI) specification".
ETSI

---------------------- Page: 6 ----------------------
7 ETSI GS F5G 005 V1.1.1 (2022-03)
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI TR 102 505: "Speech and multimedia Transmission Quality (STQ); Development of a
Reference Web page".
[i.2] ETSI EG 202 057 (Part 1 to 4): "Speech Processing, Transmission and Quality Aspects (STQ);
User related QoS parameter definitions and measurements".
[i.3] Broadband Forum (BBF) TR-126: "Triple-play Services Quality of Experience (QoE)
Requirements".
[i.4] ETSI GR F5G 002: "F5G Use Cases Release 1".
[i.5] ETSI White Paper No. 47, "Fibre Development Index: Driving Towards an F5G Gigabit Society",
ISBN No. 979-10-92620-41-1.
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the terms given in F5G Architecture [1] and the following apply:
Key Quality Indicators (KQI): QoS metrics, which are important and have a major impact on the QoE of applications
and networks
Mean Opinion Score (MOS): mean of the values on a predefined scale that users assign to their opinion of the
performance of a system quality
NOTE: See Recommendation ITU-T P.10 [11].
Quality of Experience (QoE): subjective measure of performance of applications or services that relies in human
opinion on the perceived quality
Quality of Service (QoS): description or quantitative measurements of the overall performance of the F5G system at
the network, service, and application domain
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the abbreviations given in F5G Architecture [1] and the following apply:
®
AP Wi-Fi Access Points
Cloud VR Cloud Virtual Reality
DRTT Downstream Round-Trip Time
DSLR Downstream Segment Loss Rate
FoV Field of View
ETSI

---------------------- Page: 7 ----------------------
8 ETSI GS F5G 005 V1.1.1 (2022-03)
KQI Key Quality Indicators
MOS Mean Opinion Score
NPS Net Promoter Score
USLR Upstream Segment Loss Rate
VoD Video on Demand
4 Introduction
4.1 Overview of High-Quality of Experience (QoE)
This clause provides an introduction to Quality of Experience (QoE) and the distinction between QoE and QoS as used
in the present document.
The QoE (Quality of Experience) and QoS (Quality of Service) terminology (see clause 3.1 for the term) are often used
interchangeably, but are actually two separate concepts.
The QoE is a combination of objective measurable components (as metrics on the conditions in the network and service
platforms that are required for a specific service to work properly) and subjective components (as user expectancy on
the service, user previous experience or user personal preferences).
Mean Opinion Score (MOS) is one often used QoE measurement metric typically used to quantify the perceptual impact
(the users' QoE) for various forms of service degradation.
QoE can also be assessed based on objective QoS metrics. There are different QoS metrics, which can be gathered,
some easy to collect other more difficult. Depending on the specific service different combinations of these metrics may
be needed for QoE assessment. The availability and understanding of these QoS metrics determine QoE assessment in
different levels of detail. This QoE assessment based on QoS metrics is the focus of the present document.
QoS is a measure of the performance of networked services at the network or application level. QoS also refers to a set
of techniques that enable the network administrator to manage the network performance differentiating between
different users. QoS metrics may include network layer measurements such as packet loss, delay or jitter or application
level measurements such as video frame loss, frame freezing, image distortion. The Key Quality Indicators (KQI) are
the QoS metrics, which have the largest impact on QoE.
In general, there is a non-linear relationship between the subjective QoE as measured by the MOS or other metrics and
various parameters used to measure network performance (e.g. encoding bit rate, packet loss, delay, availability,
etc.).Typically there will be multiple service or network level performance (QoS) metrics that will impact overall QoE.
The relationship between QoE and service and network performance (QoS) metrics is typically derived empirically.
Having identified the QoE/QoS relationship, if it is possible, it can be used to predict the expected QoE for a user, given
the QoS parameters, or given a target QoE, the required network and service requirements can be derived.

Figure 4-1: Example QoS/QoE non-linear relationship
ETSI

---------------------- Page: 8 ----------------------
9 ETSI GS F5G 005 V1.1.1 (2022-03)
The Key Quality Indicators (KQI) are composed by the QoS metrics, which have the largest impact on QoE, namely
user centric and service specific quality patterns that directly influence the user perception for each service category.
The definition of these quality patterns poses a challenge where Artificial Intelligence correlation techniques may play
an important role.
QoE targets are needed for each service and application and should be included from the beginning in system design
and engineering processes where they are translated into objective service level performance metrics.
QoE requirements shall be considered from a complete end-to-end system perspective. All end-systems (client and
servers), application services and networks (nodes, links) that can contribute to the user experience using a service shall
be taken into account. But also several stakeholders are contributing to a high end-to-end QoE. Those include the
network service provider, the application provider, and the server/client device providers among others.
QoE-oriented engineering includes processes to analyses user requirements, derive measurable parameters, having the
different configuration aspects of the components in the end-to-end service delivery chain, and identify the relationship
between the measurable parameters and the subjective user quality of experience.
Quality of Experience is an important factor in the success of F5G services and is expected to be a key differentiator
with respect to competing service offerings. Subscribers to network services and applications are increasingly sensitive
to how well a service meets their expectations for performance, operability, availability, and ease of use.
4.2 Structure of the present document
User assessment of application and service quality has some subjective aspects, however the present document focuses
on QoE assessment based on measurements. These measurements are made at network and at application level.
F5G High Quality Service Experience Factors
(Clause 4)
Overview
(Clause 5) (Clause 6)
KQI on Application level KQI on Network level
Typical applications (voice, HIS, Customers Premises Network
Web browsing, TV)Access and Aggregation
Cloud Virtual Reality
Network
Mechanisms and Approaches for F5G QoE (Clause 7)
Summary of Requirements and Recommendations (Clause 8)

Figure 4-2: Structure of the present document
The present document is structured as follows:
• Clause 5: Specification of the measurable Key Quality Indicators (KQI) on the application level (typical
applications by referencing the appropriate specifications and Cloud VR as a new application with new sets of
KQIs enabled by F5G).
• Clause 6: Specification of the measurable Key Quality Indicators on the network level in the different
segments of the network.
• Clause 7: Specification of different mechanisms and approaches to either measure or improve QoE. Several
measurement approaches for key performance indicators and QoE assessment methods are specified and the
use of novel concepts like network slicing and AI-based QoE assessment are described.
• Clause 8: Finally, the present document is summarizing the requirements and recommendation for a F5G QoE.
ETSI

---------------------- Page: 9 ----------------------
10 ETSI GS F5G 005 V1.1.1 (2022-03)
5 Application Services and related QoE factors
5.1 QoE of Typical Applications
5.1.1 General Description
In the present document, the term typical application is used for applications that are well established, which have
standardized quality metrics.
...