ETSI GS F5G 015 V1.1.1 (2023-04)

Fifth Generation Fixed Network (F5G); F5G Residential Services Quality Evaluation and Classification Release 2

DGS/F5G-0015_ residential

General Information

• Status: Not Published
• Technical Committee: F5G - 5th Generation Fixed Network
• Current Stage: 12 - Completion
• Due Date: 27-Apr-2023
• Completion Date: 28-Apr-2023

Standards Content (Sample)

ETSI GS F5G 015 V1.1.1 (2023-04)






GROUP SPECIFICATION
Fifth Generation Fixed Network (F5G);
F5G Residential Services Quality Evaluation and
Classification
Release 2
Disclaimer
The present document has been produced and approved by the Fifth Generation Fixed Network (F5G) ETSI Industry
Specification Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.

---------------------- Page: 1 ----------------------
2 ETSI GS F5G 015 V1.1.1 (2023-04)

Reference
DGS/F5G-0015_ residential
Keywords
MOS, network KQI, QoE, residential network,
service classification, service KQI

ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from:
https://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure Program:
https://www.etsi.org/standards/coordinated-vulnerability-disclosure
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
arranty is made of merchantability or fitness
and/or governmental rule and/or regulation and further, no representation or w
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2023.
All rights reserved.

ETSI

---------------------- Page: 2 ----------------------
3 ETSI GS F5G 015 V1.1.1 (2023-04)
Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
1 Scope . 7
2 References . 7
2.1 Normative references . 7
2.2 Informative references . 7
3 Definition of terms, symbols and abbreviations . 8
3.1 Terms . 8
3.2 Symbols . 8
3.3 Abbreviations . 8
4 Introduction . 10
4.1 Overview . 10
4.2 Motivation . 11
4.3 Document structure . 12
5 Service KQIs . 12
5.1 General description. 12
5.2 Voice . 12
5.2.1 Voice service KQIs overview . 12
5.2.2 Call completion rate . 13
5.2.3 Call setup time . 13
5.2.4 Conversational quality . 13
5.2.5 Call drop rate . 13
5.3 Web browsing . 13
5.3.1 Web browsing service KQIs overview . 13
5.3.2 Page response time. 13
5.3.3 First screen display time . 13
5.3.4 Full load time . 13
5.4 Data upload/download . 14
5.4.1 Upload/download service KQI overview . 14
5.4.2 Download rate ratio . 14
5.4.3 Upload rate ratio . 14
5.5 IPTV . 14
5.5.1 IPTV service KQI overview . 14
5.5.2 Interactive user experience . 15
5.5.3 Viewing user experience . 15
5.6 On-line game . 15
5.6.1 Overview . 15
5.6.2 Terminal-based rendered game . 15
5.6.2.1 Overview of terminal-based rendered game KQIs . 15
5.6.2.2 Game start-up time . 15
5.6.2.3 Operation response delay . 16
5.6.2.4 Desynchronization time . 16
5.6.3 Cloud-based rendered game . 16
5.6.3.1 Overview of cloud-based rendered game KQIs . 16
5.6.3.2 Frame freezing time ratio . 16
5.6.3.3 Operation response delay . 16
5.7 On-line education/telework . 16
5.7.1 Overview of on-line education/telework KQI . 16
5.7.2 Frame freezing times . 17
5.7.3 Frame freezing time ratio . 17
5.7.4 Interaction delay . 17
5.8 Cloud VR. 17
5.8.1 Overview . 17
ETSI

---------------------- Page: 3 ----------------------
4 ETSI GS F5G 015 V1.1.1 (2023-04)
5.8.2 Cloud VR video . 17
5.8.2.1 Overview . 17
5.8.2.2 Initial buffering duration . 17
5.8.2.3 Average percentage of frames freezing . 17
5.8.2.4 Low quality image display (the indicator definition is only for videos that use the FOV
transmission solution) . 18
5.8.3 Cloud VR Game . 18
5.8.3.1 Overview . 18
5.8.3.2 Black edge and smearing . 18
5.8.3.3 Average percentage of frame freezing . 18
5.8.3.4 Operation response delay . 18
6 Network KQI . 19
6.1 Overview . 19
6.2 Throughput . 19
6.3 Latency . 20
6.4 Connectivity . 20
6.5 Handover . 21
6.6 Green & security . 22
6.6.1 Introduction. 22
6.6.2 Green (power consumption) . 22
6.6.3 Security . 24
6.7 Smart O&M . 24
7 User experience evaluation . 25
7.1 General description. 25
7.1.1 Introduction. 25
7.1.2 The Concept of a MOS value. 25
7.2 Voice . 25
7.2.1 MOS mapping of Call Completion Rate (CCR) . 25
7.2.2 MOS mapping of Call Setup Time (CST) . 26
7.2.3 MOS mapping of voice quality . 27
7.2.3.1 Introduction . 27
7.2.3.2 E-Model . 27
7.2.3.3 PESQ Model . 28
7.2.4 MOS mapping of Call Drop Rate (CDR). 28
7.2.5 Comprehensive service score . 29
7.3 Web browsing . 29
7.3.1 MOS mapping of Page Response Time (PRT) . 29
7.3.2 MOS mapping of the First Screen Display Time (FSDT) . 29
7.3.3 MOS mapping of Full Load Time (FLT) . 30
7.3.4 Comprehensive service score . 30
7.4 Data upload/download . 31
7.4.1 MOS mapping of Download Rate Ratio (DRR) . 31
7.4.2 MOS mapping of Upload Rate Ratio (URR) . 31
7.4.3 Comprehensive service score . 31
7.5 IPTV . 32
7.5.1 MOS mapping of Interactive Experience (IE) . 32
7.5.2 MOS mapping of Viewing Experience (VE) . 33
7.5.3 Comprehensive service score . 35
7.6 Terminal-based rendering game . 35
7.6.1 MOS mapping of Network Start-up Time (NST) . 35
7.6.2 MOS mapping of Operation Response Delay (ORD) . 36
7.6.3 MOS mapping of Desynchronization Time Ratio (DTR) . 37
7.6.4 Comprehensive service score . 37
7.7 Cloud-based rendering game . 37
7.7.1 MOS mapping of Frame Freezing Time Ratio (FFTR) . 37
7.7.2 MOS mapping of Operation Response Delay (ORD) . 38
7.7.3 Comprehensive service score . 39
7.8 On-line education/telework . 39
7.8.1 MOS mapping of Frame Freezing Times (FFT) . 39
7.8.2 MOS mapping of Frame Freezing Time Ratio (FFTR) . 39
ETSI

---------------------- Page: 4 ----------------------
5 ETSI GS F5G 015 V1.1.1 (2023-04)
7.8.3 MOS mapping of Interaction Delay (ID) . 40
7.8.4 Comprehensive service score . 41
7.9 Cloud VR video . 41
7.9.1 MOS mapping of Initial Buffering Duration (IBD) . 41
7.9.2 MOS mapping of Average Percentage of Frame Freezing (APFF) . 42
7.9.3 MOS mapping of Low Quality Image Display (LQID) . 42
7.9.4 Comprehensive service score . 43
7.10 Cloud VR game . 43
7.10.1 MOS mapping of black edge and smearing . 43
7.10.2 MOS mapping of Average Percentage of Frame Freezing (APFF) . 44
7.10.3 MOS mapping of Operation Response Delay (ORD) . 44
7.10.4 Comprehensive service score . 45
7.11 User experience classification and evaluation framework for service bundles . 45
7.11.1 Service bundle evaluation framework. 45
7.11.2 Calculation of integrated MOS for residential network service bundles . 45
8 Residential Service classification . 46
8.1 Overview . 46
8.2 Residential Service classification into network characteristics levels . 46
8.3 Network evaluation . 47
8.3.1 Introduction. 47
8.3.2 Detailed network evaluation . 47
8.3.3 Basic network evaluation . 49
History . 50


ETSI

---------------------- Page: 5 ----------------------
6 ETSI GS F5G 015 V1.1.1 (2023-04)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI Web server (https://ipr.etsi.org/).
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its

Members. 3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and of the 3GPP
Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of the
®
oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This Group Specification (GS) has been produced by ETSI Industry Specification Group (ISG) Fifth Generation Fixed
Network (F5G).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.

ETSI

---------------------- Page: 6 ----------------------
7 ETSI GS F5G 015 V1.1.1 (2023-04)
1 Scope
The present document specifies the service KQIs for evaluating user experience for residential services. The
corresponding evaluation criteria and the calculation methodology are specified using MOS values. To achieve a good
user experience, network KQIs are specified and dedicated network KQI thresholds are defined for different network
services.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
https://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] ETSI GS F5G 005: "Fifth Generation Fixed Network (F5G) F5G High-Quality Service Experience
Factors Release#1".
[2] Recommendation ITU-T P.10: "Vocabulary for performance, quality of service and quality of
experience".
[3] European Union EUR 30789 (2021): "Code of Conduct on Energy Consumption of Broadband
Equipment".
™
[4] IEEE 802.11 /1234r0-2018: "Real-time Mobile Game vs Wi-Fi".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number o
...