ETSI GS F5G 017 V1.1.1 (2024-04)

Fifth Generation Fixed Network (F5G); F5G Measurement Specification for Residential Services Quality Evaluation

DGS/F5G-0017

General Information

• Status: Not Published
• Technical Committee: F5G - Fifth Generation Fixed Network
• Current Stage: 12 - Citation in the OJ (auto-insert)
• Due Date: 18-Apr-2024
• Completion Date: 11-Apr-2024

Standards Content (Sample)

GROUP SPECIFICATION
Fifth Generation Fixed Network (F5G);
F5G Measurement Specification for
Residential Services Quality Evaluation
Disclaimer
The present document has been produced and approved by the Fifth Generation Fixed Network (F5G) ETSI Industry
Specification Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.

2 ETSI GS F5G 017 V1.1.1 (2024-04)

Reference
DGS/F5G-0017
Keywords
measurement, network KQI, QoE, QoS,
service KQI
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from:
https://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure Program:
https://www.etsi.org/standards/coordinated-vulnerability-disclosure
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
and/or governmental
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2024.
All rights reserved.
ETSI
3 ETSI GS F5G 017 V1.1.1 (2024-04)
Contents
Intellectual Property Rights . 7
Foreword . 7
Modal verbs terminology . 7
1 Scope . 8
2 References . 8
2.1 Normative references . 8
2.2 Informative references . 9
3 Definition of terms, symbols and abbreviations . 9
3.1 Terms . 9
3.2 Symbols . 10
3.3 Abbreviations . 10
4 Introduction . 11
4.1 Overview . 11
4.2 Measurement methodologies . 12
4.2.1 Measurement methodology for the service KQIs . 12
4.2.2 Measurement methodology for the network KQIs . 13
4.2.2.1 Measurement methodology of the detailed network evaluation . 13
4.2.2.2 Measurement methodology of the basic network evaluation . 13
5 Measurement methodology of service KQIs . 13
5.1 Measurement requirements . 13
5.1.1 Requirements of the end user device . 13
5.1.2 Additional Measurement requirements . 13
5.1.3 Data record requirements . 14
5.2 Measurement of service KQIs . 14
5.2.1 Telephony . 14
5.2.1.1 Measurement environment . 14
5.2.1.2 Measurement suite . 15
5.2.1.2.1 Call completion ratio . 15
5.2.1.2.2 Call setup time . 15
5.2.1.2.3 Call drop rate . 15
5.2.1.2.4 Conversational quality . 15
5.2.1.3 Data processing . 15
5.2.2 Web browsing . 16
5.2.2.1 Measurement environment . 16
5.2.2.2 Measurement suite . 16
5.2.2.2.1 Page response time . 16
5.2.2.2.2 First screen display time . 16
5.2.2.2.3 Full load time . 17
5.2.2.3 Data processing . 17
5.2.3 Data upload/download . 17
5.2.3.1 Measurement environment . 17
5.2.3.2 Measurement suite . 17
5.2.3.2.1 Download rate ratio . 17
5.2.3.2.2 Upload rate ratio . 18
5.2.3.3 Data processing . 18
5.2.4 IPTV . 18
5.2.4.1 Measurement environment . 18
5.2.4.2 Measurement suite . 18
5.2.4.2.1 Interactive experience . 18
5.2.4.2.2 Viewing experience . 19
5.2.4.3 Data processing . 19
5.2.5 On-line game . 19
5.2.5.1 Terminal-based rendered game . 19
5.2.5.1.1 Measurement environment . 19
ETSI
4 ETSI GS F5G 017 V1.1.1 (2024-04)
5.2.5.1.2 Measurement suite . 20
5.2.5.1.3 Data processing . 21
5.2.5.2 Cloud-based rendered game . 21
5.2.5.2.1 Measurement environment . 21
5.2.5.2.2 Measurement suite . 21
5.2.5.2.3 Data processing . 22
5.2.6 On-line education/telework . 22
5.2.6.1 Measurement environment . 22
5.2.6.2 Measurement suite . 22
5.2.6.2.1 Frame freezing time . 22
5.2.6.2.2 Frame freezing time ratio . 22
5.2.6.2.3 Interaction delay . 22
5.2.6.3 Data processing . 23
5.2.7 Cloud VR . 23
5.2.7.1 Cloud VR video . 23
5.2.7.1.1 Measurement environment . 23
5.2.7.1.2 Measurement suite . 23
5.2.7.1.3 Data processing . 24
5.2.7.2 Cloud VR game . 24
5.2.7.2.1 Measurement environment . 24
5.2.7.2.2 Measurement suite . 25
5.2.7.2.3 Data processing . 25
6 Measurement of network KQI . 26
6.1 Detailed network evaluation . 26
6.1.1 Background . 26
6.1.2 Throughput . 26
6.1.2.1 Measurement purpose . 26
6.1.2.2 Measurement environment . 26
6.1.2.3 Measurement configuration. 27
6.1.2.4 Measurement procedure . 27
6.1.2.5 Measurement result . 28
6.1.3 Latency . 28
6.1.3.1 Overview of latency measurement . 28
6.1.3.2 Single user scenario. 28
6.1.3.2.1 Measurement purpose . 28
6.1.3.2.2 Measurement condition . 29
6.1.3.2.3 Measurement configuration . 29
6.1.3.2.4 Measurement procedure . 30
6.1.3.2.5 Measurement result . 30
6.1.3.3 Multiple user scenario . 31
6.1.3.3.1 Measurement purpose . 31
6.1.3.3.2 Measurement condition . 31
6.1.3.3.3 Measurement configuration . 31
6.1.3.3.4 Measurement procedure . 34
6.1.3.3.5 Measurement result . 34
6.1.4 Connectivity . 35
6.1.4.1 Number of connected devices . 35
6.1.4.1.1 Measurement purpose . 35
6.1.4.1.2 Measurement condition . 35
6.1.4.1.3 Measurement configuration . 35
6.1.4.1.4 Measurement procedure . 35
6.1.4.1.5 Measurement result . 36
6.1.4.2 Performance of concurrently connected devices . 36
6.1.4.2.1 Measurement purpose . 36
6.1.4.2.2 Measurement configuration . 36
6.1.4.2.3 Measurement procedure . 37
6.1.4.2.4 Measurement result . 37
6.1.5 Handover . 37
6.1.5.1 Measurement purpose . 37
6.1.5.2 Measurement condition . 37
6.1.5.3 Measurement configuration. 38
ETSI
5 ETSI GS F5G 017 V1.1.1 (2024-04)
6.1.5.4 Measurement procedure . 39
6.1.5.5 Measurement result . 39
6.1.6 Green & security . 39
6.1.6.1 Green (power consumption) . 39
6.1.6.1.1 Measurement purpose . 39
6.1.6.1.2 Measurement condition . 39
6.1.6.1.3 Measurement configuration . 40
6.1.6.1.4 Measurement procedure . 40
6.1.6.1.5 Measurement result . 41
6.1.6.2 Security of hardware and system . 41
6.1.6.2.1 Overview . 41
6.1.6.2.2 Measurement purpose . 42
6.1.6.2.3 Measurement condition . 42
6.1.6.2.4 Measurement configuration . 42
6.1.6.2.5 Measurement procedure . 42
6.1.6.2.6 Measurement result . 43
6.1.6.3 Protection capability of network attack . 43
6.1.6.3.1 Measurement purpose . 43
6.1.6.3.2 Measurement condition . 44
6.1.6.3.3 Measurement configuration . 44
6.1.6.3.4 Measurement procedure . 44
6.1.6.3.5 Measurement result . 45
6.1.7 Smart O&M . 45
6.1.7.1 Automatic services provisioning . 45
6.1.7.1.1 Measurement purpose . 45
6.1.7.1.2 Measurement condition . 45
6.1.7.1.3 Measurement procedure . 45
6.1.7.1.4 Measurement result . 46
6.1.7.2 Fault identification, diagnostic & recovery . 46
6.1.7.2.1 Measurement purpose . 46
6.1.7.2.2 Measurement condition . 46
6.1.7.2.3 Measurement configuration . 47
6.1.7.2.4 Measurement procedure . 47
6.1.7.2.5 Measurement result . 47
6.1.7.3 Network optimization. 48
6.1.7.3.1 Measurement purpose . 48
6.1.7.3.2 Measurement condition . 48
6.1.7.3.3 Measurement configuration . 48
6.1.7.3.4 Measurement procedure . 48
6.1.7.3.5 Measurement result . 49
6.1.8 Classification levels of residential services . 49
6.2 Basic network evaluation . 49
6.2.1 Measurement purpose . 49
6.2.2 Measurement condition . 49
6.2.3 Measurement configuration . 50
6.2.4 Measurement Record . 50
6.2.5 Measurement of network KQI . 50
6.2.5.1 Throughput . 50
6.2.5.1.1 Overview . 50
6.2.5.1.2 Actual throughput in real environment . 50
6.2.5.1.3 Signal coverage . 51
6.2.5.2 Latency . 51
6.2.5.3 Packet Delay Jitter. 51
6.2.5.4 Interference . 52
6.2.5.5 Packet loss rate . 52
6.2.5.6 Handover . 52
6.2.6 Measurement result . 52
6.2.6.1 Actual throughput . 52
6.2.6.2 Latency . 52
6.2.6.3 Handover . 53
6.2.7 Classification levels of residential services . 53
ETSI
6 ETSI GS F5G 017 V1.1.1 (2024-04)
7 User privacy protection . 53
Annex A (informative): Record form for measurement result . 54
History . 58

ETSI
7 ETSI GS F5G 017 V1.1.1 (2024-04)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI Web server (https://ipr.etsi.org/).
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its

Members. 3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and of the 3GPP
Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of the ®
oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This Group Specification (GS) has been produced by ETSI Industry Specification Group (ISG) Fifth Generation Fixed
Network (F5G).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.

ETSI
8 ETSI GS F5G 017 V1.1.1 (2024-04)
1 Scope
The present document specifies the measurement methodologies to evaluate the quality of residential network services
and network characteristics/functionalities based on the service and network KQIs defined in document ETSI
GS F5G 015 [1]. The measurement methodologies include measurement setup, measurement procedure, and
measurement recording.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
https://docbox.etsi.org/Reference/.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] ETSI GS F5G 015: "Fifth Generation Fixed Network (F5G); F5G Residential Services Quality
Evaluation and Classification Release 2".
[2] BBF TR-126: "Triple-play Services Quality of Experience (QoE) Requirements".
[3] Recommendation ITU-T G.9976: "Supporting ultra-high-definition video service over G.hn".
[4] BBF TR-398 Issue: 2 Corrigendum 1: "Wi-Fi Residential & SOHO Performance Testing".
[5] Recommendation ITU-T X.509: "Information technology - Open Systems Interconnection - The
Directory: Public-key and attribute certificate frameworks".
[6] IETF RFC 2544: "Benchmarking Methodology for Network Interconnect Devices".
[7] Recommendation ITU-T P.863: "Perceptual objective listening quality assessment".
[8] IETF RFC 791: "Internet protocol".
[9] Recommendation ITU-T G.107: "The E-model: a computational model for use in transmission
planning".
[10] IETF RFC 793: "Transmission Control Protocol".
TM
[11] IEEE 802.11k -2008: "IEEE Standard for Information technology -- Local and metropolitan area
networks -- Specific requirements -- Part 11: Wireless LAN Medium Access Control (MAC)and
Physical Layer (PHY) Specifications Amendment 1: Radio Resource Measurement of Wireless
LANs".
TM
[12] IEEE 802.11v -2011: "IEEE Standard for Information technology -- Local and metropolitan area
networks -- Specific requirements -- Part 11: Wireless LAN Medium Access Control (MAC) and
Physical Layer (PHY) specifications Amendment 8: IEEE 802.11 Wireless Network
Management".
TM
[13] IEEE 802.11ac -2013: "IEEE Standard for Information technology -- Telecommunications and
information exchange between systems-Local and metropolitan area networks -- Specific
requirements -- Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY)
Specifications -- Amendment 4: Enhancements for Very High Throughput for Operation in Bands
below 6 GHz".
ETSI
9 ETSI GS F5G 017 V1.1.1 (2024-04)
TM
[14] IEEE 802.11ax -2021: "IEEE Standard for Information Technology -- Telecommunications and
Information Exchange between Systems Local and Metropolitan Area Networks -- Specific
Requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY)
Specifications Amendment 1: Enhancements for High-Efficiency WLAN".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] Wikipedia: "Cumulative distribution function".
[i.2] BBF TR-309 (Issue 2 Amendment 1): "XG-PON and XGS-PON TC Layer Interoperability Test
Plan".
[i.3] ETSI TS 102 165-2: "Telecommunications and Internet converged Services and Protocols for
Advanced Networking (TISPAN); Methods and protocols; Part 2: Protocol Framework Definition;
Security Counter Measures".
[i.4] ETSI TR 103 733: "Speech and multimedia Transmission Quality (STQ); Best practices of testing
the performance of web content delivery".
[i.5] ETSI TS 102 250-2: "Speech and multimedia Transmission Quality (STQ); QoS aspects for
popular services in mobile networks; Part 2: Definition of Quality of Service parameters and their
computation".
[i.6] ETSI TS 102 250-4: "Speech and multimedia Transmission Quality (STQ); QoS aspects for
popular services in mobile networks; Part 4: Requirements for Quality of Service measurement
equipment".
[i.7] ETSI TR 101 578: "Speech and multimedia Transmission Quality (STQ); QoS aspects of
TCP-based video services like YouTube™".
[i.8] ETSI GS F5G 014: "Fifth Generation Fixed Network (F5G); F5G Network Architecture
Release 2".
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
CDF99: value indicating less than or equal to 99 percentage probability of all outcomes
firmware analysis tool: software tool for firmware analysis
NOTE: For firmware security analysis, the encryption status of the binary source code is examined.
render start: time when the browser starts rendering, which is an approximation of the user's perception when the user
sees the first content on the screen
security scanning tool: software tool to perform network discovery and security auditing which scans the target host's
port and service information
ETSI
10 ETSI GS F5G 017 V1.1.1 (2024-04)
telework: practice of working from home, making use of residential internet, email, telephone, etc.
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
AC Alternating Current
ACK Acknowledge
AES Advanced Encryption Standard
AP Access Point
APBEA Average Percentage of the black Edge Area
APFF Average Percentage of Frame Freezing
APP Application
APTQIA Average Percentage of The low-Quality Image Area
BNG Broadband Network Gateway
BRAS Broadband Remote Access Server
CDF99 99 % of Cumulated Distribution Function
CDN Content Delivery Network
CP Content Provider
CPU Central Processing Unit
CSMA Carrier Sense Multiple Access
dBm dB relative to 1 milliwatt
DC Direct Current
DDoS Distributed Denial of Service
DHCP Dynamic Host Configuration Protocol
DNS Domain Name Server
DoS Denial of Service
DRR Download Rate Ratio
DTR Desynchronization Time Ratio
E2E End to End
E-ONU Edge-ONU
FFT Frame Freezing Times
FFTR Frame Freezing Time Ratio
FLT Full Load Time
FSDT First Screen Display Time
FSPL Free Space Path Loss
FTTR Fibre-To-The-Room
GB Gigabyte
GHz Giga Hertz
HTML Hypertext Markup Language
HTTP Hypertext Transfer Protocol
IBD Initial Buffering Duration
ICMP Internet Control Message Protocol
ID Identifier
IGMP Internet Group Management Protocol
IP Internet Protocol
IPTV Internet Protocol Television
KQI Key Quality Indicator
LAN Local Area Network
MAC Medium Access Control
MOS Mean Opinion Score
MTU Maximum Transmission Unit
NBI North Bound Interface
NIC Network Interface Card
NST Network Start-up Time
O&M Operation & Management
ETSI
11 ETSI GS F5G 017 V1.1.1 (2024-04)
OLT Optical Line Termination
ONU Optical Network Unit
ORD Operation Response Delay
OTT Over The Top
PBED Percentage of the Black Edge Duration
PC Personal Computer
PID Protocol Identifier
PING Packet Internet Groper
PLQID Percentage of Low-Quality Image Duration
POLQA Perceptual Objective Listening Quality Analysis
PON Passive Optical Network
P-ONU Primary ONU
POTS Plain Old Telephone Service
PRT Page Response Time
QoE Quality of Experience
RFC Request for Comments
RSSI Received Signal Strength Indication
RTP Real-time Transport Protocol
RTT Round Trip Time
SLA Service Level Agreement
SP Service Provider
SSID Service Set Identifier
STB Set-Top Box
SYN Synchronization
TCP Transmission Control Protocol
TV Television
UDP User Datagram Protocol
URR Upload Rate Ratio
VLAN Virtual Local Area Network
VOD Video On Demand
VR Virtual Reality
WAN Wide Area Network ®
Protected Access 2
WPA2 Wi-Fi
xPON (x = G, XG, XGS) PON
4 Introduction
4.1 Overview
ETSI GS F5G 015 [1] specifies the service KQIs, experience evaluation methodology with MOS value, and
corresponding network KQIs. The overview of the service KQIs and network KQIs is shown in Figure 1.
The services specified in ETSI GS F5G 015 [1] include voice, web browsing, data upload/download, IPTV,
terminal-based rendered game, cloud-based rendered game, internet video, on-line Education/Telework, cloud VR
video, cloud VR game.
The network KQI contains six dimensions, which are: throughput, latency, connectivity, handover, green & security and
smart O&M.
Figure 1: Overview of service KQIs and network KQIs
ETSI
12 ETSI GS F5G 017 V1.1.1 (2024-04)
The detailed service KQIs are listed below each service, as shown in Figure 1. For example, the KQIs of Telephony
service include: call completion rate, call setup time, call drop rate and conversational quality.
In general, the service KQIs quantify the user experience from different aspects while the network KQIs reflect the
network capabilities (shown in Figure 1) and can significantly influences the service KQIs.
Figure 2 shows the general E2E measurement setup for service KQI.

Figure 2: E2E measurement setup for service KQIs
The E2E network is composed of the following network segments:
1) Residential network: from the end user device to the access network termina
...