ETSI GR ENI 032 V4.1.1 (2024-05)

Experiential Networked Intelligence (ENI); In-situ Flow Information Telemetry (IFIT) Deployment Scenarios

DGR/ENI-0032v411_IFIT

General Information

• Status: Not Published
• Technical Committee: ENI - Experiential Networked Intelligence
• Current Stage: 12 - Citation in the OJ (auto-insert)
• Due Date: 10-Jun-2024
• Completion Date: 30-May-2024

Standards Content (Sample)

GROUP REPORT
Experiential Networked Intelligence (ENI);
In-situ Flow Information Telemetry (IFIT)
Deployment Scenarios
Disclaimer
The present document has been produced and approved by the Experiential Networked Intelligence (ENI) ETSI Industry
Specification Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.

2 ETSI GR ENI 032 V4.1.1 (2024-05)

Reference
DGR/ENI-0032v411_IFIT
Keywords
network, performance, telemetry

ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from:
https://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure Program:
https://www.etsi.org/standards/coordinated-vulnerability-disclosure
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
and/or governmental
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2024.
All rights reserved.
ETSI
3 ETSI GR ENI 032 V4.1.1 (2024-05)
Contents
Intellectual Property Rights . 4
Foreword . 4
Modal verbs terminology . 4
1 Scope . 5
2 References . 5
2.1 Normative references . 5
2.2 Informative references . 5
3 Definition of terms, symbols and abbreviations . 6
3.1 Terms . 6
3.2 Symbols . 6
3.3 Abbreviations . 6
4 Introduction . 7
5 IFIT Framework . 8
5.1 IFIT-based Reactive Telemetry and ENI integration . 8
5.2 Closed-Loop Performance-Management . 9
6 IFIT Measurement Domain and Nodes . 10
7 Manageability . 10
7.1 Introduction . 10
7.2 Packet Flow Selection and Configuration . 11
7.3 Data Export, Collection and Calculation . 11
8 Examples of Application . 13
8.1 IP RAN Mobile Bearer Network . 13
8.2 Intelligent Cloud-Network Private Line Service . 13
8.3 One Financial WAN . 13
9 Conclusions and Recommendations . 13
Annex A: Change history . 14
History . 15

ETSI
4 ETSI GR ENI 032 V4.1.1 (2024-05)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI Web server (https://ipr.etsi.org/).
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its

Members. 3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and of the 3GPP
Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of the ®
oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This Group Report (GR) has been produced by ETSI Industry Specification Group (ISG) Experiential Networked
Intelligence (ENI).
Modal verbs terminology
In the present document "should", "should not", "may", "need not", "will", "will not", "can" and "cannot" are to be
interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.

ETSI
5 ETSI GR ENI 032 V4.1.1 (2024-05)
1 Scope
The purpose of the present document is to provide guidelines about IFIT deployment use cases and application
scenarios. As described in ETSI GR ENI 012 [i.1], IFIT is a key technology for ensuring the SLA of future network
services and for implementing automated and intelligent IP networks. Several technical specifications in IETF have
already been defined to set the basis and ISG ENI is playing an important role in defining the whole framework. The
present document includes a report of IFIT use cases and how they fit the ENI architecture.
2 References
2.1 Normative references
Normative references are not applicable in the present document.
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI GR ENI 012 (V1.1.1): "Experiential Networked Intelligence (ENI); Reactive In-situ Flow
Information Telemetry".
[i.2] IETF RFC 9341 (December 2022): "Alternate-Marking Method".
[i.3] IETF RFC 9342 (December 2022): "Clustered Alternate-Marking Method".
[i.4] IETF RFC 9343 (December 2022): "IPv6 Application of the Alternate-Marking Method".
[i.5] IETF RFC 9197 (May 2022): "Data Fields for In Situ Operations, Administration, and
Maintenance (IOAM)".
[i.6] IETF RFC 9326 (November 2022): "In-situ OAM Direct Exporting".
[i.7] IETF RFC 7011 (September 2013): "Specification of the IP Flow Information Export (IPFIX)
Protocol for the Exchange of Flow Information".
[i.8] IETF draft-song-opsawg-ifit-framework (work in progress): "In-situ Flow Information Telemetry".
[i.9] Bo Lu, Ling Xu, Yuezhong Song, Longfei Dai, Min Liu, Tianran Zhou, Zhenbin Li and Haoyu
Song: "IFIT: Intelligent Flow Information Telemetry". In Proceedings of the ACM SIGCOMM
2019 Conference Posters and Demos (SIGCOMM Posters and Demos '19). Association for
Computing Machinery, New York, NY, USA, p15-17.
[i.10] IETF RFC 8639 (September 2019): "Subscription to YANG Notifications".
[i.11] IETF RFC 8640 (September 2019): "Dynamic Subscription to YANG Events and Datastores over
NETCONF".
[i.12] IETF RFC 8641 (September 2019): "Subscription to YANG Notifications for Datastore Updates".
[i.13] IETF RFC 8650 (November 2019): "Dynamic Subscription to YANG Events and Datastores over
RESTCONF".
ETSI
6 ETSI GR ENI 032 V4.1.1 (2024-05)
[i.14] draft-ietf-ippm-ioam-yang (work in progress): "A YANG Data Model for In-Situ OAM".
[i.15] IETF RFC 7950 (August 2016): "The YANG 1.1 Data Modeling Language".
[i.16] IETF RFC 6241 (June 2011): "Network Configuration Protocol (NETCONF)".
[i.17] IETF RFC 8040 (January 2017): "RESTCONF Protocol".
[i.18] draft-ietf-idr-sr-policy-ifit (work in progress): "BGP SR Policy Extensions to Enable IFIT".
[i.19] draft-ietf-pce-pcep-ifit (work in progress): "Path Computation Element Communication Protocol
(PCEP) Extensions to Enable IFIT".
[i.20] ETSI GS ENI 005 (V2.1.1): "Experiential Networked Intelligence (ENI); System Architecture".
[i.21] draft-ietf-ippm-alt-mark-deployment (work in progress): "Alternate Marking Deployment
Framework".
[i.22] draft-gfz-opsawg-ipfix-alt-mark (work in progress): "IPFIX Alternate-Marking Information".
[i.23] draft-gfz-ippm-alt-mark-yang (work in progress): "A YANG Data Model for the Alternate
Marking Method".
[i.24] draft-fz-spring-srv6-alt-mark (work in progress): "Application of the Alternate Marking Method to
the Segment Routing Header".
[i.25] draft-ietf-opsawg-ipfix-on-path-telemetry (work in progress): "Export of On-Path Delay in
IPFIX".
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
In-situ Flow Information Telemetry (IFIT): network OAM data plane on-path telemetry techniques, including
Alternate Marking Method (AMM), In-situ OAM (IOAM), IOAM Direct Exporting (IOAM-DEX), and Postcard-Based
Telemetry (PBT)
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
AMM Alternate Marking Method
API Application Programming Interface
BGP Border Gateway Protocol
BUM Broadcast, Unknown-Unicast and Multicast
DEX Direct Exporting
E2E End-to-End
ECMP Equal-Cost Multipath
ENI Experiential Networked Intelligence
ESQM Enhanced Stream Quality Monitoring
GTP GPRS Tunnelling Protocol
GUI Graphical User Interface
HD High-Definition
IFIT In-situ Flow Information Telemetry
ETSI
7 ETSI GR ENI 032 V4.1.1 (2024-05)
IOAM In-situ OAM
IoT Internet of Things
IP Internet Protocol
IPv6 IP version 6
IPFIX IP Flow Information eXport
MDT Model Driven Telemetry
MPLS Multi-Protocol Label Switching
NBI North Bound Interface
NMS Network Management System
OAM Operation, Administration and Maintenance
OWAMP One-Way Active Measurement Protocol
PBT Postcard-Based Telemetry
PCEP Path Computation Element communication Protocol
PM Performance Management
RAN Radio Access network
SBI South Bound Interface
SCTP Stream Control Transmission Protocol
SDN Software-Defined Network
SLA Service Level Agreement
SR Segment Routing
SRH Segment Routing Header
TLV Type Length Value
TCP Transmission Control Protocol
TWAMP Two-Way Active Measurement Protocol
VPN Virtual Private Network
WAN Wide Area Network
YANG Yet Another Next Generation
4 Introduction
IFIT [i.8] and [i.9] denote a family of flow-oriented on-path telemetry techniques defined in the Internet Engineering
Task Force (IETF). IFIT measurement methods (i.e. AMM, IOAM) insert option headers in the real service packets,
thereby directly measuring network performance indicators, such as delay, packet loss rate, and jitter. IFIT uses
telemetry technology to report measurement data in real time and displays the results on a Graphical User Interface
(GUI).
In contrast with traditional network OAM technologies, IFIT features high precision, real-time performance, and
visualization. It can flexibly adapt to multiple service scenarios and promotes intelligent OAM by working with the big
data platform and intelligent algorithms.
As introduced in ETSI GS ENI 005 [i.20], current network management and performance measurement functions are
not optimized due to the different technologies and implementations from different vendors. The human-machine
interaction challenges increase the time to market of innovative and advanced services (including the new performance
management tools).
IFIT techniques are hybrid data-plane telemetry technologies, through which the flow quality measurement information
is directly recorded and encapsulated in data packets to implement flow quality visualization at a granularity of each
data packet.
Differently from active performance measurement, IFIT performance measurement directly monitors data flows without
sending additional probe packets or modifying data packets. In addition, hybrid performance measurement combines
active performance measurement and passive performance measurement to modify certain fields of data packets
without introducing additional probe packets to the network.
Traditional network performance measurement technologies (such as OWAMP, TWAMP) cannot meet the
requirements of high-precision and real-time network performance monitoring. While, the In-situ Flow Information
Telemetry (IFIT) technologies provide near real time and high-precision visualization of flow quality (such as jitter,
delay, packet loss).
ETSI
8 ETSI GR ENI 032 V4.1.1 (2024-05)
IFIT methods, also introduced in ETSI GR ENI 012 [i.1], include:
• Alternate Marking Method (AMM), defined in IETF RFC 9341 [i.2] and IETF RFC 9342 [i.3];
• In-situ OAM (IOAM), IOAM Direct Exporting (IOAM-DEX), defined in IETF RFC 9197 [i.5] and IETF
RFC 9326 [i.6].
This family of In-situ flow information telemetry technologies are currently defined by IETF.
ETSI GS ENI 005 [i.20] defines a Functional Block architecture that helps to address the application of In-situ flow
information telemetry. The experiential architecture and self-learning principle are key to implement a smart, context-
aware and flexible performance management.
5 IFIT Framework
5.1 IFIT-based Reactive Telemetry and ENI integration
As a hybrid performance measurement technology, the IFIT techniques provide high-precision visualization of flow
quality and real-time network fault alarms (such as jitter, delay, packet loss) to meet the requirements for
high-performance network quality measurement of the emerging applications. IFIT encapsulates flow quality
measurement information into user data packets to implement real-time and per-packet flow quality measurement.
Figure 1 shows the IFIT-based reactive telemetry framework within the ENI System, which includes Application and
Management System, Controller, and IFIT-enabled forwarding devices.

Figure 1: IFIT-based Telemetry Framework within the ENI System
As shown in ETSI GR ENI 012 [i.1], to meet the measurement requirements of different applications, multiple data-
plane measurement technologies and data exporting technologies can be flexibility integrated to provide comprehensive
performance information for network OAM.
ETSI GS ENI 005 [i.20] specifies in clause 6.3.1.4 and clause 6.3.1.5 that there a
...