ETSI TR 103 419 V1.1.1 (2016-02)

Environmental Engineering (EE); Testing methodology for equipment able of dynamic performances adaptation

DTR/EE-EEPS9

General Information

• Status: Published
• Publication Date: 22-Feb-2016
• Technical Committee: EE EEPS - EE Eco Environmental Product Standards
• Current Stage: 12 - Completion
• Due Date: 02-Mar-2016
• Completion Date: 23-Feb-2016

Standards Content (Sample)

ETSI TR 103 419 V1.1.1 (2016-02)






TECHNICAL REPORT
Environmental Engineering (EE);
Testing methodology for equipment able of
dynamic performances adaptation

---------------------- Page: 1 ----------------------
2 ETSI TR 103 419 V1.1.1 (2016-02)



Reference
DTR/EE-EEPS9
Keywords
energy efficiency, measurement, SDN
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
The present document can be downloaded from:
http://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the
print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying
and microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2016.
All rights reserved.

TM TM TM
DECT , PLUGTESTS , UMTS and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members.
TM
3GPP and LTE™ are Trade Marks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI

---------------------- Page: 2 ----------------------
3 ETSI TR 103 419 V1.1.1 (2016-02)
Contents
Intellectual Property Rights . 4
Foreword . 4
Modal verbs terminology . 4
Executive summary . 4
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 6
3.1 Definitions . 6
3.2 Abbreviations . 7
4 Overview . 7
4.0 General . 7
4.1 DUT characterizing parameters (Performance Indexes) . 8
4.2 Data Throughput . 8
4.3 Transition Time . 8
4.4 Power . 8
4.5 Latency . 9
4.6 Jitter . 9
4.7 Traffic Loss and/or instabilities . 9
4.8 Traffic Load Gradient . 9
4.9 Network Test Set Up . 12
5 Conclusions . 14
History . 16

ETSI

---------------------- Page: 3 ----------------------
4 ETSI TR 103 419 V1.1.1 (2016-02)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (https://ipr.etsi.org/).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Technical Report (TR) has been produced by ETSI Technical Committee Environmental Engineering (EE).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
Executive summary
The present document addresses the issue of testing methodology for equipment and networks able to dynamically
adapt performance as function of real need. In the ambit of SDN (Software Defined Networks) equipment performances
such as throughput, latency, consumption, etc. may be dynamically optimized as function of real-time traffic load for
instance, as an example in order to optimize operational expenditures.
In the assumption that equipment always shows constant performances, today's standardized testing procedures
considers only one fixed test configuration, typically at maximum load, or at most very few steady states e.g. 100 %,
50 %, 0 % of traffic load. That is, current testing methodologies do not replicate testing conditions resembling traffic
load variations as happens in real life, and equipment performances are not verified and correlated accordingly.
When it comes to Software Defined Networks and equipment able to dynamically adapt performances according to
real-time needs, novel measurement methodologies should be developed to properly evaluate and characterize "load
cognizant" equipment and networks. Such novel methods should be able to meaningfully resemble real life traffic load
shapes, as well as to aggregate and correlate measured data also in coordination with the Network Management System
and/or the Equipment Management System, properly testing and characterizing equipment performances proportionality
(such as power consumption, throughput, latency, etc.), as well as the response time to States transitions and any other
eventual impacts on QoS and/or on Network stability.
As an example, an Energy Aware equipment may operate in a plurality of Power Management Modes according to
traffic load, while an Energy Aware Network may adjust traffic routing paths so that, when traffic level is high, higher
performances are provided (e.g. an higher number of links are enabled) while when the traffic load level is reduced,
performances are proportionally reduced, for instance by merging traffic to a smaller number of links so that other links
can run at reduced rate or set in sleeping or power-off modes.
Main scope of this Technical Report is to start building consciousness of this new problematic, to suggest environments
and conditions for properly testing such new techniques, paving the way to new series of Standard test methodologies
specifically tailored to SDN.

ETSI

---------------------- Page: 4 ----------------------
5 ETSI TR 103 419 V1.1.1 (2016-02)
Introduction
Implementing SDN and NFV may be slowed down by lack of proper standardization able to ensure operators that the
security, resilience and availability of their networks are not impaired when virtualised network functions, software
defined network topologies and/or software defined equipment performances are introduced.
As an example the ability to dynamically adapt power consumption to actual traffic load can become a key feature for
the success of Software Defined Networks, by leading to consistent OPEX saving thanks to energy usage optimization
while guaranteeing peak load. Whereby, coming generation of communications equipment will be designed to adapt
performances and power consumption according to traffic load, while actual standard measurement procedures simply
do not consider such conditions and are therefore unsuitable to determines equipment's ability to adapt performances to
traffic load needs, i.e. to provide a suitable test and characterization environment for testing the dynamic response of
equipment and networks to performances variations requests.
In an environment, communications equipment can operate in more than one power management mode. The power
management mode determines the power consumption, and it is properly selected to optimize power consumption to
real needs. The testing method herein described is aimed to closely resemble real life traffic load, and measures the
response of the communications equipment to the transition event between power management modes triggered by the
traffic load variations. One or more parameters can be measured, for example communications equipment performances
such as data throughput, latency, loss of rate, as function of dynamic variations in traffic load, as well as characteristics
such as transition timing, power consumption, etc.
Measurements taken should corresponds specifically to time periods when the communications equipment is handling
the transition between traffic load levels eventually triggering transition between power management modes or other
dynamic adaptation functions, or when the communications equipment is in one of the possible steady States which are
dependent by the applied traffic load or by any other State transition trigger.
The testing apparatus should also determine the coordination and promptness of the dynamic response, such as for
instance the ability to withstand sudden traffic ramping up, e.g. to timely wake-up from a sleeping or power-off State.
Thus, the testing equipment determines the direct response of the communications equipment to a transition in level of
the trigger event, e.g. traffic load, ultimately determining if the equipment under test guarantee the desired quality of
service (QoS) in all the possible working conditions.
ETSI

---------------------- Page: 5 ----------------------
6 ETSI TR 103 419 V1.1.1 (2016-02)
1 Scope
The present document addresses the issues of testing methodology for equipment and/or network configurations able to
dynamically adapt its performance as function of a generic variable, e.g. traffic load variations, eventually under the
control of a local and/or a centralized Management entity. Useful in the ambit of SDN (Software Defined Networks)
and/or NFV (Network Function Virtualization) applications where network topology, equipment availability and/or
performances such as throughput, latency, power consumption, jitter, etc. may be dynamically adapted as function of
real-time needs, in order for instance to optimize operational expenditures.
The present document is intended as a general introduction to the issue in question, with the aim to be the basis for a
family of papers dedicated to relevant applications may be developed in the future as part of SDN and/or NFV
evolution. For sake of clarity the present document mainly refers to the ability to dynamically adapt power consumption
to traffic load variations (hereinafter also called Energy Aware Networking), but principles herein described may be
extended to test any other SDN and/or NFV application having the scope of altering network topology or equipment
performances as function of a generic variable.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
https://docbox.etsi.org/Reference/.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
Not applicable.
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
energy consumption: amount of consumed energy
energy efficiency: relation between the useful output and energy consumption
node: physical representation of one or more functions
ETSI

---------------------- Page: 6 ----------------------
7 ETSI TR 103 419 V1.1.1 (2016-02)
power consumption: amount of consumed power
power saving feature: feature which contributes to decreasing power consumption compared to the case when the
feature is not implemented
system under test: node being measured
test suite: complete sequence of measurements including low, medium, and high load levels as individual test steps
useful output: maximum capacity of the system under test which is depending on the different functions
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
bps bits per second
CBR Constant Bit Rate
DCN Data Control Network
DUT Device Under Test
IUpp Interval Unit peak to peak
NE Network Element
NFV Network Function Virtualization
NMS Network Management System
OPEX OPeration EXpenditure
PMM Power Management Mod
...