ETSI GS NFV-INF 003 V1.1.1 (2014-12)

Network Functions Virtualisation (NFV); Infrastructure; Compute Domain

DGS/NFV-INF003

General Information

• Status: Published
• Publication Date: 22-Dec-2014
• Technical Committee: NFV INF - Architecture of the Virtualisation Infrastructure
• Current Stage: 12 - Completion
• Due Date: 19-Jan-2015
• Completion Date: 23-Dec-2014

Standards Content (Sample)

ETSI GS NFV-INF 003 V1.1.1 (2014-12)






GROUP SPECIFICATION
Network Functions Virtualisation (NFV);
Infrastructure;
Compute Domain
Disclaimer
This document has been produced and approved by the Network Functions Virtualisation (NFV) ETSI Industry Specification
Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.

---------------------- Page: 1 ----------------------
2 ETSI GS NFV-INF 003 V1.1.1 (2014-12)



Reference
DGS/NFV-INF003
Keywords
NFV
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
The present document can be downloaded from:
http://www.etsi.org
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the
print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying
and microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2014.
All rights reserved.

TM TM TM
DECT , PLUGTESTS , UMTS and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members.
TM
3GPP and LTE™ are Trade Marks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI

---------------------- Page: 2 ----------------------
3 ETSI GS NFV-INF 003 V1.1.1 (2014-12)
Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
1 Scope . 7
2 References . 7
2.1 Normative references . 7
2.2 Informative references . 8
3 Definitions and abbreviations . 8
3.1 Definitions . 8
3.2 Abbreviations . 8
4 Domain Overview . 10
4.1 Domain Scope . 11
4.2 High Level NFV Framework. 11
4.3 Compute Domain and Inter-Domain Interfaces . 11
4.3.1 Relevant Interfaces . 12
4.4 Relation to NFV Architecture Framework . 12
4.4.1 Elements of the Compute Domain . 14
4.4.1.1 Processor & Accelerator . 15
4.4.1.2 Network Interfaces . 15
4.4.1.3 Storage . 15
4.4.2 Influence of the Disaggregation Model . 15
4.5 Deployment Scenarios . 16
4.5.1 Monolithic Operator . 16
4.5.2 Network Operator Hosting Virtual Network Operators . 17
4.5.3 Hosted Network Operator . 17
4.5.4 Hosted Communications Providers . 17
4.5.5 Hosted Communications and Application Providers . 17
4.5.6 Managed Network Service on Customer Premises . 17
4.5.7 Managed Network Service on Customer Premises Equipment. 17
5 External Interfaces of the Domain . 18
5.1 Physical Network Interfaces . 18
5.1.1 Ethernet . 18
5.1.1.1 Nature of the Interface . 18
5.1.1.2 Specifications in Current Widespread Issue . 18
5.1.1.3 Achieving Interoperability . 18
5.1.2 Fibre-Channel . 18
5.1.2.1 Nature of the Interface . 18
5.1.2.2 Specifications in Current Widespread Use . 19
5.1.2.3 Achieving Interoperability . 19
5.1.3 Infiniband . 19
5.1.3.1 Nature of the Interface . 19
5.1.3.2 Specifications in Current Widespread Use . 19
5.1.3.3 Achieving Interoperability . 19
5.2 Internal & External Domain Interfaces . 19
5.2.1 NFVI to VIM (Nf-Vi) Interface . 19
5.2.2 Nf-Vi/C and [VI-Ha]/CSr Interfaces. 20
5.2.2.1 Nature of the Interface . 20
5.2.2.2 Specifications in Current Widespread Issue . 20
5.2.2.3 Achieving Interoperability . 20
5.3 Orchestration & Management Interfaces . 20
5.3.1 Managing NFVI Hardware Elements . 21
5.3.1.1 The Rack . 21
5.3.1.2 The Fabric . 21
ETSI

---------------------- Page: 3 ----------------------
4 ETSI GS NFV-INF 003 V1.1.1 (2014-12)
5.3.1.3 The Top of Rack (TOR) Switch . 22
5.3.1.4 The Power Grid . 22
5.3.1.5 The Rack Shelf Contents . 22
5.3.1.6 Server Chassis . 23
5.3.1.7 Storage Chassis . 24
6 ISG E2E Requirements & Implications over Compute & Storage . 24
6.1 General (E2E requirements) . 25
6.2 Performance (E2E requirements) . 25
6.3 Elasticity (E2E Requirements) . 26
6.4 Resiliency (E2E Requirements) . 26
6.5 Security E2E Requirements . 26
6.6 Service Continuity (E2E Requirements) . 26
6.7 Service Assurance (E2E Requirements) . 26
6.8 Operations & Management (E2E Requirements) . 27
6.8.1 Statistics Collection - Objectives in NFV Framework . 27
6.8.2 Proposed Hierarchy of resources and management software for statistics collection . 28
6.9 Energy Efficiency (E2E Requirements) . 28
6.10 Additional points of interest (ISG documents) . 29
7 Functional Blocks within the Domain . 30
7.1 Definition of the "Compute Node" . 30
7.1.1 CPU Complex Overview . 31
7.2 Network Interface & Accelerators . 31
7.2.1 Network Interface Controller (NIC) . 31
7.2.2 Accelerators . 31
7.2.3 Hardware Acceleration . 34
7.2.3.1 Need for Hardware Acceleration (HWA) Abstraction . 34
7.2.3.2 Need for Dynamic Allocation and Management . 35
7.2.3.3 Hardware Accelerator Example . 35
7.2.4 Heterogeneous Acceleration . 36
7.2.4.1 CPU Complex, NIC, and PCIe-attached Devices Accelerator Examples . 36
7.2.4.2 Examples for functional accelerations . 36
7.2.4.3 Accelerator Abstraction API Examples . 36
7.3 Storage . 37
7.3.1 Storage Building Blocks . 37
7.3.1.1 Hard Disk Drives . 37
7.3.1.2 Solid State Disks . 37
7.3.1.3 Cache Storage . 37
7.3.1.4 Cold Storage . 38
7.3.2 Storage Topologies . 38
7.3.2.1 Block-based Storage. 38
7.3.2.2 File-based Storage . 39
7.3.2.3 Object-based Storage . 39
7.3.2.4 Scale-out Storage . 39
7.3.3 Serviceability . 40
7.3.3.1 Live Migration . 40
7.3.3.1.1 Local Storage . 40
7.3.3.1.2 Remote Storage . 40
7.3.4 Management . 41
7.3.5 Security . 41
7.3.5.1 Auditing Framework . 41
7.3.5.2 Protecting Data at Rest . 41
7.3.5.3 Protecting Data In Flight . 42
7.3.5.4 LUN Mapping and Access Control Lists . 42
7.3.5.5 Authentication . 42
7.3.5.6 Physical Storage Nodes Within the NFVI Node . 43
7.4 Hardware Resource Metrics of the Compute Domain . 43
7.4.1 Static Metrics for FNF Capacity and Capability Characteristics . 43
7.4.2 Dynamic Metrics for VNF . 45
8 Interfaces within the Domain . 46
8.1 PCIe . 46
ETSI

---------------------- Page: 4 ----------------------
5 ETSI GS NFV-INF 003 V1.1.1 (2014-12)
8.2 SR-IOV . 46
8.3 RDMA and RoCE Support . 46
8.4 InfiniBand. 47
8.5 DPDK & ODP Support . 47
9 Modularity and Scalability . 47
9.1 Modularity and Scalability within the Domain . 47
9.2 NFVI Scale Implications for Compute Domain . 48
9.3 Modularity of NFVI Node Hardware Resources . 49
10 Features of the Domain Affecting Management and Orchestration . 50
10.1 Arbitration of hardware accelerators . 50
10.2 Life Cycle of NFVI Nodes and their Replaceable Units . 50
11 Features of the Domain Affecting Performance . 50
11.1 Matching Resource Requirements and NFVI Compute Server Capabilities . 50
11.2 Performance Related Workload Categories . 51
11.3 Other performance related concepts . 51
11.3.1 Compute Domain Performance Related Features . 51
11.4 QoS metrics . 52
11.5 Performance Monitoring . 52
11.5.1 Conclusion - Features of the Domain Affecting Performance . 52
12 Features of the Domain Affecting Reliability . 52
13 Features of the Domain Affecting Security . 54
13.1 Physical security . 54
13.2 Security devices . 54
13.3 Hardware or Device-based Authentication . 54
13.4 Tunnelling isolation in hypervisor and non-hypervisor container environments . 54
Annex A (informative): Authors & contributors . 55
Annex B (informative): Bibliography . 56
History . 57

ETSI

---------------------- Page: 5 ----------------------
6 ETSI GS NFV-INF 003 V1.1.1 (2014-12)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://ipr.etsi.org).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Group Specification (GS) has been produced by ETSI Industry Specification Group (ISG) Network Functions
Virtualisation (NFV).
The present document gives an overview to the series of documents covering the NFV Infrastructure.
Table 1: NFV infrastructure architecture documents
Infrastructure Architecture Document Document #
Overview GS NFV INF 001
Architecture of the Infrastructure Compute Domain GS NFV INF 003
Domains Hypervisor Domain GS NFV INF 004
Infrastructure Network Domain GS NFV INF 005
Architectural Methodology Interfaces and Abstraction GS NFV INF 007
Service Quality Metrics GS NFV INF 010

Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "may not", "need", "need not", "will",
"will not", "can" and "cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms
for the expression of provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI

---------------------- Page: 6 ----------------------
7 ETSI GS NFV-INF 003 V1.1.1 (2014-12)
1 Scope
The present document presents an architectural description of the compute (& storage) domain of the infrastructure
which supports virtualised network functions (VNFs). The compute domain includes the network & I/O interfaces
required to interface to the infrastructure network and the storage network, if any.
It sets out the scope of the infrastructure domain acknowledging the potential for overlap between infrastructure
domains, and between the infrastructure and the virtualised network functions. It also sets out the nature of interfaces
needed between infrastructure domains and within the compute domain.
The present document does not provide any detailed specification but makes reference to specifications developed by
other bodies and to potential specifications, which, in the opinion of the NFV ISG could be usefully developed by an
appropriate Standards Developing Organisation (SDO).
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] ETSI GS NFV 001 (V1.1.1): "Network Functions Virtualisation (NFV); Use Cases".
[2] ETSI GS NFV 002 (V1.1.1): "Network Functions Virtualisation (NFV); Architectural
Framework".
[3] ETSI GS NFV 003 (V1.1.1): "Network Functions Virtualisation (NFV); Terminology for Main
Concepts in NFV".
[4] ETSI GS NFV 004 (V1.1.1): "Network Functions Virtualisation (NFV); Virtualisation
Requirements".
[5] ETSI GS NFV-INF 001 (V1.1.1): "Network Function Virtualisation (NFV); Infrastructure
Overview".
[6] DMTF DSP 0217: "SMASH Implementation Requirements".
[7] ETSI GS NFV-PER 001 (V1.1.1): "Network Function Virtualisation (NFV); NFV Performance &
Portability Best Practices".
ETSI

---------------------- Page: 7 ----------------------
8 ETSI GS NFV-INF 003 V1.1.1 (2014-12)
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] Master Usage Model: "Compute Infrastructure as a Service, Rev 1", (2012) Open Data Cneter
Alliance.
NOTE: Ava
...