ETSI TS 126 118 V17.0.0 (2022-05)

5G; Virtual Reality (VR) profiles for streaming applications (3GPP TS 26.118 version 17.0.0 Release 17)

RTS/TSGS-0426118vh00

General Information

• Status: Not Published
• Technical Committee: 3GPP SA 4 - Codec
• Current Stage: 12 - Completion
• Completion Date: 19-May-2022

Standards Content (Sample)

TECHNICAL SPECIFICATION
5G;
Virtual Reality (VR) profiles for streaming applications
(3GPP TS 26.118 version 17.0.0 Release 17)

3GPP TS 26.118 version 17.0.0 Release 17 1 ETSI TS 126 118 V17.0.0 (2022-05)

Reference
RTS/TSGS-0426118vh00
Keywords
5G
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from:
http://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure Program:
https://www.etsi.org/standards/coordinated-vulnerability-disclosure
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
and/or governmental
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2022.
All rights reserved.
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 2 ETSI TS 126 118 V17.0.0 (2022-05)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI Web server (https://ipr.etsi.org/).
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its

Members. 3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and of the 3GPP
Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of the ®
oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Legal Notice
This Technical Specification (TS) has been produced by ETSI 3rd Generation Partnership Project (3GPP).
The present document may refer to technical specifications or reports using their 3GPP identities. These shall be
interpreted as being references to the corresponding ETSI deliverables.
The cross reference between 3GPP and ETSI identities can be found under http://webapp.etsi.org/key/queryform.asp.
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 3 ETSI TS 126 118 V17.0.0 (2022-05)
Contents
Intellectual Property Rights . 2
Legal Notice . 2
Modal verbs terminology . 2
Foreword . 7
Introduction . 8
1 Scope . 9
2 References . 9
3 Definitions, symbols and abbreviations . 10
3.1 Definitions . 10
3.2 Symbols . 10
3.3 Abbreviations . 10
4 Architectures and Interfaces for Virtual Reality . 11
4.1 Definitions and Reference Systems . 11
4.1.1 Overview . 11
4.1.2 3GPP 3DOF Coordinate System . 12
4.1.3 Video Signal Representation. 14
4.1.4 Audio Signal Representation . 15
4.2 End-to-end Architecture . 16
4.3 Client Reference Architecture . 17
4.4 Rendering Schemes, Operation Points and Media Profiles . 19
4.5 Audio Rendering . 21
4.5.1 Audio Renderer Definitions . 21
4.5.1.1 Reference Renderer . 21
4.5.1.2 Common Informative Binaural Renderer (CIBR) . 21
4.5.1.3 External Renderer . 22
4.5.1.4 Common Renderer API . 22
4.5.1.5 External Renderer API . 22
4.5.1.6 Rendering Test . 23
5 Video . 23
5.1 Video Operation Points . 23
5.1.1 Definition of Operation Point . 23
5.1.2 Parameters of Visual Operation Point . 24
5.1.3 Operation Point Summary . 24
5.1.4 Basic H.264/AVC . 25
5.1.4.1 General . 25
5.1.4.2 Profile and level . 25
5.1.4.3 Aspect Ratios and Spatial resolutions . 25
5.1.4.4 Colour information . 26
5.1.4.5 Frame rates . 26
5.1.4.6 Random access point . 26
5.1.4.7 Sequence parameter set . 26
5.1.4.8 Video usability information . 27
5.1.4.9 Omni-directional Projection Format . 27
5.1.4.10 Restricted Coverage . 27
5.1.4.11 Other VR Metadata . 27
5.1.4.12 Receiver Compatibility . 27
5.1.5 Main H.265/HEVC . 28
5.1.5.1 General . 28
5.1.5.2 Profile and level . 28
5.1.5.3 Bit depth . 28
5.1.5.4 Spatial Resolutions . 28
5.1.5.5 Colour information and Transfer Characteristics . 29
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 4 ETSI TS 126 118 V17.0.0 (2022-05)
5.1.5.6 Frame rates . 29
5.1.5.7 Random access point . 30
5.1.5.8 Video and Sequence Parameter Sets . 30
5.1.5.9 Video usability information . 30
5.1.5.10 Omni-directional Projection Formats . 30
5.1.5.11 Restricted Coverage . 30
5.1.5.12 Viewport-Optimized Content . 31
5.1.5.13 Frame packing arrangement . 31
5.1.5.14 Other VR Metadata . 31
5.1.5.15 Receiver Compatibility . 31
5.1.6 Flexible H.265/HEVC . 32
5.1.6.1 General . 32
5.1.6.2 Profile and level . 32
5.1.6.3 Bit depth . 32
5.1.6.4 Spatial Resolutions . 33
5.1.6.5 Colour information and Transfer Characteristics . 33
5.1.6.6 Frame rates . 34
5.1.6.7 Random access point . 34
5.1.6.8 Video and Sequence Parameter Sets . 35
5.1.6.9 Video usability information . 35
5.1.6.10 Omni-directional Projection Formats . 35
5.1.6.11 Restricted Coverage . 35
5.1.6.12 Viewport-Optimized Content . 36
5.1.6.13 Frame packing arrangement . 36
5.1.6.14 Other VR Metadata . 36
5.1.6.15 Receiver Compatibility . 36
5.1.7 Main 8K H.265/HEVC . 37
5.1.7.1 General . 37
5.1.7.2 Profile and level . 37
5.1.7.3 Bit depth . 37
5.1.7.4 Spatial Resolutions . 38
5.1.7.5 Colour information and Transfer Characteristics . 38
5.1.7.6 Frame rates . 39
5.1.7.7 Random access point . 39
5.1.7.8 Video and Sequence Parameter Sets . 39
5.1.7.9 Video usability information . 39
5.1.7.10 Omni-directional Projection Formats . 39
5.1.7.11 Restricted Coverage . 40
5.1.7.12 Frame packing arrangement . 40
5.1.7.13 Other VR Metadata . 40
5.1.7.14 Receiver Compatibility . 40
5.2 Video Media Profiles. 40
5.2.1 Introduction and Overview . 40
5.2.2 Basic Video Media Profile . 41
5.2.2.1 Overview . 41
5.2.2.2 File Format Signaling and Encapsulation . 41
5.2.2.3 DASH Integration . 42
5.2.2.3.1 Definition. 42
5.2.2.3.2 Additional Restrictions for DASH Representations . 42
5.2.2.3.3 DASH Adaptation Set Constraints . 43
5.2.3 Main Video Media Profile . 44
5.2.3.1 Overview . 44
5.2.3.2 File Format Signaling and Encapsulation . 44
5.2.3.3 DASH Integration . 46
5.2.3.3.1 Definition. 46
5.2.3.3.2 Additional Restrictions for DASH Representations . 46
5.2.3.3.3 DASH Adaptation Set Constraints . 46
5.2.3.3.4 Adaptation Set Ensembles for Viewport-Optimized offering. 48
5.2.4 Advanced Video Media Profile . 49
5.2.4.1 Overview . 49
5.2.4.2 File Format Signaling and Encapsulation . 49
5.2.4.3 DASH Integration . 51
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 5 ETSI TS 126 118 V17.0.0 (2022-05)
5.2.4.3.1 Definition. 51
5.2.4.3.2 Additional Restrictions for DASH Representations . 51
5.2.4.3.3 DASH Adaptation Set Constraints . 52
5.2.4.3.4 Adaptation Set Constraints for Viewport Selection . 54
6 Audio . 54
6.1 Audio Operation Points . 54
6.1.1 Definition of Operation Point . 54
6.1.2 Parameters of Audio Operation Point . 55
6.1.3 Summary of Audio Operation Points . 55
6.1.4 3GPP MPEG-H Audio Operation Point. 55
6.1.4.1 Overview . 55
6.1.4.2 Bitstream requirements . 56
6.1.4.3 Receiver requirements . 56
6.1.4.3.1 General . 56
6.1.4.3.2 Decoding process. 56
6.1.4.3.3 Random Access . 57
6.1.4.3.4 Configuration change . 57
6.1.4.3.5 MPEG-H Multi-stream Audio . 57
6.1.4.3.6 Rendering requirements . 57
6.2 Audio Media Profiles . 59
6.2.1 Introduction and Overview . 59
6.2.2 OMAF 3D Audio Baseline Media Profile . 60
6.2.2.1 Overview . 60
6.2.2.2 File Format Signaling and Encapsulation . 60
6.2.2.2.1 General . 60
6.2.2.2.2 Configuration change constraints . 60
6.2.2.3 Multi-stream constraints . 60
6.2.2.3a Additional Restrictions for DASH Representations . 60
6.2.2.4 DASH Adaptation Set Constraints . 61
6.2.2.4.1 General . 61
6.2.2.4.2 DASH Adaptive Bitrate Switching . 61
7 Metadata . 61
7.1 Presentation without Pose Information to 2D Screens . 61
8 VR Presentation . 62
8.1 Definition . 62
8.2 3GPP VR File . 62
8.3 3GPP VR DASH Media Presentation . 62
9 VR Metrics . 62
9.1 General . 62
9.2 VR Client Reference Architecture . 62
9.2.1 Architecture . 62
9.2.2 Observation Point 1 . 63
9.2.3 Observation Point 2 . 63
9.2.4 Observation Point 3 . 64
9.2.5 Observation Point 4 . 64
9.2.6 Observation Point 5 . 64
9.3 Metrics Definitions . 65
9.3.1 General . 65
9.3.2 Comparable quality viewport switching latency . 65
9.3.3 Rendered viewports . 67
9.3.4 VR Device information . 68
9.4 Metrics Configuration and Reporting . 69
9.4.1 Configuration . 69
9.4.2 Reporting . 69
9.4.3 Reporting Format . 69
Annex A (informative): Content Generation Guidelines . 72
A.1 Introduction . 72
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 6 ETSI TS 126 118 V17.0.0 (2022-05)
A.2 Video . 72
A.2.1 Overview . 72
A.2.2 Decoded Texture Signal Constraints . 72
A.2.2.1 General . 72
A.2.2.2 Constraints for Main and Flexible H.265/HEVC Operation Point . 72
A.2.2.2a Constraints for Main 8K H.265/HEVC Operation Point . 73
A.2.3 Conversion of ERP Signals to CMP . 74
A.2.3.1 General . 74
A.2.3.2 Equirectangular Projection (ERP) . 75
A.2.3.3 Cubemap Projection (CMP) . 75
A.2.3.4 Conversion between two projection formats . 76
Annex B (informative): Example External Binaural Renderer . 78
B.1 General . 78
B.2 Interfaces . 78
B.2.1 Interface for Audio Data and Metadata . 78
B.2.2 Head Tracking Interface. . 79
B.2.3 Interface for Head-Related Impulse Responses . 79
B.3 Preprocessing . 79
B.3.1 Channel Content . 79
B.3.2 Object Content . 79
B.3.3 HOA Content . 79
B.3.4 Non-diegetic Content . 79
B.4 Scene Displacement Processing . 80
B.4.1 General . 80
B.4.2 Applying Scene Displacement Information . 80
B.5 Headphone Output Signal Computation . 80
B.5.1 General . 80
B.5.2 HRIR Selection . 80
B.5.3 Initialization . 80
B.5.4 Convolution and Crossfade . 81
B.5.5 Binaural Downmix . 81
B.5.6 Complexity . 82
B.5.7 Motion Latency . 82
Annex C (informative): Registration Information . 83
C.1 3GPP Registered URIs . 83
Annex D (informative): VR metrics calculation examples . 84
D.1 Comparable quality viewport switching latency . 84
D.2 Rendered viewports . 86
Annex E (informative): Change history . 89
History . 90

ETSI
3GPP TS 26.118 version 17.0.0 Release 17 7 ETSI TS 126 118 V17.0.0 (2022-05)
Foreword
This Technical Specification has been produced by the 3rd Generation Partnership Project (3GPP).
The contents of the present document are subject to continuing work within the TSG and may change following formal
TSG approval. Should the TSG modify the contents of the present document, it will be re-released by the TSG with an
identifying change of release date and an increase in version number as follows:
Version x.y.z
where:
x the first digit:
1 presented to TSG for information;
2 presented to TSG for approval;
3 or greater indicates TSG approved document under change control.
y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections,
updates, etc.
z the third digit is incremented when editorial only changes have been incorporated in the document.
In the present document, modal verbs have the following meanings:
shall indicates a mandatory requirement to do something
shall not indicates an interdiction (prohibition) to do something
The constructions "shall" and "shall not" are confined to the context of normative provisions, and do not appear in
Technical Reports.
The constructions "must" and "must not" are not used as substitutes for "shall" and "shall not". Their use is avoided
insofar as possible, and they are not used in a normative context except in a direct citation from an external, referenced,
non-3GPP document, or so as to maintain continuity of style when extending or modifying the provisions of such a
referenced document.
should indicates a recommendation to do something
should not indicates a recommendation not to do something
may indicates permission to do something
need not indicates permission not to do something
The construction "may not" is ambiguous and is not used in normative elements. The unambiguous constructions
"might not" or "shall not" are used instead, depending upon the meaning intended.
can indicates that something is possible
cannot indicates that something is impossible
The constructions "can" and "cannot" are not substitutes for "may" and "need not".
will indicates that something is certain or expected to happen as a result of action taken by an agency
the behaviour of which is outside the scope of the present document
will not indicates that something is certain or expected not to happen as a result of action taken by an
agency the behaviour of which is outside the scope of the present document
might indicates a likelihood that something will happen as a result of action taken by some agency the
behaviour of which is outside the scope of the present document
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 8 ETSI TS 126 118 V17.0.0 (2022-05)
might not indicates a likelihood that something will not happen as a result of action taken by some agency
the behaviour of which is outside the scope of the present document
In addition:
is (or any other verb in the indicative mood) indicates a statement of fact
is not (or any other negative verb in the indicative mood) indicates a statement of fact
The constructions "is" and "is not" do not indicate requirements.
Introduction
The present document provides technologies for interoperable Virtual Reality services with focus on streaming and
consumption.
Virtual Reality (VR) is the ability to be virtually present in a space created by the rendering of natural and/or synthetic
image and sound correlated by the movements of the immersed user allowing interacting with that world.
Suitable media formats for providing immersive experiences are specified to enable Virtual Reality Services in the
context of 3GPP bearer and user services.
ETSI
3GPP TS 26.118 version 17.0.0 Release 17 9 ETSI TS 126 118 V17.0.0 (2022-05)
1 Scope
The present document defines interoperable formats for Virtual Reality for streaming services. Specifically, the present
document defines operation points, media profiles and presentation profiles for Virtual Reality. The present document
builds on the findings and conclusions in TR 26.918 [2].
2 References
The following documents contain provisions which, through reference in this text, constitute provisions of the present
document.
- References are either specific (identified by date of publication, edition number, version number, etc.) or
non-specific.
- For a specific reference, subsequent revisions do not apply.
- For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP do
...