Information technology — Coding of audio-visual objects — Part 15: Carriage of network abstraction layer (NAL) unit structured video in the ISO base media file format

This document specifies the storage format for streams of video that is structured as NAL units, such as AVC (ISO/IEC 14496-10) and HEVC (ISO/IEC 23008-2) video streams.

Technologies de l'information — Codage des objets audiovisuels — Partie 15: Transport de vidéo structurée en unités NAL sur la couche réseau au format ISO de base pour les fichiers médias

General Information

Status
Published
Publication Date
23-Sep-2019
Current Stage
9092 - International Standard to be revised
Start Date
24-Jun-2021
Completion Date
24-Jun-2021
Ref Project

RELATIONS

Buy Standard

Standard
ISO/IEC 14496-15:2019 - Information technology -- Coding of audio-visual objects
English language
171 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO/IEC
STANDARD 14496-15
Fifth edition
2019-09
Information technology — Coding of
audio-visual objects —
Part 15:
Carriage of network abstraction layer
(NAL) unit structured video in the ISO
base media file format
Technologies de l'information — Codage des objets audiovisuels —
Partie 15: Transport de vidéo structurée en unités NAL sur la couche
réseau au format ISO de base pour les fichiers médias
Reference number
ISO/IEC 14496-15:2019(E)
ISO/IEC 2019
---------------------- Page: 1 ----------------------
ISO/IEC 14496-15:2019(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2019

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 14496-15:2019(E)
Contents Page

Foreword ........................................................................................................................................................................................................................................vi

Introduction ..............................................................................................................................................................................................................................vii

1 Scope ................................................................................................................................................................................................................................. 1

2 Normative references ...................................................................................................................................................................................... 1

3 Terms, definitions and abbreviated terms ................................................................................................................................ 1

3.1 Terms and definitions ....................................................................................................................................................................... 1

3.2 Abbreviated terms ............................................................................................................................................................................... 7

4 General definitions ............................................................................................................................................................................................. 8

4.1 Overview ...................................................................................................................................................................................................... 8

4.2 Elementary stream structure ..................................................................................................................................................... 8

4.3 Sample and configuration definition ................................................................................................................................... 9

4.3.1 General...................................................................................................................................................................................... 9

4.3.2 Canonical order and restrictions ....................................................................................................................... 9

4.3.3 Sample format .................................................................................................................................................................10

4.3.4 Optional boxes in the sample entry ..............................................................................................................11

4.4 Video track structure ......................................................................................................................................................................11

4.5 Template fields used........................................................................................................................................................................11

4.6 Visual width and height ................................................................................................................................................................11

4.7 Decoding time (DTS) and composition time (CTS) ..............................................................................................12

4.8 Sample groups on random access recovery points 'roll' and random access

points 'rap ' .......................................................................................................................................................................................12

4.9 Hinting .........................................................................................................................................................................................................12

4.10 On change of sample entry .......................................................................................................................................................12

4.11 SEI information box .........................................................................................................................................................................14

4.11.1 Definition .............................................................................................................................................................................14

4.11.2 Syntax .....................................................................................................................................................................................14

4.11.3 Semantics ............................................................................................................................................................................14

4.12 Post-decoder requirements scheme for signalling of SEI ...............................................................................14

4.12.1 General...................................................................................................................................................................................14

4.12.2 Definition .............................................................................................................................................................................15

5 AVC elementary streams and sample definitions ............................................................................................................15

5.1 Overview ...................................................................................................................................................................................................15

5.2 Elementary stream structure ..................................................................................................................................................15

5.3 Sample and configuration definition ................................................................................................................................18

5.3.1 Overview ..............................................................................................................................................................................18

5.3.2 Canonical order and restrictions ....................................................................................................................18

5.3.3 Decoder configuration information ..............................................................................................................19

5.4 Derivation from ISO base media file format ...............................................................................................................22

5.4.1 AVC file type and identification ........................................................................................................................22

5.4.2 AVC video stream definition................................................................................................................................23

5.4.3 AVC parameter set stream definition ..........................................................................................................24

5.4.4 Parameter sets ................................................................................................................................................................25

5.4.5 Sync sample .......................................................................................................................................................................26

5.4.6 Shadow sync .....................................................................................................................................................................26

5.4.7 Layering and sub-sequences ..............................................................................................................................27

5.4.8 Alternate streams and switching pictures ..............................................................................................30

5.4.9 Definition of a sub-sample for AVC ...............................................................................................................33

6 SVC elementary stream and sample definitions ...............................................................................................................33

6.1 Overview ...................................................................................................................................................................................................33

6.2 Elementary stream structure ..................................................................................................................................................34

6.3 Use of the plain AVC file format .............................................................................................................................................35

6.4 Sample and configuration definition ................................................................................................................................35

© ISO/IEC 2019 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 14496-15:2019(E)

6.4.1 Overview ..............................................................................................................................................................................35

6.4.2 Canonical order and restrictions ....................................................................................................................35

6.5 Derivation from the ISO base media file format ......................................................................................................37

6.5.1 SVC track structure .....................................................................................................................................................37

6.5.2 Data sharing and extraction ................................................................................................................................37

6.5.3 SVC video stream definition ................................................................................................................................38

6.5.4 SVC visual width and height ................................................................................................................................40

6.5.5 Sync sample .......................................................................................................................................................................40

6.5.6 Shadow sync .....................................................................................................................................................................41

6.5.7 Independent and disposable samples box..............................................................................................41

6.5.8 Sample groups on random access recovery points 'roll' and random

access points 'rap ' ..................................................................................................................................................41

6.5.9 Definition of a sub-sample for SVC ................................................................................................................41

7 MVC and MVD elementary stream and sample definitions ...................................................................................43

7.1 Overview ...................................................................................................................................................................................................43

7.2 Overview of MVC or MVD storage .......................................................................................................................................44

7.3 MVC and MVD elementary stream structures ...........................................................................................................46

7.4 Use of the plain AVC file format .............................................................................................................................................48

7.5 Sample and configuration definition ................................................................................................................................48

7.5.1 Overview ..............................................................................................................................................................................48

7.5.2 Canonical order and restriction .......................................................................................................................48

7.5.3 Decoder configuration record ...........................................................................................................................48

7.6 Derivation from the ISO base media file format ......................................................................................................51

7.6.1 MVC and MVD track structures ........................................................................................................................51

7.6.2 Reconstruction of an access unit.....................................................................................................................51

7.6.3 Sample entry ....................................................................................................................................................................52

7.6.4 Sync sample .......................................................................................................................................................................64

7.6.5 Shadow sync .....................................................................................................................................................................64

7.6.6 Independent and disposable samples box..............................................................................................65

7.6.7 Sample groups on random access recovery points 'roll' and random

access points 'rap ' ................................................................................................................................................65

7.7 MVC specific information boxes ............................................................................................................................................65

7.7.1 Overview ..............................................................................................................................................................................65

7.7.2 Multiview information box ..................................................................................................................................66

7.7.3 Multiview group box ..................................................................................................................................................66

7.7.4 Multiview group relation box ............................................................................................................................68

7.7.5 Multiview relation attribute box .....................................................................................................................69

7.7.6 Multiview scene info box .......................................................................................................................................75

7.7.7 MVC view priority assignment box ...............................................................................................................76

8 HEVC elementary streams and sample definitions .......................................................................................................76

8.1 Overview ...................................................................................................................................................................................................76

8.2 Elementary stream structure ..................................................................................................................................................77

8.3 Sample and configuration definition ................................................................................................................................77

8.3.1 Overview ..............................................................................................................................................................................77

8.3.2 Canonical order and restrictions ....................................................................................................................77

8.3.3 Decoder configuration information ..............................................................................................................78

8.4 Derivation from ISO base media file format ...............................................................................................................82

8.4.1 HEVC video stream definition ...........................................................................................................................82

8.4.2 Parameter sets in sample entry .......................................................................................................................83

8.4.3 Sync sample .......................................................................................................................................................................83

8.4.4 Sync sample sample grouping ...........................................................................................................................84

8.4.5 Temporal scalability sample grouping .......................................................................................................85

8.4.6 Temporal sub-layer access sample grouping .......................................................................................87

8.4.7 Step-wise temporal layer access sample grouping .........................................................................87

8.4.8 Definition of a sub-sample for HEVC ...........................................................................................................88

8.4.9 Handling non-output samples ...........................................................................................................................90

9 Layered HEVC elementary stream and sample definitions ...................................................................................91

iv © ISO/IEC 2019 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 14496-15:2019(E)

9.1 Overview ...................................................................................................................................................................................................91

9.2 Overview of L-HEVC storage ....................................................................................................................................................92

9.3 L-HEVC elementary stream structure ..............................................................................................................................92

9.4 Sample and configuration definition ................................................................................................................................93

9.4.1 Overview ..............................................................................................................................................................................93

9.4.2 Canonical order and restrictions ....................................................................................................................93

9.4.3 Decoder configuration record ...........................................................................................................................93

9.5 Derivation from the ISO base media file format and the HEVC file format (Clause 8) ...........94

9.5.1 L-HEVC track structure............................................................................................................................................94

9.5.2 Data sharing and reconstruction of an L-HEVC bitstream ........................................................95

9.5.3 L-HEVC video stream definition ......................................................................................................................97

9.5.4 L-HEVC visual width and height ...................................................................................................................100

9.5.5 Sync sample ....................................................................................................................................................................100

9.5.6 Independent and disposable samples box...........................................................................................101

9.5.7 Stream access point sample group .............................................................................................................101

9.5.8 The 'roll', 'rap ', 'sync', 'tsas' and 'stsa' sample groups .........................................102

9.5.9 Definition of a sub-sample for L-HEVC ...................................................................................................102

9.5.10 Handling non-output samples ........................................................................................................................102

9.6 L-HEVC specific structures .....................................................................................................................................................103

9.6.1 External base layer sample group ...............................................................................................................103

9.6.2 The operating points information sample group...........................................................................103

9.6.3 The layer information sample group ........................................................................................................107

9.6.4 The layer information sample group ........................................................................................................108

10 Storage of tiled HEVC and L-HEVC video streams ........................................................................................................109

10.1 Overview ................................................................................................................................................................................................109

10.2 NAL unit map entry .......................................................................................................................................................................110

10.2.1 Definition ..........................................................................................................................................................................110

10.2.2 Syntax ..................................................................................................................................................................................110

10.2.3 Semantics .........................................................................................................................................................................111

10.3 Tile region group entry ..............................................................................................................................................................111

10.3.1 Definition ..........................................................................................................................................................................111

10.3.2 Syntax ..................................................................................................................................................................................112

10.3.3 Semantics .........................................................................................................................................................................112

10.4 Tile sub track definition ............................................................................................................................................................114

10.4.1 Overview ...........................................................................................................................................................................114

10.4.2 TileSubTrackGroupBox ........................................................................................................................................114

10.5 HEVC and L-HEVC tile track ...................................................................................................................................................115

10.5.1 Overview ...........................................................................................................................................................................115

10.5.2 Sample entry name and format for HEVC tile tracks ..................................................................116

10.5.3 Sample entry name and format for L-HEVC tile tracks .............................................................117

10.5.4 Bitstream reconstruction from tile base and tile tracks ..........................................................117

10.5.5 Sample entry names for tile base tracks................................................................................................118

Annex A (normative) In-stream structures ............................................................................................................................................119

Annex B (normative) SVC, MVC, and MVD sample group and sub-track definitions ....................................128

Annex C (normative) Temporal metadata support.........................................................................................................................152

Annex D (normative) File format toolsets and brands ...............................................................................................................162

Annex E (normative) Sub-parameters for the MIME type ‘codecs’ parameter ..................................................165

Annex F (informative) Unspecified nal_unit_type value management .......................................................................170

© ISO/IEC 2019 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 14496-15:2019(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that

are members of ISO or IEC participate in the development of International Standards through

technical committees established by the respective organization to deal with particular fields of

technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other

international organizations, governmental and non-governmental, in liaison with ISO and IEC, also

take part in the work.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for

the different types of document should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/directives).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www .iso .org/patents) or the IEC

list of patent declarations received (see http: //patents .iec .ch).
Any trade name used in this document is information given for the
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.