ISO/IEC 14496-12:2022

Information technology — Coding of audio-visual objects — Part 12: ISO base media file format

This document specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations.

Technologies de l'information — Codage des objets audiovisuels — Partie 12: Format ISO de base pour les fichiers médias

General Information

• Status: Published
• Publication Date: 24-Jan-2022
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29/WG 3 - MPEG Systems
• Current Stage: 9092 - International Standard to be revised
• Completion Date: 02-Sep-2022

Relations

• Revises: ISO/IEC 14496-12:2020 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format
• Effective Date: 04-Sep-2021

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 14496-12
Seventh edition
2022-01
Information technology — Coding of
audio-visual objects —
Part 12:
ISO base media file format
Technologies de l'information — Codage des objets audiovisuels —
Partie 12: Format ISO de base pour les fichiers médias
Reference number
ISO/IEC 14496-12:2022(E)
© ISO/IEC 2022

---------------------- Page: 1 ----------------------
ISO/IEC 14496-12:2022(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2022
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii
  © ISO/IEC 2022 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 14496-12:2022(E)
Contents Page
Foreword .x
Introduction .xi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 2
3.1 Terms and definitions . 2
3.2 Abbreviated terms . 7
4 Object-structured file organization .7
4.1 File structure . 7
4.2 Object structure . 7
4.2.1 Object syntax conventions . 7
4.2.2 Object definitions . . 8
4.2.3 Extensibility of object definitions . 9
4.3 File-type box . 10
4.3.1 Definition . 10
4.3.2 Syntax . . 10
4.3.3 Semantics . 11
4.4 Extended type box . . . 11
4.4.1 Definition . 11
4.4.2 Syntax . . 11
4.4.3 Semantics . 11
5 Structure of this document .12
6 ISO base media file organization .12
6.1 Files, segments, and streams .12
6.2 Presentation structure . 13
6.2.1 Object structure of a presentation . 13
6.2.2 Meta data and media data . 13
6.3 Structure-data (objects) . 13
6.3.1 Box . .13
6.3.2 Data types and fields .13
6.3.3 URIs as type indicators . . 14
6.3.4 Box order .15
6.4 Time structure overview . 18
6.5 Identifiers . 19
6.6 Brand identification . 19
6.7 Uniform resource locators (URLs) . 19
7 Streaming support .19
8 Box structures .19
8.1 File structure and general boxes . 19
8.1.1 Media data box . 19
8.1.2 Free space box . 20
8.1.3 Progressive download information box . 20
8.1.4 Identified media data box . 21
8.2 Movie structure . 21
8.2.1 Movie box . 21
8.2.2 Movie header box . 21
8.3 Track structure . 23
8.3.1 Track box . 23
8.3.2 Track header box . 23
8.3.3 Track reference box. 26
8.3.4 Track group box . .28
iii
© ISO/IEC 2022 – All rights reserved

---------------------- Page: 3 ----------------------
ISO/IEC 14496-12:2022(E)
8.3.5 Track type box .29
8.4 Track media structure . 30
8.4.1 Media box .30
8.4.2 Media header box .30
8.4.3 Handler reference box . 31
8.4.4 Media information box . 32
8.4.5 Media information header boxes . 32
8.4.6 Extended language tag . 32
8.5 Sample tables . 33
8.5.1 Sample table box .33
8.5.2 Sample description box .34
8.5.3 Degradation priority box . 36
8.5.4 Sample scale box .36
8.6 Track time structures .36
8.6.1 Time to sample boxes .36
8.6.2 Sync sample box . 41
8.6.3 Shadow sync . 42
8.6.4 Independent and disposable samples box . 43
8.6.5 Edit box . 45
8.6.6 Edit list box . 45
8.7 Track data layout structures .48
8.7.1 Data information box.48
8.7.2 Data reference box .48
8.7.3 Sample size boxes .50
8.7.4 Sample to chunk box . 51
8.7.5 Chunk offset box . 52
8.7.6 Padding bits box . 52
8.7.7 Sub-sample information box . 53
8.7.8 Sample auxiliary information sizes box .54
8.7.9 Sample auxiliary information offsets box.56
8.8 Movie fragments . 57
8.8.1 Movie extends box . 57
8.8.2 Movie extends header box .58
8.8.3 Track extends box .58
8.8.4 Movie fragment box . 59
8.8.5 Movie fragment header box .60
8.8.6 Track fragment box .60
8.8.7 Track fragment header box .60
8.8.8 Track fragment run box . . 62
8.8.9 Movie fragment random access box .63
8.8.10 Track fragment random access box .64
8.8.11 Movie fragment random access offset box .65
8.8.12 Track fragment decode time box .65
8.8.13 Level assignment box .66
8.8.14 Sample auxiliary information in movie fragments.68
8.8.15 Track Extension Properties box.68
8.8.16 Alternative startup sequence properties box .68
8.8.17 Metadata and user data in movie fragments . 69
8.9 Sample group structures . 70
8.9.1 Overview . 70
8.9.2 Sample to group box . 70
8.9.3 Sample group description box .72
8.9.4 Representation of group structures in movie fragments .74
8.9.5 Compact sample to group box . 75
8.10 User data .77
8.10.1 User data box .77
8.10.2 Copyright box .77
8.10.3 Track selection box . 78
iv
  © ISO/IEC 2022 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC 14496-12:2022(E)
8.10.4 Track kind . 79
8.11 Metadata support .80
8.11.1 MetaBox .80
8.11.2 XML boxes . . . 81
8.11.3 Item location box .81
8.11.4 Primary item box .84
8.11.5 Item protection box .85
8.11.6 Item information box .85
8.11.7 Additional metadata container box .87
8.11.8 Metabox Relation box .87
8.11.9 URL forms for MetaBoxes .88
8 .11.10 St at ic me t ad at a .88
8.11.11 Item data box .89
8.11.12 Item reference box .89
8.11.13 Auxiliary video metadata .90
8.11.14 Item properties box .90
8.11.15 Brand item property . 92
8.12 Support for protected streams. 93
8.12.1 Overview . 93
8.12.2 Protection scheme information box .94
8.12.3 Original format box .94
8.12.4 IPMPInfoBox . 95
8.12.5 IPMP control box . 95
8.12.6 Scheme type box . 95
8.12.7 Scheme information box . 95
8.12.8 Scramble Scheme Information Box .96
8.13 File delivery format support .96
8.13.1 Overview .96
8.13.2 FD item information box . 97
8.13.3 File partition box .97
8.13.4 FEC reservoir box .99
8.13.5 FD session group box .99
8.13.6 Group ID to name box . .100
8.13.7 File reservoir box . 101
8.14 Sub tracks . 101
8.14.1 Overview . 101
8.14.2 Backward compatibility .102
8.14.3 Sub track box.102
8.14.4 Sub track information box .102
8.14.5 Sub track definition box .103
8.14.6 Sub track sample group box .104
8.15 Post-decoder requirements on media .104
8.15.1 General .104
8.15.2 Restricted sample entry transformation .105
8.15.3 Restricted scheme information box .105
8.15.4 Scheme for stereoscopic video arrangements .106
8.15.5 Compatible scheme type box .108
8.16 Segments .
...

FINAL
INTERNATIONAL ISO/IEC
DRAFT
STANDARD FDIS
14496-12
ISO/IEC JTC 1/SC 29
Information technology — Coding of
Secretariat: JISC
audio-visual objects —
Voting begins on:
2021-09-10
Part 12:
Voting terminates on:
ISO base media file format
2021-11-05
Technologies de l'information — Codage des objets audiovisuels —
Partie 12: Format ISO de base pour les fichiers médias
RECIPIENTS OF THIS DRAFT ARE INVITED TO
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
Reference number
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO-
ISO/IEC FDIS 14496-12:2021(E)
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN-
DARDS TO WHICH REFERENCE MAY BE MADE IN
©
NATIONAL REGULATIONS. ISO/IEC 2021

---------------------- Page: 1 ----------------------
ISO/IEC FDIS 14496-12:2021(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC FDIS 14496-12:2021(E)

Contents Page
Foreword .ix
Introduction .x
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 2
3.1 Terms and definitions . 2
3.2 Abbreviated terms . 7
4 Object-structured file organization . 7
4.1 File structure . 7
4.2 Object structure. 7
4.2.1 Object syntax conventions . 7
4.2.2 Object definitions . 8
4.2.3 Extensibility of object definitions . 9
4.3 File-type box .10
4.3.1 Definition .10
4.3.2 Syntax .10
4.3.3 Semantics .11
4.4 Extended type box .11
4.4.1 Definition .11
4.4.2 Syntax .11
4.4.3 Semantics .11
5 Structure of this document .12
6 ISO base media file organization .12
6.1 Files, segments, and streams .12
6.2 Presentation structure .13
6.2.1 Object structure of a presentation .13
6.2.2 Meta data and media data .13
6.3 Structure-data (objects) .13
6.3.1 Box . .13
6.3.2 Data types and fields .13
6.3.3 URIs as type indicators .14
6.3.4 Box order .15
6.4 Time structure overview .18
6.5 Identifiers .19
6.6 Brand identification .19
6.7 Uniform resource locators (URLs) .19
7 Streaming support .19
8 Box structures .19
8.1 File structure and general boxes .19
8.1.1 Media data box . .19
8.1.2 Free space box .20
8.1.3 Progressive download information box .20
8.1.4 Identified media data box .21
8.2 Movie structure .21
8.2.1 Movie box .21
8.2.2 Movie header box .21
8.3 Track structure .23
8.3.1 Track box .23
8.3.2 Track header box .23
8.3.3 Track reference box .26
8.3.4 Track group box .28
© ISO/IEC 2021 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC FDIS 14496-12:2021(E)

8.3.5 Track type box .29
8.4 Track media structure .30
8.4.1 Media box .30
8.4.2 Media header box .30
8.4.3 Handler reference box .31
8.4.4 Media information box .32
8.4.5 Media information header boxes .32
8.4.6 Extended language tag .32
8.5 Sample tables .33
8.5.1 Sample table box .33
8.5.2 Sample description box .34
8.5.3 Degradation priority box .36
8.5.4 Sample scale box .36
8.6 Track time structures .36
8.6.1 Time to sample boxes .36
8.6.2 Sync sample box .41
8.6.3 Shadow sync .42
8.6.4 Independent and disposable samples box.43
8.6.5 Edit box .45
8.6.6 Edit list box .45
8.7 Track data layout structures .48
8.7.1 Data information box .48
8.7.2 Data reference box.48
8.7.3 Sample size boxes.50
8.7.4 Sample to chunk box . .51
8.7.5 Chunk offset box .52
8.7.6 Padding bits box .52
8.7.7 Sub-sample information box .53
8.7.8 Sample auxiliary information sizes box .54
8.7.9 Sample auxiliary information offsets box.56
8.8 Movie fragments .57
8.8.1 Movie extends box .57
8.8.2 Movie extends header box .58
8.8.3 Track extends box .58
8.8.4 Movie fragment box . .59
8.8.5 Movie fragment header box.60
8.8.6 Track fragment box .60
8.8.7 Track fragment header box .60
8.8.8 Track fragment run box .62
8.8.9 Movie fragment random access box .63
8.8.10 Track fragment random access box .63
8.8.11 Movie fragment random access offset box .64
8.8.12 Track fragment decode time box .65
8.8.13 Level assignment box .66
8.8.14 Sample auxiliary information in movie fragments .68
8.8.15 Track Extension Properties box .68
8.8.16 Alternative startup sequence properties box .68
8.8.17 Metadata and user data in movie fragments .69
8.9 Sample group structures .70
8.9.1 Overview .70
8.9.2 Sample to group box .70
8.9.3 Sample group description box .72
8.9.4 Representation of group structures in movie fragments .74
8.9.5 Compact sample to group box .75
8.10 User data .77
8.10.1 User data box .77
8.10.2 Copyright box .77
8.10.3 Track selection box .78
iv © ISO/IEC 2021 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC FDIS 14496-12:2021(E)

8.10.4 Track kind .79
8.11 Metadata support .80
8.11.1 MetaBox .80
8.11.2 XML boxes .81
8.11.3 Item location box .82
8.11.4 Primary item box .84
8.11.5 Item protection box .85
8.11.6 Item information box .85
8.11.7 Additional metadata container box .87
8.11.8 Metabox Relation box .87
8.11.9 URL forms for MetaBoxes .88
8.11.10 Static metadata .88
8.11.11 Item data box .89
8.11.12 Item reference box.89
8.11.13 Auxiliary video metadata .90
8.11.14 Item properties box .90
8.11.15 Brand item property .92
8.12 Support for protected streams .93
8.12.1 Overview .93
8.12.2 Protection scheme information box .94
8.12.3 Original format box . .94
8.12.4 IPMPInfoBox .95
8.12.5 IPMP control box .95
8.12.6 Scheme type box .95
8.12.7 Scheme information box .95
8.12.8 Scramble Scheme Information Box .96
8.13 File delivery format support .96
8.13.1 Overview .96
8.13.2 FD item information box .97
8.13.3 File partition box .97
8.13.4 FEC reservoir box .99
8.13.5 FD session group box .99
8.13.6 Group ID to name box .100
8.13.7 File reservoir box . .101
8.14 Sub tracks .101
8.14.1 Overview .101
8.14.2 Backward compatibility .102
8.14.3 Sub track box .102
8.14.4 Sub track information box .102
8.14.5 Sub track definition box .103
8.14.6 Sub track sample group box .104
8.15 Post-decoder requirements on media .104
8.15.1 General.104
8.15.2 Restricted sample entry transformation .105
8.15.3 Restricted scheme information box .105
8.15.4 Scheme for stereoscopic video arrangements .106
8.15.5 Compatible scheme type box
...