ISO/IEC 14496-12:2015

Information technology — Coding of audio-visual objects — Part 12: ISO base media file format

ISO/IEC 14496-12:2015 specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations. ISO/IEC 14496-12:2015 is applicable to MPEG-4, but its technical content is identical to that of ISO/IEC 15444-12, which is applicable to JPEG 2000.

Technologies de l'information — Codage des objets audiovisuels — Partie 12: Format ISO de base pour les fichiers médias

General Information

• Status: Withdrawn
• Publication Date: 24-Nov-2015
• ICS: 35.040 - Information coding
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Current Stage: 9599 - Withdrawal of International Standard
• Completion Date: 16-Dec-2020

Relations

• Revised: ISO/IEC 14496-12:2020 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format
• Effective Date: 02-Sep-2017
• Amended By: ISO/IEC 14496-12:2015/Amd 2:2018 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format — Amendment 2: Support for image file format
• Effective Date: 08-May-2020
• Amended By: ISO/IEC 14496-12:2015/Amd 1:2017 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format — Amendment 1: DRC Extensions
• Effective Date: 25-Apr-2020
• Revises: ISO/IEC 14496-12:2012/Amd 3:2015 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format — Amendment 3: Font streams and other improvements to file format
• Effective Date: 05-Nov-2015
• Revises: ISO/IEC 14496-12:2012/Amd 2:2014 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format — Amendment 2: Carriage of timed text and other visual overlays
• Effective Date: 05-Nov-2015
• Revises: ISO/IEC 14496-12:2012/Amd 1:2013 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format — Amendment 1: Various enhancements including support for large metadata
• Effective Date: 05-Nov-2015
• Revises: ISO/IEC 14496-12:2012 - Information technology — Coding of audio-visual objects — Part 12: ISO base media file format
• Effective Date: 05-Nov-2015

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 14496-12
Fifth edition
2015‐12‐15

Information technology — Coding of audio-
visual objects —
Part 12:
ISO base media file format
Technologies de l'information — Codage des objets audiovisuels —
Partie 12: Format ISO de base pour les fichiers médias




Reference number
ISO/IEC 14496‐12:2015(E)

©
ISO/IEC 2015

---------------------- Page: 1 ----------------------
ISO/IEC 14496-12:2015(E)

COPYRIGHT PROTECTED DOCUMENT


© ISO/IEC 2015
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISO's
member body in the country of the requester.
ISO copyright office
Case postale 56  CH‐1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E‐mail [e-mail]
Web www.iso.org
Published in Switzerland


ii
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 14496-12:2015(E)
Contents Page
1 Scope . 1
2 Normative references . 1
3 Terms, definitions, and abbreviated terms . 3
3.1 Terms and definitions . 3
3.2 Abbreviated terms . 5
4 Object-structured File Organization . 6
4.1 File Structure . 6
4.2 Object Structure . 6
4.3 File Type Box . 7
5 Design Considerations . 8
5.1 Usage . 8
5.1.1 Introduction . 8
5.1.2 Inte rcha nge . 8
5.1.3 Content Creation . 9
5.1.4 Preparation for streaming . 10
5.1.5 Local presentation . 10
5.1.6 Streamed presentation . 10
5.2 Design principles . 11
6 ISO Base Media File organization . 12
6.1 Presentation structure . 12
6.1.1 File Structure . 12
6.1.2 Object Structure . 12
6.1.3 Meta Data and Media Data . 12
6.1.4 Track Identifiers . 12
6.2 Metadata Structure (Objects) . 13
6.2.1 Box . 13
6.2.2 Data Types and fields . 13
6.2.3 Box Order . 14
6.2.4 URIs as type indicators . 17
6.3 Brand Identification . 17
7 Streaming Support . 18
7.1 Handling of Streaming Protocols . 18
7.2 Protocol ‘hint’ tracks . 18
7.3 Hint Track Format . 19
8 Box Structures . 20
8.1 File Structure and general boxes . 20
8.1.1 Media Data Box . 20
8.1.2 Free Space Box . 21
iii
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 3 ----------------------
ISO/IEC 14496-12:2015(E)
8.1.3 Progressive Download Information Box . 21
8.2 Movie Structure . 22
8.2.1 Movie Box . 22
8.2.2 Movie Header Box . 22
8.3 Track Structure . 24
8.3.1 Track Box . 24
8.3.2 Track Header Box . 24
8.3.3 Track Reference Box . 26
8.3.4 Track Group Box . 27
8.4 Track Media Structure . 28
8.4.1 Media Box . 28
8.4.2 Media Header Box . 29
8.4.3 Handler Reference Box . 29
8.4.4 Media Information Box . 30
8.4.5 Media Information Header Boxes . 30
8.4.6 Extended language tag . 31
8.5 Sample Tables . 32
8.5.1 Sample Table Box . 32
8.5.2 Sample Description Box . 32
8.5.3 Degradation Priority Box . 34
8.5.4 Sample Scale Box . 35
8.6 Track Time Structures . 35
8.6.1 Time to Sample Boxes . 35
8.6.2 Sync Sample Box . 40
8.6.3 Shadow Sync Sample Box . 40
8.6.4 Independent and Disposable Samples Box . 41
8.6.5 Edit Box . 43
8.6.6 Edit List Box . 43
8.7 Track Data Layout Structures . 45
8.7.1 Data Information Box . 45
8.7.2 Data Reference Box . 45
8.7.3 Sample Size Boxes . 47
8.7.4 Sample To Chunk Box . 48
8.7.5 Chunk Offset Box . 49
8.7.6 Padding Bits Box . 49
8.7.7 Sub-Sample Information Box . 50
8.7.8 Sample Auxiliary Information Sizes Box . 51
8.7.9 Sample Auxiliary Information Offsets Box . 53
8.8 Movie Fragments . 54
8.8.1 Movie Extends Box . 54
8.8.2 Movie Extends Header Box . 54
8.8.3 Track Extends Box . 55
8.8.4 Movie Fragment Box . 56
8.8.5 Movie Fragment Header Box . 56
8.8.6 Track Fragment Box . 57
8.8.7 Track Fragment Header Box . 57

iv
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC 14496-12:2015(E)
8.8.8 Track Fragment Run Box . 58
8.8.9 Movie Fragment Random Access Box . 60
8.8.10 Track Fragment Random Access Box . 60
8.8.11 Movie Fragment Random Access Offset Box . 61
8.8.12 Track fragment decode time . 62
8.8.13 Level Assignment Box . 63
8.8.14 Sample Auxiliary Information in Movie Fragments . 65
8.8.15 Track Extension Properties Box . 65
8.8.16 Alternative Startup Sequence Properties Box . 66
8.8.17 Metadata and user data in movie fragments . 66
8.9 Sample Group Structures . 67
8.9.1 Introduction . 67
8.9.2 Sample to Group Box . 68
8.9.3 Sample Group Description Box . 69
8.9.4 Representation of group structures in Movie Fragments . 70
8.10 User Data . 71
8.10.1 User Data Box . 71
8.10.2 Copyright Box . 72
8.10.3 Track Selection Box . 72
8.10.4 Track kind . 74
8.11 Metadata Support . 75
8.11.1 The Meta box . 75
8.11.2 XML Boxes . 76
8.11.3 The Item Location Box . 77
8.11.4 Primary Item Box . 80
8.11.5 Item Protection Box . 80
8.11.6 Item Information Box . 81
8.11.7 Additional Metadata Container Box . 83
8.11.8 Metabox Relation Box . 84
8.11.9 URL Forms for meta boxes . 85
8.11.10 Static Metadata . 85
8.11.11 Item Data Box . 86
8.11.12 Item Reference Box . 87
8.11.13 Auxiliary video metadata . 88
8.12 Support for Protected Streams . 88
8.12.1 Protection Scheme Information Box . 89
8.12.2 Original Format Box . 90
8.12.3 IPMPInfoBox . 90
8.12.4 IPMP Control Box . 90
8.12.5 Scheme Type Box . 90
8.12.6 Scheme Information Box . 91
8.13 File Delivery Format Support . 91
8.13.1 Introduction . 91
8.13.2 FD Item Information B ox . 92
8.13.3 File Partition Box . 92
8.13.4 FEC Reservoir Box . 94
v
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 14496-12:2015(E)
8.13.5 FD Session Group Box . 95
8.13.6 Group ID to Name Box . 96
8.13.7 File Reservoir Box . 96
8.14 Sub tracks . 97
8.14.1 Introduction . 97
8.14.2 Backward compatibility . 97
8.14.3 Sub Track box . 98
8.14.4 Sub Track Information box . 98
8.14.5 Sub Track Definition box . 100
8.14.6 Sub Track Sample Group box . 100
8.15 Post-decoder requirements on media . 100
8.15.1 General . 100
8.15.2 Transformation . 101
8.15.3 Restricted Scheme Information box . 102
8.15.4 Scheme for stereoscopic video arrangements . 102
8.16 Segments . 104
8.16.1 Introduction . 104
8.16.2 Segment Type Box . 104
8.16.3 Segment Index Box . 105
8.16.4 Subsegment Index Box . 109
8.16.5 Producer Reference Time Box . 111
8.17 Support for Incomplete Tracks . 112
8.17.1 General . 112
8.17.2 Transformation . 113
8.17.3 Complete Track Information Box . 114
9 Hint Track Formats . 114
9.1 RTP and SRTP Hint Track Format . 114
9.1.1 Introduction . 114
9.1.2 Sample Description Format . 115
9.1.3 Sample Format . 117
9.1.4 SDP Information . 119
9.1.5 Statistical Information . 120
9.2 ALC/LCT and FLUTE Hint Track Format . 121
9.2.1 Introduction . 121
9.2.2 Design principles . 122
9.2.3 Sample Description Format . 123
9.2.4 Sample Format . 124
9.3 MPEG-2 Transport Hint Track Format . 127
9.3.1 Introduction . 127
9.3.2 Design Principles . 128
9.3.3 Sample Description Format . 130
9.3.4 Sample Format . 132
9.3.5 Protected MPEG 2 Transport Stream Hint Track . 134
9.4 RTP, RTCP, SRTP and SRTCP Reception Hint Tracks . 134
9.4.1 RTP Reception Hint Track . 134

vi
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 6 ----------------------
ISO/IEC 14496-12:2015(E)
9.4.2 RTCP Reception Hint Track .
...

INTERNATIONAL ISO/IEC
STANDARD 14496-12
Fifth edition
2015-02-2012-15


Information technology — Coding of audio-
visual objects —
Part 12:
ISO base media file format
Technologies de l'information — Codage des objets audiovisuels —
Partie 12: Format ISO de base pour les fichiers médias






Reference number

ISO/IEC 14496-12:2015(E)

©
ISO/IEC 2015

---------------------- Page: 1 ----------------------
ISO/IEC 14496-12:2015(E)
Copyright notice
This ISO document is a Draft International Standard and is copyright-protected by ISO. Except as
permitted under the applicable laws of the user's country, neither this ISO draft nor any extract from it
may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic,
photocopying, recording or otherwise, without prior written permission being secured.
Requests for permission to reproduce should be addressed to either ISO at the address below or ISO's
member body in the country of the requester.
ISO copyright office
Case postale 56  CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Reproduction may be subject to royalty payments or a licensing agreement.
Violators may be prosecuted.

ii
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 14496-12:2015(E)
Contents Page
1 Scope . 1
2 Normative references . 1
3 Terms, definitions, and abbreviated terms . 3
3.1 Terms and definitions . 3
3.2 Abbreviated terms . 5
4 Object-structured File Organization . 5
4.1 File Structure . 5
4.2 Object Structure . 6
4.3 File Type Box . 7
5 Design Considerations . 8
5.1 Usage . 8
5.1.1 Introduction . 8
5.1.2 Interchange . 8
5.1.3 Content Creation . 8
5.1.4 Preparation for streaming . 9
5.1.5 Local presentation . 9
5.1.6 Streamed presentation . 10
5.2 Design principles . 10
6 ISO Base Media File organization . 11
6.1 Presentation structure . 11
6.1.1 File Structure . 11
6.1.2 Object Structure . 11
6.1.3 Meta Data and Media Data . 12
6.1.4 Track Identifiers . 12
6.2 Metadata Structure (Objects) . 12
6.2.1 Box . 12
6.2.2 Data Types and fields . 12
6.2.3 Box Order . 13
6.2.4 URIs as type indicators . 16
6.3 Brand Identification . 17
7 Streaming Support . 17
7.1 Handling of Streaming Protocols . 17
7.2 Protocol ‘hint’ tracks . 18
7.3 Hint Track Format . 18
8 Box Structures . 20
8.1 File Structure and general boxes . 20
8.1.1 Media Data Box . 20
8.1.2 Free Space Box . 20
8.1.3 Progressive Download Information Box . 21
8.2 Movie Structure . 21
8.2.1 Movie Box . 21
iii
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 3 ----------------------
ISO/IEC 14496-12:2015(E)
8.2.2 Movie Header Box . 22
8.3 Track Structure . 23
8.3.1 Track Box . 23
8.3.2 Track Header Box . 23
8.3.3 Track Reference Box . 25
8.3.4 Track Group Box . 27
8.4 Track Media Structure . 28
8.4.1 Media Box . 28
8.4.2 Media Header Box . 28
8.4.3 Handler Reference Box . 29
8.4.4 Media Information Box . 30
8.4.5 Media Information Header Boxes . 30
8.4.6 Extended language tag . 31
8.5 Sample Tables . 31
8.5.1 Sample Table Box . 31
8.5.2 Sample Description Box . 32
8.5.3 Degradation Priority Box . 34
8.5.4 Sample Scale Box . 34
8.6 Track Time Structures . 34
8.6.1 Time to Sample Boxes . 34
8.6.2 Sync Sample Box . 39
8.6.3 Shadow Sync Sample Box . 40
8.6.4 Independent and Disposable Samples Box . 41
8.6.5 Edit Box . 43
8.6.6 Edit List Box . 43
8.7 Track Data Layout Structures . 45
8.7.1 Data Information Box . 45
8.7.2 Data Reference Box . 45
8.7.3 Sample Size Boxes . 46
8.7.4 Sample To Chunk Box . 48
8.7.5 Chunk Offset Box . 48
8.7.6 Padding Bits Box . 49
8.7.7 Sub-Sample Information Box . 50
8.7.8 Sample Auxiliary Information Sizes Box . 51
8.7.9 Sample Auxiliary Information Offsets Box . 53
8.8 Movie Fragments . 54
8.8.1 Movie Extends Box . 54
8.8.2 Movie Extends Header Box . 54
8.8.3 Track Extends Box . 55
8.8.4 Movie Fragment Box . 56
8.8.5 Movie Fragment Header Box . 56
8.8.6 Track Fragment Box . 57
8.8.7 Track Fragment Header Box . 57
8.8.8 Track Fragment Run Box . 58
8.8.9 Movie Fragment Random Access Box . 60
8.8.10 Track Fragment Random Access Box . 60

iv
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC 14496-12:2015(E)
8.8.11 Movie Fragment Random Access Offset Box . 61
8.8.12 Track fragment decode time . 62
8.8.13 Level Assignment Box . 63
8.8.14 Sample Auxiliary Information in Movie Fragments . 65
8.8.15 Track Extension Properties Box . 65
8.8.16 Alternative Startup Sequence Properties Box . 66
8.8.17 Metadata and user data in movie fragments . 66
8.9 Sample Group Structures . 67
8.9.1 Introduction . 67
8.9.2 Sample to Group Box . 68
8.9.3 Sample Group Description Box . 69
8.9.4 Representation of group structures in Movie Fragments . 70
8.10 User Data . 71
8.10.1 User Data Box . 71
8.10.2 Copyright Box . 72
8.10.3 Track Selection Box . 72
8.10.4 Track kind . 74
8.11 Metadata Support . 75
8.11.1 The Meta box . 75
8.11.2 XML Boxes . 76
8.11.3 The Item Location Box . 77
8.11.4 Primary Item Box . 80
8.11.5 Item Protection Box . 80
8.11.6 Item Information Box . 81
8.11.7 Additional Metadata Container Box . 83
8.11.8 Metabox Relation Box . 84
8.11.9 URL Forms for meta boxes . 85
8.11.10 Static Metadata . 85
8.11.11 Item Data Box . 86
8.11.12 Item Reference Box . 87
8.11.13 Auxiliary video metadata . 88
8.12 Support for Protected Streams . 88
8.12.1 Protection Scheme Information Box . 89
8.12.2 Original Format Box . 90
8.12.3 IPMPInfoBox . 90
8.12.4 IPMP Control Box . 90
8.12.5 Scheme Type Box . 90
8.12.6 Scheme Information Box . 91
8.13 File Delivery Format Support . 91
8.13.1 Introduction . 91
8.13.2 FD Item Information Box . 92
8.13.3 File Partition Box . 92
8.13.4 FEC Reservoir Box . 94
8.13.5 FD Session Group Box . 95
8.13.6 Group ID to Name Box . 96
8.13.7 File Reservoir Box . 96
v
© ISO/IEC 2015 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 14496-12:2015(E)
8.14 Sub tracks . 97
8.14.1 Introduction . 97
8.14.2 Backward compatibility . 97
8.14.3 Sub Track box . 98
8.14.4 Sub Track Information box . 98
8.14.5 Sub Track Definition box . 100
8.14.6 Sub Track Sample Group box . 100
8.15 Post-decoder requirements on media . 100
8.15.1 General . 100
8.15.2 Transformation . 101
8.15.3 Restricted Scheme Information box . 102
8.15.4 Scheme for stereoscopic video arrangements . 102
8.16 Segments . 104
8.16.1 Introduction . 104
8.16.2 Segment Type Box . 104
8.16.3 Segment Index Box . 105
8.16.4 Subsegment Index Box . 109
8.16.5 Producer Reference Time Box . 111
8.17 Support for Incomplete Tracks . 112
8.17.1 General . 112
8.17.2 Transformation . 113
8.17.3 Complete Track Information Box . 114
9 Hint Track Formats . 114
9.1 RTP and SRTP Hint Track Format . 114
9.1.1 Introduction . 114
9.1.2 Sample Description Format . 115
9.1.3 Sample Format . 117
9.1.4 SDP Information . 119
9.1.5 Statistical Information . 120
9.2 ALC/LCT and FLUTE Hint Track Format . 121
9.2.1 Introduction . 121
9.2.2 Design principles . 122
9.2.3 Sample Description Format . 123
9.2.4 Sample Format . 124
9.3 MPEG-2 Transport Hint Track Format . 127
9.3.1 Introduction . 127
9.3.2 Design Principles . 128
9.3.3 Sample Description Format . 130
9.3.4 Sample Format . 132
9.3.5 Protected MPEG 2 Transport Stream Hint Track . 134
9.4 RTP, RTCP, SRTP and SRTCP Reception Hint Tracks . 134
9.4.1 RTP Reception Hint Track . 134
9.4.2 RTCP Reception Hint Track .
...