ISO/IEC 23090-2:2021

Information technology — Coded representation of immersive media — Part 2: Omnidirectional media format

This document specifies the omnidirectional media format for coding, storage, delivery and rendering of omnidirectional media, including video, images, audio and timed text. Omnidirectional image or video can contain graphics elements generated by computer graphics but encoded as image or video. Multiple viewpoints, each corresponding to an omnidirectional camera, are supported. The document also specifies storage and delivery of overlay images or video intended to be rendered over the omnidirectional background image or video.

Technologies de l'information — Représentation codée de média immersifs — Partie 2: Format de média omnidirectionnel

General Information

• Status: Withdrawn
• Publication Date: 06-Jul-2021
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Current Stage: 9599 - Withdrawal of International Standard
• Start Date: 09-Jun-2023
• Completion Date: 09-Jun-2023

Relations

• Revised: ISO/IEC 23090-2:2023 - Information technology — Coded representation of immersive media — Part 2: Omnidirectional media format
• Effective Date: 06-Jun-2022
• Revises: ISO/IEC 23090-2:2019 - Information technology -- Coded representation of immersive media
• Effective Date: 23-Apr-2020

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 23090-2
Second edition
2021-07
Information technology — Coded
representation of immersive media —
Part 2:
Omnidirectional media format
Technologies de l'information — Représentation codée de média
immersifs —
Partie 2: Format de média omnidirectionnel
Reference number
©
ISO/IEC 2021
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

Contents Page
Foreword. vii
Introduction . viii
1 Scope . 1
2 Normative references . 1
3 Terms, definitions, abbreviated terms and conventions . 2
3.1 Terms and definitions .2
3.2 Abbreviated terms . 10
3.3 Conventions . 10
3.3.1 Arithmetic operators and mathematical functions . 10
3.3.2 Order of operation precedence . 12
3.3.3 Range notation . 12
3.3.4 Variables . 13
3.3.5 Processes . 13
3.3.6 Conventions for indicating the number of boxes in tables . 13
4 Overview . 13
4.1 Organization of this clause . 13
4.2 Overall architecture . 14
4.3 Projected omnidirectional video/images . 16
4.3.1 General . 16
4.3.2 Stitching, rotation, projection, and region-wise packing . 16
4.4 Fisheye omnidirectional video/images . 17
4.5 Mesh omnidirectional video . 18
4.6 Streaming methods for omnidirectional video . 18
4.6.1 Overview . 18
4.6.2 Tile-based streaming with viewport-specific author-driven binding . 20
4.6.3 Tile-based streaming with free-viewport author-driven binding. 20
4.6.4 Tile-based streaming with late binding . 21
4.7 Additional functionalities . 22
4.8 Conformance and interoperability . 23
4.8.1 General . 23
4.8.2 Media profiles . 23
4.8.3 Presentation profiles . 25
4.8.4 Toolset brands . 25
4.8.5 Summary of referenceable code points . 26
5 Omnidirectional video projection and region-wise packing . 32
5.1 Coordinate system . 32
5.2 Omnidirectional projection formats . 33
5.2.1 General . 33
5.2.2 Equirectangular projection for one sample location . 34
5.2.3 Cubemap projection for one sample location. 34
5.3 Conversion from the local coordinate axes to the global coordinate axes . 36
5.4 Region-wise packing formats . 37
5.4.1 General . 37
5.4.2 Conversion of one sample location for rectangular region-wise packing . 38
6 Fisheye omnidirectional video . 39
6.1 General . 39
6.2 The FisheyeVideoEssentialInfoStruct() syntax structure . 39
6.2.1 Syntax . 39
6.2.2 Semantics . 40
6.3 The FisheyeVideoSupplementalInfoStruct() syntax structure . 43
6.3.1 Syntax . 43
6.3.2 Semantics . 44
© ISO/IEC 2021 – All rights reserved iii

7 Omnidirectional media storage and metadata signalling in the ISOBMFF . 48
7.1 Generic extensions to the ISOBMFF . 48
7.1.1 Indication of a track not intended to be presented alone . 49
7.1.2 Association of timed metadata tracks with media tracks or track groups . 49
7.1.3 Clarifications on the stereo video box . 49
7.1.4 Generic sub-picture track grouping extensions . 49
7.1.5 Track reference indicating a track providing shadow sync samples . 53
7.1.6 Media offset box . 54
7.2 Generic extensions to ISO/IEC 14496-15 . 55
7.2.1 Containing of SpatialRelationship2DDescriptionBox for HEVC tile base track and
HEVC tile tracks . 56
7.3 OMAF-specific extensions to the ISOBMFF . 56
7.3.1 Sync samples in timed metadata tracks . 56
7.4 OMAF-specific extensions to ISO/IEC 14496-15 . 56
7.4.1 Coverage information box in an HEVC tile base track . 56
7.5 Structures and semantics that are common for video tracks and image items . 56
7.5.1 Semantics of sample locations within a decoded picture . 56
7.5.2 Projection format structure . 60
7.5.3 Region-wise packing structure . 60
7.5.4 Rotation structure . 68
7.5.5 Content coverage structure . 69
7.5.6 Sphere region structure . 70
7.6 Restricted video schemes for omnidirectional video . 73
7.6.1 Scheme types . 73
7.6.2 Projected omnidirectional video box . 78
7.6.3 Fisheye omnidirectional video box . 79
7.6.4 Region-wise packing box . 80
7.6.5 Rotation box .
...

INTERNATIONAL ISO/IEC
STANDARD 23090-2
Second edition
2021-07
Information technology — Coded
representation of immersive media —
Part 2:
Omnidirectional media format
Technologies de l'information — Représentation codée de média
immersifs —
Partie 2: Format de média omnidirectionnel
Reference number
©
ISO/IEC 2021
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

Contents Page
Foreword. vii
Introduction . viii
1 Scope . 1
2 Normative references . 1
3 Terms, definitions, abbreviated terms and conventions . 2
3.1 Terms and definitions .2
3.2 Abbreviated terms . 10
3.3 Conventions . 10
3.3.1 Arithmetic operators and mathematical functions . 10
3.3.2 Order of operation precedence . 12
3.3.3 Range notation . 12
3.3.4 Variables . 13
3.3.5 Processes . 13
3.3.6 Conventions for indicating the number of boxes in tables . 13
4 Overview . 13
4.1 Organization of this clause . 13
4.2 Overall architecture . 14
4.3 Projected omnidirectional video/images . 16
4.3.1 General . 16
4.3.2 Stitching, rotation, projection, and region-wise packing . 16
4.4 Fisheye omnidirectional video/images . 17
4.5 Mesh omnidirectional video . 18
4.6 Streaming methods for omnidirectional video . 18
4.6.1 Overview . 18
4.6.2 Tile-based streaming with viewport-specific author-driven binding . 20
4.6.3 Tile-based streaming with free-viewport author-driven binding. 20
4.6.4 Tile-based streaming with late binding . 21
4.7 Additional functionalities . 22
4.8 Conformance and interoperability . 23
4.8.1 General . 23
4.8.2 Media profiles . 23
4.8.3 Presentation profiles . 25
4.8.4 Toolset brands . 25
4.8.5 Summary of referenceable code points . 26
5 Omnidirectional video projection and region-wise packing . 32
5.1 Coordinate system . 32
5.2 Omnidirectional projection formats . 33
5.2.1 General . 33
5.2.2 Equirectangular projection for one sample location . 34
5.2.3 Cubemap projection for one sample location. 34
5.3 Conversion from the local coordinate axes to the global coordinate axes . 36
5.4 Region-wise packing formats . 37
5.4.1 General . 37
5.4.2 Conversion of one sample location for rectangular region-wise packing . 38
6 Fisheye omnidirectional video . 39
6.1 General . 39
6.2 The FisheyeVideoEssentialInfoStruct() syntax structure . 39
6.2.1 Syntax . 39
6.2.2 Semantics . 40
6.3 The FisheyeVideoSupplementalInfoStruct() syntax structure . 43
6.3.1 Syntax . 43
6.3.2 Semantics . 44
© ISO/IEC 2021 – All rights reserved iii

7 Omnidirectional media storage and metadata signalling in the ISOBMFF . 48
7.1 Generic extensions to the ISOBMFF . 48
7.1.1 Indication of a track not intended to be presented alone . 49
7.1.2 Association of timed metadata tracks with media tracks or track groups . 49
7.1.3 Clarifications on the stereo video box . 49
7.1.4 Generic sub-picture track grouping extensions . 49
7.1.5 Track reference indicating a track providing shadow sync samples . 53
7.1.6 Media offset box . 54
7.2 Generic extensions to ISO/IEC 14496-15 . 55
7.2.1 Containing of SpatialRelationship2DDescriptionBox for HEVC tile base track and
HEVC tile tracks . 56
7.3 OMAF-specific extensions to the ISOBMFF . 56
7.3.1 Sync samples in timed metadata tracks . 56
7.4 OMAF-specific extensions to ISO/IEC 14496-15 . 56
7.4.1 Coverage information box in an HEVC tile base track . 56
7.5 Structures and semantics that are common for video tracks and image items . 56
7.5.1 Semantics of sample locations within a decoded picture . 56
7.5.2 Projection format structure . 60
7.5.3 Region-wise packing structure . 60
7.5.4 Rotation structure . 68
7.5.5 Content coverage structure . 69
7.5.6 Sphere region structure . 70
7.6 Restricted video schemes for omnidirectional video . 73
7.6.1 Scheme types . 73
7.6.2 Projected omnidirectional video box . 78
7.6.3 Fisheye omnidirectional video box . 79
7.6.4 Region-wise packing box . 80
7.6.5 Rotation box .
...