Information technology — Coded representation of immersive media — Part 10: Carriage of visual volumetric video-based coding data

This document specifies carriage of coded media representations which comply with visual volumetric video-based coding and video-based point cloud compression (specified in ISO/IEC 23090-5).

Technologies de l'information — Représentation codée de média immersifs — Partie 10: Transport de données de codage basé sur la vidéo volumétrique

General Information

Status
Published
Publication Date
17-May-2022
Current Stage
4060 - Close of voting
Start Date
29-Dec-2020
Completion Date
28-Dec-2020
Ref Project

Buy Standard

Standard
ISO/IEC 23090-10:2022 - Information technology — Coded representation of immersive media — Part 10: Carriage of visual volumetric video-based coding data Released:5/18/2022
English language
85 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO/IEC
STANDARD 23090-10
First edition
2022-05
Information technology — Coded
representation of immersive media —
Part 10:
Carriage of visual volumetric video-
based coding data
Technologies de l'information — Représentation codée de média
immersifs —
Partie 10: Transport de données de codage basé sur la vidéo
volumétrique
Reference number
ISO/IEC 23090-10:2022(E)
© ISO/IEC 2022
---------------------- Page: 1 ----------------------
ISO/IEC 23090-10:2022(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2022

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on

the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below

or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
© ISO/IEC 2022 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 23090-10:2022(E)
Contents Page

Foreword ....................................................................................................................................................................................................................................... vi

Introduction .............................................................................................................................................................................................................................vii

1 Scope ................................................................................................................................................................................................................................. 1

2 Normative references ..................................................................................................................................................................................... 1

3 Terms and definitions .................................................................................................................................................................................... 1

4 Abbreviated terms ............................................................................................................................................................................................. 2

5 Overview ....................................................................................................................................................................................................................... 3

5.1 General ........................................................................................................................................................................................................... 3

5.2 Overall architecture for carriage of V3C data ............................................................................................................ 3

5.3 Summary of referenceable code points ............................................................................................................................ 4

5.3.1 Brands .......................................................................................................................................................................................... 4

5.3.2 Uniform resource names ............................................................................................................................................. 4

5.3.3 Restricted scheme types ............................................................................................................................................. 4

5.3.4 Sample entry types .......................................................................................................................................................... 4

5.3.5 Box types ................................................................................................................................................................................... 5

5.3.6 Track reference types .................................................................................................................................................... 6

5.3.7 Track grouping types...................................................................................................................................................... 6

5.3.8 Entity grouping types .................................................................................................................................................... 6

5.3.9 Sample grouping types ................................................................................................................................................. 7

6 Volumetric media ................................................................................................................................................................................................7

6.1 General ........................................................................................................................................................................................................... 7

6.2 Volumetric visual media ................................................................................................................................................................ 7

6.3 Volumetric visual media header ............................................................................................................................................. 7

6.3.1 Definition .................................................................................................................................................................................. 7

6.3.2 Syntax ........................................................................................................................................... ................................................ 7

6.3.3 Semantics .................................................................................................................................................................................. 7

6.4 Volumetric visual sample entry .............................................................................................................................................. 7

6.4.1 Definition .................................................................................................................................................................................. 7

6.4.2 Syntax ........................................................................................................................................... ................................................ 7

6.4.3 Semantics .................................................................................................................................................................................. 8

6.5 Volumetric visual sample group entry .............................................................................................................................. 8

6.6 Volumetric visual samples ........................................................................................................................................................... 8

7 Carriage of visual volumetric video-based coding data ............................................................................................ 8

7.1 General ........................................................................................................................................................................................................... 8

7.2 Common boxes and data structures .................................................................................................................................... 8

7.2.1 V3C decoder configuration record ..................................................................................................................... 8

7.2.2 V3C decoder configuration box .......................................................................................................................... 10

7.2.3 V3C unit header box ........................................................................................................................................... ........... 10

7.2.4 V3C atlas parameter set sample group ........................................................................................................ 10

7.2.5 Object switch alternatives box ........................................................................................................................... 11

7.3 Single track encapsulation of V3C data .......................................................................................................................... 11

7.3.1 General ..................................................................................................................................................................................... 11

7.3.2 V3C bitstream sample entry .................................................................................................................................12

7.3.3 V3C bitstream track sample format ...............................................................................................................12

7.4 Multi-track encapsulation of V3C data ........................................................................................................................... 13

7.4.1 General .....................................................................................................................................................................................13

7.4.2 V3C atlas sample entry .............................................................................................................................................. 14

7.4.3 V3C atlas tile sample entry..................................................................................................................................... 16

7.4.4 V3C atlas sample format ........................................................................................................................................... 17

7.4.5 V3C video component track ................................................................................................................................... 18

7.4.6 Track references............................................................................................................................................................... 19

7.4.7 Track alternatives and track grouping ........................................................................................................ 19

iii
© ISO/IEC 2022 – All rights reserved
---------------------- Page: 3 ----------------------
ISO/IEC 23090-10:2022(E)

7.4.8 Playout groups ...................................................................................................................................................................20

7.4.9 Summary ................................................................................................................................................................................20

8 Carriage of non-timed visual volumetric video-based coding data ...........................................................21

8.1 General ........................................................................................................................................................................................................ 21

8.2 V3C atlas item ....................................................................................................................................................................................... 22

8.3 V3C atlas tile item ............................................................................................................................................................................. 22

8.4 V3C component item ........................................................................................................................................... ............................22

8.5 V3C-related item properties ....................................................................................................................................................23

8.5.1 General .....................................................................................................................................................................................23

8.5.2 V3C configuration item property ..................................................................................................................... 23

8.5.3 V3C unit header item property ........................................................................................................................... 23

8.5.4 V3C atlas tile configuration item property .............................................................................................. 24

8.5.5 Playout groups ................................................................................................................................................................... 24

9 Partial access of volumetric visual data ..................................................................................................................................25

9.1 General ........................................................................................................................................................................................................ 25

9.2 Common data structures............................................................................................................................................................ 25

9.2.1 3D vector ................................................................................................................................................................................ 25

9.2.2 Spatial region bounding box ................................................................................................................................. 25

9.2.3 Tile mapping ........................................................................................................................................................................26

9.2.4 Object collection .............................................................................................................................................................. 27

9.3 Spatial region information structure ..............................................................................................................................29

9.3.1 Definition ...............................................................................................................................................................................29

9.3.2 Syntax ........................................................................................................................................... .............................................29

9.3.3 Semantics ............................................................................................................................................................................... 29

9.4 V3C tile video component track grouping ...................................................................................................................29

9.4.1 Definition ...............................................................................................................................................................................29

9.4.2 Syntax ........................................................................................................................................... .............................................30

9.4.3 Semantics ............................................................................................................................................................................... 30

9.5 Volumetric media bounding box .......................................................................................................................................... 30

9.5.1 Definition ...............................................................................................................................................................................30

9.5.2 Syntax ........................................................................................................................................... ............................................. 31

9.6 Static spatial region collection box ................................................................................................................................... 31

9.6.1 Definition ............................................................................................................................................................................... 31

9.6.2 Syntax ........................................................................................................................................... ............................................. 31

9.6.3 Semantics ............................................................................................................................................................................... 31

9.7 Dynamic spatial region information ................................................................................................................................ 31

9.7.1 General ..................................................................................................................................................................................... 31

9.7.2 Sample entry ....................................................................................................................................................................... 32

9.7.3 Sample format .................................................................................................................................................................... 32

9.7.4 Sync samples ....................................................................................................................................................................... 32

9.8 Storage of atlas tiles using NALUMapEntry............................................................................................................... 32

10 Viewport information ..................................................................................................................................................................................33

10.1 General ........................................................................................................................................................................................................ 33

10.2 Structures ................................................................................................................................................................................................ 33

10.2.1 Extrinsic camera information ............................................................................................................................. 33

10.2.2 Intrinsic camera information ...............................................................................................................................34

10.2.3 Viewport information ................................................................................................................................................. 35

10.3 Viewport information timed-metadata track .......................................................................................................... 35

10.3.1 General ..................................................................................................................................................................................... 35

10.3.2 Viewport information sample entry .............................................................................................................. 35

10.3.3 Viewport information sample format .......................................................................................................... 37

11 Encapsulation and signalling in MPEG-DASH.....................................................................................................................38

11.1 Single track mode ..............................................................................................................................................................................38

11.2 Multi-track mode ...............................................................................................................................................................................38

11.2.1 General .....................................................................................................................................................................................38

11.2.2 V3C preselections ........................................................................................................................................................... 39

© ISO/IEC 2022 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 23090-10:2022(E)

11.2.3 V3C atlas tile preselections ....................................................................................................................................40

11.3 DASH MPD descriptors for V3C content ........................................................................................................................40

11.3.1 XML namespace and schema ................................................................................................................................40

11.3.2 V3C video component descriptor .....................................................................................................................40

11.3.3 V3C descriptor ................................................................................................................................................................... 43

11.4 Supporting multiple versions of a V3C media ..........................................................................................................44

11.5 Switching codecs for V3C video components ...........................................................................................................44

11.6 Signalling spatial regions for partial access .............................................................................................................44

11.6.1 Static spatial regions ...................................................................................................................................................44

11.6.2 Dynamic spatial regions ........................................................................................................................................... 47

11.7 Signalling recommended viewports ................................................................................................................................ 47

11.7.1 Static viewports ............................................................................................................................................................... 47

11.7.2 Dynamic viewports.......................................................................................................................................................49

12 Encapsulation and signalling MMT ...............................................................................................................................................49

12.1 Introduction ...........................................................................................................................................................................................49

12.2 MMT signalling descriptors for V3C content ............................................................................................................50

12.2.1 Asset reference descriptor .....................................................................................................................................50

12.2.2 V3C Asset descriptor ................................................................................................................................................... 51

12.3 MMT signalling messages for V3C Content ................................................................................................................ 52

12.3.1 General ..................................................................................................................................................................................... 52

12.3.2 V3C Asset Group message ....................................................................................................................................... 52

12.3.3 V3C Selection message ...............................................................................................................................................54

12.3.4 V3C View Change Feedback message ............................................................................................................ 55

Annex A (normative) File format toolsets and brands ..................................................................................................................58

Annex B (normative) V3C DASH schema .......................................................................................................................................................59

Annex C (normative) MIME types and sub-parameters ...............................................................................................................61

Annex D (informative) DASH MPD examples ...........................................................................................................................................62

Annex E (informative) Partial access utilizing V3C volumetric annotation SEI message

family ............................................................................................................................................................................................................................77

Annex F (informative) Partial access using volumetric information timed-metadata tracks............80

Annex G (informative) Partial access for overlapping spatial subdivisions ..........................................................82

Annex H (informative) Examples of using alternate groups ...................................................................................................83

Bibliography .............................................................................................................................................................................................................................85

© ISO/IEC 2022 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 23090-10:2022(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that are

members of ISO or IEC participate in the development of International Standards through technical

committees established by the respective organization to deal with particular fields of technical

activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international

organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the

work.

The procedures used to develop this document and those intended for its further maintenance

are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria

needed for the different types of document should be noted. This document was drafted in

accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or

www.iec.ch/members_experts/refdocs).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents) or the IEC

list of patent declarations received (see https://patents.iec.ch).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to

the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see

www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,

Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.

A list of all parts in the ISO/IEC 23090 series can be found on the ISO and IEC websites.

Any feedback or questions on this document should be directed to the user’s national standards

body. A complete listing of these bodies can be found at www.iso.org/members.html and

www.iec.ch/national-committees.
© ISO/IEC 2022 – All rights reserved
---------------------- Page: 6 ----------------------
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.