Information technology -- Coded representation of immersive media

Technologies de l'information -- Représentation codée de média immersifs

General Information

Status
Published
Current Stage
4020 - DIS ballot initiated: 5 months
Start Date
05-Oct-2020
Completion Date
05-Oct-2020
Ref Project

Buy Standard

Draft
ISO/IEC DIS 23090-10 - Information technology -- Coded representation of immersive media
English language
48 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

DRAFT INTERNATIONAL STANDARD
ISO/IEC DIS 23090-10
ISO/IEC JTC 1/SC 29 Secretariat: JISC
Voting begins on: Voting terminates on:
2020-10-05 2020-12-28
Information technology — Coded representation of
immersive media —
Part 10:
Carriage of visual volumetric video-based coding data
ICS: 35.040.40
THIS DOCUMENT IS A DRAFT CIRCULATED
FOR COMMENT AND APPROVAL. IT IS
THEREFORE SUBJECT TO CHANGE AND MAY
NOT BE REFERRED TO AS AN INTERNATIONAL
STANDARD UNTIL PUBLISHED AS SUCH.
IN ADDITION TO THEIR EVALUATION AS
BEING ACCEPTABLE FOR INDUSTRIAL,
This document is circulated as received from the committee secretariat.
TECHNOLOGICAL, COMMERCIAL AND
USER PURPOSES, DRAFT INTERNATIONAL
STANDARDS MAY ON OCCASION HAVE TO
BE CONSIDERED IN THE LIGHT OF THEIR
POTENTIAL TO BECOME STANDARDS TO
WHICH REFERENCE MAY BE MADE IN
Reference number
NATIONAL REGULATIONS.
ISO/IEC DIS 23090-10:2020(E)
RECIPIENTS OF THIS DRAFT ARE INVITED
TO SUBMIT, WITH THEIR COMMENTS,
NOTIFICATION OF ANY RELEVANT PATENT
RIGHTS OF WHICH THEY ARE AWARE AND TO
PROVIDE SUPPORTING DOCUMENTATION. ISO/IEC 2020
---------------------- Page: 1 ----------------------
ISO 23090-10:2020(E)
ISO/IEC DIS 23090-10:2020(E)
Contents

Foreword ...................................................................................................................................................................... vi

Introduction ................................................................................................................................................................ vii

1 Scope ......................................................................................................................................................................... 8

2 Normative references ......................................................................................................................................... 8

3 Terms and definitions ........................................................................................................................................ 8

4 Abbreviations ........................................................................................................................................................ 9

5 Volumetric media ................................................................................................................................................. 9

5.1 Volumetric visual media .................................................................................................................................... 9

5.1.1 General .............................................................................................................................................................. 9

5.1.2 Volumetric visual media header ............................................................................................................ 10

5.1.3 Volumetric visual sample entry ............................................................................................................. 10

5.1.4 Volumetric visual samples ....................................................................................................................... 10

6 Carriage of Visual Volumetric Video-based Coding Data ..................................................................... 10

6.1 General .................................................................................................................................................................. 10

6.2 Common boxes and data structures ........................................................................................................... 11

6.2.1 V3C decoder configuration record ........................................................................................................ 11

6.2.2 V3C decoder configuration box .............................................................................................................. 12

6.2.3 V3C unit header box ................................................................................................................................... 12

6.2.4 V3C atlas parameter set sample group ................................................................................................ 13

6.3 Single track encapsulation of V3C data ...................................................................................................... 13

6.3.1 General ........................................................................................................................................................... 13

6.3.2 V3C bitstream track ................................................................................................................................... 14

6.4 Multi-track encapsulation of V3C data ....................................................................................................... 15

6.4.1 General ........................................................................................................................................................... 15

6.4.2 V3C tracks ...................................................................................................................................................... 17

6.4.3 V3C atlas tile tracks .................................................................................................................................... 18

6.4.4 V3C sample format ..................................................................................................................................... 19

6.4.5 Video-encoded V3C component tracks ................................................................................................ 20

6.4.6 Track references ......................................................................................................................................... 20

6.4.7 Track alternatives and track grouping ................................................................................................ 21

6.4.8 Playout groups ............................................................................................................................................. 21

6.4.9 Summary ........................................................................................................................................................ 22

7 Carriage of non-timed Visual Volumetric Video-based Coding Data ............................................... 23

7.1 General .................................................................................................................................................................. 23

7.2 V3C Items ............................................................................................................................................................. 24

7.3 V3C Unit Item ...................................................................................................................................................... 24

7.4 V3C-related item properties .......................................................................................................................... 24

7.4.1 V3C configuration item property ........................................................................................................... 25

7.4.2 V3C unit header item property .............................................................................................................. 25

COPYRIGHT PROTECTED DOCUMENT

8 Partial Access of Volumetric Visual Data .................................................................................................. 26

8.1 Spatial region information structure ......................................................................................................... 26

© ISO/IEC 2020

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may 8.1.1 Definition ....................................................................................................................................................... 26

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

8.1.2 Syntax .............................................................................................................................................................. 26

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

8.1.3 Semantics ....................................................................................................................................................... 26

below or ISO’s member body in the country of the requester.

8.2 Spatial region track grouping ....................................................................................................................... 26

ISO copyright office

CP 401 • Ch. de Blandonnet 8 8.2.1 Definition ....................................................................................................................................................... 26

CH-1214 Vernier, Geneva

8.2.2 Syntax .............................................................................................................................................................. 27

Phone: +41 22 749 01 11

8.2.3 Semantics ....................................................................................................................................................... 27

Fax: +41 22 749 09 47

8.3 Volumetric media bounding box .................................................................................................................. 27

Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
© ISO 2020 – All rights reserved iii
ii © ISO/IEC 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO 23090-10:2020(E)
Contents

Foreword ...................................................................................................................................................................... vi

Introduction ................................................................................................................................................................ vii

1 Scope ......................................................................................................................................................................... 8

2 Normative references ......................................................................................................................................... 8

3 Terms and definitions ........................................................................................................................................ 8

4 Abbreviations ........................................................................................................................................................ 9

5 Volumetric media ................................................................................................................................................. 9

5.1 Volumetric visual media .................................................................................................................................... 9

5.1.1 General .............................................................................................................................................................. 9

5.1.2 Volumetric visual media header ............................................................................................................ 10

5.1.3 Volumetric visual sample entry ............................................................................................................. 10

5.1.4 Volumetric visual samples ....................................................................................................................... 10

6 Carriage of Visual Volumetric Video-based Coding Data ..................................................................... 10

6.1 General .................................................................................................................................................................. 10

6.2 Common boxes and data structures ........................................................................................................... 11

6.2.1 V3C decoder configuration record ........................................................................................................ 11

6.2.2 V3C decoder configuration box .............................................................................................................. 12

6.2.3 V3C unit header box ................................................................................................................................... 12

6.2.4 V3C atlas parameter set sample group ................................................................................................ 13

6.3 Single track encapsulation of V3C data ...................................................................................................... 13

6.3.1 General ........................................................................................................................................................... 13

6.3.2 V3C bitstream track ................................................................................................................................... 14

6.4 Multi-track encapsulation of V3C data ....................................................................................................... 15

6.4.1 General ........................................................................................................................................................... 15

6.4.2 V3C tracks ...................................................................................................................................................... 17

6.4.3 V3C atlas tile tracks .................................................................................................................................... 18

6.4.4 V3C sample format ..................................................................................................................................... 19

6.4.5 Video-encoded V3C component tracks ................................................................................................ 20

6.4.6 Track references ......................................................................................................................................... 20

6.4.7 Track alternatives and track grouping ................................................................................................ 21

6.4.8 Playout groups ............................................................................................................................................. 21

6.4.9 Summary ........................................................................................................................................................ 22

7 Carriage of non-timed Visual Volumetric Video-based Coding Data ............................................... 23

7.1 General .................................................................................................................................................................. 23

7.2 V3C Items ............................................................................................................................................................. 24

7.3 V3C Unit Item ...................................................................................................................................................... 24

7.4 V3C-related item properties .......................................................................................................................... 24

7.4.1 V3C configuration item property ........................................................................................................... 25

7.4.2 V3C unit header item property .............................................................................................................. 25

8 Partial Access of Volumetric Visual Data .................................................................................................. 26

8.1 Spatial region information structure ......................................................................................................... 26

8.1.1 Definition ....................................................................................................................................................... 26

8.1.2 Syntax .............................................................................................................................................................. 26

8.1.3 Semantics ....................................................................................................................................................... 26

8.2 Spatial region track grouping ....................................................................................................................... 26

8.2.1 Definition ....................................................................................................................................................... 26

8.2.2 Syntax .............................................................................................................................................................. 27

8.2.3 Semantics ....................................................................................................................................................... 27

8.3 Volumetric media bounding box .................................................................................................................. 27

© ISO 2020 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO 23090-10:2020(E)

8.3.1 Definition ....................................................................................................................................................... 27

8.3.2 Syntax .............................................................................................................................................................. 27

8.4 Static spatial region information box ......................................................................................................... 27

8.4.1 Definition ....................................................................................................................................................... 27

8.4.2 Syntax .............................................................................................................................................................. 28

8.4.3 Semantics ....................................................................................................................................................... 28

8.5 Dynamic spatial region information ........................................................................................................... 28

8.5.1 General ........................................................................................................................................................... 28

8.5.2 Sample entry ................................................................................................................................................. 29

8.5.3 Sample format .............................................................................................................................................. 30

8.5.3.1 Syntax .............................................................................................................................................................. 30

8.5.3.2 Semantics ....................................................................................................................................................... 30

9 Encapsulation and signalling in MPEG-DASH .......................................................................................... 31

9.1 Single-Track DASH mode ................................................................................................................................ 31

9.2 Multi-track mode ............................................................................................................................................... 32

9.2.1 General ........................................................................................................................................................... 32

9.2.2 V3C preselections ....................................................................................................................................... 33

9.2.3 DASH MPD descriptors for V3C media in the namespace

"urn:mpeg:mpegI:v3c:2020" .......................................................................................................... 33

9.2.3.1 XML namespace and schema ................................................................................................................... 33

9.2.3.2 V3C component descriptor ...................................................................................................................... 33

9.2.3.3 V3C descriptor ............................................................................................................................................. 36

9.3 Supporting Multiple Versions of the V3C Media ..................................................................................... 36

9.4 Switching Codecs for V3C Components ...................................................................................................... 36

9.5 Partial Access ...................................................................................................................................................... 37

9.5.1 Static Spatial Regions ................................................................................................................................. 37

9.5.2 Dynamic Spatial Regions .......................................................................................................................... 39

10 Encapsulation and signalling in MMT ........................................................................................................ 39

Annex A (normative) File format toolsets and brands ................................................................................ 40

A.1 General .................................................................................................................................................................. 40

A.2 Single-track encapsulation of V3C data ..................................................................................................... 40

A.3 Multi-track encapsulation of V3C data ....................................................................................................... 40

Annex B (normative) V3C DASH Schema ......................................................................................................... 41

Annex C (normative) Sub-parameters for the MIME type ‘codecs’ parameter ................................... 42

C.1 General .................................................................................................................................................................. 42

C.2 V3C family ............................................................................................................................................................ 42

Annex D (informative) DASH MPD examples ................................................................................................. 43

D.1 Single track example ........................................................................................................................................ 43

D.2 Multi-track example (using Preselection element) ............................................................................... 43

D.3 Multi-track example (using Preselection descriptor) .......................................................................... 46

D.4 Multi-track example with spatial regions (using Preselection element) ....................................... 46

Annex E (informative) Expected process between file parser and V3C ................................................ 47

E.1 TBD ......................................................................................................................................................................... 47

Annex F (informative) Partial access utilizing V3C Volumetric Annotation SEI message

family .............................................................................................................................................................. 48

F.1 General .................................................................................................................................................................. 48

F.2 Content stored in a single atlas with a single tile ................................................................................... 48

F.3 Content stored in a single atlas with multiple tiles ............................................................................... 48

F.4 Content stored in multiple atlases .............................................................................................................. 49

Annex G (normative) Timed metadata for V3C data .................................................................................... 51

G.1 General .................................................................................................................................................................. 51

iv © ISO 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO 23090-10:2020(E)

G.2 Camera Information ......................................................................................................................................... 51

G.2.1 General ........................................................................................................................................................... 51

G.2.2 Structures ...................................................................................................................................................... 51

G.2.2.1 Syntax .............................................................................................................................................................. 51

G.2.2.2 Semantics ....................................................................................................................................................... 52

G.2.3 Camera Information Timed Metadata Track ..................................................................................... 53

G.2.3.1 General ........................................................................................................................................................... 53

G.2.3.2 Sample Entry ................................................................................................................................................ 53

G.2.3.3 Sample format .............................................................................................................................................. 54

© ISO 2020 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO 23090-10:2020(E)
Foreword

ISO (the International Organization for Standardization) is a worldwide federation of national standards

bodies (ISO member bodies). The work of preparing International Standards is normally carried out

through ISO technical committees. Each member body interested in a subject for which a technical

committee has been established has the right to be represented on that committee. International

organizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO

collaborates closely with the International Electrotechnical Commission (IEC) on all matters of

electrotechnical standardization.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the

different types of ISO documents should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).

Attention is drawn to the possibility that some of the elements of this document may be the subject of

patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of any

patent rights identified during the development of the document will be in the Introduction and/or on

the ISO list of patent declarations received (see www.iso.org/patents).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the World

Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see

www.iso.org/iso/foreword.html.

This document was prepared by Technical Committee ISO/IEC JTC 1 Information technology,

Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.

A list of all parts in the ISO 23090 series can be found on the ISO website.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www.iso.org/members.html.
vi ©
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.