ISO/IEC 23001-10:2020/Amd 1:2021

Information technology — MPEG systems technologies — Part 10: Carriage of timed metadata metrics of media in ISO base media file format — Amendment 1: Support for content-guided transcoding and spatial relationship of immersive media

Technologies de l'information — Technologies des systèmes MPEG — Partie 10: Transport de métriques de métadonnées de temporisation de supports au format de fichier de support en base ISO — Amendement 1: Support pour transcodage guidé par le contenu et relation spatiale des média immersifs

General Information

• Status: Published
• Publication Date: 19-Sep-2021
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29/WG 3 - MPEG Systems
• Current Stage: 6060 - International Standard published
• Start Date: 20-Sep-2021
• Due Date: 18-Aug-2021
• Completion Date: 20-Sep-2021

Relations

• Amends: ISO/IEC 23001-10:2020 - Information technology — MPEG systems technologies — Part 10: Carriage of timed metadata metrics of media in ISO base media file format
• Effective Date: 11-Dec-2021

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 23001-10
Second edition
2020-04
AMENDMENT 1
2021-09
Information technology — MPEG
systems technologies —
Part 10:
Carriage of timed metadata metrics of
media in ISO base media file format
AMENDMENT 1: Support for content-
guided transcoding and spatial
relationship of immersive media
Technologies de l'information — Technologies des systèmes MPEG —
Partie 10: Transport de métriques de métadonnées de temporisation
de supports au format de fichier de support en base ISO
AMENDEMENT 1: Support pour transcodage guidé par le contenu et
relation spatiale des média immersifs
Reference number
ISO/IEC 23001-10:2020/Amd.1:2021(E)
©
ISO/IEC 2021

---------------------- Page: 1 ----------------------
ISO/IEC 23001-10:2020/Amd.1:2021(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 23001-10:2020/Amd.1:2021(E)

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives or www .iec .ch/ members
_experts/ refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC
list of patent declarations received (see patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso .org/
iso/ foreword .html. In the IEC, see www .iec .ch/ understanding -standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 23001 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html and www .iec .ch/ national
-committees.
© ISO/IEC 2021 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC 23001-10:2020/Amd.1:2021(E)
Information technology — MPEG systems technologies —
Part 10:
Carriage of timed metadata metrics of media in ISO base
media file format
AMENDMENT 1: Support for content-guided transcoding and
spatial relationship of immersive media
5.2.2
Replace:
“The decoder power indication metadata sample entry shall be as follows.“
with:
“The decoder-power indication metadata uses the following sample entry:“
Replace:
“The decoder-power indication sample shall conform to the following syntax:“
with:
“The decoder-power indication samples use the following syntax:“
5.3.2.2
Replace:
“Display power indication metadata shall use the following sample entry:
with:
“The display-power indication metadata uses the following sample entry:
Replace:
“The display power indication sample shall use the following syntax“
with:
“The decoder-power indication samples use the following syntax:“
5.3.3.2
Replace:
“The display fine control metadata sample entry shall store static metadata as follows.“
© ISO/IEC 2021 – All rights reserved 1

---------------------- Page: 4 ----------------------
ISO/IEC 23001-10:2020/Amd.1:2021(E)

with:
“The display fine control metadata uses the following sample entry:“
Replace:
“The display fine control metadata sample shall use the following syntax:“
with:
“The display fine control metadata samples use the following syntax:“
Clause 6
Add new Clauses 7 and 8 at the end of Clause 6 as follows:
7  Carriage of timed metadata for content-guided transcoding
7.1  General
The metadata provide metrics on the streams that may be produced by a transcoding task. The
metadata are encapsulated into timed metadata tracks of ISOBMFF file. Two types of sample entry are
proposed to match two use-cases of content-guided transcoding. For an optimal usage of the metadata,
the metadata producer needs to be informed of the transcoding function that is used in the network.
The detailed description of the transcoding function is out of scope of this specification.
The timed metadata track is linked to the track it describes by means of a ‘cdsc’ (content describes)
track reference. The synchronisation of metadata when using CMAF standard is based on the same
timed metadata tracks.
7.2  Recommended video format metadata
7.2.1  Definition
Sample Entry Type: 'rvrf'
Container: Sample Description Box ('stsd')
Mandatory: No
Quantity: 0 or 1
This metadata indicates the recommended video resolution and frame rate at different bitrates over
the sample duration.
7.2.2  Syntax
Recommended Video Format Metadata use the following sample entry:
class RecVideoFormatMetaDataSampleEntry()
   extends MetaDataSampleEntry ('rvrf') {
  RecVideoFormatConfigurationBox();
}
class Device () {
  unsigned int(5) device_class;
  unsigned int(3) reserved = 0;
  unsigned int(32) codec_type;
  unsigned int(8) codec_profile;
}
aligned(8) class RecVideoFormatConfigurationBox
   extends FullBox('rvfc', version = 0, flags = 0) {
  unsigned int(5) num_devices;
2 © ISO/IEC 2021 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 23001-10:2020/Amd.1:2021(E)

  unsigned int(3) reserved = 0;
  unsigned int(4) num_bitrates;
  unsigned int(3) reserved = 0;
  unsigned int(1) rate_ctl_type;
  unsigned int(8) max_peak_bitrate_var_from_avg;
  for (i = 1; i <= num_devices; i++) {
   Device dev[i];
  }
  for (i = 1; i <= num_bitrates; i++)
   unsigned int(16) bitrate[i];
}
The Recommended Video Format samples use the following syntax:
class VideoFormat () {
  unsigned int(16) picture_width;
  unsigned int(16) picture_height;
  unsigned int(16) frame_rate;
}
class RecVideoFormatMetaDataSample (int num_devices, int num_bitrates) {
  for (i = 1; i <= num_devices; i++)
   for (j = 1; j <= num_bitrates; j++)
VideoFormat rec_video_fmt[i][j];
}
}
7.2.3  Semantics
device_class specifies a service-related identifier f
...

FINAL
ISO/IEC
AMENDMENT
DRAFT
23001-10:2020
FDAM 1
ISO/IEC JTC 1/SC 29
Information technology — MPEG
Secretariat: JISC
systems technologies —
Voting begins on:
2021-06-28
Part 10:
Voting terminates on:
Carriage of timed metadata metrics of
2021-08-23
media in ISO base media file format
AMENDMENT 1: Support for content-
guided transcoding and spatial
relationship of immersive media
Technologies de l'information — Technologies des systèmes MPEG —
Partie 10: Transport de métriques de métadonnées de temporisation
de supports au format de fichier de support en base ISO
AMENDEMENT 1
RECIPIENTS OF THIS DRAFT ARE INVITED TO
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
Reference number
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO-
ISO/IEC 23001-10:2020/FDAM 1:2021(E)
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN-
DARDS TO WHICH REFERENCE MAY BE MADE IN
©
NATIONAL REGULATIONS. ISO/IEC 2021

---------------------- Page: 1 ----------------------
ISO/IEC 23001-10:2020/FDAM 1:2021(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 23001-10:2020/FDAM 1:2021(E)

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives or www .iec .ch/ members
_experts/ refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC
list of patent declarations received (see patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso .org/
iso/ foreword .html. In the IEC, see www .iec .ch/ understanding -standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 23001 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html and www .iec .ch/ national
-committees.
© ISO/IEC 2021 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC 23001-10:2020/FDAM 1:2021(E)
Information technology — MPEG systems technologies —
Part 10:
Carriage of timed metadata metrics of media in ISO base
media file format
AMENDMENT 1: Support for content-guided transcoding and
spatial relationship of immersive media

5.2.2
Replace:
“The decoder power indication metadata sample entry shall be as follows.“
with:
“The decoder-power indication metadata uses the following sample entry:“
Replace:
“The decoder-power indication sample shall conform to the following syntax:“
with:
“The decoder-power indication samples use the following syntax:“

5.3.2.2
Replace:
“Display power indication metadata shall use the following sample entry:
with:
“The display-power indication metadata uses the following sample entry:
Replace:
“The display power indication sample shall use the following syntax“
with:
“The decoder-power indication samples use the following syntax:“

5.3.3.2
Replace:
“The display fine control metadata sample entry shall store static metadata as follows.“
© ISO/IEC 2021 – All rights reserved 1

---------------------- Page: 4 ----------------------
ISO/IEC 23001-10:2020/FDAM 1:2021(E)

with:
“The display fine control metadata uses the following sample entry:“
Replace:
“The display fine control metadata sample shall use the following syntax:“
with:
“The display fine control metadata samples use the following syntax:“

Clause 6
Add new Clauses 7 and 8 at the end of Clause 6 as follows:

7  Carriage of timed-metadata for content-guided transcoding
7.1  General
The metadata provide metrics on the streams that may be produced by a transcoding task. The
metadata are encapsulated into timed-metadata tracks of ISOBMFF file. Two types of sample entry are
proposed to match two use-cases of content-guided transcoding. For an optimal usage of the metadata,
the metadata producer needs to be informed of the transcoding function that is used in the network.
The detailed description of the transcoding function is out of scope of this specification.
The timed metadata track is linked to the track it describes by means of a ‘cdsc’ (content describes)
track reference. The synchronisation of metadata when using CMAF standard is based on the same
timed-metadata tracks.
7.2  Recommended video format metadata
7.2.1  Definition
Sample Entry Type: 'rvrf'
Container: Sample Description Box ('stsd')
Mandatory: No
Quantity: 0 or 1
This metadata indicates the recommended video resolution and frame rate at different bitrates over
the sample duration.
7.2.2  Syntax
Recommended Video Format Metadata use the following sample entry:
class RecVideoFormatMetaDataSampleEntry()
   extends MetaDataSampleEntry ('rvrf') {
  RecVideoFormatConfigurationBox();
}
class Device () {
  unsigned int(5) device_class;
  unsigned int(3) reserved = 0;
  unsigned int(32) codec_type;
  unsigned int(8) codec_profile;
}
aligned(8) class RecVideoFormatConfigurationBox
   extends FullBox('rvfc', version = 0, flags = 0) {
  unsigned int(5) num_devices;
2 © ISO/IEC 2021 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 23001-10:2020/FDAM 1:2021(E)

  unsigned int(3) reserved = 0;
  unsigned int(4) num_bitrates;
  unsigned int(3) reserved = 0;
  unsigned int(1) rate_ctl_type;
  unsigned int(8) max_peak_bitrate_var_from_avg;
  for (i = 1; i <= num_devices; i++) {
   Device dev[i];
  }
  for (i = 1; i <= num_bitrates; i++)
   unsigned int(16) bitrate[i];
}
The Recommended Video Format samples use the following syntax:
class VideoFormat () {
  unsigned int(16) picture_width;
  unsigned int(16) picture_height;
  unsigned int(16) frame_rate;
}
class RecVideoFormatMetaDataSample (in
...