ISO/IEC TR 23008-13:2017
(Main)Information technology — High efficiency coding and media delivery in heterogeneous environments — Part 13: MPEG media transport implementation guidelines
Information technology — High efficiency coding and media delivery in heterogeneous environments — Part 13: MPEG media transport implementation guidelines
ISO/IEC TR 23008-13:2017 provides technical guidelines for implementing and deploying systems based on ISO/IEC 23008‑1.
Technologies de l'information — Codage à haute efficacité et livraison des medias dans des environnements hétérogènes — Partie 13: Lignes directrices de mise en oeuvre du transport des medias MPEG
General Information
Relations
Standards Content (Sample)
TECHNICAL ISO/IEC TR
REPORT 23008-13
Second edition
2017-08
Corrected version
2017-10
Information technology — High
efficiency coding and media delivery
in heterogeneous environments —
Part 13:
MPEG media transport
implementation guidelines
Technologies de l'information — Codage à haute efficacité et livraison
des medias dans des environnements hétérogènes —
Partie 13: Lignes directrices de mise en oeuvre du transport des
medias MPEG
Reference number
ISO/IEC TR 23008-13:2017(E)
©
ISO/IEC 2017
---------------------- Page: 1 ----------------------
ISO/IEC TR 23008-13:2017(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2017, Published in Switzerland
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form
or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior
written permission. Permission can be requested from either ISO at the address below or ISO’s member body in the country of
the requester.
ISO copyright office
Ch. de Blandonnet 8 • CP 401
CH-1214 Vernier, Geneva, Switzerland
Tel. +41 22 749 01 11
Fax +41 22 749 09 47
copyright@iso.org
www.iso.org
ii © ISO/IEC 2017 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC TR 23008-13:2017(E)
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions, symbols and abbreviated terms . 1
4 Overview . 1
4.1 System overview . 1
4.2 Normative parts . 2
5 MMT function deployments . 3
5.1 General . 3
5.2 Object reconstruction . 3
5.2.1 General. 3
5.2.2 Recovery in MPU mode . 4
5.2.3 Recovery in GFD mode . 5
5.3 Default assets . 6
5.4 Low-delay live streaming . 6
5.5 Parallel processing in MMT sending and receiving entities . 9
5.5.1 Processing in MMT sending entity . 9
5.5.2 Processing in MMT receiving entity .11
5.6 MPU streaming for live services .13
5.6.1 MPU packetization.13
5.6.2 Sending of MPU and signalling message .16
5.7 Fast MMT session acquisition .17
5.8 Referencing and processing non-timed data .18
5.8.1 General.18
5.8.2 Resource grouping and referencing .19
5.8.3 Receiver handling .19
5.9 Media adaptation for quality control in MMTP .19
5.9.1 General.19
5.9.2 Parameters for media adaptation .19
5.9.3 Adaptation operation of MMT entity .20
5.10 Hybrid delivery in MMT .20
5.10.1 General.20
5.10.2 Classification of hybrid delivery .20
5.10.3 Technical elements for hybrid delivery .21
5.11 Example of detailed implementation of MMT .22
5.11.1 Use case: Combination of MMT and MPEG-2 TS for synchronized presentation .22
5.11.2 Use case: True real-time video streaming over lossy channel .22
5.12 HRBM signalling for hybrid delivery .23
5.12.1 Hybrid delivery from the single MMT sending entity .23
5.12.2 Hybrid delivery from the multiple MMT sending entities .25
5.13 Error resilience in MMT protocol .27
5.14 Delay-constrained ARQ .28
5.14.1 General.28
5.14.2 Delivery-time constrained ARQ.28
5.14.3 Arrival-deadline constrained ARQ .29
5.15 Application layer forward error correction (AL-FEC) . .31
5.15.1 FEC decoding method for ssbg_mode2 . .31
5.15.2 Usage of two-stage FEC coding structure .35
5.15.3 MPU mapping to source packet block .37
5.15.4 FEC for hybrid service .38
5.16 Delivery of encrypted MPUs .40
© ISO/IEC 2017 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC TR 23008-13:2017(E)
5.17 HRBM message updating .41
5.17.1 General.41
5.17.2 HRBM message sending schedule .41
5.17.3 Use case.42
5.18 MMTP packet with padded data .42
6 Use cases for MMT deployment .44
6.1 General .44
6.2 Delivery of DASH Presentations using MMT .44
6.2.1 General.44
6.2.2 Delivery of the MPD . .44
6.2.3 Delivery of the data segments .44
6.3 Client operation for DASH service delivered through MMT Protocol .45
6.3.1 Delivery of MPD with MMTP .45
6.3.2 Delivery and consumption of DASH Segments with MMTP .45
6.4 Hybrid of MMT and DASH over heterogeneous network .47
6.5 MMT caching for effective bandwidth utilization .49
6.5.1 Overview of MMT caching middlebox architecture .49
6.5.2 Content-based caching of MMT media .49
6.5.3 MPU sync protocol between server and caching middlebox .52
6.5.4 MMT cache manifest .56
6.6 Usage of ADC signalling message .58
6.6.1 General.58
6.6.2 Operation in MMT sending entity .58
6.6.3 Operation in MANE router .58
6.6.4 Example operation in MMT receiving entities .58
6.6.5 QoE multiplexing gain and bottleneck coordination .58
6.7 MMT deployment in Japanese broadcasting systems .62
6.7.1 General.62
6.7.2 Broadcasting systems using MMT .62
6.7.3 Media transport protocol .64
6.7.4 Signalling information.69
6.7.5 Start-up procedure of broadcasting service . .78
6.8 Conversion of MMTP stream to MPEG-2 TS .80
6.8.1 Overview of conversion operation .80
6.8.2 Restrictions to MMTP packets .80
6.8.3 Calculation of PTS, DTS .80
6.8.4 Restriction related to MPEG-2 T-STD .81
6.8.5 Packet field conversion rule .81
6.8.6 PSI conversion rules .82
6.9 MMT service provisioning at conventional broadcast environment .84
6.10 Usage of multimedia configuration for interface switching management .86
Bibliography .87
iv © ISO/IEC 2017 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC TR 23008-13:2017(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work. In the field of information technology, ISO and IEC have established a joint technical committee,
ISO/IEC JTC 1.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation on the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see the following
URL: www.iso.org/iso/foreword.html.
This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
This second edition cancels and replaces the first edition (ISO/IEC/TR 23008-13:2015), which has been
technically revised.
The main changes compared to the previous edition are as follows:
— areas on MMT deployment case in Japan and conversion between MMTP and MPEG-2 TS stream
have been improved by adding new guidelines.
A list of all parts in the ISO/IEC 23008 series can be found on the ISO website.
This corrected version of ISO/IEC TR 23008-13:2017 incorporates the following corrections:
— headers have been corrected and now read “ISO/IEC TR” instead of “ISO/TR”.
© ISO/IEC 2017 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC TR 23008-13:2017(E)
Introduction
This document provides guidelines for implementation and deployment of multimedia systems based
on the ISO/IEC 23008 series. These guidelines include the following:
— guidelines on usage of MMT functions;
— guidelines on deployment use cases designed based on ISO/IEC 23008-1.
vi © ISO/IEC 2017 – All rights reserved
---------------------- Page: 6 ----------------------
TECHNICAL REPORT ISO/IEC TR 23008-13:2017(E)
Information technology — High efficiency coding and
media delivery in heterogeneous environments —
Part 13:
MPEG media transport implementation guidelines
1 Scope
This document provides technical guidelines for implementing and deploying systems based on
ISO/IEC 23008-1.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 23008-1:2014, Information technology — High efficiency coding and media delivery in
heterogeneous environments — Part 1: MPEG media transport (MMT)
3 Terms, definitions, symbols and abbreviated terms
For the purposes of this document, the terms, definitions, symbols and abbreviated terms given in
ISO/IEC 23008-1 apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— IEC Electropedia: available at http://www.electropedia.org/
— ISO Online browsing platform: available at http://www.iso.org/obp
4 Overview
4.1 System overview
This clause describes the exemplary but typical system overview of MPEG Media Transport (MMT) as
shown in Figure 1.
The media origin provides A/V media or generic files to MMT sending entity in the form of Packages or
Assets which are defined in ISO/IEC 23008-1. A Package is comprised of Assets, Presentation Information
and Transparent Characteristics, etc. Physically, an Asset is a group of MPUs or generic files.
The MMT sending entity fragments MPU/generic files and generates MMTP packets to deliver A/V
media data itself. Concurrently, it also generates signalling message for the successful delivery and
presentation of A/V media included on that MMTP packet flow.
© ISO/IEC 2017 – All rights reserved 1
---------------------- Page: 7 ----------------------
ISO/IEC TR 23008-13:2017(E)
Figure 1 — Example of MMT-based media distribution chain
The MMT Aware Network Element (MANE) may be any network element, such as media caches and
routers, that are aware of MMTP and has augmented functions for its own purposes to utilize tools
from MMT.
Then, MMTP packets can be transmitted through either or both of broadcast channel and broadband
channel at its own environment and scenarios.
The CI information provides presentation information, such as the location of media objects, as well as
the timing and relation of the media objects that MMT receiving entity has to follow. This information
is provided by MMT sending entity and also pushes related MMTP packet flow to the MMT receiving
entity. It means It fully controls the media streaming session, i.e. it manages the on-time delivery,
playback and temporal/spatial presentation information of the media.
4.2 Normative parts
ISO/IEC 23008-1 specifies a set of tools to enable advanced media transport and delivery services.
Figure 2 depicts the end-to-end architecture and illustrates the different functional tools and
their relationships. Moreover, it shows interfaces between existing protocols and standards
defined by ISO/IEC 23008-1 and those defined in other specifications. The tools spread over three
different functional areas, Media Processing Unit (MPU) format, delivery and signalling, defined in
ISO/IEC 23008-1 as follows.
— The Media Processing Unit (MPU) defines the logical structure of media content format of the data
units to be processed by an MMT entity and their instantiation with ISO Base Media File Format as
specified in ISO/IEC 14496-12.
— The delivery function defines an application layer transport protocol and a payload format.
The MMTP transport protocol provides enhanced features for delivery of multimedia data, e.g.
multiplexing and support of mixed use of streaming and download delivery in a single packet flow.
The payload format is defined to enable the carriage of encoded media data which is agnostic to
media types and encoding methods.
— The signalling function defines formats of signalling messages to manage delivery and consumption
of media data.
2 © ISO/IEC 2017 – All rights reserved
---------------------- Page: 8 ----------------------
ISO/IEC TR 23008-13:2017(E)
Figure 2 — MMT functions deployment
Other aspects, such as client implementations for media reconstruction and presentation itself, are not
defined as normative parts of the ISO/IEC 23008-1.
5 MMT function deployments
5.1 General
This clause gives implementation guidelines on general MMT deployment based on basic functionalities
provided by MMT standard itself. This subclause intends, in particular, to guide implementers to make
best use of the specification for the basic topics such as, but not limited to the following:
— low delay media consumption;
— media adaptation;
— hybrid delivery;
— error recovery.
5.2 Object reconstruction
5.2.1 General
MMTP is designed to deliver object flows that may be multiplexed together in the same MMTP flow.
The objects of an object flow are usually related to each other, meaning that the application is likely to
consume all objects of an object flow, if the flow or one of its objects is of interest to that application.
Depending on the delivery mode, the recovery of the object may differ. The GFD mode usually requires
that the full object is recovered prior to its delivery to the application. However, the application may
request that correctly received contiguous byte ranges of the object are forwarded to the application.
© ISO/IEC 2017 – All rights reserved 3
---------------------- Page: 9 ----------------------
ISO/IEC TR 23008-13:2017(E)
The MPU mode is used to deliver MPUs and usually operates on movie fragments. Alternatively, the
application may request that each received MFU is forwarded to the application without additional
delay. It may also require that the complete MPU be reconstructed prior to forwarding it to the
application.
5.2.2 Recovery in MPU mode
When operating in the MPU mode, the object flow consists of MPUs of the same asset. Each MPU is a
single object in the object flow and shares the same packet_id as all MPUs of the same asset.
The MMT receiving entity performs the following steps.
a) Receive MMTP packet.
b) Check if packet_id is equal to the packet_id of the object flow of interest, discard packet and go to
step a) if it does not belong to an object flow of interest.
c) Assert that type of the MMTP packet is MPU.
d) If fragmentation flags are set (different than “00”)
1) if fragmentation flag is equal to “11”, attempt to recover packet and if successful go to step f), or
2) add packet to the list of packet fragments based on the MMTP sequence number and go to step a).
e) If Aggregation flag A is set, extract all aggregated data units and proceed to step g) for each
extracted data unit.
f) If object map with the same MPU_sequence_number does not exist, create a new object map for the
MPU with that sequence number.
g) Check fragment type (FT) of the MPU payload header.
1) If FT is MPU metadata
i) Check if MPU metadata is already received.
I) If yes, discard the MPU metadata as being a duplicate, or
II) insert MPU metadata at the beginning of the object map
— optionally, forward MPU metadata to application.
ii) Go to step a).
2) If FT is Fragment metadata
i) Check if movie fragment with the same movie_fragment_sequence_number already exists.
I) If no, create a placeholder for the movie fragment in the object map, or
II) check if Fragment metadata has already been received.
— If yes, discard fragment metadata as being a duplicate,
— otherwise, insert fragment metadata at the beginning of the fragment placeholder.
III) Go to step a).
3) If FT is MFU
i) If fragment placeholder with sequence number movie_fragment_sequence_number does
not exist in the object map of the MPU with sequence number MPU_sequence_number, then
create movie fragment placeholder in the object map of the MPU.
4 © ISO/IEC 2017 – All rights reserved
---------------------- Page: 10 ----------------------
ISO/IEC TR 23008-13:2017(E)
ii) If timed metadata flag is set
I) insert payload in the fragment placeholder in the correct order based on the sample_
number and offset values;
II) check if movie fragment is complete, and
— if yes, forward fragment to the application.
III) Go to step a).
iii) If timed metadata flag is not set
I) insert payload in the item in the object map based on the item item_ID,
II) recover item information from MPU metadata for the recovered item and forward the
item to the application, and
III) go to step a).
The sender may send the movie fragment out of order, i.e. sending the movie fragment header after
sending all the media units that are contained in that movie fragment. At the receiver side, step g.3.i
ensures that the movie fragment is recovered appropriately by reordering the received data using the
MPU_sequence_number and the movie_fragment_sequence_number. This is necessary if the receiver
is operating in the Fragment mode or MPU mode, where only complete movie fragments or complete
MPUs are forwarded to the application. When operating in
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.