ISO/IEC JTC 1/SC 29/WG 3 - MPEG Systems

This document specifies extensions to existing scene description formats in order to support MPEG media, in particular immersive media. MPEG media includes but is not limited to media encoded with MPEG codecs, media stored in MPEG containers, MPEG media and application formats as well as media provided through MPEG delivery mechanisms. Extensions include scene description format syntax and semantics and the processing model when using these extensions by a Presentation Engine. It also defines a Media Access Function (MAF) API for communication between the Presentation Engine and the Media Access Function for these extensions. While the extensions defined in this document can be applicable to other scene description formats, they are provided for ISO/IEC 12113.

This document specifies the means (e.g. protocols and application programming interfaces) for converting MPEG-21 XML and RDF media contracts (ISO/IEC 21000-19, ISO/IEC 21000-20, and ISO/IEC 21000-21) to smart contracts executable on existing DLT environments.

This document specifies the system layer of the coding. It was developed principally to support the combination of the video and audio coding methods defined in Parts 2 and 3 of ISO/IEC 13818. The system layer supports six basic functions: 1) the synchronization of multiple compressed streams on decoding; 2) the interleaving of multiple compressed streams into a single stream; 3) the initialization of buffering for decoding start up; 4) continuous buffer management; 5) time identification; 6) multiplexing and signalling of various components in a system stream. A Rec. ITU-T H.222.0 | ISO/IEC 13818-1 multiplexed bit stream is either a transport stream or a program stream. Both streams are constructed from PES packets and packets containing other necessary information. Both stream types support multiplexing of video and audio compressed streams from one program with a common time base. The transport stream additionally supports the multiplexing of video and audio compressed streams from multiple programs with independenttime bases. For almost error-free environments the program stream is generally more appropriate, supporting software processing of program information. The transport stream is more suitable for use in environments where errors are likely. A Rec. ITU-T H.222.0 | ISO/IEC 13818-1 multiplexed bit stream, whether a transport stream or a program stream, is constructed in two layers: the outermost layer is the system layer, and the innermost is the compression layer. The system layer provides the functions necessary for using one or more compressed data streams in a system. The video and audio parts of this Specification define the compression coding layer for audio and video data. Coding of other types of data is not defined by this Specification, but is supported by the system layer provided that the other types of data adhere to the constraints defined in 2.7.

This document specifies four data formats: User Description (UD), Context Description (CD), Service Description (SD), and Recommendation Description (RD). This document also specifies technologies related to consecutive vibration.

This document specifies the format of the event message track.

This document specifies carriage of coded media representations which comply with visual volumetric video-based coding and video-based point cloud compression (specified in ISO/IEC 23090-5).

This document specifies the format of the Session-Based Description document and the MPD's extension to be used in session-based operations with MPEG DASH (ISO/IEC 23009-1).

This document specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations.

This document defines a storage format for derived visual tracks and an initial base set of related transformation operations. The format defined in this document enables the interchange, editing, and display of timed sequences of images that result from transformation operations applied to input still images or samples of timed sequences of images in the same presentation. This format defines normative structures used to contain the description of transformation operations, how to link that transformation operations to the inputs, and defines how to process those transformation operations to obtain a timed sequence of video frames.

This document specifies the conformance and reference software for omnidirectional media format (specified in ISO/IEC 23090‑2). This document describes the reference software modules and the features that is supports. It also provides a description of how the reference software can be utilized. In addition, the document lists and describes test vectors comprising ISO base media file format files, media presentation descriptions, segments and combinations thereof that conform to ISO/IEC 23090‑2.

This document specifies immersive media metrics and the measurement framework. The immersive media metrics can be collected by service providers and used to enhance the immersive media quality and experiences. This document also includes a client reference model with observation and measurement points for collection of the metrics.

This document describes the reference software and conformance suite for the file format documents in MPEG-4 and MPEG-H. Since these documents share a lot of technology, their reference software and conformance program are being handled together. These documents are: ISO/IEC 14496-12, ISO/IEC 14496-14, ISO/IEC 14496-15, ISO/IEC 14496-30 and ISO/IEC 23008-12. The purpose of the conformance suite is to cover the set of valid features that can be exercised in the file format. Media conformance is not covered, though of course in order to exercise the file format features, media will be stored.

The network-based media processing (NBMP) framework defines the interfaces including both data formats and application programming interfaces (APIs) among the entities connected through digital networks for media processing. Users can access and configure their operations remotely for efficient, intelligent processing. This document describes and manages workflows to be applied to the media data. This process includes uploading of media data to the network, instantiation of the media processing tasks, and configuration of the tasks. The framework enables dynamic creation of media processing pipelines, as well as access to processed media data and metadata in real-time or in a deferred way. The media and metadata formats used between the media source, workflow manager and media processing entities in a media processing pipeline are also specified.

This document provides guidance for implementing and deploying systems based on ISO/IEC 23008‑1.

This document specifies the conformance and reference software implementing the test vectors comprising media presentation descriptions, segments and combinations thereof in ISO/IEC 23009‑1, and the corresponding software modules.

ISO/IEC 23008-11:2015 specifies MPEG Composition Information (CI), a method describing composition information of media for delivery of multimedia services over packet-based heterogeneous networks. The technologies for composition function specify the method associating content delivered in the format defined in this part of ISO/IEC 23008 to the presentation and the method representing synchronization between timed and non-timed content.

This document specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations.