ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information

This document specifies carriage of coded media representations which comply with visual volumetric video-based coding and video-based point cloud compression (specified in ISO/IEC 23090-5).

This document provides reference implementations of ISO/IEC 21794-1 and ISO/IEC 21794-2, also known as JPEG Pleno.

This document specifies conformance criteria for both bitstreams and decoders compliant with the MPEG-D Unified speech and audio coding standard as defined in ISO/IEC 23003‑3. This is done to assist implementers and to ensure interoperability.

This document specifies the abstract class of a media thing (MThing), which is a basic component to construct the Internet of media things. The MThing class contains the basic APIs to: — discover other MThing(s) in the network; — connect/disconnect MThing(s); — support transactions (e.g. payments) using media tokens between MThings.

This document describes the architecture of systems for the internet of media things.

This document defines a set of compression methods for coding one or more images of bi-level, continuous-tone greyscale, or continuous-tone colour, or multichannel digital samples. This document: — specifies decoding processes for converting compressed image data to reconstructed image data; — specifies a codestream syntax containing information for interpreting the compressed image data; — provides guidance on encoding processes for converting source image data to compressed image data.

This document defines a number of subsets of the syntax specified in ISO/IEC 21122-1 as profiles. It also defines lower bounds on the throughput in the decoded domain via levels and the encoded domain via sublevels that a conforming decoder implementation shall support. Furthermore, it defines a buffer model to ensure interoperability between implementations in the presence of a latency constraint.

This document defines transport and container formats for JPEG XS codestreams as specified in ISO/IEC 21122-1. It defines file formats for working with still image and motion image sequence files on computer platforms and gives guidance on how to embed the codestream in transport streams, allowing internet-based communication. This document uses already existing specifications for file formats and extends them for the embedding of JPEG XS codestreams.

This document defines the syntax and an accompanying decompression process that is capable to represent continuous-tone grey-scale, or continuous-tone colour digital images without visual loss at moderate compression rates. Typical compression rates are between 2:1 and 6:1 but can also be higher depending on the nature of the image. In particular, the syntax and the decoding process specified in this document allow lightweight encoder and decoder implementations that limit the end-to-end latency to a fraction of the frame size. However, the definition of transmission channel buffer models necessary to ensure such latency is beyond the scope of this document. This document: — specifies decoding processes for converting compressed image data to reconstructed image data; — specifies a codestream syntax containing information for interpreting the compressed image data; — provides guidance on encoding processes for converting source image data to compressed image data.

This document specifies conformance criteria for both bitstreams and decoders compliant with the MPEG-H 3D audio standard as defined in ISO/IEC 23008-3. This is done to assist implementers and to ensure interoperability.

This document specifies the format of the Session-Based Description document and the MPD's extension to be used in session-based operations with MPEG DASH (ISO/IEC 23009-1).

This document specifies a set of tests and procedures designed to indicate whether encoders or decoders essential video coding (EVC), which contains tests and a reference software designed to verify whether bitstreams and decoders meet normative requirements specified in ISO/IEC 23094-1. An encoder can claim conformance to ISO/IEC 23094-1 if the bitstreams that it generates are conforming bitstreams. Characteristics of coded bitstreams and decoders are defined in ISO/IEC 23094-1. Decoder characteristics define the properties and capabilities of the applied decoding process. The capabilities of a decoder specify which bitstreams the decoder can decode and reconstruct. A bitstream can be decoded by a decoder if the characteristics of the bitstream are within the specified decoder capabilities.

This document specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations.

This document defines a storage format for derived visual tracks and an initial base set of related transformation operations. The format defined in this document enables the interchange, editing, and display of timed sequences of images that result from transformation operations applied to input still images or samples of timed sequences of images in the same presentation. This format defines normative structures used to contain the description of transformation operations, how to link that transformation operations to the inputs, and defines how to process those transformation operations to obtain a timed sequence of video frames.

This document defines a set of lossless (bit-preserving) and lossy compression methods for coding continuous-tone, bi-level, grey-scale, colour digital still images, or multi-component images. This document: – specifies extended decoding processes for converting compressed image data to reconstructed image data; – specifies an extended codestream syntax containing information for interpreting the compressed image data; – specifies an extended file format; – specifies a container to store image metadata; – defines a standard set of image metadata; – provides guidance on extended encoding processes for converting source image data to compressed image data; – provides guidance on how to implement these processes in practice.

This document specifies low complexity enhancement video coding.

Rec. ITU-T T.800 | ISO/IEC 15444-1 defines a set of lossless and lossy compression methods for coding continuous-tone, bi-level, greyscale or colour digital still images. This Recommendation | International Standard provides three independently created software reference implementations of Rec. ITU-T T.800 | ISO/IEC 15444-1, in order to assist implementers of Rec. ITU-T T.800 | ISO/IEC 15444-1 in testing and understanding its content. The packages are JASPER, JJ2000 and OPENJPEG. This Recommendation | International Standard also provides an independently created software reference implementation of Rec. ITU-T T.814 | ISO/IEC 15444-15, which specifies a high-throughput (HT) block coding algorithm that can be used in place of the block coding algorithm of Rec. ITU-T T.800 | ISO/IEC 15444-1, in order to assist implementers of Rec. ITU-T T.814 | ISO/IEC 15444-15 in testing and understanding its content. The package is TT. This Recommendation | International Standard additionally provides an independently created software reference implementation for parsing of a JP2 file format specified in Rec. ITU-T T.800 | ISO/IEC 15444-1 and a JPH file format specified in Rec. ITU-T T.814 | ISO/IEC 15444-15, The package is Codestream-parser. This Recommendation | International Standard does not define any additional part of the JPEG 2000 image coding system. Each version of the J2K reference software contains source code, which can be compiled to provide the following functionality: – Transcoding from selected, widely available image formats into a JPEG 2000 codestream. – Transcoding from selected, widely available image formats into the JP2 file format. – Selection of a wide range of JPEG 2000 encoding options (as documented in each reference software). – Decoding from a JPEG 2000 codestream to a range of selected widely available image formats. – Processing of a JP2 file to extract a JPEG 2000 codestream for decoding and conversion to a range of selected widely available image formats. – The ability to extract metadata from a JP2 file, including the contents of the Image Header box and the colour space. – The decoding of JP2 files that use the three-component matrix-based form of the restricted ICC method for the specification of colour space and the conversion of the decoded image data to the sRGB colour space for display, including limited upsampling of all decoded components to the same resolution. – The decoding of JP2 files that use the monochrome form of the restricted ICC method for the specification of colour space and the conversion of the decoded image data to the sRGB based greyscale space as defined within the JP2 file format. – The decoding of JP2 files that use the sYCC colour space and the conversion of the decoded image data to the sRGB colour space for display, including upsampling of all decoded components to the same resolution. – Some additional tools to help with evaluation and testing. The TT HTJ2K reference software contains source code, which can be compiled to provide the following functionality: – Decoding from a HTJ2K codestream to a range of selected widely available image formats. The codestream-parser reference software contains source code, which can provide the following functionality: – Parsing of JP2 file format; – Parsing of JPH file format. The reference software is intended for use as a testing and validation tool for other implementations of JPEG 2000, and to help in the understanding of Rec. ITU-T T.800 | ISO/IEC 15444-1 and Rec. ITU-T T.814 | ISO/IEC 15444-15.

This Recommendation | International Standard specifies the framework, concepts, methodology for testing, and criteria to be achieved to claim compliance to Rec. ITU-T T.800 | ISO/IEC 15444-1 or Rec. ITU-T T.814 | ISO/IEC 15444-15. It provides a framework for specifying abstract test suites (ATSs) and for defining the procedures to be followed during compliance testing. This Recommendation | International Standard: ‒ specifies compliance testing procedures for encoding and decoding using Rec. ITU-T T.800 | ISO/IEC 15444-1 and Rec. ITU-T T.814 | ISO/IEC 15444-15; ‒ specifies codestreams, decoded images, and error metrics to be used with the testing procedures; ‒ specifies ATSs; ‒ provides guidance for creating an encoder compliance test This Recommendation | International Standard does not include the following tests: Acceptance testing: the process of determining whether an implementation satisfies acceptance criteria and enables the user to determine whether or not to accept the implementation. This includes the planning and execution of several kinds of tests (e.g., functionality, quality, and speed performance testing) that demonstrate that the implementation satisfies the user requirements. Performance testing: measures the performance characteristics of an implementation under test (IUT) such as its throughput and responsiveness, under various conditions. Robustness testing: the process of determining how well an implementation processes data which contains errors.

This document specifies the conformance and reference software for omnidirectional media format (specified in ISO/IEC 23090‑2). This document describes the reference software modules and the features that is supports. It also provides a description of how the reference software can be utilized. In addition, the document lists and describes test vectors comprising ISO base media file format files, media presentation descriptions, segments and combinations thereof that conform to ISO/IEC 23090‑2.

This document defines various code points and fields that establish properties of a video (or still image) representation and are independent of the compression encoding and bit rate. These properties can describe the appropriate interpretation of decoded data or can, similarly, describe the characteristics of such a signal before the signal is compressed by an encoder that is suitable for compressing such an input signal.

This document contains simulation software for the MPEG-H 3D audio standard as defined in ISO/IEC 23008‑3.

This document specifies the transport and container formats for JPEG XL codestreams as specified in ISO/IEC 18181-1. This document specifies how to add metadata and extensions to JPEG XL codestreams. A file as described by this document is called a JPEG XL file.

This document provides reference software for the coding technology specified in Recommendation ITU-T T.81 | ISO/IEC 10918-1. While the reference implementations also provide an encoder, conformance testing of their encoding process is beyond the scope of this document.

This document specifies the encapsulation of image formats specified in the JPEG 2000 family of Recommendations | International Standards in the framework defined in ISO/IEC 23008-12.

This document specifies the omnidirectional media format for coding, storage, delivery and rendering of omnidirectional media, including video, images, audio and timed text. Omnidirectional image or video can contain graphics elements generated by computer graphics but encoded as image or video. Multiple viewpoints, each corresponding to an omnidirectional camera, are supported. The document also specifies storage and delivery of overlay images or video intended to be rendered over the omnidirectional background image or video.

This document specifies the syntax, semantics and decoding for visual volumetric media using video‑based coding methods. This document also specifies processes that can be needed for reconstruction of visual volumetric media, which can also include additional processes such as post‑decoding, pre-reconstruction, post‑reconstruction and adaptation.

This document specifies immersive media metrics and the measurement framework. The immersive media metrics can be collected by service providers and used to enhance the immersive media quality and experiences. This document also includes a client reference model with observation and measurement points for collection of the metrics.

This document specifies the assessment of conformance to ISO/IEC 15938-15 as well as the reference software.

This document describes common industry representation practices for the usage of video signal type code points, as these properties are conveyed across video content production and distribution carriage systems.

This document provides general information about coding efficiency measurement practices for video coding. This document does not provide recommendations for evaluating video quality; it describes the practices that have recently been followed for coding efficiency experiments conducted during work to develop video coding standards.

This document specifies a series of interfaces to allow disparate systems an interoperable management of image repositories. It also specifies the general rules which govern the usage of metadata in JPSearch and provides a specification which provides rules for the representation of image metadata descriptions, consisting of the definition of the JPSearch Core Metadata Schema, provides rules for the publication of machine-readable translations between metadata terms belonging to proprietary metadata schemas and metadata terms in the JPSearch Core Metadata Schema, and provides rules for the registration and request of metadata schemas and its translation rules or links to them. JPSearch is an extensible standard. The method of extending the structures and rules beyond the JPSearch Core Metadata Schema is provided in this document.

This document specifies a coded codestream format for storage of light field modalities as well as associated metadata descriptors that are light field modality specific. This document also provides information on the encoding tools.

This document specifies a video coding technology known as versatile video coding (VVC), comprising a video coding technology with a compression capability that is substantially beyond that of the prior generations of such standards and with sufficient versatility for effective use in a broad range of applications. Only the syntax format, semantics, and associated decoding process requirements are specified, while other matters such as pre-processing, the encoding process, system signalling and multiplexing, data loss recovery, post-processing, and video display are considered to be outside the scope of this document. Additionally, the internal processing steps performed within a decoder are also considered to be outside the scope of this document; only the externally observable output behaviour is required to conform to the specifications of this document. This document is designed to be generic in the sense that it serves a wide range of applications, bit rates, resolutions, qualities and services. Applications include, but are not limited to, video coding for digital storage media, television broadcasting and real-time communication. In the course of creating This document, various requirements from typical applications have been considered, necessary algorithmic elements have been developed, and these have been integrated into a single syntax. Hence, this document is designed to facilitate video data interchange among different applications.

This document specifies the syntax and semantics of video usability information (VUI) parameters and supplemental enhancement information (SEI) messages. The VUI parameters and SEI messages defined in this document are designed to be conveyed within coded video bitstreams in a manner specified in a video coding specification or to be conveyed by other means determined by the specifications for systems that make use of such coded video bitstreams. This document is particularly intended for use with coded video bitstreams as specified by Rec. ITU‑T H.266 | ISO/IEC 23090-3, although it can also be used with other types of coded video bitstreams. VUI parameters and SEI messages can assist in processes related to decoding, display or other purposes. However, unless otherwise specified in a referencing specification, the interpretation and use of the VUI parameters and SEI messages specified in this document is not a required functionality of a video decoder or receiving video system. Although semantics are specified for the VUI parameters and SEI messages, decoders and receiving video systems can simply ignore the content of the VUI parameters and SEI messages or can use them in a manner that somewhat differs from what is specified in this document.

This document describes the reference software and conformance suite for the file format documents in MPEG-4 and MPEG-H. Since these documents share a lot of technology, their reference software and conformance program are being handled together. These documents are: ISO/IEC 14496-12, ISO/IEC 14496-14, ISO/IEC 14496-15, ISO/IEC 14496-30 and ISO/IEC 23008-12. The purpose of the conformance suite is to cover the set of valid features that can be exercised in the file format. Media conformance is not covered, though of course in order to exercise the file format features, media will be stored.

The network-based media processing (NBMP) framework defines the interfaces including both data formats and application programming interfaces (APIs) among the entities connected through digital networks for media processing. Users can access and configure their operations remotely for efficient, intelligent processing. This document describes and manages workflows to be applied to the media data. This process includes uploading of media data to the network, instantiation of the media processing tasks, and configuration of the tasks. The framework enables dynamic creation of media processing pipelines, as well as access to processed media data and metadata in real-time or in a deferred way. The media and metadata formats used between the media source, workflow manager and media processing entities in a media processing pipeline are also specified.

This document specifies advanced video coding for coding of audio-visual objects