ISO/IEC 23002-4:2014
(Main)Information technology — MPEG video technologies — Part 4: Video tool library
Information technology — MPEG video technologies — Part 4: Video tool library
ISO/IEC 23002-4:2014 defines the description of the MPEG video tool library (VTL) based on the decoder description specified in ISO/IEC 23001-4. This tool library defines the specification of FUs, which are sufficient to build complete decoding solutions according to the following coding standards: ISO/IEC 14496-2 (MPEG-4 Simple Profile), and ISO/IEC 14496-10 (MPEG-4 AVC Constrained Baseline Profile). The objective of ISO/IEC 23001-4 is to define the general framework principles, and ISO/IEC 23002-4:2014 defines the MPEG VTL that includes relevant tools (or FUs) from the existing MPEG coding standards. Each FU is defined in the form of a textual description. The conventions followed by the input and output behavior are also described. Implementations compliant with ISO/IEC 23002-4:2014 can be designed using any software or hardware language and components. The reference software for the textual specification of FUs is written in RVC-CAL language of which a formal syntax is provided in ISO/IEC 23001-4, and which will be defined in Amendment 1 to ISO/IEC 23002-4.
Technologies de l'information — Technologies vidéo MPEG — Partie 4: Bibliothèque d'outils vidéo
General Information
Relations
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 23002-4
Second edition
2014-04-15
Information technology — MPEG video
technologies —
Part 4:
Video tool library
Technologies de l'information — Technologies vidéo MPEG —
Partie 4: Bibliothèque d'outils vidéo
Reference number
ISO/IEC 23002-4:2014(E)
©
ISO/IEC 2014
---------------------- Page: 1 ----------------------
ISO/IEC 23002-4:2014(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2014
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form or by any
means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission.
Permission can be requested from either ISO at the address below or ISO’s member body in the country of the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2014 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 23002-4:2014(E)
Contents Page
Foreword .vi
Introduction.vii
1 Scope.1
2 Normative references.1
3 Terms and definitions .1
4 FU description convention .2
4.1 FU interfaces.2
4.2 FU IDs.2
4.3 Token Pool.5
5 General-Purpose FUs.8
5.1 Syntax Parsing.8
5.1.1 Generic Syntax Parser.8
5.1.2 Algo_Byte2bit.8
5.1.3 Mgnt_Select_MB_4.8
5.1.4 Mgnt_Merger420.9
5.1.5 Mgnt_Select_MB_8.9
6 FUs for MPEG-4 Simple Profile .10
6.1 Syntax Parsing.10
6.1.1 Algo_ SynP.10
6.1.2 Mgnt_BlockExpand.10
6.1.3 Mgnt_Splitter420B.11
6.1.4 Mgnt_Splitter420MV.11
6.1.5 Algo_MVR_MedianOfThreeLeftAndTopAndTopRight .12
6.1.6 Mgnt_Splitter_420_TYPE.12
6.1.7 Algo_VLDtableB6_MPEG4Part2.13
6.1.8 Algo_VLDtableB7_MPEG4Part2.13
6.1.9 Algo_VLDtableB8_MPEG4Part2.14
6.1.10 Algo_VLDtableB12_MPEG4Part2.14
6.1.11 Algo_VLDtableB13_MPEG4Part2.14
6.1.12 Algo_VLDtableB14_MPEG4Part2.15
6.1.13 Algo_VLDtableB15_MPEG4Part2.15
6.1.14 Algo_VLDtableB16_MPEG4Part2.16
6.1.15 Algo_VLDtableB17_MPEG4Part2.16
6.2 Texture Decoding.17
6.2.1 Algo_IQ_QSAndQmatrixMp4vOrH263Scaler.17
6.2.2 Algo_DCRAddr_ThreeLeftTop_8x8.17
6.2.3 Algo_DCRAddr_ThreeLeftTop_16x16.18
6.2.4 Algo_DCRInvPred_CHROMA_8x8.18
6.2.5 Algo_DCRInvPred_LUMA_16x16.19
6.2.6 Algo_IS_ZigzagOrAlternateHorizontalVertical_8x8 .20
6.2.7 Algo_IAP_AdaptiveHorizontalOrVerticalPred_8x8 .20
6.2.8 Algo_IAP_AdaptiveHorizontalOrVerticalPred_16x16 .21
6.2.9 Algo_IDCT2D_ISOIEC_23002_1.22
6.2.10 Mgnt_DCSplit.22
6.3 Motion Compensation.23
6.3.1 Mgnt_FB_w_Addess_8x8 .23
6.3.2 Mgnt_FB_w_Addess_16x16.23
6.3.3 Algo_PictureReconstruction_Saturation.24
6.3.4 Algo_Interp_HalfpelBilinearRoundingControl.24
© ISO/IEC 2014 — All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 23002-4:2014(E)
7 FUs for MPEG-4 AVC Constrained Baseline Profile.25
7.1 Syntax Parsing.25
7.1.1 Algo_NALU.25
7.1.2 Algo_SynP.25
7.1.3 Algo_BlockExpand.26
7.1.4 Algo_BlockSplit.27
7.1.5 Algo_IntraPred_Split.27
7.1.6 Algo_Parser_I_PCM.28
7.1.7 Algo_DemuxParserInfoForBlocks_Chroma.28
7.1.8 Algo_DemuxParserInfoForBlocks_Luma.28
7.2 Texture Decoding.29
7.2.1 Algo_IS_Zigzag_4x4.29
7.2.2 Algo_DCR_Hadamard_LUMA_IHT1d.29
7.2.3 Algo_Transpose4x4.30
7.2.4 Algo_DCR_Hadamard_LUMA_Reordering.30
7.2.5 Algo_DCR_Hadamard_LUMA_Scaling.31
7.2.6 Algo_DCR_Hadamard_CHROMA.31
7.2.7 Algo_IT4x4_1d.31
7.2.8 Algo_IT4x4_Addshift.32
7.2.9 Algo_IntraPred_LUMA_16x16.32
7.2.10 Algo_IntraPred_LUMA_4x4.33
7.2.11 Algo_Merge_4x4_to_16x16.33
7.2.12 Algo_IQ_QSAndSLAndIDCTScaler_4x4.33
7.2.13 Mgnt_IQ_INTRA16x16.34
7.2.14 Algo_IntraPred_4x4_to_8x8.34
7.2.15 Algo_IntraPred_CHROMA.35
7.2.16 Mgnt_Intra16x16.35
7.2.17 Mgnt_Intra4x4.36
7.2.18 Mgnt_IQ_Chroma.36
7.2.19 Mgnt_Buffer_Neighbour_FullMb.36
7.2.20 Mgnt_Buffer_Neighbour_YxY.37
7.2.21 Algo_Merge_4x4_to_16x16_norasterscan.37
7.2.22 Algo_Split_16x16_to_4x4_norasterscan.38
7.3 Motion Compensation .38
7.3.1 Algo_Interp_EighthPelBilinear .38
7.3.2 Algo_Interp_SeparableSixTapQuarterPel.39
7.3.3 Algo_Interp_Reord.39
7.3.4 Algo_MvLXReconstr.39
7.3.5 Mgnt_DPB.40
7.3.6 Algo_MMCO.41
7.3.7 AlgoRefList.41
7.3.8 Mgnt_InterPred.42
7.3.9 Algo_RefIdxtoFrameNum.42
7.4 Filtering.42
7.4.1 Mgnt_DBF_AdaptiveFilter.42
7.4.2 Algo_DBF_AdaptiveFilter.43
7.4.3 Algo_MvComponentReorder .43
7.5 Renderer.44
7.5.1 Mgnt_POC.44
7.5.2 Mgnt_BufferRender .44
7.5.3 Mgnt_Merger420_AVC.45
8 FUs for MPEG-4 AVC Progressive High Profile.45
8.1.1 Algo_SynP.45
8.1.2 Algo_BlockExpand.46
8.1.3 Algo_DemuxParserInfoForBlocks_Luma.47
8.2 Texture Decoding.47
8.2.1 Algo_IS_Zigzag_8x8.47
8.2.2 Algo_IQ_QSAndSLAndIDCTScaler_8x8.48
8.2.3 Algo_IIT_8x8.48
iv © ISO/IEC 2014 — All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 23002-4:2014(E)
8.2.4 Algo_IntraPred_LUMA_8x8.49
8.2.5 Mgnt_Intra_8x8.49
8.2.6 Algo_Merge_8x8_to_16x16.50
8.2.7 Algo_DCR_Hadamard_CHROMA.50
8.2.8 Algo_DCR_Hadamard_LUMA_Scaling.50
8.2.9 Algo_IQ_QSAndSLAndIDCTScaler_4x4.51
8.2.10 Algo_Merge_8x8_to_16x16_norasterscan.51
8.2.11 Algo_Split_16x16_to_8x8_norasterscan.52
8.2.12 Mgnt_I4x4_I8x8_demux.52
8.2.13 Mgnt_I4x4_I8x8_mux.52
8.3 Motion Compensation.53
8.3.1 Algo_GeneratePredWeight.53
8.3.2 Mgnt_SelectMvpLX.53
8.3.3 Algo_MvLXReconstr.54
8.3.4 Algo_MvBuffer.55
8.3.5 Mgnt_SelectMvpLX.55
8.3.6 Algo_FrameNumToPocList.56
8.4 Filtering.56
8.4.1 Algo_DBF_AdaptiveFilter.56
8.4.2 Algo_MvComponentReorder.57
Annex A (normative) Naming Convention of FU .58
A.1 Simple Functional Units name convention.58
A.2 Description of the fields.58
Annex B (informative) FU Network Examples.60
B.1 Value of the RVC descriptions .60
B.2 FNL of MPEG-4 Simple Profile .60
B.3 FNL of MPEG-4 AVC Constrained Baseline Profile decoder .66
Annex C (normative) FNL of MPEG-4 AVC Progressive High Profile decoder.81
Bibliography.104
© ISO/IEC 2014 — All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 23002-4:2014(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
ISO/IEC 23002-4 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
This second edition cancels and replaces the first edition (ISO/IEC 23002-4:2010), which has been technically
revised. It also incorporates the Amendment ISO/IEC 23002-4:2010/Amd.1:2011.
ISO/IEC 23002 consists of the following parts, under the general title Information technology — MPEG video
technologies:
⎯ Part 1: Accuracy requirements for implementation of integer-output 8×8 inverse discrete cosine transform
⎯ Part 2: Fixed-point 8×8 inverse discrete cosine transform and discrete cosine transform
⎯ Part 3: Representation of auxiliary video and supplemental information
⎯ Part 4: Video tool library
⎯ Part 5: Reconfigurable media coding conformance and reference software
vi © ISO/IEC 2014 — All rights reserved
---------------------- Page: 6 ----------------------
ISO/IEC 23002-4:2014(E)
Introduction
This part of ISO/IEC 23002 defines the MPEG video tool library, which contains tools drawn from existing
MPEG coding standards, such as ISO/IEC 14496-2 and ISO/IEC 14496-10, and ISO/IEC 23001-4 defines the
methods capable of describing codec configurations in the reconfigurable video coding (RVC) framework.
This part of ISO/IEC 23002 primarily addresses reconfigurable video aspects and will only focus on the
description of representation of video codec configurations under the RVC framework, but could be extended
to a more generic reconfigurable media coding (RMC) framework.
The objective of RVC is to offer a framework that is capable of configuring and specifying video codecs as a
collection of “higher level” modules by using video coding tools. The video coding tools are defined in video
tool libraries. This part of ISO/IEC 23002 defines the MPEG video tool library. The RVC framework principle
could also support non-MPEG tool libraries, provided that their developers have taken care to obey the
appropriate rules of operation.
For the purpose of framework deployment, an appropriate description is needed to describe configurations of
decoders composed of or instantiated from a subset of video tools from either one or more libraries. As
illustrated in Figure 1, the configuration information consists of
⎯ bitstream syntax description, and
⎯ network of functional units (FUs) description (also referred to as the decoder configuration)
that together constitute the entire decoder description.
Bitstreams of existing MPEG standards are specified by specific syntax structures and decoders are
composed of various coding tools. Therefore, RVC includes support for bitstream syntax descriptions as well
as video coding tools. As depicted in Figure 1, a typical RVC decoder requires two types of information,
namely the decoder description and the encoded media (e.g. video bitstreams) data.
1. Bitstream syntax
2. Decoder configuration
Decoder Description
Encoder Decoder
Encoded Video Data
Figure 1 — Conceptual diagram of RVC
A more detailed description of the RVC decoder is illustrated in Figure 2. As shown in Figure 2, the decoder
description is required for the configuration of a RVC decoder. The Bitstream Syntax Description (BSD) and
FU Network Description (FND) (which compose the Decoder Description) are used to configure or compose
an abstract decoder model (ADM) which is instantiated through the selection of FUs from tool libraries
optionally with proper parameter assignment. Such ADM constitutes the behavioral reference model used in
setting up a decoding solution under the RVC framework. The process of yielding a decoding solution may
vary depending on the technologies used for the desired implementations. Examples of the instantiation of an
ADM and generation of proprietary decoding solutions can be found in ISO/IEC 23001-4.
© ISO/IEC 2014 — All rights reserved vii
---------------------- Page: 7 ----------------------
ISO/IEC 23002-4:2014(E)
Figure 2 — Graphical representation of the process for setting up a decoding solution under the RVC
framework
Within the RVC framework, the decoder description describes a particular decoder configuration and consists
of the FND and the BSD. The FND describes the connectivity of the network of FUs used to form a decoder
whereas the parsing process for the bitstream syntax is implicitly described by the BSD. These two
descriptions are specified using two standard XML-based languages or dialects:
⎯ Functional unit network language (FNL) is a language that describes the FND, known also as “network of
FUs”. The FNL specified normatively within the scope of the RVC framework is provided in
ISO/IEC 23001-4.
⎯ Bitstream syntax description language (BSDL), standardized in ISO/IEC 23001-5 (MPEG-B Part 5),
describes the bitstream syntax and the parsing rules. A pertinent subset of this BSDL named RVC-BSDL
is defined within the scope of the current RVC framework. This RVC-BSDL also includes possibilities for
further extensions, which are necessary to provide complete description of video bitstreams. RVC-BSDL
specified normatively within the scope of the RVC framework is provided in ISO/IEC 23001-4.
The decoder configuration specified using FNL, together with the specification of the bitstream syntax using
RVC-BSDL fully specifies the ADM and provides an “executable” model of the RVC decoder description.
The instantiated ADM includes the information about the selected FUs and how they should be connected. As
already mentioned, the FND with the network connection information is expressed by using FNL. Furthermore,
the RVC framework specifies and uses a dataflow-oriented language called RVC-CAL for describing FUs'
behavior. The normative specification of RVC-CAL is provided in ISO/IEC 23001-4. The ADM is the behavioral
model that should be referred to in order to implement any RVC conformant decoder. Any RVC compliant
viii © ISO/IEC 2014 — All rights reserved
---------------------- Page: 8 ----------------------
ISO/IEC 23002-4:2014(E)
decoding solution/implementation can be achieved by using proprietary non-normative tools and mechanisms
that yield decoders that behave equivalent to the RVC ADM.
The decoder description, the MPEG tool library, and the associated instantiation of an ADM are normative.
More precisely, the ADM is intended to be normative in terms of a behavioral model. In other words what is
normative is the input/output behavior of the complete ADM as well as the input/output behavior of all the FUs
that are included in the ADM.
© ISO/IEC 2014 — All rights reserved ix
---------------------- Page: 9 ----------------------
INTERNATIONAL STANDARD ISO/IEC 23002-4:2014(E)
Information technology — MPEG video technologies —
Part 4:
Video tool library
1 Scope
This part of ISO/IEC 23002 defines the description of the MPEG video tool library (VTL) based on the dec
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.