ISO/IEC 14496-4:2004/Amd 1:2005
(Amendment)Information technology — Coding of audio-visual objects — Part 4: Conformance testing — Amendment 1: Conformance testing for MPEG-4
Information technology — Coding of audio-visual objects — Part 4: Conformance testing — Amendment 1: Conformance testing for MPEG-4
Technologies de l'information — Codage des objets audiovisuels — Partie 4: Essai de conformité — Amendement 1: Essai de conformité pour MPEG-4
General Information
Relations
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 14496-4
Second edition
2004-12-15
AMENDMENT 1
2005-04-15
Information technology — Coding of
audio-visual objects —
Part 4:
Conformance testing
AMENDMENT 1: Conformance testing for
MPEG-4
Technologies de l'information — Codage des objets audiovisuels —
Partie 4: Essai de conformité
AMENDEMENT 1: Essai de conformité pour MPEG-4
Reference number
ISO/IEC 14496-4:2004/Amd.1:2005(E)
©
ISO/IEC 2005
---------------------- Page: 1 ----------------------
ISO/IEC 14496-4:2004/Amd.1:2005(E)
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but
shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In
the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.
© ISO/IEC 2005
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2005 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 14496-4:2004/Amd.1:2005(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
Amendment 1 to ISO/IEC 14496-4:2004 was prepared by Joint Technical Committee ISO/IEC JTC 1,
Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia
information.
© ISO/IEC 2005 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 14496-4:2004/Amd.1:2005(E)
Information technology — Coding of audio-visual objects —
Part 4:
Conformance testing
AMENDMENT 1: Conformance testing for MPEG-4
Add the following text at the end of Clause 4.
4.8 Advanced Synchronization Model (FlexTime Model)
4.8.1 Bitstream conformance
4.8.1.1 Conformance Requirements
BIFS streams shall comply with the specifications of FlexTime nodes in Clause 9 of ISO/IEC 14496-1.
4.8.1.2 Measurement procedure
Syntax of the BIFS stream shall meet the requirements of FlexTime nodes in Clause 9 of ISO/IEC 14496-1.
4.8.1.3 Tolerance
There is no tolerance for bitstream syntax checking. The diagnosis is pass or fail.
4.8.2 Terminal conformance
4.8.2.1 Conformance Points
FlexTime conformance points are defined in the TemporalGroup node by the Temporal constraints "Co-End",
"Meet" and "Co-Begin".
4.8.2.2 Measurement Procedure
The terminal shall produce formatted output each time a Temporal constraint is met. Typically, when a
temporal constraint is met, certain objects end and certain objects begin. The output is to include:
• The time that the constraint was met, in seconds.
• The type of constraint that was met, i.e. "Co-End", "Meet" or "Co-Begin".
• A list of objects that end. For each ending object:
• The ES_ID.
• The minimum, optimum, and maximum duration.
• The actual duration.
• A list of objects that start. For each starting object:
• The ES_ID.
• The minimum, optimum, and maximum duration.
© ISO/IEC 2005 – All rights reserved 1
---------------------- Page: 4 ----------------------
ISO/IEC 14496-4:2004/Amd.1:2005(E)
4.8.2.3 Output Format
The output format is in XML. An example is:
maxDuration="9.0" actDuration="8.5" \>
maxDuration="6.0" \>
4.8.2.4 Tolerance
The conformance is passed when the actual duration of an ending object falls in between the minimum and
the maximum duration. If not, the test fails.
Add the following text at the end of Clause 5.
5.7 Normative test streams for Visual New Levels and Tools
5.7.1 Specification of the test bitstreams
5.7.1.1 Test Bitstreams — General
5.7.1.1.1 Test bitstream #A3GE-1
Specification: A bitstream with all slice and macroblock syntax transitions progressive and interlaced coded
VOPs.
Functional stage: parser
Purpose: Check that decoder handles all scenarios in parsing tree.
5.7.1.1.2 Test bitstream #A3GE-2
Specification: A bitstream with many different combinations of values for top_field_first,
intra_predictors_reset, alternate_scan, frame_pred_frame_dct, dct_precision, intra_dc_precision,
q_scale_type, vop_fcode, dead_zone_disable, variable numbers of consecutive coded P-VOPs and coded I-
VOPs with downloaded quantization weighting matrices. Ideally the bitstream should contain all possible legal
combinations. Various syntax switches are toggled from VOP-to-VOP.
Functional stage: parser and control
Purpose: Check that decoder handle all scenarios.
5.7.1.1.3 Test bitstream #A3GE-3
Specification: All possible VLC’s symbols and IDCT mismatch. Mismatch and saturation.
Functional stage: parser ; IDCT accuracy
Purpose: Test that decoders has included the complete VLC tables and implements mismatch control.
2 © ISO/IEC 2005 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 14496-4:2004/Amd.1:2005(E)
5.7.1.1.4 Test bitstream #A3GE-4
Specification: Bitstream with only intra macroblocks using only the DC coefficient and predicted macroblocks
having no DCT coefficients. Reconstructed motion vectors used for predicting both luminance and
chrominance have all possible combinations of half-sample and full-sample values, both for the horizontal and
the vertical coordinates, and all those combinations are used for each prediction mode in both progressive
and interlaced coded VOPs.
Functional stage: MCP
Purpose: Check that decoder implements motion compensation stages with full accuracy in all cases. Except
for reconstruction of Intra DC blocks, the test does not involve other decoder functions such as IDCT, inverse
quantization and mismatch control. When a static decoder test is performed using the static test technique
described in this document, the decoder under test shall reconstruct samples identical to those reconstructed
by a reference decoder for all predicted macroblocks.
5.7.1.1.5 Test bitstream #A3GE-5
Specification: A bitstream implementing a test close to the IEEE 1180 IDCT mismatch test, to test the
decoder's IDCT statistical accuracy. Can be done using I-VOPs with a flat custom quantization matrix with all
16, and a quantizer value of 1. Use whatever number of VOPs are required to satisfy statistic count. Note that
because of saturation in [0, 255], the test cannot emulate exactly the IEEE 1180 IDCT test.
Functional stage: IDCT
Purpose: Check IDCT decoder accuracy. This is not a drift test since all macroblocks are of type Intra.
5.7.1.1.6 Test bitstream #A3GE-6
Specification: Bitstream causing maximum saturation of the inverse quantization by creating the greatest
n
amplitude combinations of macroblock quantization (quantizer value 31), visual weighting matrix (value 2 ),
n+3 n+3
and DCT coefficient (value −2 or 2 ), where n is the maximum allowed number of bits per pixel for the
profile-and-level combination.
Functional stage: inverse quantization
Purpose: Test that decoder implements properly the saturation of the inverse quantization (before the
mismatch control).
5.7.1.1.7 Test bitstream #A3GE-7
n
Specification: Bitstream causing large positive sample domain coefficients f[y][x] (e.g., 2 −1) added to large
n n
predicted values p[y][x] (e.g., 2 −1), or large negative sample domain coefficients f[y][x] (e.g., −2 ) added to
small predicted values p[y][x] (e.g., 0).
Functional stage: addition of the output of IDCT f[y][x] to the predicted values p[y][x] and saturation of the
n
result to the range [0, 2 −1].
Purpose: Test that decoder implements properly the addition of the output of IDCT f[y][x] to the predicted
n
values p[y][x] and saturation of the result to the range [0, 2 −1].
5.7.1.1.8 Test bitstream #A3GE-8
Specification: A bitstream with I-, P-VOPs, with motion vectors that are as large as permitted by the profile-
and-level combination.
Functional stage: reconstruction of motion vectors, MCP, control
Purpose: Check that decoder implements motion compensation properly when motion vectors are very large.
© ISO/IEC 2005 – All rights reserved 3
---------------------- Page: 6 ----------------------
ISO/IEC 14496-4:2004/Amd.1:2005(E)
5.7.1.1.9 Test bitstream #A3GE-9
Specification: A bitstream with quantizer matrices (intra and non-intra, and if permitted, chroma matrices too).
n
Matrices are not symmetrical (e.g., matrix coefficients are random numbers in the range [1, 2 ]). If permitted,
use of both scanning orders.
Functional stage: quantizer matrix download, matrix scanning.
Purpose: Check that decoder can download properly quantizer matrices and that it uses of correct scanning
of the matrices (i.e. not transposed).
5.7.1.1.10 Test bitstream #A3GE-10
Specification: A bitstream in which the output of the non-saturated integer number mathematical
IDCT f ’ (x, y), as defined in Annex A of ISO/IEC 14496-2, has large absolute values but values within the
n n−1 n n−1
range [−2 -2 , 2 +2 −1] for each coded block, where n is the maximum allowed number of bits per pixel
for the profile-and-level combination.
Functional stage: IDCT
Purpose: Check that IDCT decoder accuracy meets the requirements defined in Annex A of ISO/IEC 14496-2.
The peak error for a compliant decoder shall be less or equal to than 2 when decoding this bitstream. Note
that for blocks where f ’ (x, y) has values within the range [−300, 300], decoders that have a peak error larger
than 1 may not be compliant with the IEEE 1180 IDCT specification.
5.7.1.1.11 Test bitstream #A3GE-11
Specification: A bitstream with all macroblocks coded as the DPCM macroblock.
Functional stage: DPCM macroblock.
Purpose: Check that decoder implements the DPCM macroblock coding. When a static decoder test is
performed using the static test technique described in this document, the decoder under test shall reconstruct
samples identical to those reconstructed by the reference decoder for all DPCM macroblocks.
5.7.1.2 Test Bitstreams - Shape coding
Test bitstreams for shape coding in ISO/IEC 14496-4/Amd.3 do not belong to any class defined in 5.5.3.2 of
ISO/IEC 14496-4.
5.7.1.2.1 Test Bitstream #A3SH-1
Specification: A series of consecutive I -VOP with all macroblocks lying on the boundary and coded using the
HHC. The bitstream is designed such as to use ideally possible combinations of the HHC syntax and the VLC
entries. This bitstream contains both binary shape and texture information.
Functional stage: HHC
Purpose: Check that decoder process the HHC.
5.7.1.2.2 Test Bitstream #A3SH-2
Specification: A series of consecutive I- and P-VOP with all macroblocks lying on the boundary and coded
using shape MVs of non-zero. The bitstream is designed such as to use all entries of the VLC table for shape
MV decoding. This bitstream contains both binary shape and texture information.
Functional stage: shape MC, padding
Purpose: Check that decoder process the shape MC and paddin
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.