ISO/IEC 14496-4:2004/Amd 46:2019
(Main)Conformance testing for internet video coding
Conformance testing for internet video coding
Titre manque
General Information
Relations
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 14496-4
Second edition
2004-12-15
AMENDMENT 46
2019-04
Information technology — Coding of
audio-visual objects —
Part 4:
Conformance testing
AMENDMENT 46: Conformance testing
for internet video coding
Reference number
ISO/IEC 14496-4:2004/Amd.46:2019(E)
©
ISO/IEC 2019
---------------------- Page: 1 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso
.org/iso/foreword .html.
This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 14496 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/members .html.
© ISO/IEC 2019 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
Information technology — Coding of audio-visual
objects —
Part 4:
Conformance testing
AMENDMENT 46: Conformance testing for internet video coding
Clause 2
Add the following new references:
ISO/IEC 14496-5, Information technology — Coding of audio-visual objects — Part 5: Reference software
ISO/IEC 14496-33, Information technology — Coding of audio-visual objects — Part 33: Internet video coding
Clause 13
Add the following new clause:
13 Internet video coding
13.1 General
This clause specifies tests designed to verify whether bitstreams and decoders meet the normative
requirements specified in ISO/IEC 14496-33.
Characteristics of coded bitstreams and decoders are defined in ISO/IEC 14496-33. An encoder can
claim conformance to ISO/IEC 14496-33 if the bitstreams that it generates are conforming bitstreams.
Decoder characteristics define the properties and capabilities of the applied decoding process. The
capabilities of a decoder specify which bitstreams the decoder can decode and reconstruct. A bitstream
can be decoded by a decoder if the characteristics of the bitstream are within the specified decoder
capabilities.
Procedures are described for testing conformance of bitstreams and decoders to the requirements
defined in ISO/IEC 14496-33. Given the set of characteristics claimed, the requirements that shall
be met are fully determined by ISO/IEC 14496-33. This clause summarizes the requirements, cross
references them to characteristics, and defines how conformance with them can be tested. This clause
also gives guidelines on how to construct bitstream test suites to check or verify decoder conformance.
In addition, a set of test bitstreams implemented according to those guidelines are provided at http:
//standards .iso .org/iso -iec/14496/ -4/ed -2/amd/46/en.
13.2 Conformance for ISO/IEC 14496-33
13.2.1 Normative tests for verifying conformance
The following subclauses specify normative tests for verifying conformance of video bitstreams as
well as decoders. These normative tests make use of test data (bitstream test suites) provided at http:
//standards .iso .org/iso -iec/14496/ -4/ed -2/amd/46/en and the reference software decoder provided in
ISO/IEC 14496-5 for ISO/IEC 14496-33 with source code included in ISO/IEC 14496-5 in electronic format.
© ISO/IEC 2019 – All rights reserved 1
---------------------- Page: 4 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
13.2.2 Procedure to test bitstreams
A bitstream that claims conformance with ISO/IEC 14496-33 shall pass the following normative test.
The bitstream shall be decoded by processing it with the reference software decoder provided in ISO/
IEC 14496-5 for ISO/IEC 14496-33. When processed by the reference software decoder, the bitstream
shall not cause any error or non-conformance messages to be reported by the reference software
decoder. This test should not be applied to bitstreams that are known to contain errors introduced by
transmission.
Successfully passing the reference software decoder test provides only a strong presumption that the
bitstream under test is conforming to the video coding specification, i.e. that it does indeed meet all the
requirements for ISO/IEC 14496-33 that are tested by the reference software decoder.
Additional tests may be necessary to more thoroughly check that the bitstream properly meets all the
requirements specified in ISO/IEC 14496-33. These complementary tests may be performed using other
video bitstream verifiers that perform more complete tests than those implemented by the reference
software decoder.
To check correctness of a bitstream, it is necessary to parse the entire bitstream and to extract all the
syntactic elements and other values derived from those syntactic elements and used by the decoding
process specified in ISO/IEC 14496-33.
A verifier may not necessarily perform all stages of the decoding process described in ISO/IEC 14496-
33 in order to verify bitstream correctness. Many tests can be performed on syntax elements in a state
prior to their use in some processing stages.
13.2.3 Procedure to test decoder conformance
13.2.3.1 Conformance bitstreams
Conformance bitstreams are available at http: //standards .iso .org/iso -iec/14496/ -4/ed -2/amd/46/en.
The following information is included in a single zipped file for each such bitstream.
Bitstream
MD5 sum file (for each decoded frame)
The reference software decoder provided in ISO/IEC 14496-5 shall be used to generate the necessary
reference decoded frames from the bitstream.
13.2.3.2 Requirements on output of the decoding process
It is a requirement that all of the decoded frames output by a conforming decoder shall be in the same
order as output by the reference software decoder. It is a further requirement that all of the values of
samples output by a conforming decoder, prior to post processing, shall be exactly equal to the values of
the corresponding samples output by the reference software decoder.
13.2.4 Test bitstreams — IVC
13.2.4.1 Test bitstreams #TRANS_A
Specification: All slices are coded as I slices. Each frame contains only one slice. abt_enable is set to 1.
Functional stage: Test the reconstruction process of I slices with variable block-size transform and
intra prediction.
Purpose: Check if decoder can correctly decode I slices with variable block-size transform and intra
prediction.
2 © ISO/IEC 2019 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
13.2.4.2 Test bitstreams #TRANS_B
Specification: All slices are coded as I and P slices. Each frame contains only one slice. abt_enable is
set to 1.
Functional stage: Test the reconstruction process of I and P slices with variable block-size transform.
Purpose: Check if decoder can correctly decode I and P slices with variable block-size transform.
13.2.4.3 Test bitstreams #TRANS_C
Specification: All slices are coded as I, P, and B slices. Each frame contains only one slice. abt_enable is
set to 1.
Functional stage: Test the reconstruction process of I, P, and B slices with variable block-size transform.
Purpose: Check if decoder can correctly decode I, P, and B slices with variable block-size transform.
13.2.4.4 Test bitstreams #MULQP_A
Specification: All slices are coded as I slices. Each frame contains only one slice. Each slice has a random
QP value in the range of 0 to 63.
Functional stage: The reconstruction process of I slices with various QP values.
Purpose: Check if the decoder can handle I slices with various QP values.
13.2.4.5 Test bitstreams #MULQP_B
Specification: All slices are coded as I and P slices. Each frame contains only one slice. Each slice has a
random QP value in the range of 0 to 63.
Functional stage: The reconstruction process of I and P slices with various QP values.
Purpose: Check if the decoder can handle I and P slices with various QP values.
13.2.4.6 Test bitstreams #MULQP_C
Specification: All slices are coded as I, P, and B slices. Each frame contains only one slice. Each slice has
a random QP value in the range of 0 to 63.
Functional stage: The reconstruction process of I, P, and B slices with various QP values.
Purpose: Check if the decoder can handle I, P, and B slices with various QP values.
13.2.4.7 Test bitstreams #MULSLICE_A
Specification: All slices are coded as I slices. Each frame contains a random number of slices from 1 to 10.
Functional stage: Test the reconstruction process of I frames with multiple slices.
Purpose: Check if the decoder can correctly decode I frames with multiple slices.
13.2.4.8 Test bitstreams #MULSLICE_B
Specification: All slices are coded as I and P slices. Each frame contains a random number of slices
from 1 to 10.
Functional stage: Test the reconstruction process of I and P frames with multiple slices.
Purpose: Check if the decoder can correctly decode I and P frames with multiple slices.
© ISO/IEC 2019 – All rights reserved 3
---------------------- Page: 6 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
13.2.4.9 Test bitstreams #MULSLICE_C
Specification: All slices are coded as I, P, and B slices. Each frame contains a random number of slices
from 1 to 10.
Functional stage: Test the reconstruction process of I, P, and B frames with multiple slices.
Purpose: Check if the decoder can correctly decode I, P, and B frames with multiple slices.
13.2.4.10 Test bitstreams #DBLK_A
Specification: All slices are coded as I slices. Each frame contains only one slice. Each slice has a random
QP value in the range of 22 to 63.
Functional stage: Test the deblocking filter process of I slices with various QP values.
Purpose: Check if the decoder can correctly decode I slices with various QP values.
13.2.4.11 Test bitstreams #DBLK_B
Specification: All slices are coded as I and P slices. Each frame contains only one slice. Each slice has a
random QP value in the range of 22 to 63.
Functional stage: Test the deblocking filter process of I and P slices with various QP values.
Purpose: Check if the decoder can correctly decode I and P slices with various QP values.
13.2.4.12 Test bitstreams #DBLK_C
Specification: All slices are coded as I, P, and B slices. Each frame contains only one slice. Each slice has
a random QP value in the range of 22 to 63.
Functional stage: Test the deblocking filter process of I, P, and B slices with various QP values.
Purpose: Check if the decoder can correctly decode slices with var
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.