Conformance testing for internet video coding

Titre manque

General Information

Status
Published
Publication Date
16-Apr-2019
Current Stage
6060 - International Standard published
Start Date
17-Jun-2018
Completion Date
17-Apr-2019
Ref Project

RELATIONS

Buy Standard

Standard
ISO/IEC 14496-4:2004/Amd 46:2019 - Conformance testing for internet video coding
English language
9 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO/IEC
STANDARD 14496-4
Second edition
2004-12-15
AMENDMENT 46
2019-04
Information technology — Coding of
audio-visual objects —
Part 4:
Conformance testing
AMENDMENT 46: Conformance testing
for internet video coding
Reference number
ISO/IEC 14496-4:2004/Amd.46:2019(E)
ISO/IEC 2019
---------------------- Page: 1 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2019

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that

are members of ISO or IEC participate in the development of International Standards through

technical committees established by the respective organization to deal with particular fields of

technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other

international organizations, governmental and non-governmental, in liaison with ISO and IEC, also

take part in the work.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for

the different types of document should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/directives).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www .iso .org/patents).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the

World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso

.org/iso/foreword .html.

This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology,

Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.

A list of all parts in the ISO/IEC 14496 series can be found on the ISO website.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www .iso .org/members .html.
© ISO/IEC 2019 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
Information technology — Coding of audio-visual
objects —
Part 4:
Conformance testing
AMENDMENT 46: Conformance testing for internet video coding
Clause 2
Add the following new references:

ISO/IEC 14496-5, Information technology — Coding of audio-visual objects — Part 5: Reference software

ISO/IEC 14496-33, Information technology — Coding of audio-visual objects — Part 33: Internet video coding

Clause 13
Add the following new clause:
13 Internet video coding
13.1 General

This clause specifies tests designed to verify whether bitstreams and decoders meet the normative

requirements specified in ISO/IEC 14496-33.

Characteristics of coded bitstreams and decoders are defined in ISO/IEC 14496-33. An encoder can

claim conformance to ISO/IEC 14496-33 if the bitstreams that it generates are conforming bitstreams.

Decoder characteristics define the properties and capabilities of the applied decoding process. The

capabilities of a decoder specify which bitstreams the decoder can decode and reconstruct. A bitstream

can be decoded by a decoder if the characteristics of the bitstream are within the specified decoder

capabilities.

Procedures are described for testing conformance of bitstreams and decoders to the requirements

defined in ISO/IEC 14496-33. Given the set of characteristics claimed, the requirements that shall

be met are fully determined by ISO/IEC 14496-33. This clause summarizes the requirements, cross

references them to characteristics, and defines how conformance with them can be tested. This clause

also gives guidelines on how to construct bitstream test suites to check or verify decoder conformance.

In addition, a set of test bitstreams implemented according to those guidelines are provided at http:

//standards .iso .org/iso -iec/14496/ -4/ed -2/amd/46/en.
13.2 Conformance for ISO/IEC 14496-33
13.2.1 Normative tests for verifying conformance

The following subclauses specify normative tests for verifying conformance of video bitstreams as

well as decoders. These normative tests make use of test data (bitstream test suites) provided at http:

//standards .iso .org/iso -iec/14496/ -4/ed -2/amd/46/en and the reference software decoder provided in

ISO/IEC 14496-5 for ISO/IEC 14496-33 with source code included in ISO/IEC 14496-5 in electronic format.

© ISO/IEC 2019 – All rights reserved 1
---------------------- Page: 4 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
13.2.2 Procedure to test bitstreams

A bitstream that claims conformance with ISO/IEC 14496-33 shall pass the following normative test.

The bitstream shall be decoded by processing it with the reference software decoder provided in ISO/

IEC 14496-5 for ISO/IEC 14496-33. When processed by the reference software decoder, the bitstream

shall not cause any error or non-conformance messages to be reported by the reference software

decoder. This test should not be applied to bitstreams that are known to contain errors introduced by

transmission.

Successfully passing the reference software decoder test provides only a strong presumption that the

bitstream under test is conforming to the video coding specification, i.e. that it does indeed meet all the

requirements for ISO/IEC 14496-33 that are tested by the reference software decoder.

Additional tests may be necessary to more thoroughly check that the bitstream properly meets all the

requirements specified in ISO/IEC 14496-33. These complementary tests may be performed using other

video bitstream verifiers that perform more complete tests than those implemented by the reference

software decoder.

To check correctness of a bitstream, it is necessary to parse the entire bitstream and to extract all the

syntactic elements and other values derived from those syntactic elements and used by the decoding

process specified in ISO/IEC 14496-33.

A verifier may not necessarily perform all stages of the decoding process described in ISO/IEC 14496-

33 in order to verify bitstream correctness. Many tests can be performed on syntax elements in a state

prior to their use in some processing stages.
13.2.3 Procedure to test decoder conformance
13.2.3.1 Conformance bitstreams

Conformance bitstreams are available at http: //standards .iso .org/iso -iec/14496/ -4/ed -2/amd/46/en.

The following information is included in a single zipped file for each such bitstream.

Bitstream
MD5 sum file (for each decoded frame)

The reference software decoder provided in ISO/IEC 14496-5 shall be used to generate the necessary

reference decoded frames from the bitstream.
13.2.3.2 Requirements on output of the decoding process

It is a requirement that all of the decoded frames output by a conforming decoder shall be in the same

order as output by the reference software decoder. It is a further requirement that all of the values of

samples output by a conforming decoder, prior to post processing, shall be exactly equal to the values of

the corresponding samples output by the reference software decoder.
13.2.4 Test bitstreams — IVC
13.2.4.1 Test bitstreams #TRANS_A

Specification: All slices are coded as I slices. Each frame contains only one slice. abt_enable is set to 1.

Functional stage: Test the reconstruction process of I slices with variable block-size transform and

intra prediction.

Purpose: Check if decoder can correctly decode I slices with variable block-size transform and intra

prediction.
2 © ISO/IEC 2019 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
13.2.4.2 Test bitstreams #TRANS_B

Specification: All slices are coded as I and P slices. Each frame contains only one slice. abt_enable is

set to 1.

Functional stage: Test the reconstruction process of I and P slices with variable block-size transform.

Purpose: Check if decoder can correctly decode I and P slices with variable block-size transform.

13.2.4.3 Test bitstreams #TRANS_C

Specification: All slices are coded as I, P, and B slices. Each frame contains only one slice. abt_enable is

set to 1.

Functional stage: Test the reconstruction process of I, P, and B slices with variable block-size transform.

Purpose: Check if decoder can correctly decode I, P, and B slices with variable block-size transform.

13.2.4.4 Test bitstreams #MULQP_A

Specification: All slices are coded as I slices. Each frame contains only one slice. Each slice has a random

QP value in the range of 0 to 63.
Functional stage: The reconstruction process of I slices with various QP values.
Purpose: Check if the decoder can handle I slices with various QP values.
13.2.4.5 Test bitstreams #MULQP_B

Specification: All slices are coded as I and P slices. Each frame contains only one slice. Each slice has a

random QP value in the range of 0 to 63.

Functional stage: The reconstruction process of I and P slices with various QP values.

Purpose: Check if the decoder can handle I and P slices with various QP values.
13.2.4.6 Test bitstreams #MULQP_C

Specification: All slices are coded as I, P, and B slices. Each frame contains only one slice. Each slice has

a random QP value in the range of 0 to 63.

Functional stage: The reconstruction process of I, P, and B slices with various QP values.

Purpose: Check if the decoder can handle I, P, and B slices with various QP values.

13.2.4.7 Test bitstreams #MULSLICE_A

Specification: All slices are coded as I slices. Each frame contains a random number of slices from 1 to 10.

Functional stage: Test the reconstruction process of I frames with multiple slices.

Purpose: Check if the decoder can correctly decode I frames with multiple slices.

13.2.4.8 Test bitstreams #MULSLICE_B

Specification: All slices are coded as I and P slices. Each frame contains a random number of slices

from 1 to 10.

Functional stage: Test the reconstruction process of I and P frames with multiple slices.

Purpose: Check if the decoder can correctly decode I and P frames with multiple slices.

© ISO/IEC 2019 – All rights reserved 3
---------------------- Page: 6 ----------------------
ISO/IEC 14496-4:2004/Amd.46:2019(E)
13.2.4.9 Test bitstreams #MULSLICE_C

Specification: All slices are coded as I, P, and B slices. Each frame contains a random number of slices

from 1 to 10.

Functional stage: Test the reconstruction process of I, P, and B frames with multiple slices.

Purpose: Check if the decoder can correctly decode I, P, and B frames with multiple slices.

13.2.4.10 Test bitstreams #DBLK_A

Specification: All slices are coded as I slices. Each frame contains only one slice. Each slice has a random

QP value in the range of 22 to 63.

Functional stage: Test the deblocking filter process of I slices with various QP values.

Purpose: Check if the decoder can correctly decode I slices with various QP values.

13.2.4.11 Test bitstreams #DBLK_B

Specification: All slices are coded as I and P slices. Each frame contains only one slice. Each slice has a

random QP value in the range of 22 to 63.

Functional stage: Test the deblocking filter process of I and P slices with various QP values.

Purpose: Check if the decoder can correctly decode I and P slices with various QP values.

13.2.4.12 Test bitstreams #DBLK_C

Specification: All slices are coded as I, P, and B slices. Each frame contains only one slice. Each slice has

a random QP value in the range of 22 to 63.

Functional stage: Test the deblocking filter process of I, P, and B slices with various QP values.

Purpose: Check if the decoder can correctly decode slices with var
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.