ISO/IEC 23000-10:2009/Amd 1:2010
(Amendment)Information technology — Multimedia application format (MPEG-A) — Part 10: Video surveillance application format — Amendment 1: Conformance and reference software
Information technology — Multimedia application format (MPEG-A) — Part 10: Video surveillance application format — Amendment 1: Conformance and reference software
Technologie de l'information — Format pour application multimédia (MPEG-A) — Partie 10: Format pour application à la vidéosurveillance — Amendement 1: Conformité et logiciel de référence
General Information
Relations
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 23000-10
First edition
2009-05-01
AMENDMENT 1
2010-06-01
Information technology — Multimedia
application format (MPEG-A) —
Part 10:
Video surveillance application format
AMENDMENT 1: Conformance and
reference software
Technologie de l'information — Format pour application multimédia
(MPEG-A) —
Partie 10: Format pour application à la vidéosurveillance
AMENDEMENT 1: Conformité et logiciel de référence
Reference number
ISO/IEC 23000-10:2009/Amd.1:2010(E)
©
ISO/IEC 2010
---------------------- Page: 1 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but
shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In
the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2010
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2010 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
Amendment 1 to ISO/IEC 23000-10:2009 was prepared by Joint Technical Committee ISO/IEC JTC 1,
Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia
information.
This Amendment contains details of the conformance specifications and reference software for the Video
surveillance application format (VSAF).
© ISO/IEC 2010 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
Information technology — Multimedia application format
(MPEG-A) —
Part 10:
Video surveillance application format
AMENDMENT 1: Conformance and reference software
Page 15, after 6.4.1.3 add the following two new clauses:
7 Conformance Points
7.1 Introduction
This Clause provides bitstreams and pointers to the software implementation that can be used to provide a
deterministic answer to the following questions:
⎯ Does a given bitstream conform to Video surveillance application format (VSAF) as defined in this part of
ISO/IEC 23000, i.e. is it able to be decoded by the informative Video surveillance viewer (VSV)
implementation?
⎯ Does a given Video surveillance viewer (VSV) implementation conform to Video surveillance application
format (VSAF) as defined in this part of ISO/IEC 23000, i.e. is it able to decode the reference bitstreams
contained in this part of ISO/IEC 23000?
⎯ The Video surveillance packer (VSP) software is normative and produces conformance VSAF bitstreams.
The term bitstream is used here to describe the VSAF file format together with its contents.
7.2 AVC Bitstream
MPEG-4 AVC (Advanced Video Coding) bitstreams stored inside a VSAF file shall comply with the
specifications of this part of ISO/IEC 23000. An AVC bitstream that conforms to the VSV shall meet the
following requirements:
⎯ All AVC bitstreams shall have the same total duration, e.g. all video clips shall be the same length of time.
Their physical lengths may vary, e.g. according to fps (frames per second) etc.
7.3 File Format
⎯ VSAF files shall comply with the specifications of this part of ISO/IEC 23000. As an extension of the AVC
File Format [ISO/IEC 14496-15:2004], it shall contain AVC file format structure with derivations as
specified in 4.5 of this part of ISO/IEC 23000 as well as metadata boxes as specified in 6.2, 6.3, and 6.4
of this part of ISO/IEC 23000.
© ISO/IEC 2010 – All rights reserved 1
---------------------- Page: 4 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
⎯ The 'major brand' name shall contain 'vsf1' brand name, so the VSV can parse the boxes in the file format
that conforms to the file format as specified in 4.5 of this part of ISO/IEC 23000.
⎯ The AVC video track shall conform to the definition as described in Clause 5 of this part of
ISO/IEC 23000.
7.4 Metadata
⎯ All the XML metadata shall conform to the sets of ISO/IEC 15938 Parts 1 (Systems), 2 (DDL), 3 (Visual)
and 5 (MDS) specified for VSAF. Every element shall comply with the specifications of this part of
ISO/IEC 23000.
⎯ The semantics of XML metadata shall conform to the specifications of this part of ISO/IEC 23000.
7.5 Measurement procedure
The procedure to check the conformance points is as follows:
⎯ The VSV parses the VSAF file and displays its contents. The video tracks it contains are playable, the
binary metadata and MPEG-7 metadata are processed and displayed.
⎯ The VSV parses the SPS (sequence parameter sets) NAL (network abstraction layer) unit of the AVC
bitstream inside the AVC video track.
There is no tolerance in measurement procedure. The diagnosis is pass or fail, however, it is possible to
identify which parts of a VSV do and which do not comply.
7.6 Conformance files
A number of conformance files have been produced using the Video surveillance packer (VSP) software. The
files are listed in Table AMD1.1.
The VSAF specification supports AVC bitstreams up to level 3.1; therefore different conformance files have
been produced reflecting a sample of the appropriate range. The files are designed to test VSAF functionality
and not the complete range of compliant AVC levels.
The conformance files are based upon the video bitstream "foreman.264". An external software module was
used to generate the ISO/IEC 15938 meta-data included.
2 © ISO/IEC 2010 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
Table AMD1.1 — Use the VSV implementation.
File Conformance test Pass/fail
(o/ x)
1.mp4 single camera (track), testing:
AVC bitstream profile and level conformance
correct mandatory binary metadata
major brand
the video tracks are the same length
2.mp4
two cameras, testing:
as above
the ability for the format to contain more than one camera (i.e. video track)
the file's MAFIdentification box Predecessor field references 1.mp4
the file's MAFIdentification box Successor field references 3.mp4
3.mp4 two cameras, testing:
as above
ISO/IEC 15938 file- and track-level metadata elements are present
8 Reference Software
8.1 Introduction
This Clause describes a cross-platform software implementation in the C++ programming language of Video
surveillance application format (VSAF) as part of this part of ISO/IEC 23000.
⎯ Video surveillance packer (VSP) – normative
⎯ Video surveillance viewer (VSV) – informative
The VSAF reference software is normative in the sense that it correctly implements the normative clauses
contained in this part of ISO/IEC 23000. Conforming this part of ISO/IEC 23000 implementations are not
expected to follow the algorithms or the programming techniques used by the VSAF reference software.
Although the packing software is considered normative, it is not expected to add anything normative to the
VSAF textual clauses included in this part of ISO/IEC 23000. At present, the software compiles under
Windows and Linux.
If present, ISO/IEC 15938 descriptors containing DominantColor are processed to provide a demonstration of
content-based image retrieval.
8.2 Architecture
The architecture of the software as depicted in Figure AMD1.1 has three main components comprising a
packer, with which to create conformance VSAF files, a viewer with which to inspect the conformance VSAF
files and the various shared software libraries.
© ISO/IEC 2010 – All rights reserved 3
---------------------- Page: 6 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
Packer Application (VSP) Viewer Application (VSV)
.NET / QT Library
Image Data Image Data
Image Data Image Data
Image Data
Image Data
AVC Bitstream
AVC Encoder Parser AVC Decoder
Binary metadata Binary metadata
Extended AVC FF
Binary metadata Binary metadata
Library
Binary metadata Binary metadata
MP7JRS Library
XML metadata XML metadata
XML metadata XML metadata
XML metadata XML metadata
Figure AMD1.1 — Architecture of the VSAF reference software
8.3 Software components
Accordingly the VSAF reference software is organised according the following structure:
⎯ Video surveillance packager (VSP): a user-interface and set of classes for the generation of the AVC
(Advanced Video Coding) File Format with Video surveillance application format extensions (VSE)
otherwise known as a VSAF file.
⎯ Video surveillance viewer (VSV): a user-interface and set of classes to parse and display the AVC file
format with VSE. The application allows the playback of the video tracks.
⎯ Extended AVC FF (File Format): a library of classes implementing the primitive functions defined in the
Technical Specification. This software is normative as much as the Technical Specification and provides
the functionalities needed to pack and unpack the VSAF files.
⎯ MP7JRS library: non-normative library of classes encapsulating the functionalities to generate and parse
MPEG-7 XML data which a device may have as a hardware or software implementation.
⎯ AVC Encoder: non-normative library of classes encapsulating the functionalities to encode an AVC
bitstream which a device may have as a hardware or software implementation.
⎯ AVC Decoder: non-normative library of classes encapsulating the functionalities to decode an AVC
bitstream which a device may have as a hardware or software implementation.
⎯ AVC Bitstream Parser: non-normative library of classes encapsulating the functionalities to pack and
unpack AVC bitstream to and from the AVC file format with VSE which a device may have as a hardware
or software implementation.
⎯ Data: The data input and output by the VSP and VSV applications. These data include folders of images,
binary metadata and XML metadata.
4 © ISO/IEC 2010 – All rights reserved
---------------------- Page: 7 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
8.3.1 Internal software tools
The VSAF reference software comprises the following software tools:
⎯ VSAF file format reference software: ISO Base Media File Format amended with AVC extensions (see
Table AMD1.2 for modifications to the library).
⎯ AVC bitstream parser: NAL (network abstraction layer) conversion and file format insertion / extraction.
⎯ YUV to RGB conversion: C++ class converts the output of the AVC decoder into red green blue (RGB)
images.
⎯ VSAF MPEG-7 metadata library: based upon MP7-JRS (see External software tools).
⎯ Video surveillance packer (VSP): command line program to create a new VSAF file based upon a
configuration file.
⎯ Video surveillance viewer (VSV): opens the VSAF file, tests for conformance and plays back tracks.
⎯ DominantColor Description Scheme decoder: restricted to aspects of the description scheme.
8.3.2 External software tools
Each individual module also requires a number of libraries in order to be compiled; these must be
downloaded.
⎯ The MP7JRS 2.2 library. The MP7-JRS performs the task of MPEG-7 Parser/ Marshaller/ Unmarshaller.
⎯ The AVC reference decoding and encoding software: (JM v.15.1).
⎯ Boost library for conversion from string to unsigned 64 bit number.
8.4 Video surveillance packer (VSP)
The Video surveillance packer (VSP) software forms the normative part of the reference software. It
comprises a command line user-interface with which to produce conformance VSAF files. The software
requires an initialisation file to provide the necessary VSAF configuration details. All the features of the
specification are able to be produced.
NOTE The timed meta-data tracks are artificially produced.
8.4.1 Header files
⎯ #include "CBitStream.h"
⎯ #include "CPacket.h"
⎯ #include "CAnalyse.h"
⎯ #include "CommonDef.h"
⎯ #include "MP4Atoms.h"
⎯ #include "MP4Movies.h"
⎯ #include "MP4Descriptors.h"
© ISO/IEC 2010 – All rights reserved 5
---------------------- Page: 8 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
⎯ #include "AVCSampleFunctions.h"
⎯ #include "vsaf_meta_data.h"
⎯ #include "boost/lexical_cast.hpp"
8.4.2 Functions
The following functions are used to generate the appropriate Boxes and functions to populate them:
⎯ ISOSetMovieBrand()
⎯ ISONewFileMeta()
⎯ ISONewMAFIdentification()
⎯ MP4NewHandle()
⎯ ISOAddPrimaryData()
⎯ MP4DisposeHandle()
⎯ MP4NewMovieTrack()
⎯ MP4AddTrackToMovieIOD()
⎯ MP4CreateAVCConfigAtom()
⎯ MP4SetHandleSize()
⎯ MP4NewTrackMedia()
⎯ MP4BeginMediaEdits()
⎯ MP4SetMediaLanguage()
⎯ ISONewAVCSampleDescription()
⎯ ChunkInit()
⎯ SampleInit()
⎯ ChunkAddSample()
⎯ MP4HandleCat()
⎯ ChunkWrite()
⎯ SampleAddNALUnit()
⎯ MP4EndMediaEdits()
⎯ MP4GetMediaDuration()
⎯ MP4InsertMediaIntoTrack()
⎯ ISONewTrackMeta()
6 © ISO/IEC 2010 – All rights reserved
---------------------- Page: 9 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
⎯ ISONewCameraIdentification()
⎯ ISOAddTrackReference()
⎯ ISONewVideoSurveillanceMetadataSampleDescription()
⎯ ISOAddMediaSamples()
⎯ ISODisposeHandle()
8.5 Video surveillance viewer (VSV)
The Video surveillance viewer (VSV) software forms the informative parts of the reference software. The
VSAF files are able to be loaded and inspected and their conformance can be verified. Screenshots of the
Main application window are shown in Figure AMD1.2 and a view of the track playback window is shown in
Figure AMD1.3.
The VSV parses the metadata using sets of “get” functions of the VSAF file using the VSAF API (Application
Programming Interface). These API calls confor
...
INTERNATIONAL ISO/IEC
STANDARD 23000-10
First edition
2009-05-01
AMENDMENT 1
2010-06-01
Information technology — Multimedia
application format (MPEG-A) —
Part 10:
Video surveillance application format
AMENDMENT 1: Conformance and
reference software
Technologies de l'information — Format pour application multimédia
(MPEG-A) —
Partie 10: Format pour application à la vidéosurveillance
AMENDEMENT 1: Conformité et logiciel de référence
Reference number
ISO/IEC 23000-10:2009/Amd.1:2010(E)
©
ISO/IEC 2010
---------------------- Page: 1 ----------------------
ISO/IEC 23000-10:2009/Amd.1:2010(E)
PDF disclaimer
PDF files may contain embedded typefaces. In accordance with Adobe's licensing policy, such files may be printed or viewed but shall
not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading a PDF file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create the PDF file(s) constituting this document can be found in the General Info relative to
the file(s); the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the files are suitable for
use by ISO member bodies. In the unlikely event that a problem relating to them is found, please inform the Central Secretariat at the
address given below.
This CD-ROM contains:
1) the publication ISO/IEC 23000-10:2009/Amd.1:2010 in portable document format (PDF), which can
be viewed using Adobe® Acrobat® Reader;
2) conformance files and reference software for video surveillance application format.
Adobe and Acrobat are trademarks of Adobe Systems Incorporated.
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2010
All rights reserved. Unless required for installation or otherwise specified, no part of this CD-ROM may be reproduced, stored in a retrieval
system or transmitted in any form or by any means without prior permission from ISO. Requests for permission to reproduce
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.