ISO/IEC 15938-15:2019
(Main)Information technology — Multimedia content description interface — Part 15: Compact descriptors for video analysis
Information technology — Multimedia content description interface — Part 15: Compact descriptors for video analysis
This document addresses descriptor technology for search and retrieval applications, i.e. for visual content matching in video. Visual content matching includes matching of views of large and small objects and scenes, with robustness to partial occlusions as well as changes in vantage point, camera parameters and lighting conditions. The objects of interest comprise planar or non-planar, rigid or partially rigid, textured or partially textured objects, but exclude the identification of people and faces. The databases can be large, for example broadcast archives or videos available on the internet. Such applications thus require video descriptors that enable matching with smaller descriptor sizes and shorter runtimes as compared to application enabled by single-frame (still image) descriptors (e.g. CVDS, ISO/IEC 15938-13) in the video domain. Compact descriptors for video analysis for search and retrieval applications: — enable design of interoperable object instance search applications; — minimize the size of video descriptors; — ensure high matching performances of objects (in terms of accuracy and complexity); — enable efficient implementation of those functionalities on professional or embedded systems. This document provides a complementary tool to the suite of existing standards, such as ISO/IEC 15938-13.
Technologies de l'information — Interface de description du contenu multimédia — Partie 15: Descripteurs compacts pour analyse de vidéo
General Information
Relations
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 15938-15
First edition
2019-07
Information technology — Multimedia
content description interface —
Part 15:
Compact descriptors for video analysis
Technologies de l'information — Interface de description du contenu
multimédia —
Partie 15: Descripteurs compacts pour analyse de vidéo
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Abbreviated terms, operators, mnemonics, functions and symbols .3
4.1 General . 3
4.2 Abbreviated terms . 3
4.3 Arithmetic operators . 3
4.4 Logical operators . 4
4.5 Relational operators . 4
4.6 Bitwise operators. 4
4.7 Interval specification . 4
4.8 Mnemonics . 5
4.9 Functions . 5
4.10 Symbols . 5
5 CDVA bitstream syntax . 6
5.1 CDVA descriptor . 6
5.1.1 Binary representation syntax . 6
5.1.2 Descriptor component semantics . 7
5.2 CDVA header . 7
5.2.1 Binary representation syntax . 7
5.2.2 Descriptor component semantics . 8
5.3 Segment header .10
5.3.1 General.10
5.3.2 Binary representation syntax .10
5.3.3 Descriptor component semantics .10
5.4 Global descriptor .11
5.4.1 Binary representation syntax .11
5.4.2 Descriptor component semantics .11
5.5 Local descriptor .12
5.5.1 General.12
5.5.2 Local feature descriptor .12
5.5.3 Local descriptor locations .14
5.6 Deep feature descriptor .15
5.6.1 Binary representation syntax .15
5.6.2 Descriptor component semantics .15
6 CDVA descriptor .15
6.1 Components .15
6.1.1 General.15
6.1.2 Global descriptor .16
6.1.3 Local descriptor .19
6.1.4 Deep feature descriptor .20
6.2 Encoding procedure .23
6.2.1 General.23
6.2.2 Normative steps .25
6.2.3 Informative steps .26
Annex A (normative) Recommended parameter values .28
Annex B (normative) Parameters of the deep feature extraction process .29
Bibliography .32
© ISO/IEC 2019 – All rights reserved iii
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
specified in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see: www .iso
.org/iso/foreword .html.
This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 15938 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at http: //www .iso .org/members .html.
iv © ISO/IEC 2019 – All rights reserved
Introduction
ISO/IEC 15938 (all parts), also known as "Multimedia content description interface", provides a
standardized set of technologies for describing multimedia content. It addresses a broad spectrum of
multimedia applications and requirements by providing a metadata system for describing the features
of multimedia content.
The following are specified in this ISO/IEC 15938 (all parts):
Description schemes (DS) describe entities or relationships pertaining to multimedia content.
Description schemes specify the structure and semantics of their components, which may be description
schemes, descriptors or datatypes.
Descriptors (D) describe features, attributes or groups of attributes of multimedia content.
Datatypes are the basic reusable datatypes employed by description schemes and descriptors.
Description definition language (DDL) defines description schemes, descriptors and datatypes by
specifying their syntax, and allows their extension.
Systems tools support delivery of descriptions, multiplexing of descriptions with multimedia content,
synchronization, file format, etc.
The ISO/IEC 15938 series is subdivided into 15 published parts with further parts in development:
— Part 1: Systems: specifies the tools for preparing descriptions for efficient transport and storage,
compressing descriptions, and allowing synchronization between content and descriptions.
— Part 2: Description definition language: specifies the language for defining the series set of
description tools (DSs, Ds and datatypes) and for defining new description tools.
— Part 3: Visual: specifies the description tools pertaining to visual content.
— Part 4: A
...
INTERNATIONAL ISO/IEC
STANDARD 15938-15
First edition
2019-07
Information technology — Multimedia
content description interface —
Part 15:
Compact descriptors for video analysis
Technologies de l'information — Interface de description du contenu
multimédia —
Partie 15: Descripteurs compacts pour analyse de vidéo
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Abbreviated terms, operators, mnemonics, functions and symbols .3
4.1 General . 3
4.2 Abbreviated terms . 3
4.3 Arithmetic operators . 3
4.4 Logical operators . 4
4.5 Relational operators . 4
4.6 Bitwise operators. 4
4.7 Interval specification . 4
4.8 Mnemonics . 5
4.9 Functions . 5
4.10 Symbols . 5
5 CDVA bitstream syntax . 6
5.1 CDVA descriptor . 6
5.1.1 Binary representation syntax . 6
5.1.2 Descriptor component semantics . 7
5.2 CDVA header . 7
5.2.1 Binary representation syntax . 7
5.2.2 Descriptor component semantics . 8
5.3 Segment header .10
5.3.1 General.10
5.3.2 Binary representation syntax .10
5.3.3 Descriptor component semantics .10
5.4 Global descriptor .11
5.4.1 Binary representation syntax .11
5.4.2 Descriptor component semantics .11
5.5 Local descriptor .12
5.5.1 General.12
5.5.2 Local feature descriptor .12
5.5.3 Local descriptor locations .14
5.6 Deep feature descriptor .15
5.6.1 Binary representation syntax .15
5.6.2 Descriptor component semantics .15
6 CDVA descriptor .15
6.1 Components .15
6.1.1 General.15
6.1.2 Global descriptor .16
6.1.3 Local descriptor .19
6.1.4 Deep feature descriptor .20
6.2 Encoding procedure .23
6.2.1 General.23
6.2.2 Normative steps .25
6.2.3 Informative steps .26
Annex A (normative) Recommended parameter values .28
Annex B (normative) Parameters of the deep feature extraction process .29
Bibliography .32
© ISO/IEC 2019 – All rights reserved iii
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
specified in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see: www .iso
.org/iso/foreword .html.
This document was prepared by Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 15938 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at http: //www .iso .org/members .html.
iv © ISO/IEC 2019 – All rights reserved
Introduction
ISO/IEC 15938 (all parts), also known as "Multimedia content description interface", provides a
standardized set of technologies for describing multimedia content. It addresses a broad spectrum of
multimedia applications and requirements by providing a metadata system for describing the features
of multimedia content.
The following are specified in this ISO/IEC 15938 (all parts):
Description schemes (DS) describe entities or relationships pertaining to multimedia content.
Description schemes specify the structure and semantics of their components, which may be description
schemes, descriptors or datatypes.
Descriptors (D) describe features, attributes or groups of attributes of multimedia content.
Datatypes are the basic reusable datatypes employed by description schemes and descriptors.
Description definition language (DDL) defines description schemes, descriptors and datatypes by
specifying their syntax, and allows their extension.
Systems tools support delivery of descriptions, multiplexing of descriptions with multimedia content,
synchronization, file format, etc.
The ISO/IEC 15938 series is subdivided into 15 published parts with further parts in development:
— Part 1: Systems: specifies the tools for preparing descriptions for efficient transport and storage,
compressing descriptions, and allowing synchronization between content and descriptions.
— Part 2: Description definition language: specifies the language for defining the series set of
description tools (DSs, Ds and datatypes) and for defining new description tools.
— Part 3: Visual: specifies the description tools pertaining to visual content.
— Part 4: A
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.