Information technology — Multimedia content description interface — Part 14: Reference software, conformance and usage guidelines for compact descriptors for visual search

ISO/IEC 15938-14:2018 provides the reference software, specifies the conformance testing, and gives usage guidelines for ISO/IEC 15938‑13.

Technologies de l'information — Interface de description du contenu multimédia — Partie 14: Logiciels de référence, conformité et lignes directrices pour l'utilisation des descripteurs compacts pour recherche visuelle

General Information

Status
Published
Publication Date
06-Feb-2018
Current Stage
9060 - Close of review
Start Date
02-Sep-2028
Ref Project

Buy Standard

Standard
ISO/IEC 15938-14:2018 - Information technology -- Multimedia content description interface
English language
15 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 15938-14
First edition
2018-02
Information technology — Multimedia
content description interface —
Part 14:
Reference software, conformance
and usage guidelines for compact
descriptors for visual search
Technologies de l'information — Interface de description du contenu
multimédia —
Partie 14: Logiciels de référence, conformité et lignes directrices pour
l'utilisation des descripteurs compacts pour recherche visuelle
Reference number
ISO/IEC 15938-14:2018(E)
©
ISO/IEC 2018

---------------------- Page: 1 ----------------------
ISO/IEC 15938-14:2018(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2018, Published in Switzerland
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form
or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior
written permission. Permission can be requested from either ISO at the address below or ISO’s member body in the country of
the requester.
ISO copyright office
Ch. de Blandonnet 8 • CP 401
CH-1214 Vernier, Geneva, Switzerland
Tel. +41 22 749 01 11
Fax +41 22 749 09 47
copyright@iso.org
www.iso.org
ii © ISO/IEC 2018 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 15938-14:2018(E)

Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Symbols and abbreviated terms . 2
4.1 General . 2
4.2 Abbreviations . 2
4.3 Arithmetic operations . 2
4.4 Logical operators . 2
4.5 Relational operators . 3
4.6 Bitwise operators. 3
4.7 Assignment . 3
4.8 Set operators . 3
4.9 Constants . 3
4.10 Functions . 4
5 Reference software . 4
5.1 Reference software location . 4
5.2 Reference software license . 4
5.3 Reference software documentation . 4
5.4 Reference software compilation . 4
5.5 Reference software architecture . 4
6 Conformance testing . 5
6.1 Conformance image data set and reference CDVS bitstreams . 5
6.2 Conformance test conditions . 5
6.2.1 General. 5
6.2.2 Global descriptor test . 6
6.2.3 Interest point test . 6
6.2.4 Local descriptor test . 6
7 Usage guidelines . 7
7.1 Overview . 7
7.2 Pairwise matching . 7
7.2.1 Overview . 7
7.2.2 Global descriptor matching . 8
7.2.3 Local descriptors matching . 8
7.2.4 Image match decision .11
7.2.5 Homography estimation for localization .13
7.3 Retrieval .14
7.3.1 Overview .14
7.3.2 Shortlist generation . .14
7.3.3 Geometric reranking . .15
© ISO/IEC 2018 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC 15938-14:2018(E)

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work. In the field of information technology, ISO and IEC have established a joint technical committee,
ISO/IEC JTC 1.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation on the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see the following
URL: www .iso .org/ iso/ foreword .html.
This document was prepared by ISO/IEC JTC 1, Information technology, Subcommittee SC 29, Coding of
audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 15938 series can be found on the ISO website.
iv © ISO/IEC 2018 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC 15938-14:2018(E)

Introduction
ISO/IEC 15938 (all parts) also known as “Multimedia Content Description Interface,” provides a
standardized set of technologies for describing multimedia content. It addresses a broad spectrum of
multimedia applications and requirements by providing a metadata system for describing the features
of multimedia content.
The following are specified in ISO/IEC 15938 (all parts).
— Description schemes (DS) describe entities or relationships pertaining to multimedia content.
Description schemes specify the structure and semantics of their components, which may be
Description Schemes, descriptors, or datatypes.
— Descriptors (D) describe features, attributes, or groups of attributes of multimedia content.
— Datatypes are the basic reusable datatypes employed by description schemes and descriptors
— Systems tools support delivery of descriptions, multiplexing of descriptions with multimedia
content, synchronization, file format, and so forth.
ISO/IEC 15938 consists of 14 parts.
— Part 1 – Systems: specifies the tools for preparing descriptions for efficient transport and storage,
compressing descriptions, and allowing synchronization between content and descriptions.
— Part 2 – Description definition language: specifies the language for defining the International
Standard set of description tools (DSs, Ds, and datatypes) and for defining new description tools.
— Part 3 – Visual: specifies the description tools pertaining to visual content.
— Part 4 – Audio: specifies the description tools pertaining to audio content.
— Part 5 – Multimedia description schemes: specifies the generic description tools pertaining to
multimedia including audio and visual content.
— Part 6 – Reference software: provides a software implementation of ISO/IEC 15938.
— Part 7 – Conformance testing: specifies the guidelines and procedures for testing conformance of
implementations of ISO/IEC 15938.
— Part 8 – Extraction and use of MPEG-7 descriptions: provides guidelines and examples of the
extraction and use of descriptions.
— Part 9 – Profiles and levels: provides guidelines and standard profiles.
— Part 10 – Schema definition: specifies the schema using description definition language.
— Part 11 – Profile Schemas: listing of profile schemas using description definition language.
— Part 12 – Query format: contains the tools of the MPEG Query Format (MPQF).
— Part 13 – Compact descriptors for visual search: specifies an image description tool for visual
search applications.
— Part 14 – Reference software, conformance and usage guidelines for compact descriptors for
visual search: provides the reference software, specifies the conformance testing, and gives usage
guidelines for compact descriptors for visual search.
The compact descriptors for visual search (CDVS) tool specified in ISO/IEC 15938-13 is designed to
enable efficient and interoperable visual search applications, allowing visual content matching in
images. Visual content matching includes matching of views of objects, landmarks, and printed
© ISO/IEC 2018 – All rights reserved v

---------------------- Page: 5 ----------------------
ISO/IEC 15938-14:2018(E)

documents, while being robust to partial occlusions as well as changes in viewpoint, camera parameters,
and lighting conditions.
ISO/IEC 15938-14:
— specifies the reference software for CDVS (Clause 5);
— specifies the conformance testing dataset, reference descriptors and conditions for CDVS (Clause 6);
— provides guidelines for the usage of CDVS (Clause 7).
The CDVS reference software is provided at http:// standards .iso .org/ iso -iec/ 15938/ -14/ ed -1/ en.
vi © ISO/IEC 2018 – All rights reserved

---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO/IEC 15938-14:2018(E)
Information technology — Multimedia content description
interface —
Part 14:
Reference software, conformance and usage guidelines for
compact descriptors for visual search
1 Scope
This document provides the reference software, specifies the conformance testing, and gives usage
guidelines for ISO/IEC 15938-13.
2 Normative references
There are no normative references in this document.
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— IEC Electropedia: available at http:// www .electropedia .org/
— ISO Online browsing platform: available at https:// www .iso .org/ obp
3.1
image descriptor
descriptor extracted from one image
3.2
image descriptor length
size of an image descriptor in bytes
Note 1 to entry: ISO/IEC 15938-13 specifies six average (i.e. over a large number of images) image descriptor
lengths, i.e. 512 bytes, 1024 bytes, 2048 bytes, 4096 bytes, 8192 bytes and 16384 bytes.
3.3
interest point
point in an image showing detection stability under local and global perturbations in the image domain,
including perspective transformations, changes in image scale, and illumination variations
3.4
local region
area in an image in the neighbourhood of an interest point, used to generate local feature descriptors
3.5
local feature descriptor
descriptor of a local region
3.6
global descriptor
aggregation of local feature descriptors into a compact representation of the image
© ISO/IEC 2018 – All rights reserved 1

---------------------- Page: 7 ----------------------
ISO/IEC 15938-14:2018(E)

3.7
compressed local feature descriptor
compressed representation of a local feature descriptor
4 Symbols and abbreviated terms
4.1 General
NOTE The mathematical operators used in this part of ISO/IEC 15938 are similar to those used in the C
programming language. Unless otherwise indicated, all the arithmetic operations are performed with real
values. Numbering and counting conventions generally begin from 0.
4.2 Abbreviations
CDVS Compact Descriptors for Visual Search
MPEG Moving Picture Experts Group
MPEG-7 ISO/IEC 15938
4.3 Arithmetic operations
+ addition
− subtraction (as a binary operator) or negation (as a unary operator)
++ increment by 1, i.e. x++ is equivalent to x=x+1
-- decrement by 1, i.e. x-- is equivalent to x=x-1
+= increment by value, i.e. x+=y is equivalent to x=x+y
-= decrement by value, i.e. x-=y is equivalent to x=x-y
* multiplication (in binary representation syntax and pseudo-code) or convolution (elsewhere)
× multiplication
· multiplication
/ division
÷ division
% modulo operator
4.4 Logical operators
|| logical OR
˅ logical OR
&& logical AND
˄ logical AND
! logical NOT
2 © ISO/IEC 2018 – All rights reserved

---------------------- Page: 8 ----------------------
ISO/IEC 15938-14:2018(E)

4.5 Relational operators
> greater than
>= greater than or equal to
≥ greater than or equal to
< less than
<= less than or equal to
≤ less than or equal to
== equal to
!= not equal to
≠ not equal to
4.6 Bitwise operators
| OR
& AND
4.7 Assignment
= assignment operator
← assignment operator
→ assignment operator, except in Q→R and R→Q, where it denotes matching direction between
image descriptors Q and R
4.8 Set operators
⋃ set union
⋂ set intersection
⊆ subset
# cardinality
4.9 Constants
π 3.141 592 653 58…
e 2.718 281 828 45…
© ISO/IEC 2018 – All rights reserved 3

---------------------- Page: 9 ----------------------
ISO/IEC 15938-14:2018(E)

4.10 Functions
ln() base-e logarithm
max() maximum value in argument list
min() minimum value in argument list
cos() cosine function
absolute value of scalar or a vector norm
floor function which returns the maximum integer number less than or equal to the given
 
 
real number
5 Reference software
5.1 Reference software location
The CDVS reference software is provided at http:// standards .iso .org/ iso -iec/ 15938/ -14/ ed -1/ en.
5.2 Reference software license
Licensing information is provided in “CDVS_evaluation_framework/COPYING” and
“CDVS_applications/COPYING”. Each source code file also contains its own detailed licensing
information in the header.
5.3 Reference software documentation
The CDVS reference software is documented by means of Doxygen. The documentation is provided in
“CDVS_evaluation_framework/docs” of the CDVS reference software.
5.4 Reference software compilation
Instructions on how to compile the CDVS reference software is provided in
“CDVS_evaluation_framework/docs/CDVS-build-run-instructions.pdf” of the CDVS reference software.
The CDVS reference software is entirely written in C and C++. On Windows, it has been compiled and
tested on Windows 7 Enterprise 64-bit using Visual C++ 2010 (64-bit). On Linux, it has been compiled
and tested on Ubuntu 14.04 LTS (64-bit).
5.5 Reference software architecture
The CDVS reference software comprises a library and several 64-bit applications using the library,
which are functionally split into two groups:
a) CDVS evaluation framework, as used during the development of ISO/IEC 15938-13:
1) “extract”: extracts CDVS descriptor from a set of images;
2) “match”: ex
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.