ISO/IEC 15938-3:2002/Amd 3:2009

Information technology — Multimedia content description interface — Part 3: Visual — Amendment 3: Image signature tools

Technologies de l'information — Interface de description du contenu multimédia — Partie 3: Visuel — Amendement 3: Outils de signature d'image

General Information

• Status: Published
• Publication Date: 29-Mar-2009
• ICS: 35.040 - Information coding
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Current Stage: 6060 - International Standard published
• Due Date: 15-Jul-2010
• Completion Date: 30-Mar-2009

Relations

• Child: ISO/IEC 15938-3:2002 - Information technology — Multimedia content description interface — Part 3: Visual
• Effective Date: 15-Apr-2008
• Amends: ISO/IEC 15938-3:2002 - Information technology — Multimedia content description interface — Part 3: Visual
• Effective Date: 06-Jun-2022

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 15938-3
First edition
2002-05-15
AMENDMENT 3
2009-04-01

Information technology — Multimedia
content description interface —
Part 3:
Visual
AMENDMENT 3: Image signature tools
Technologies de l'information — Interface de description du contenu
multimédia —
Partie 3: Visuel
AMENDEMENT 3: Outils de signature d'image




Reference number
ISO/IEC 15938-3:2002/Amd.3:2009(E)
©
ISO/IEC 2009

---------------------- Page: 1 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but
shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In
the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.


COPYRIGHT PROTECTED DOCUMENT


©  ISO/IEC 2009
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Published in Switzerland

ii © ISO/IEC 2009 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
Amendment 3 to ISO/IEC 15938-3:2002 was prepared by Joint Technical Committee ISO/IEC JTC 1,
Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia
information.

© ISO/IEC 2009 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)

Information technology — Multimedia content description
interface —
Part 3:
Visual
AMENDMENT 3: Image signature tools
Page 1, Scope
Replace 1.2 entirely with the following:
1.2 Overview of Visual Description Tools
This part of ISO/IEC 15938 specifies tools for description of visual content, including still images, video and
3D models. These tools are defined by their syntax in DDL and binary representations and semantics
associated with the syntactic elements. They enable description of the visual features of the visual material,
such as color, texture, shape, motion, localization of the described objects in the image or video sequence
and also unique and robust identification of visual material. An overview of the visual description tools is
shown in Figure 1.
The basic structure description tools include five supporting tools of visual descriptions defined in clauses 6-11.
They are categorized into two groups, descriptor containers and basic supporting tools. The former consists of
three datatypes, GridLayout providing efficient representations of visual features on grids, TimeSeries
representing temporal arrays of several descriptions, GofGopFeature describes representative descriptions
over video segment, and MultipleView describing a 3D object using several pictures captured from different
view angles. The latter contains two tools, Spatial2DcoordinateSystem used to specify the 2D coordinate
system and TemporalInterpolation indicating the interpolation method between two samples on a time axis.
The remaining description tools, except for the FaceRecognition and ImageSignature descriptors, are
associated with visual features and are grouped into five feature categories: Color, Texture, Shape, Motion
and Localization.
The color description tools include five color descriptors to represent different aspects of color features:
representative colors (DominantColor), color distribution (ScalableColor), spatial distribution of colors
(ColorLayout and ColorStructure) and perceptual feeling of illumination color (ColorTemperature). It also
contains three supporting tools, ColorSpace and ColorQuantization used in DominantColor and
IlluminationInvariantColor to extend four color descriptors, DominantColor, ScalableColor, ColorLayout and
ColorStructure, to support illumination invariant similarity matching. An extension of ScalableColor to a group
of frames or pictures (GoFGoPColor) is also included in this group. All the color descriptors can be extracted
from arbitrarily shaped regions.
The texture description tools facilitate browsing (TextureBrowsing) and similarity retrieval
(HomogeneousTexture and EdgeHistogram) using the texture of a still or moving image region. All the texture
descriptors can be extracted from arbitrarily shaped regions.
The shape description tools include two descriptors that characterize different shape features of a 2D object or
region. The RegionShape descriptor captures the distribution of all pixels within a region and the Contour
© ISO/IEC 2009 – All rights reserved 1

---------------------- Page: 4 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
Shape descriptor characterizes the shape properties of the contour of an object. The extension of
RegionShape is also defined as ShapeVariation to describe temporal variation of shape over video segment.
The Shape3D and Perceptual 3D Shape descriptors provide 3-dimensional shape information; the former
represents an intrinsic shape characterization of 3D mesh models, and the latter represents part-based
representation of a 3D object.
The motion description tools include four descriptors that characterize various aspects of motion. The
CameraMotion descriptor specifies a set of basic camera operations such as, for example, panning and tilting.
The motion of a key point (pixel) from a moving object or region can be characterized by the MotionTrajectory
descriptor. The ParametricMotion descriptor characterizes an evolution of an arbitrarily shaped region over
time in terms of a 2D geometric transformation. Finally, the MotionActivity descriptor captures the pace of the
motion in the sequence, as perceived by the viewer. All motion descriptors except for CameraMotion can be
extracted from arbitrarily shaped regions.
The localization description tools can be used to indicate regions of interest in the spatial (RegionLocator) and
spatio-temporal (SpatioTemporalLocator) domains.
The FaceRecognition descriptor and the Advanced Face Recognition descriptor are not associated with any
particular visual feature and can be used to describe a human face for applications requiring the matching and
retrieval of face images.
The ImageSignature descriptor provides a "fingerprint" of an image that uniquely identify it. The signature is
robust (unchanging) across a wide range of common editing operations, but is sufficiently different for every
item of "original" content to identify it uniquely and reliably – just like human fingerprints. The ImageSignature
has no direct association with specific visual features such as colour, shape or texture.
2 © ISO/IEC 2009 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
Basic Structures
Descriptor Containers Basic Supporting Tools
GridLayout TemporalInterpolation
TimeSeries Spatial2DcoordinateSystem
GofGopFeature
MultipleView
Visual Features
Color
Color Feature Descriptors
Color Supporting Tools
DominantColor ColorSpace
ScalableColor ColorQuantization
ColorLayout IlluminationInvariantColor
ColorStructure
GofGopColor
ColorTemperature
Texture Shape Motion
HomogeneousTexture RegionShape CameraMotion
TextureBrowsing ContourShape MotionTrajectory
EdgeHistogram ParametricMotion
ShapeVariation
MotionActivity
Shape3D
Perceptual 3D Shape
Localization
RegionLocator
SpatioTemporalLocator
Other
Signatures
FaceRecognition
ImageSignature
AdvancedFaceRecognition

Figure 1 — Overview of Visual Description Tools

© ISO/IEC 2009 – All rights reserved 3

---------------------- Page: 6 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
Replace 3.2 with:
3.2  Abbreviations
ART Angular-Radial Transform
CSS Curvature Scale Space
DDL Description Definition Language
DS  Description Scheme
D  Descriptor
DCT Discrete Cosine Transform
FOC Focus of Contraction
FOE Focus of Expansion
FFT Fast Fourier Transform
GoF Group of Frames
GoP Group of Pictures
HMMD Hue-Min-Max-Difference
HSV Hue-Saturation-Value
RGB Red-Green-Blue
Replace 4.2.2 with:
4.2.2 Generic binary representation
The use of the video-specific syntax is signalled using the codec configuration mechanism defined in ISO/IEC
15938-1. The following classification scheme is defined for this purpose.


 MPEG7CameraMotion
 ISO/IEC 15938-3 Binary Camera Motion
  Codec


 MPEG7ColorLayout
 ISO/IEC 15938-3 Binary Color Layout
  Codec


 MPEG7ColorQuantization
 ISO/IEC 15938-3 Binary Color Quantization
  Codec


 MPEG7ColorSpace
 ISO/IEC 15938-3 Binary Color Space
  Codec


 MPEG7ColorStructure
 ISO/IEC 15938-3 Binary Color Structure
  Codec


 MPEG7ContourShape
 ISO/IEC 15938-3 Binary Contour Shape
  Codec
4 © ISO/IEC 2009 – All rights reserved

---------------------- Page: 7 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)


 MPEG7DominantColor
 ISO/IEC 15938-3 Binary Dominant Color
  Codec


 MPEG7EdgeHistogram
 ISO/IEC 15938-3 Binary Edge Histogram
  Codec


 MPEG7FaceRecognition
 ISO/IEC 15938-3 Binary Face Recognition
  Codec


 MPEG7FoFGoPColor
 ISO/IEC 15938-3 Binary GoFGoP Color
  Codec


 MPEG7GridLayout
 ISO/IEC 15938-3 Binary Grid Layout
  Codec


 MPEG7HomogeneousTexture
 ISO/IEC 15938-3 Binary Homogeneous Texture
  Codec


 MPEG7IrregularVisualTimeSeries
 ISO/IEC 15938-3 Binary Irregular Time Series
  Codec


 MPEG7MotionActivity
 ISO/IEC 15938-3 Binary Motion Activity
  Codec


 MPEG7MotionTrajectory
 ISO/IEC 15938-3 Binary Motion Trajectory
  Codec


 MPEG7MultipleView
 ISO/IEC 15938-3 Binary Multiple View
  Codec


 MPEG7ParametricMotion
 ISO/IEC 15938-3 Binary Parametric Motion
  Codec


 MPEG7RegionLocator
 ISO/IEC 15938-3 Binary Region Locator
  Codec

© ISO/IEC 2009 – All rights reserved 5

---------------------- Page: 8 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)

 MPEG7RegionShape
 ISO/IEC 15938-3 Binary Region Shape
  Codec


 MPEG7RegularVisualTimeSeries
 ISO/IEC 15938-3 Binary Regular Time Series
  Codec


 MPEG7ScalableColor
 ISO/IEC 15938-3 Binary Scalable Color
  Codec


 MPEG7Shape3D
 ISO/IEC 15938-3 Binary Shape 3D
  Codec


 MPEG7Spatial2DCoordinateSystem
 ISO/IEC 15938-3 Binary Spatial 2D Coordinate
  System Codec


 MPEG7SpatioTemporalLocator
 ISO/IEC 15938-3 Binary SpatioTemporal Locator
  Codec


 MPEG7TemporalInterpolation
 ISO/IEC 15938-3 Binary Temporal Interpolation
  Codec


 MPEG7TextureBrowsing
 ISO/IEC 15938-3 Binary Texture Browsing
  Codec


 MPEG7GofGopFeature
 ISO/IEC 15938-3 Binary Gof Gop Feature
Codec


 MPEG7ColorTemperature
 ISO/IEC 15938-3 Binary Color Temperature
Codec


 MPEG7ShapeVariation
 ISO/IEC 15938-3 Binary Shape Variation
Codec


 MPEG7IlluminationInvariantColor
 ISO/IEC 15938-3 Binary Illumination Invariant
Color Codec

6 © ISO/IEC 2009 – All rights reserved

---------------------- Page: 9 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)

 MPEG7AdvancedFaceRecognition
 ISO/IEC 15938-3 Binary Advanced Face Recognition
Codec


 MPEG7Perceptual3DShape
 ISO/IEC 15938-3 Binary Perceptual 3D Shape
Codec


 MPEG7ImageSignature
 ISO/IEC 15938-3 Binary Image Signature
Codec



In 5.2.4, replace Table 1 with:
Table 1 — Assignment of IDs to descriptors
ID Descriptor
0 Forbidden
1 CameraMotion
2 ColorLayout
3 ColorSpace
4 ColorStructure
5 ColorQuantization
6 ContourShape
7 DominantColor
8 EdgeHistogram
9 FaceRecognition
10 GoFGoPColor
11 GridLayout
12 HomogeneousTexture
13 IrregularVisualTimeSeries
14 MotionActivity
15 MotionTrajectory
16 MultipleView
17 ParametricMotion
18 RegionLocator
19 RegionShape
20 RegularVisualTimeSeries
21 ScalableColor
22 Shape3D
23 Spatial2DCoordinateSystem
24 SpatioTemporalLocator
25 TemporalInterpolation
26 TextureBrowsing
27 GofGopFeature
28 ColorTemperature
29 ShapeVariation
30 IlluminationInvariantColor
31 AdvancedFaceRecognition
32 Perceptual3DShape
33 ImageSignature
34-255 Reserved
© ISO/IEC 2009 – All rights reserved 7

---------------------- Page: 10 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
After 11.2, add the following:
1.3 Image Signature
11.3.1 Introduction
Most visual descriptors are very useful when trying to find images with similar content however, such
descriptions are intended to be general: finding identical content is not of special importance. The image
signature descriptor is robust (unchanging) across a wide range of common editing operations, but is
sufficiently different for every item of "original" content to identify it uniquely and reliably – just like human
fingerprints. Therefore this descriptor is able to distinguish between two images which have similar content
and two images which are the same.
There are three components within the image signature, the first two are global signatures of the complete
image and the third is composed of a set of local image signatures.
11.3.2 DDL representation syntax

 
  
   
    
     
      
       
        
       
       
      
     
    
   
 
    
     
      
       
        
       
       
      
     
    

     
      
       
        
         
          
          
         
        
       
       
        
         
8 © ISO/IEC 2009 – All rights reserved

---------------------- Page: 11 ----------------------
ISO/IEC 15938-3:2002/Amd.3:2009(E)
          
          
          
          
           
            
             
              
             
             
            
           
          
         
        
       
      
     
    
   
  
 


11.3.3 Binary Representation Syntax
ImageSignature { Number of bits Mnemonics
GlobalSignatureA 512 bslbf
    GlobalSignatureB 512 bslbf
FeaturePointCount 8 uimsbf
for( k=0; k  Xcoord 8 uimsbf
 Ycoord 8 uimsbf
 Direction 4 uimsbf
 LocalSignature 60 bslbf
}
}

NumberOfPoints = FeaturePointCount + 32
The value of FeaturePointCount is restricted to the range 0-48
11.3.4 Descriptor Component Semantics
GlobalSignatureA
This element represents the first global signature of the image normalised with the original aspect ratio
maintained.
GlobalSignatureB
This element represents the second global sign
...