ISO/IEC 19794-5:2011

Information technology — Biometric data interchange formats — Part 5: Face image data

ISO/IEC 19794-5:2011 specifies a record format for storing, recording, and transmitting information from one or more facial images or a short video stream of facial images, specifies scene constraints of the facial images, specifies photographic properties of the facial images, specifies digital image attributes of the facial images, and provides best practices for the photography of faces.

Technologies de l'information — Formats d'échange de données biométriques — Partie 5: Données d'image de la face

General Information

• Status: Published
• Publication Date: 02-Nov-2011
• ICS: 35.040 - Information coding
• ICS: 35.240.15 - Identification cards. Chip cards. Biometrics
• Technical Committee: ISO/IEC JTC 1/SC 37 - Biometrics
• Drafting Committee: ISO/IEC JTC 1/SC 37 - Biometrics
• Current Stage: 9060 - Close of review
• Start Date: 02-Sep-2028

Relations

• Amended By: ISO/IEC 19794-5:2011/Amd 1:2014 - Information technology — Biometric data interchange formats — Part 5: Face image data — Amendment 1: Conformance testing methodology and clarification of defects
• Effective Date: 17-Jul-2021
• Amended By: ISO/IEC 19794-5:2011/Amd 2:2015 - Information technology — Biometric data interchange formats — Part 5: Face image data — Amendment 2: XML encoding and clarification of defects
• Effective Date: 14-Oct-2020
• Revises: ISO/IEC 19794-5:2005 - Information technology — Biometric data interchange formats — Part 5: Face image data
• Effective Date: 15-Apr-2008
• Revises: ISO/IEC 19794-5:2005/Amd 1:2007 - Information technology — Biometric data interchange formats — Part 5: Face image data — Amendment 1: Conditions for taking photographs for face image data
• Effective Date: 15-Apr-2008
• Revises: ISO/IEC 19794-5:2005/Amd 2:2009 - Information technology — Biometric data interchange formats — Part 5: Face image data — Amendment 2: Three-dimensional face image data interchange format
• Effective Date: 12-Nov-2011

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 19794-5
Second edition
2011-11-01


Information technology — Biometric data
interchange formats —
Part 5:
Face image data
Technologies de l'information — Formats d'échange de données
biométriques —
Partie 5: Données d'image de la face




Reference number
ISO/IEC 19794-5:2011(E)
©
ISO/IEC 2011

---------------------- Page: 1 ----------------------
ISO/IEC 19794-5:2011(E)

COPYRIGHT PROTECTED DOCUMENT


©  ISO/IEC 2011
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56  CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Published in Switzerland

ii © ISO/IEC 2011 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 19794-5:2011(E)
Contents Page
Foreword . v
Introduction . vi
1  Scope . 1
2  Conformance . 1
3  Normative references . 2
4  Terms and definitions . 2
5  The Face Image Data Record Format . 4
5.1  Overview . 4
5.2  Data Conventions . 7
5.3  The General Header . 8
5.4  The Representation Header . 9
5.5  The Facial Information Block . 11
5.6  The Landmark Point Block . 16
5.7  The Image Information Block . 22
5.8  The Representation Data block . 25
5.9  The Image Data Block . 25
5.10  The 3D Information Block . 25
5.11  The 3D Data Block . 32
6  The Basic Face Image Type . 35
6.1  Inheritance requirements for the Basic Face Image Type . 35
6.2  Image data encoding requirements for the Basic Face Image Type . 35
6.3  Image data compression requirements for the Basic Face Image Type . 35
6.4  Format requirements for the Basic Face Image Type . 35
7  The Frontal Face Image Type . 35
7.1  Inheritance requirements for the Frontal Face Image Type . 35
7.2  Scene requirements for the Frontal Image Type . 36
7.3  Photographic Requirements for the Frontal Image Type . 37
7.4  Digital requirements for the Frontal Image Type . 38
7.5  Format requirements for the Frontal Image Type . 39
8  The Full Frontal Image Type . 39
8.1  Inheritance requirements for the Full Frontal Face Image Type . 39
8.2  Scene requirements for the Full Frontal Face Image Type . 39
8.3  Photographic requirements for the Full Frontal Face Image Type . 40
8.4  Digital requirements for the Full Frontal Face Image Type . 42
8.5  Format requirements for the Full Frontal Image Type . 42
9  The Token Face Image Type . 42
9.1  Inheritance requirements for Token Face Image Type . 42
9.2  Digital requirements for the Token Face Image Type . 42
9.3  Format requirements for the Token Face Image Type . 44
10  The Post-processed Frontal Face Image Type . 44
10.1  Introduction . 44
10.2  Inheritance requirements for the Post-processed Frontal Face Image Type . 44
10.3  Format requirements for the Post-processed Frontal Face Image Type . 44
11  The Basic 3D Image Type . 45
11.1  Inheritance Requirements for the Basic 3D Image Type . 45
11.2  The Basic 3D Image Type using the 3D Point Map representation . 45
© ISO/IEC 2011 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC 19794-5:2011(E)
11.3  The Basic 3D Image Type using the 3D Vertex representation .45
12  The Full Frontal 3D Image Type .45
12.1  Inheritance requirements .45
12.2  Coordinate System Type .46
12.3  Pose of the 3D representation .46
12.4  Calibration Texture Projection Accuracy .46
12.5  Requirements on Full Frontal 3D Image Types using the Range Image Representation .46
12.6  Requirements on Full Frontal 3D Image Types using the 3D Point Map Representation .47
12.7  Requirements on Full Frontal 3D Image Types using the 3D Vertex Representation .47
13  The Token Frontal 3D Image Type .47
13.1  Inheritance requirements .47
13.2  Requirements on Token Frontal 3D Image Types using the Range Image Representation .48
13.3  Requirements on Token Frontal 3D Image Types using the 3D Point Map Representation.48
13.4  Requirements on Token Frontal 3D Image Types using the Vertex Representation .48
14  Registered Format Type Identifier .48
Annex A (normative)  Conformance test methodology .49
Annex B (informative) Best practices for Face Images .50
Annex C (informative) Conditions for Taking Photographs .70
Annex D (informative) Experimental studies . 100
Annex E (informative) The Frankfurt Horizon . 110
Bibliography . 111

iv © ISO/IEC 2011 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC 19794-5:2011(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO shall not be held responsible for identifying any or all such patent rights.
ISO/IEC 19794-5 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 37, Biometrics.
This second edition constitutes a technical revision of the first edition (ISO/IEC 19794-5:2005), which is
provisionally retained. It also incorporates the Amendments ISO/IEC 19794-5:2005/Amd.1:2007 and
ISO/IEC 19794-5:2005/Amd.2:2009, and the Technical Corrigenda ISO/IEC 19794-5:2005/Cor.1:2008 and
ISO/IEC 19794-5:2005/Cor.2:2008. This edition reflects the harmonization across the second generation of
ISO/IEC 19794. Clause 5 contains descriptions of the harmonized general and representation headers; and
Clauses 5 to 13 have been technically revised. Annexes C, D, and E have been added.
ISO/IEC 19794 consists of the following parts, under the general title Information technology — Biometric data
interchange formats:
 Part 1: Framework
 Part 2: Finger minutiae data
 Part 3: Finger pattern spectral data
 Part 4: Finger image data
 Part 5: Face image data
 Part 6: Iris image data
 Part 7: Signature/sign time series data
 Part 8: Finger pattern skeletal data
 Part 9: Vascular image data
 Part 10: Hand geometry silhouette data
 Part 11: Signature/sign processed dynamic data
 Part 13: Voice data
 Part 14: DNA data
© ISO/IEC 2011 – All rights reserved v

---------------------- Page: 5 ----------------------
ISO/IEC 19794-5:2011(E)
Introduction
Face images, also commonly referred to as displayed portraits, have been used for many decades to verify
the identity of persons. In recent years, digital face images are used in many applications including human
examination as well as computer automated face recognition. Although photographic formats have been
standardized in some cases such as for passports and driver licenses, there is a need to define a standard
data format of digital face images to allow interoperability among vendors.
This part of ISO/IEC 19794 is intended to provide a face image format for face recognition applications
requiring exchange of face image data. The typical applications are
1) human examination of facial images with sufficient resolution to allow a human examiner to ascertain
small features such as moles and scars that might be used to verify identity,
2) human verification of identity by comparison of persons against facial images,
3) computer automated face biometric identification (one-to-many searching), and
4) computer automated face biometric verification (one-to-one comparison).
To enable many applications on a variety of devices, including devices that have limited resources available
for data storage, and to improve face recognition accuracy, this part of ISO/IEC 19794 specifies not only a
data format, but also scene constraints (lighting, pose, expression, etc.), photographic properties (positioning,
camera focus, etc.) and digital image attributes (image resolution, image size, etc.).
Several face image types are introduced to define categories that satisfy requirements of some applications:
 Basic: This is the fundamental Face Image Type that specifies a record format including header and
representation data. All Face Image Types adhere to the properties of this type. No mandatory scene,
photographic and digital requirements are specified for this image type.
 Frontal: A Basic Face Image Type that adheres to additional requirements appropriate for frontal face
recognition and/or human examination. Two types of Frontal Face Image Types are defined in this
part of ISO/IEC 19794, Full Frontal and Token Frontal (or simply Token).
 Full Frontal: A Face Image Type that specifies frontal images with sufficient resolution for human
examination as well as reliable computer face recognition. This type of Face Image Type includes the
full head with all hair in most cases, as well as neck and shoulders. This image type is suitable for
permanent storage of the face information, and it is applicable to portraits for passport, driver license,
and “mugshot” images.
 Token Frontal: A Face Image Type that specifies frontal images with a specific geometric size and
eye positioning based on the width and height of the image. This image type is suitable for minimizing
the storage requirements for computer face recognition tasks such as verification while still offering
vendor independence and human verification (versus human examination which requires more detail)
capabilities.
 Post-processed Frontal: Applying digital post-processing to a captured image can modify this image
in a way that it is more suitable for automatic face recognition. The Post-processed Frontal Face
Image Type is thought of as the interchange format for these kinds of facial images.
 Basic 3D: The Basic 3D Image Type is the base Image Type of all 3D Face Image Types. All 3D
Face Image Types obey normative requirements of this image type.
 Full Frontal 3D: The Full Frontal 3D Image Type combines a Full Frontal 2D image with additional 3D
information.
 Token Frontal 3D: The Token Frontal 3D Image Type combines a Token Frontal 2D image with
additional 3D information.
vi © ISO/IEC 2011 – All rights reserved

---------------------- Page: 6 ----------------------
ISO/IEC 19794-5:2011(E)
Table 1 shows the relationships between Face Image Types using the notion of inheritance. For example,
Frontal inherits properties from Basic, which means that all normative clauses that apply to Basic also apply to
Frontal.
Table 1 — Inheritance of Face Image Types
Face Image Type Inherits from Normative clauses Informative annexes
Basic None 1, 2, 3, 4, 5, 6 B.1
Frontal Basic 7 B.2
Full Frontal Frontal 8 B.3
Token Frontal Frontal 9 B.4
Post-processed Frontal Frontal 10

Figure 1 gives a general overview of the scene, photographic, digitization, and format requirements for the
face image types specified in this part of ISO/IEC 19794.
Requirements
Scene Photographic Digital Format





Digital Specifications



Positioning Digital Camera
Lighting





Record Format and

Organization


Camera Attributes



Image and Subject
Analogue to Digital




Image Scanning
Clauses: Clauses: Clauses: Clauses:
Basic Face None Basic Face
None Basic Face None Basic Face 5
   6.2

 6.3
   6.4
Frontal Face 7.2 Frontal Face 7.3 Frontal Face 7.4 Frontal Face 7.5
Full Frontal Face 8.2 Full Frontal Face 8.3 Full Frontal Face 8.4 Full Frontal Face 8.5
Token Face 9.2 Token Face 9.3
 Post-processed 10.3
Frontal Face

Figure 1 — The types of imaging requirements specified in this part of ISO/IEC 19794. The Basic Face
Image Type has no scene, photographic, or digital requirements
© ISO/IEC 2011 – All rights reserved vii

---------------------- Page: 7 ----------------------
ISO/IEC 19794-5:2011(E)
This is a revision of ISO/IEC 19794-5:2005. The structure of the data format is not compatible with the
previous version.
NOTE This part of ISO/IEC 19794 relies on other ISO International Standards.


viii © ISO/IEC 2011 – All rights reserved

---------------------- Page: 8 ----------------------
INTERNATIONAL STANDARD ISO/IEC 19794-5:2011(E)

Information technology — Biometric data interchange
formats —
Part 5:
Face image data
1 Scope
This part of ISO/IEC 19794
 specifies a record format for storing, recording, and transmitting the information from one or more facial
images or a short video stream of facial images,
 specifies scene constraints of the facial images,
 specifies photographic properties of the facial images,
 specifies digital image attributes of the facial images,
 provides best practices for the photography of faces.
2 Conformance
A biometric data record conforms to this part of ISO/IEC 19794 if it satisfies all of the normative requirements
related to:
A) Its data structure, data values and the relationships between its data elements, as specified in Clauses 5, 6,
7, 8 for the Full Frontal Face Image Type, Clauses 5, 6, 7, 9 for the Token Frontal Image Type, and Clauses 5,
6, 7, 10 for the Post-processed Frontal Image Type of this part of ISO/IEC 19794, respectively.
B) The relationship between its data values and the input biometric data from which the biometric data record
was generated, as specified in Clauses 5, 6, 7, 8 for the Full Frontal Face Image Type, Clauses 5, 6, 7, 9 for
the Token Frontal Image Type, and Clauses 5, 6, 7, 10 for the Post-processed Frontal Image Type of this part
of ISO/IEC 19794, respectively.
A system that produces biometric data records is conformant to this part of ISO/IEC 19794 if all biometric data
records that it outputs conform to this part of ISO/IEC 19794 (as defined above) as claimed in the
Implementation Conformance Statement associated with that system. A system does not need to be capable
of producing biometric data records that cover all possible aspects of this part of ISO/IEC 19794, but only
those that are claimed to be supported by the system in the Implementation Conformance Statement.
A system that uses biometric data records is conformant to this part of ISO/IEC 19794 if it can read, and use
for the purpose intended by that system, all biometric data records that conform to this part of ISO/IEC 19794
(as defined above) as claimed in the Implementation Conformance Statement associated with that system. A
system does not need to be capable of using biometric data records that cover all possible aspects of this part
of ISO/IEC 19794, but only those that are claimed to be supported by the system in an Implementation
Conformance Statement.
© ISO/IEC 2011 – All rights reserved 1

---------------------- Page: 9 ----------------------
ISO/IEC 19794-5:2011(E)
3 Normative references
The following referenced documents are indispensable for the application of this document. For dated
references, only the edition cited applies. For undated references, the latest edition of the referenced
document (including any amendments) applies.
ISO/IEC 10918-1, Information technology — Digital compression and coding of continuous-tone still images:
Requirements and guidelines
ISO/IEC 14496-2:2004, Information technology — Coding of audio-visual objects — Part 2: Visual
ISO/IEC 15444-1, Information technology — JPEG 2000 image coding system: Core coding system
ISO/IEC 15948, Information technology — Computer graphics and image processing — Portable Network
Graphics (PNG): Functional specification
ISO/IEC 19794-1:2011, Information technology — Biometric data interchange formats — Part 1: Framework
ISO/IEC 29794-1, Information technology — Biometric sample quality — Part 1: Framework
4 Terms and definitions
For the purposes of this document, the terms and definitions as well as abbreviated terms given in
ISO/IEC 19794-1 and the following apply.
4.1
2D image
two-dimensional face representation that encodes the luminance and/or colour texture of a capture subject in
a given lighting environment
4.2
3D image
three-dimensional face representation that encodes a surface in a 3D space
4.3
3D point map
3D point cloud representing a capture subject, where each surface point is encoded with a triplet, representing
the x, y and z value of the point in 3D respectively
4.4
3D vertex representation
representation using 3D vertices and triangles between these points for coding of a 3D surface
4.5
anthropometric landmark
landmark point on the face used for identification and classification of humans
4.6
anthropometric landmark code
two-part code that defines an anthropometric landmark uniquely
4.7
Cartesian coordinate system
3D orthogonal coordinate system
4.8
chin
central forward portion of the lower jaw
2 © ISO/IEC 2011 – All rights reserved

---------------------- Page: 10 ----------------------
ISO/IEC 19794-5:2011(E)
4.9
colour image
continuous-tone image that has more than one channel, each of which is coded with one or multiple bits
4.10
colour space
way of representing colours of pixels in an image
EXAMPLE RGB, YUV and greyscale colour spaces are typically used in this part of ISO/IEC 19794.
4.11
crown
top of the head, or (if obscured by hair or headwear) where the top of the head/skull would be if it could be
seen
4.12
cylindrical coordinate system
three-dimensional polar coordinate system describing a point by the three components radius, azimuth and
height
4.13
dots per inch (DPI)
measurement of scanner and printer spatial sampling rate
4.14
facial image
electronic image-based representation of the portrait of a person
4.15
face image type
category of facial images that satisfy specific requirements
4.16
feature point
reference point in a face image as used by face recognition algorithms
NOTE Commonly referred to as a landmark, an example being the position of the eyes.
4.17
fish eye
type of distortion where central objects of the image erroneously appear closer than those at the edge
4.18
greyscale image
continuous-tone image encoded with one luminance channel
NOTE For example, if the luminance channel is coded with 8 bits, the greyscale image is also referred to as a
monochrome or black and white image.
4.19
human examination
process of careful human comparison of a face image with a person or another face image to ascertain the
identity of the respective person by a detailed examination of facial characteristics and structures
4.20
human verification
validation of the identity of a face image by means of comparison with a person or other face image
NOTE Also known as one-to-one (1:1) comparison.
© ISO/IEC 2011 – All rights reserved 3

---------------------- Page: 11 ----------------------
ISO/IEC 19794-5:2011(E)
4.21
JPEG
image compression standard specified as ISO/IEC 10918-1
NOTE The JPEG baseline standard was published as ISO/IEC 10918-1 and ITU-T Rec. T.81.
4.22
JPEG2000
image compression standard specified as ISO/IEC 15444-1
NOTE The JPEG2000 baseline standard was published as ISO/IEC 15444-1 and ITU-T Rec. T.800.
4.23
PNG format
lossless image compression standard specified in ISO/IEC 15948
4.24
portrait
photograph of a person which includes the full head, with all hair in most cases, as well as neck and top of
shoulders
4.25
range image
numerical matrix that encodes a surface point in 3D space, where the position encodes the first two
coordinates and the value at that position encodes the third coordinate
4.26
red-eye
red glow from a subject's eye caused by light from flash reflecting from blood vessels behind the retina
4.27
texture
two-dimensional representation of the luminance and/or colour of a capture subject in a given lighting
environment
4.28
texture projection matrix
3x4 matrix to transform a 3D surface coordinate from a metric Cartesian coordinate system to a 2D texture
image coordinate, where the transformation makes use of the 3D homogeneous coordinates of the 3D point
as well as the 2D homogeneous coordinates of the 2D point
NOTE See reference [2] for details.
5 The Face Image Data Record Format
5.1 Overview
The ISO/IEC 19794-5 BDIR format specified in this part of ISO/IEC 19794 is a format to store face
representations within a biometric data record. Each BDIR shall pertain to a single subject and shall contain at
least one or more 2D image and zero or more geometric representations (range images, 3D point maps, 3D
vertex representations) of a human face. Depending on the face image type, a 3D representation of a face
may be included in addition to the 2D representation. The record structure is depicted in Figure 2,
and Figure 3.
Adherence to this format requires compliance to the standards referred to above. In particular, 2D image data
will be encoded using JPEG, JPEG2000 or PNG.
4 © ISO/IEC 2011 – All rights reserved

---------------------- Page: 12 ----------------------
ISO/IEC 19794-5:2011(E)
When referring to elements of the record format, “field” denotes the singular element such as Face Image
Type and Image Data Type, “block” denotes the group of fields such as Facial Information block or Image
Information block, and “record” denotes the data that consists of the General Header and one or more
Representations.

Figure 2 — The ISO/IEC 19794-5 Biometric Data Interchange Record. The length value of each field in
bytes is shown below the field. The white boxes indicate fields or blocks that shall be specified, and
dark grey boxes indicate optional fields.
© ISO/IEC 2011 – All rights reserved 5

---------------------- Page: 13 ----------------------
ISO/IEC 19794-5:2011(E)
Length of 3D 3D Capture 3D Capture 3D to 2D 3D to 2D
Coordinate Texture ScaleX, OffsetX, Reserved 3D Capture 3D
3D 3D 2D Texture
3D Device
Data Device Image Texture Texture Map Texture Map
System Projection ScaleY, OffsetY, Representation Supplemental for Future Device Type Acquisition Acquisition
Represen- Technology Vendor Temporal Temporal Type Spectrum
Information Type Data Time
Type Matrix ScaleZ OffsetZ Use Identifier Time
tation Synchronicity Synchronicity
Identifier Identifier
4 1 48 12 12 48 1 1 1 1 2 2 2 2 2 2 1 1
Range
3D Data Range
Image Bit Error Map Texture Map
Image
Range Image
Depth
1 Variable Variable Variable
3D Data 3D Point 3D Point 3D Point
Error Map Texture Map
Map Width
3D Point Map Map Height Map
2 2 Variable Variable Variable
3D Data Vertex Triangle Triangle
Normal Flag Vertex Data Texture Map
Count Face Count Data
Vertex
2 4 1 Variable Variable Variable
1
Vertex Vertex Vertex Vertex
Vertex Data
Coordinates
Normals Errors Texture
Vertex
Vertex X Vertex Y Vertex Z
Coordinates
coordinate coordinate coordinate
2 2 2
Vertex Normals Normal X Normal Y Normal Z
2 2 2
Vertex Errors Vertex Error
1
Vertex Vertex
Vertex Textures
Texture X Texture Y
2 2
Triangle Triangle Triangle
Triangle Data
Index 1 Index 2 Index 3
2 2 2
mandatory,
mandatory but can be optional
unspecified

Figure 3 — The 3D Inform
...