ISO/IEC TS 19795-9:2019
(Main)Information technology — Biometric performance testing and reporting — Part 9: Testing on mobile devices
Information technology — Biometric performance testing and reporting — Part 9: Testing on mobile devices
This document provides guidance for performance testing of biometrics when this technology is used on mobile devices with local biometric authentication to improve authentication assurance. This document aims to: — Provide guidance for affordable and cost-efficient testing and reporting methods for performance assessment at a full system level of biometric systems embedded in mobile devices with offline evaluation of false accept rate (FAR) claims. — Define modality-specific considerations of these methods. This document is applicable to: — verification use cases related to secure transactions. This document is not applicable to: — privacy aspects; — secure authentication from mobile device to server; — testing and reporting for presentation attack detection (PAD) mechanisms in mobile devices; — performance testing of biometric sub-systems such as acquisition sub-system or comparison sub-system; — continuous authentication.
Technologies de l'information — Essais et rapports de performance biométriques — Partie 9: Titre manque
General Information
Buy Standard
Standards Content (Sample)
TECHNICAL ISO/IEC TS
SPECIFICATION 19795-9
First edition
2019-12
Information technology — Biometric
performance testing and reporting —
Part 9:
Testing on mobile devices
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 General considerations for biometrics on mobile devices . 2
4.1 Biometric authentication process . 2
4.2 Biometric capture sensor. 3
4.3 Uncontrolled environment . 3
4.4 Challenges in storing references and generating comparison scores . 3
4.5 Adaptation of the biometric references . 4
5 Overview of full-system evaluation of mobile devices . 4
5.1 General description . 4
5.2 Considerations for time efficient evaluation . 4
5.2.1 Factors that increase the time and cost of biometric performance evaluations . 4
5.2.2 Reduction of the number of recognition transactions . 5
5.2.3 Reduction of the number of conditions to evaluate. 8
5.2.4 Reduction of the number of visits . 9
6 Guidance for testing and reporting . 9
6.1 Data collection . 9
6.1.1 General procedures . 9
6.1.2 Test crew size and characteristics . 9
6.1.3 Test subject interaction .10
6.1.4 Modality specific consideration .10
6.2 Test method .12
6.2.1 Enrolment .12
6.2.2 Iterative and multi session enrolment .12
6.2.3 Verification .12
6.3 Performance measurement.12
6.3.1 Metrics .12
6.3.2 Optional technology evaluation for lower FAR claims .12
6.3.3 Guidance for target requirements evaluation.13
6.4 Considerations for third party evaluation .13
6.4.1 General.13
6.4.2 Specifications for the system under test .13
6.4.3 Consistency of system under test online and offline .15
6.4.4 Checking a system provider self-attestation.15
6.5 Reporting .15
Annex A (informative) Sample test report .18
Annex B (normative) Profiling ISO/IEC TS 19795-9 (this document) for an application .22
Bibliography .26
© ISO/IEC 2019 – All rights reserved iii
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC
list of patent declarations received (see http:// patents .iec .ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso .org/
iso/ foreword .html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 37, Biometrics.
A list of all parts in the ISO/IEC 19795 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
iv © ISO/IEC 2019 – All rights reserved
Introduction
The development of a mass-market in connected mobile devices, e.g. smartphones and tablets, has
allowed users the convenience of accessing remotely a variety of services which previously needed
face-to-face interactions or to have physical access to the service provider’s infrastructure.
For some services, convenience should nevertheless remain secondary to the security needs. These
services include for example remote payment on commercial websites, banking transactions or
certified signing of official documents. To allow these trustful interactions, the need of reliable user
authentication is of paramount importance.
One way to certify the user’s identity is to implement biometric authentication ability in the device.
It is then important to properly evaluate the accuracy of biometric authentication to ensure that
security is strong enough to allow mobile sensible transactions.
Several biometric modalities are widely utilized in consumer-focused mobile devices. Evaluation of
biometric performance for all of these modalities should be consistent and follow the same guidelines,
methodologies and requirements. Nevertheless, some modality specific considerations should also be
addressed when conducting an evaluation. This document provides a general framework usable for all
modalities as well as dedicated recommendations when needed.
ISO/IEC 19795-1 describes three types of biometric performance evaluations: technology, scenario and
[1]
operational evaluations. ISO/IEC TR 30125 recommends scenario evaluation as the most proper type
of evaluation for testing biometric performance on mobile devices.
A scenario evaluation is an “end-to-end” biometrics evaluation in which the full system is tested with
a careful control of the surrounding conditions. However, when applying this type of evaluation to
biometric systems working on mobile devices, testing and reporting methods should consider the
particularities and constraints of these use cases.
© ISO/IEC 2019 – All rights reserved v
TECHNICAL SPECIFICATION ISO/IEC TS 19795-9:2019(E)
Information technology — Biometric performance testing
and reporting —
Part 9:
Testing on mobile devices
1 Scope
This document provides guidance for performance testing of biometrics when this technology is used
on mobile devices with local biometric authentication to improve authentication assurance.
This document aims to:
— Provide guidance for affordable and cost-efficient testing and reporting methods for performance
assessment at a full system level of biometric systems embedded in mobile devices with offline
evaluation of false accept rate (FAR) claims.
— Define modality-specific considerations of these methods.
This document is applicable to:
— verification use cases related to secure transactions.
This document is not applicable to:
— privacy aspects;
— secure authentication from mobile device to server;
— testing and reporting for presentation attack detection (PAD) mechanisms in mobile devices;
— performance testing of biometric sub-systems such as acquisition sub-system or comparison
sub-system;
— continuous authentication.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 2382-37, Information technology — Vocabulary — Part 37: Biometrics
ISO/IEC 19795-1, Information technology — Biometric performance testing and reporting — Part 1:
Principles and framework
ISO/IEC 19795-2, Information technology — Biometric performance testing and reporting — Part 2:
Testing methodologies for technology and scenario evaluation
3 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO/IEC 2382-37, ISO/IEC 19795-1
and the following apply.
© ISO/IEC 2019 – All rights reserved 1
...
TECHNICAL ISO/IEC TS
SPECIFICATION 19795-9
First edition
2019-12
Information technology — Biometric
performance testing and reporting —
Part 9:
Testing on mobile devices
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 General considerations for biometrics on mobile devices . 2
4.1 Biometric authentication process . 2
4.2 Biometric capture sensor. 3
4.3 Uncontrolled environment . 3
4.4 Challenges in storing references and generating comparison scores . 3
4.5 Adaptation of the biometric references . 4
5 Overview of full-system evaluation of mobile devices . 4
5.1 General description . 4
5.2 Considerations for time efficient evaluation . 4
5.2.1 Factors that increase the time and cost of biometric performance evaluations . 4
5.2.2 Reduction of the number of recognition transactions . 5
5.2.3 Reduction of the number of conditions to evaluate. 8
5.2.4 Reduction of the number of visits . 9
6 Guidance for testing and reporting . 9
6.1 Data collection . 9
6.1.1 General procedures . 9
6.1.2 Test crew size and characteristics . 9
6.1.3 Test subject interaction .10
6.1.4 Modality specific consideration .10
6.2 Test method .12
6.2.1 Enrolment .12
6.2.2 Iterative and multi session enrolment .12
6.2.3 Verification .12
6.3 Performance measurement.12
6.3.1 Metrics .12
6.3.2 Optional technology evaluation for lower FAR claims .12
6.3.3 Guidance for target requirements evaluation.13
6.4 Considerations for third party evaluation .13
6.4.1 General.13
6.4.2 Specifications for the system under test .13
6.4.3 Consistency of system under test online and offline .15
6.4.4 Checking a system provider self-attestation.15
6.5 Reporting .15
Annex A (informative) Sample test report .18
Annex B (normative) Profiling ISO/IEC TS 19795-9 (this document) for an application .22
Bibliography .26
© ISO/IEC 2019 – All rights reserved iii
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC
list of patent declarations received (see http:// patents .iec .ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso .org/
iso/ foreword .html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 37, Biometrics.
A list of all parts in the ISO/IEC 19795 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
iv © ISO/IEC 2019 – All rights reserved
Introduction
The development of a mass-market in connected mobile devices, e.g. smartphones and tablets, has
allowed users the convenience of accessing remotely a variety of services which previously needed
face-to-face interactions or to have physical access to the service provider’s infrastructure.
For some services, convenience should nevertheless remain secondary to the security needs. These
services include for example remote payment on commercial websites, banking transactions or
certified signing of official documents. To allow these trustful interactions, the need of reliable user
authentication is of paramount importance.
One way to certify the user’s identity is to implement biometric authentication ability in the device.
It is then important to properly evaluate the accuracy of biometric authentication to ensure that
security is strong enough to allow mobile sensible transactions.
Several biometric modalities are widely utilized in consumer-focused mobile devices. Evaluation of
biometric performance for all of these modalities should be consistent and follow the same guidelines,
methodologies and requirements. Nevertheless, some modality specific considerations should also be
addressed when conducting an evaluation. This document provides a general framework usable for all
modalities as well as dedicated recommendations when needed.
ISO/IEC 19795-1 describes three types of biometric performance evaluations: technology, scenario and
[1]
operational evaluations. ISO/IEC TR 30125 recommends scenario evaluation as the most proper type
of evaluation for testing biometric performance on mobile devices.
A scenario evaluation is an “end-to-end” biometrics evaluation in which the full system is tested with
a careful control of the surrounding conditions. However, when applying this type of evaluation to
biometric systems working on mobile devices, testing and reporting methods should consider the
particularities and constraints of these use cases.
© ISO/IEC 2019 – All rights reserved v
TECHNICAL SPECIFICATION ISO/IEC TS 19795-9:2019(E)
Information technology — Biometric performance testing
and reporting —
Part 9:
Testing on mobile devices
1 Scope
This document provides guidance for performance testing of biometrics when this technology is used
on mobile devices with local biometric authentication to improve authentication assurance.
This document aims to:
— Provide guidance for affordable and cost-efficient testing and reporting methods for performance
assessment at a full system level of biometric systems embedded in mobile devices with offline
evaluation of false accept rate (FAR) claims.
— Define modality-specific considerations of these methods.
This document is applicable to:
— verification use cases related to secure transactions.
This document is not applicable to:
— privacy aspects;
— secure authentication from mobile device to server;
— testing and reporting for presentation attack detection (PAD) mechanisms in mobile devices;
— performance testing of biometric sub-systems such as acquisition sub-system or comparison
sub-system;
— continuous authentication.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 2382-37, Information technology — Vocabulary — Part 37: Biometrics
ISO/IEC 19795-1, Information technology — Biometric performance testing and reporting — Part 1:
Principles and framework
ISO/IEC 19795-2, Information technology — Biometric performance testing and reporting — Part 2:
Testing methodologies for technology and scenario evaluation
3 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO/IEC 2382-37, ISO/IEC 19795-1
and the following apply.
© ISO/IEC 2019 – All rights reserved 1
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.