ISO/IEC 19795-1:2021
(Main)Information technology — Biometric performance testing and reporting — Part 1: Principles and framework
Information technology — Biometric performance testing and reporting — Part 1: Principles and framework
This document: — establishes general principles for testing the performance of biometrics systems in terms of error rates and throughput rates for purposes including measurement of performance, prediction of performance, comparison of performance, and verifying conformance with specified performance requirements; — specifies performance metrics for biometric systems; — specifies requirements on the recording of test data and reporting of test results; and — specifies requirements on test protocols in order to: — reduce bias due to inappropriate data collection or analytic procedures; — help achieve the best estimate of field performance for the expended effort; — improve understanding of the limits of applicability of the test results. This document is applicable to empirical performance testing of biometric systems and algorithms through analysis of the comparison scores and decisions output by the system, without requiring detailed knowledge of the system’s algorithms or of the underlying distribution of biometric characteristics in the population of interest. Not within the scope of this document is the measurement of error and throughput rates for people deliberately trying to subvert the intended operation of the biometric system (e.g. by presentation attacks).
Technologies de l'information — Essais et rapports de performance biométriques — Partie 1: Principes et canevas
General Information
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 19795-1
Second edition
2021-05
Information technology — Biometric
performance testing and reporting —
Part 1:
Principles and framework
Technologies de l'information — Essais et rapports de performance
biométriques —
Partie 1: Principes et canevas
Reference number
©
ISO/IEC 2021
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved
Contents Page
Foreword .vi
Introduction .vii
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Abbreviated terms . 5
5 Conformance . 6
6 General biometric system . 6
6.1 Conceptual representation of general biometric system . 6
6.2 Conceptual components of a general biometric system. 7
6.2.1 Data capture subsystem . 7
6.2.2 Transmission subsystem. 7
6.2.3 Signal processing subsystem . 7
6.2.4 Data storage subsystem . 8
6.2.5 Comparison subsystem . 8
6.2.6 Decision subsystem . 8
6.2.7 Administration subsystem . 9
6.2.8 Interface to external application . 9
6.3 Functions of general biometric system . 9
6.3.1 Enrolment . 9
6.3.2 Verification of a positive biometric claim .10
6.3.3 Identification .11
6.4 Enrolment, verification and identification transactions .11
6.5 Performance measures .12
6.5.1 Error rates .12
6.5.2 Throughput rates .12
6.5.3 Types of performance testing .13
7 Planning the evaluation .13
7.1 General .13
7.2 Determine information about the system .14
7.3 Controlling factors that influence performance .15
7.4 Test subject selection.16
7.5 Test size .17
7.5.1 General.17
7.5.2 Collecting multiple recognition transactions per test subject per system .17
7.5.3 Requirements on test size .18
7.6 Multiple tests .18
8 Data collection .19
8.1 Avoidance of data collection errors .19
8.2 Data and details collected .19
8.3 Enrolments .20
8.3.1 Enrolment transactions .20
8.3.2 Enrolment conditions .21
8.3.3 Enrolment failures and presentation errors .21
8.4 One-to-one comparison trials .22
8.4.1 General.22
8.4.2 Collection conditions . .22
8.4.3 Frequency of use .22
8.4.4 Systems performing optimization based on enrolled references .23
8.4.5 Systems performing reference adaptation .23
8.4.6 Processes for data entry errors and system misuse .23
© ISO/IEC 2021 – All rights reserved iii
8.4.7 Failures to acquire .23
8.4.8 Adding test data to the corpus .23
8.4.9 Online comparison trials .23
8.4.10 Offline comparison trials .24
8.4.11 Offline non-mated comparison trials when references are dependent . .25
8.4.12 Offline non-mated comparison trials based on comparison of references .25
8.4.13 Use of samples from multi-capture comparison transactions .25
8.5 Identification trials .26
8.5.1 General.26
8.5.2 Identification testing with non-enrolled test subjects .26
8.5.3 Use of jack-knife approach for identification testing .26
9 Analyses .26
9.1 General .26
9.2 Performance of biometric enrolment .27
9.2.1 Failure-to-enrol rate.27
9.2.2 Enrolment transaction duration.27
9.3 Performance of biometric acquisition .28
9.3.1 Failure-to-acquire rate .28
9.3.2 Acquisition process duration .28
9.3.3 Other aspects of acquisition performance .28
9.4 One-to-one comparison performance.29
9.4.1 False non-match rate .29
9.4.2 False match rate .29
9.5 Verification system performance metrics .30
9.5.1 General.30
9.5.2 False reject rate .30
9.5.3 False accept rate .
...
INTERNATIONAL ISO/IEC
STANDARD 19795-1
Second edition
2021-05
Information technology — Biometric
performance testing and reporting —
Part 1:
Principles and framework
Technologies de l'information — Essais et rapports de performance
biométriques —
Partie 1: Principes et canevas
Reference number
©
ISO/IEC 2021
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved
Contents Page
Foreword .vi
Introduction .vii
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Abbreviated terms . 5
5 Conformance . 6
6 General biometric system . 6
6.1 Conceptual representation of general biometric system . 6
6.2 Conceptual components of a general biometric system. 7
6.2.1 Data capture subsystem . 7
6.2.2 Transmission subsystem. 7
6.2.3 Signal processing subsystem . 7
6.2.4 Data storage subsystem . 8
6.2.5 Comparison subsystem . 8
6.2.6 Decision subsystem . 8
6.2.7 Administration subsystem . 9
6.2.8 Interface to external application . 9
6.3 Functions of general biometric system . 9
6.3.1 Enrolment . 9
6.3.2 Verification of a positive biometric claim .10
6.3.3 Identification .11
6.4 Enrolment, verification and identification transactions .11
6.5 Performance measures .12
6.5.1 Error rates .12
6.5.2 Throughput rates .12
6.5.3 Types of performance testing .13
7 Planning the evaluation .13
7.1 General .13
7.2 Determine information about the system .14
7.3 Controlling factors that influence performance .15
7.4 Test subject selection.16
7.5 Test size .17
7.5.1 General.17
7.5.2 Collecting multiple recognition transactions per test subject per system .17
7.5.3 Requirements on test size .18
7.6 Multiple tests .18
8 Data collection .19
8.1 Avoidance of data collection errors .19
8.2 Data and details collected .19
8.3 Enrolments .20
8.3.1 Enrolment transactions .20
8.3.2 Enrolment conditions .21
8.3.3 Enrolment failures and presentation errors .21
8.4 One-to-one comparison trials .22
8.4.1 General.22
8.4.2 Collection conditions . .22
8.4.3 Frequency of use .22
8.4.4 Systems performing optimization based on enrolled references .23
8.4.5 Systems performing reference adaptation .23
8.4.6 Processes for data entry errors and system misuse .23
© ISO/IEC 2021 – All rights reserved iii
8.4.7 Failures to acquire .23
8.4.8 Adding test data to the corpus .23
8.4.9 Online comparison trials .23
8.4.10 Offline comparison trials .24
8.4.11 Offline non-mated comparison trials when references are dependent . .25
8.4.12 Offline non-mated comparison trials based on comparison of references .25
8.4.13 Use of samples from multi-capture comparison transactions .25
8.5 Identification trials .26
8.5.1 General.26
8.5.2 Identification testing with non-enrolled test subjects .26
8.5.3 Use of jack-knife approach for identification testing .26
9 Analyses .26
9.1 General .26
9.2 Performance of biometric enrolment .27
9.2.1 Failure-to-enrol rate.27
9.2.2 Enrolment transaction duration.27
9.3 Performance of biometric acquisition .28
9.3.1 Failure-to-acquire rate .28
9.3.2 Acquisition process duration .28
9.3.3 Other aspects of acquisition performance .28
9.4 One-to-one comparison performance.29
9.4.1 False non-match rate .29
9.4.2 False match rate .29
9.5 Verification system performance metrics .30
9.5.1 General.30
9.5.2 False reject rate .30
9.5.3 False accept rate .
...
International
Standard
ISO/IEC 19795-1
Second edition
Information technology —
2021-05
Biometric performance testing and
reporting —
Corrected version
2024-09
Part 1:
Principles and framework
Technologies de l'information — Essais et rapports de
performance biométriques —
Partie 1: Principes et canevas
Reference number
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
© ISO/IEC 2021 – All rights reserved
ii
Contents Page
Foreword .vi
Introduction .vii
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Abbreviated terms . 5
5 Conformance . 6
6 General biometric system . 6
6.1 Conceptual representation of general biometric system .6
6.2 Conceptual components of a general biometric system .7
6.2.1 Data capture subsystem .7
6.2.2 Transmission subsystem .7
6.2.3 Signal processing subsystem.7
6.2.4 Data storage subsystem .7
6.2.5 Comparison subsystem .7
6.2.6 Decision subsystem .8
6.2.7 Administration subsystem .8
6.2.8 Interface to external application .8
6.3 Functions of general biometric system.8
6.3.1 Enrolment .8
6.3.2 Verification of a positive biometric claim .9
6.3.3 Identification .10
6.4 Enrolment, verification and identification transactions .10
6.5 Performance measures .11
6.5.1 Error rates .11
6.5.2 Throughput rates . 12
6.5.3 Types of performance testing . 12
7 Planning the evaluation .13
7.1 General . 13
7.2 Determine information about the system . 13
7.3 Controlling factors that influence performance .14
7.4 Test subject selection . 15
7.5 Test size .16
7.5.1 General .16
7.5.2 Collecting multiple recognition transactions per test subject per system .16
7.5.3 Requirements on test size .17
7.6 Multiple tests .17
8 Data collection . .18
8.1 Avoidance of data collection errors .18
8.2 Data and details collected .18
8.3 Enrolments .19
8.3.1 Enrolment transactions .19
8.3.2 Enrolment conditions . 20
8.3.3 Enrolment failures and presentation errors . 20
8.4 One-to-one comparison trials .21
8.4.1 General .21
8.4.2 Collection conditions .21
8.4.3 Frequency of use . 22
8.4.4 Systems performing optimization based on enrolled references . 22
8.4.5 Systems performing reference adaptation . 22
8.4.6 Processes for data entry errors and system misuse . 22
8.4.7 Failures to acquire . 22
© ISO/IEC 2021 – All rights reserved
iii
8.4.8 Adding test data to the corpus . 22
8.4.9 Online comparison trials . 22
8.4.10 Offline comparison trials . 23
8.4.11 Offline non-mated comparison trials when references are dependent .24
8.4.12 Offline non-mated comparison trials based on comparison of references .24
8.4.13 Use of samples from multi-capture comparison transactions .24
8.5 Identification trials . 25
8.5.1 General . 25
8.5.2 Identification testing with non-enrolled test subjects . 25
8.5.3 Use of jack-knife approach for identification testing . 25
9 Analyses .25
9.1 General . 25
9.2 Performance of biometric enrolment . 26
9.2.1 Failure-to-enrol rate . 26
9.2.2 Enrolment transaction duration . 26
9.3 Performance of biometric acquisition .27
9.3.1 Failure-to-acquire rate .27
9.3.2 Acquisition process duration .27
9.3.3 Other aspects of acquisition performance .27
9.4 One-to-one comparison performance. 28
9.4.1 False non-match rate .
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.