Standard
Track updates
AS ISO/IEC 19795.1:2022
[Current]Information technology — Biometric performance testing and reporting, Part 1: Principles and framework
AS ISO/IEC 19795.1:2022 identically adopts ISO/IEC 19795.1:2021, which establishes general principles for testing the performance of biometrics systems in terms of error rates and throughput rates for purposes including measurement of performance, prediction of performance, comparison of performance, and verifying conformance with specified performance requirements. It also specifies requirements on test protocols and on the recording of test data and reporting of test results.
Published: 09/09/2022
Pages: 77
Table of contents
Cited references
Content history
Table of contents
Header
About this publication
Preface
Foreword
Introduction
1 Scope
2 Normative references
3 Terms and definitions
4 Abbreviated terms
5 Conformance
6 General biometric system
6.1 Conceptual representation of general biometric system
6.2 Conceptual components of a general biometric system
6.2.1 Data capture subsystem
6.2.2 Transmission subsystem
6.2.3 Signal processing subsystem
6.2.4 Data storage subsystem
6.2.5 Comparison subsystem
6.2.6 Decision subsystem
6.2.7 Administration subsystem
6.2.8 Interface to external application
6.3 Functions of general biometric system
6.3.1 Enrolment
6.3.2 Verification of a positive biometric claim
6.3.3 Identification
6.4 Enrolment, verification and identification transactions
6.5 Performance measures
6.5.1 Error rates
6.5.2 Throughput rates
6.5.2.1
6.5.2.2
6.5.3 Types of performance testing
6.5.3.1
6.5.3.2
6.5.3.3
6.5.3.4
7 Planning the evaluation
7.1 General
7.1.1
7.1.2
7.1.3
7.2 Determine information about the system
7.3 Controlling factors that influence performance
7.3.1
7.3.2
7.3.3
7.3.4
7.3.5
7.3.6
7.3.7
7.4 Test subject selection
7.4.1
7.4.2
7.4.3
7.4.4
7.4.5
7.4.6
7.4.7
7.4.8
7.4.9
7.5 Test size
7.5.1 General
7.5.2 Collecting multiple recognition transactions per test subject per system
7.5.2.1
7.5.2.2
7.5.3 Requirements on test size
7.6 Multiple tests
7.6.1
7.6.2
8 Data collection
8.1 Avoidance of data collection errors
8.1.1
8.1.2
8.1.3
8.1.4
8.2 Data and details collected
8.2.1
8.2.2
8.2.3
8.2.4
8.3 Enrolments
8.3.1 Enrolment transactions
8.3.1.1
8.3.1.2
8.3.1.3
8.3.1.4
8.3.2 Enrolment conditions
8.3.2.1
8.3.2.2
8.3.2.3
8.3.3 Enrolment failures and presentation errors
8.3.3.1
8.3.3.2
8.3.3.3
8.3.3.4
8.4 One-to-one comparison trials
8.4.1 General
8.4.1.1
8.4.1.2
8.4.1.3
8.4.1.4
8.4.2 Collection conditions
8.4.3 Frequency of use
8.4.4 Systems performing optimization based on enrolled references
8.4.5 Systems performing reference adaptation
8.4.6 Processes for data entry errors and system misuse
8.4.7 Failures to acquire
8.4.8 Adding test data to the corpus
8.4.9 Online comparison trials
8.4.10 Offline comparison trials
8.4.11 Offline non-mated comparison trials when references are dependent
8.4.12 Offline non-mated comparison trials based on comparison of references
8.4.13 Use of samples from multi-capture comparison transactions
8.5 Identification trials
8.5.1 General
8.5.2 Identification testing with non-enrolled test subjects
8.5.3 Use of jack-knife approach for identification testing
9 Analyses
9.1 General
9.1.1
9.1.2
9.1.3
9.1.4
9.2 Performance of biometric enrolment
9.2.1 Failure-to-enrol rate
9.2.1.1
9.2.1.2
9.2.1.3
9.2.1.4
9.2.2 Enrolment transaction duration
9.3 Performance of biometric acquisition
9.3.1 Failure-to-acquire rate
9.3.1.1
9.3.1.2
9.3.1.3
9.3.1.4
9.3.2 Acquisition process duration
9.3.3 Other aspects of acquisition performance
9.3.3.1
9.3.3.2
9.4 One-to-one comparison performance
9.4.1 False non-match rate
9.4.1.1
9.4.1.2
9.4.1.3
9.4.2 False match rate
9.4.2.1
9.4.2.2
9.4.2.3
9.4.2.4
9.4.2.5
9.5 Verification system performance metrics
9.5.1 General
9.5.2 False reject rate
9.5.2.1
9.5.2.2
9.5.2.3
9.5.3 False accept rate
9.5.3.1
9.5.3.2
9.5.3.3
9.5.4 Verification transaction duration
9.5.4.1
9.5.4.2
9.5.5 Generalized false reject rate and generalized false accept rate
9.6 Identification system performance metrics
9.6.1 General
9.6.2 False-negative identification rate
9.6.2.1
9.6.2.2
9.6.3 False-positive identification rate
9.6.3.1
9.6.3.2
9.6.4 Generalized false-negative identification rate and generalized false-positive identification rate
9.6.5 Selectivity
9.6.6 Closed-set test of identification performance
9.6.7 Estimation of identification error rates from one-to-one comparison results
9.6.8 Predicting identification error rates in larger populations
9.7 Analysis of performance across controlled experimental factors
9.7.1 Longitudinal analyses
9.7.1.1
9.7.1.2
9.7.1.3
9.7.2 Pairwise analyses
9.8 Detection error trade-off
9.8.1
9.8.2
9.8.3
9.9 Transaction durations
9.9.1
9.9.2
9.9.3
9.10 Computational workload
9.10.1
9.10.2
9.10.3
9.10.4
9.11 Uncertainty of estimates
9.11.1
9.11.2
10 Graphical presentation of results
10.1 Score distributions
10.1.1 General
10.1.2 Boxplots
10.2 Error rate vs threshold plot
10.3 DET plot
10.3.1
10.3.2
10.3.3
10.3.4
10.3.5
10.3.6
10.4 CMC plot / FNIR over rank plot
10.5 FNIR over number of enrolees plot
10.6 Heat maps
11 Record keeping
11.1
11.2
11.3
11.4
11.5
11.6
12 Reporting performance results
12.1 Reporting test details
12.2 Summary statistics
12.3 Reporting enrolment performance
12.4 Reporting acquisition performance
12.5 Reporting one-to-one comparison performance
12.6 Reporting verification system performance
12.7 Reporting identification system performance
12.8 Reporting performance across factors
12.8.1
12.8.2
Annex A
Annex B
B.1 Confidence intervals and test size assuming independent identically distributed comparisons
B.1.1 Rule of 3
B.1.2 Rule of 30
B.1.3 Number of comparisons to support a claimed error rate
B.1.3.1
B.1.3.2
B.1.3.3
B.2 Variance of performance measures as a function of test size
B.3 Estimates for variance of performance measures
B.3.1 General
B.3.2 Variance of observed false non-match rate
B.3.2.1 False non-match rate — Single attempt per test subject
B.3.2.2 False non-match rate — Multiple attempts per test subject
B.3.2.3 False non-match rate — Unequal numbers of attempts per test subject
B.3.3 Variance of observed false match rate
B.4 Estimating confidence intervals
B.4.1 General
B.4.1.1
B.4.1.3
B.4.2 Bootstrap estimates of the variance and confidence intervals
B.4.2.1
B.4.2.2
B.4.2.3
B.4.3 Subset sampling
B.4.3.1
B.4.3.2
Annex C
C.1 General
C.2 List of factors
C.2.1 Population demographics
C.2.2 Application
C.2.3 Capture subject anatomy
C.2.4 Capture subject behaviour
C.2.5 Capture subject appearance
C.2.6 Environmental influences
C.2.7 Sensor and hardware
C.2.8 User interface
C.3 Examples for reporting
C.3.1 Finger position
C.3.2 Change of illumination
C.3.3 Illumination reflections
C.3.4 Glasses
C.3.5 Dirt on platen
C.3.6 Weather
Annex D
D.1
D.2
D.3
D.4
D.5
D.6
D.7
D.8
Annex E
E.1
Annex F
F.1 Algorithm for generating DET data points
F.1.1 MATLAB code for DET calculation
F.1.2 Python code for DET calculation
F.1.3 R code for DET calculation
F.2 Algorithm for generating CMC data points
Annex G
Bibliography
Cited references in this standard
Content history
[Current]
[Superseded]
DR AS ISO/IEC 19795.1:2022
One-time Purchase
Access via web browser on any device
One-time purchase
Single publication
Offline access via PDF^
$259.88 AUD
Inclusive of GSTFormat *
Web Reader
Additional files available
Licenses *
1 user
Total$259.88 AUD
IMPORTANT