ISO/IEC 19795-10:2024

Information technology — Biometric performance testing and reporting — Part 10: Quantifying biometric system performance variation across demographic groups

Publication date:   Oct 4, 2024

Scope

This document establishes requirements for estimating and reporting on performance variations observed when cohorts belonging to different demographic groups engage with biometric enrolment and recognition systems. In this context, performance refers to failure-to-enrol rate, failure-to-acquire rate, shifts in comparison score, recognition error rates, and aspects of response and processing time (throughput).
This document is applicable to the following:
—    demographic group membership;
—    using phenotypic measures;
—    reporting on tests;
—    stating statistical uncertainty estimates;
—    operational thresholds settings;
—    equitability;
—    procurement agency activities.
This document also provides terms and definitions to be used when reporting performance variation across demographic groups.
This document is applicable to:
—    technology evaluations of algorithms, subsystems and systems;
—    scenario evaluations of systems;
—    operational evaluations of fielded systems.
Application of this document does not require detailed knowledge of a system’s algorithms but it does require specific knowledge of the demographic characteristics for the population of interest.