Best practices in testing and reporting performance of biometric devices.

The purpose of this document is to summarise the current understanding of the biometrics community of the best scientific practices for conducting technical performance testing towards the end of field performance estimation.

[1]  Charles Cresson Wood,et al.  Security for computer networks : D.W. Davies and W.L. Price New York: John Wiley and Sons, 1984. 386 + xix pages, $19.50 , 1985, Computers & security.

[2]  Douglas A. Reynolds,et al.  SHEEP, GOATS, LAMBS and WOLVES A Statistical Analysis of Speaker Performance in the NIST 1998 Speaker Recognition Evaluation , 1998 .

[3]  P. Jonathon Phillips,et al.  Facial Recognition Vendor Test 2000: Evaluation Report , 2001 .

[4]  Mike Bone,et al.  Facial Recognition Vendor Test 2000 , 2000 .

[5]  Thomas A. Louis,et al.  Confidence Intervals for a Binomial Parameter after Observing No Successes , 1981 .

[6]  B. Jovanovic,et al.  A Look at the Rule of Three , 1997 .

[7]  James L. Wayman,et al.  Multifinger Penetration Rate and ROC Variability for Automatic Fingerprint Identification Systems , 2004 .

[8]  P. Jonathon Phillips,et al.  An Introduction to Evaluating Biometric Systems , 2000, Computer.

[9]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[10]  W. J. Langford.  Statistical Methods , 1959, Nature.

[11]  J. P. Holmes,et al.  A performance evaluation of biometric identification devices , 1990 .

[12]  James L. Wayman,et al.  Technical Testing and Evaluation of Biometric Identification Devices , 1996 .

[13]  Anil K. Jain,et al.  FVC2000: Fingerprint Verification Competition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  G. W. Snedecor.  Statistical Methods , 1964 .

[15]  Eleanor or Mure.  The story of the three bears , 1967 .

[16]  R. V. Cox,et al.  Three new speech coders from the ITU cover a range of applications , 1997, IEEE Commun. Mag..

[17]  Sharath Pankanti,et al.  On the similarity of identical twin fingerprints , 2002, Pattern Recognit..

[18]  J A Hanley,et al.  If nothing goes wrong, is everything all right? Interpreting zero numerators. , 1983, JAMA.

[19]  Douglas A. Reynolds,et al.  The NIST speaker recognition evaluation - Overview, methodology, systems, results, perspective , 2000, Speech Commun..

[20]  David Chandler,et al.  Biometric Product Testing Final Report , 2001 .

[21]  J. Daugman,et al.  Epigenetic randomness, complexity and singularity of human iris patterns , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[22]  Alvin F. Martin,et al.  The DET curve in assessment of detection task performance , 1997, EUROSPEECH.

[23]  J. S. Ahrens,et al.  Laboratory evaluation of the IriScan prototype biometric identifier , 1996 .