Paper Info
Title
Sensitivity analysis for biometric systems: A methodology based on orthogonal experiment designs
Abstract
The purpose of this paper is to introduce an effective and structured methodology for carrying out a biometric system sensitivity analysis. The goal of sensitivity analysis is to provide the researcher/developer with insight and understanding of the key factors-algorithmic, subject-based, procedural, image quality, environmental, among others-that affect the matching performance of the biometric system under study. This proposed methodology consists of two steps: (1) the design and execution of orthogonal fractional factorial experiment designs which allow the scientist to efficiently investigate the effect of a large number of factors-and interactions-simultaneously, and (2) the use of a select set of statistical data analysis graphical procedures which are fine-tuned to unambiguously highlight important factors, important interactions, and locally-optimal settings. We illustrate this methodology by application to a study of VASIR (Video-based Automated System for Iris Recognition)-NIST iris-based biometric system. In particular, we investigated k=8 algorithmic factors from the VASIR system by constructing a (2^6^-^1x3^1x4^1) orthogonal fractional factorial design, generating the corresponding performance data, and applying an appropriate set of analysis graphics to determine the relative importance of the eight factors, the relative importance of the 28 two-term interactions, and the local best settings of the eight algorithms. The results showed that VASIR's performance was primarily driven by six factors out of the eight, along with four two-term interactions. A virtue of our two-step methodology is that it is systematic and general, and hence may be applied with equal rigor and effectiveness to other biometric systems, such as fingerprints, face, voice, and DNA.
Year
DOI
Venue
2013
10.1016/j.cviu.2013.01.003
Computer Vision and Image Understanding
Keywords
Field
DocType
analysis graphics,vasir system,structured methodology,proposed methodology,two-term interaction,orthogonal experiment design,sensitivity analysis,biometric system sensitivity analysis,statistical data analysis graphical,biometric system,relative importance,experiment design,biometrics,iris recognition,fractional factorial,orthogonal,uncertainty
Graphics,Fractional factorial design,Iris recognition,Data mining,Structured methodology,Image quality,Artificial intelligence,Biometrics,Machine learning,Mathematics,Biometric system,Design of experiments
Journal
Volume
Issue
ISSN
117
5
1077-3142
Citations 
PageRank 
References 
14
0.58
18
Authors
4
Name
Order
Citations
PageRank
Yooyoung Lee1392.65
James J. Filliben2304.21
Ross J. Micheals331332.03
P. Jonathon Phillips49209801.62