Design and Deployment of Visible-Thermal Biometric Surveillance Systems

Automatic video surveillance in uncontrolled outdoor settings is a very challenging computer vision task. Nearly infinite variability of the environmental factors and the open-ended goals of many surveillance problems conspire to create situations where even the most advanced detection, tracking and recognition algorithms falter. While the common academic response to such challenges is to develop new, more powerful algorithms capable of handling a broader range of conditions with acceptable performance, this course of action is sometimes not appropriate from the industrial-commercial point of view. Sometimes systems must be deployed sooner than would allow for the development cycle of complex new algorithms, and must be more robust than most such algorithms can be expected to be on short notice. Under those circumstances, one may look toward better data quality as one means of improving performance while remaining close to the existing state-of-the-art in algorithmic technology. This is often the motivation for deployment of multimodal surveillance systems in the real world. This presentation constitutes a brief foray into design issues for visible-thermal systems, with emphasis on biometric surveillance.

[1]  Joseph Wilder,et al.  Comparison of visible and infra-red imagery for face recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2]  Lawrence B. Wolff,et al.  Illumination invariant face recognition using thermal infrared imagery , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Pradeep Buddharaju,et al.  Pose-Invariant Physiological Face Recognition in the Thermal Infrared Spectrum , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[4]  Lawrence B. Wolff,et al.  Quantitative measurement of illumination invariance for face recognition using thermal infrared imagery , 2003, SPIE Optics + Photonics.

[5]  Patrick J. Flynn,et al.  Visible-light and Infrared Face Recognition , 2003 .

[6]  Ross Cutler,et al.  Face recognition using infrared images and eigenfaces , 1996 .

[7]  Andrea Salgian,et al.  A comparative analysis of face recognition performance with visible and thermal infrared imagery , 2002, Object recognition supported by user interaction for service robots.

[8]  Xin Chen,et al.  PCA-Based Face Recognition in Infrared Imagery: Baseline and Comparative Studies , 2003, AMFG.

[9]  Lawrence B. Wolff,et al.  Face Recognition in the Thermal Infrared , 2005 .

[10]  Andrea Salgian,et al.  Face recognition with visible and thermal infrared imagery , 2003, Comput. Vis. Image Underst..

[11]  Andrea Salgian,et al.  Thermal face recognition in an operational scenario , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  T. Sakai,et al.  Computer analysis and classification of photographs of human faces , 1973 .

[13]  F. Prokoski History, current status, and future of infrared identification , 2000, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640).