Real-time identification using a canonical face depth map

A practical identification system based on 3D face scanning is presented. The speed of comparing a probe scan to the gallery is enabled by scan normalisation followed by extraction of higher level features. Our canonical face depth map (CFDM) is a standardised representation for three-dimensional (3D) face data in a face-based coordinate system. Our experiments demonstrate that the CFDM normalisation algorithm is (a) robust to noise and occlusion, (b) significantly reduces storage requirements and thus I/O time, and (c) improves the efficiency of face recognition algorithms. Producing the CFDM takes less than a second on a desktop for 320 times 240 rangel scans. Current 3D scanning and matching methods are too slow for person identification, even for a watch list of only a few hundred face models. Transforming scanned 3D faces into CFDM format enables a probe scan to be matched to hundreds or thousands of gallery scans in a fewtimesseconds on a commodity computer. The best results achieved so far are a rank-1 recognition rate of 98.2% and a speed of 1900 face matches per second. Extrapolating these results suggests that multistage systems could achieve even better performance on even larger galleries.

[1]  Michael G. Strintzis,et al.  Robust face recognition using 2D and 3D data: Pose and illumination compensation , 2005, Pattern Recognit..

[2]  Anil K. Jain,et al.  Detection of Anchor Points for 3D Face Veri.cation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Patrick J. Flynn,et al.  Accuracy of 3D scanning technologies in a face scanning scenario , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[4]  Emeka Nkenke,et al.  The Symmetry of Faces , 2002, VMV.

[5]  C. Dorai Cosmos: a framework for representation and recognition of 3d free-form objects , 1996 .

[6]  George C. Stockman,et al.  Human face verification by robust three-dimensional surface alignment , 2006 .

[7]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[8]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Chitra Dorai,et al.  Recognition of 3D free-form objects , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[11]  Chiraz BenAbdelkader,et al.  Comparing and combining depth and texture cues for face recognition , 2005, Image Vis. Comput..

[12]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[14]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..