Efficient Segmentation of 3D Face Reconstructions

The segmentation of the face in 3D reconstructions is a crucial processing step within 3D face recognition systems. At this early processing stage discarding other surface portions such as collars, hats or hairstyle shall reduce the amount of data. In contrast to other approaches, the proposed algorithm uses only the face geometry and is therefore robust with respect to lighting conditions or texture quality. Assuming the skin region of a face is locally flat and closed, a binary mask image is created. Morphology and a simple heuristic are applied on connected components to select and join appropriate components. The implementation is straight forward, yielding just a few parameters and copes the problem without training procedure. A proof of concept is given and results are shown for several cases, limitations of the approach are discussed.

[1]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Paul Suetens,et al.  Feature detection on 3D face surfaces for pose normalisation and recognition , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[3]  Markus Brandner,et al.  State of the art on vision-based structured light systems for 3D measurements , 2005, International Workshop on Robotic Sensors: Robotic and Sensor Environments, 2005..

[4]  Guillaume Lavoué,et al.  A roughness measure for 3D mesh visual masking , 2007, APGV.

[5]  Mohammed Bennamoun,et al.  Automatic 3D Face Detection, Normalization and Recognition , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[6]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[7]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[8]  Jie Yang,et al.  Efficient face segmentation based on face attention model and seeded region merging , 2008, 2008 9th International Conference on Signal Processing.

[9]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[10]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..