Human face 3D reconstruction with handheld single 2D camera on mobile devices

In this paper, we propose a live system for 3D reconstruction of human face using only single 2D camera without any 3D sensor. Lack of feature points and homogeneous skin color leads to low quality and success rate in conventional 3D reconstruction algorithms when applied to human face. Moreover, it requires difficult user interaction. To solve this problem, we adopt the facial shape and appearance model to our 3D reconstruction pipeline. This is the first approach which creates a complete 3D face model that can be directly used for 3D printing or virtual reality applications. Model can be acquired using modern smartphone in less than 40 seconds.

[1]  Daniel Cremers,et al.  Semi-dense Visual Odometry for a Monocular Camera , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[3]  Adam Baumberg,et al.  Blending Images for Texturing 3D Models , 2002, BMVC.

[4]  C. Zach Fast and High Quality Fusion of Depth Maps , 2008 .

[5]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Marc Pollefeys,et al.  Live Metric 3D Reconstruction on Mobile Phones , 2013, 2013 IEEE International Conference on Computer Vision.