3D Face-Aware Electronics with Low-Resolution Imaging

What if your electronics with cheap cameras can reveal 3D faces of captured people? In daily life, we use a lot of consumer electronics employing cameras such as a mobile phone, a tablet PC, a CCTV, a car black box, and so on. If such devices provide 3D facial shapes of 2-dimensionally framed people, it would benefit new applications and services in higher dimensional imaging, security, HCI Human-Computer Interaction, AR Augmented Reality, and mobile applications like phone games. This paper introduces a novel method to realize the functionality in computational electronics with low-resolution imaging.

[1]  Jan P. Allebach,et al.  Optimal image scaling using pixel classification , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[3]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[4]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Ig-Jae Kim,et al.  Intuitive quasi-eigen faces , 2007, GRAPHITE '07.

[6]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[7]  Ira Kemelmacher-Shlizerman,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 3d Face Reconstruction from a Single Image Using a Single Reference Face Shape , 2022 .

[8]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[9]  Michael Elad,et al.  Super Resolution With Probabilistic Motion Estimation , 2009, IEEE Transactions on Image Processing.

[10]  Bryan S. Morse,et al.  Image magnification using level-set reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Edwin R. Hancock,et al.  Recovering facial shape and albedo using a statistical model of surface normal direction , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.