A Prototype for the Creation and Interactive Visualization of 3D Human Face Models

This paper presents a complete solution for the creation and manipulation of the 3D representationof a human face model using off the shelf components. First, the 3D model is obtained bymeans of a structured light system that is calibrated using only the vanishing points extracted from asimple planar surface. Then, an immersive interaction technique is used to manipulate the 3D model.The interaction tool is located in 3D space using a fuzzy technique with the advantages of a lowmemory usage, real-time operation and low positioning errors as compared to classical solutions. Experimentalresults including accuracy evaluation of the reconstruction and of the interaction tool arepresented. The resulting system can find applications in expression based human-computer interaction,virtual assisted cosmetic surgery, as well as in the teleconferencing, being in line with the currenttrends of intelligent user interfaces.

[1]  Juan Pablo Wachs,et al.  A Real-Time Gesture Interface for Hands-Free Control of Electronic Medical Records , 2006, AMIA.

[2]  Takeo Kanade,et al.  Projector Calibration using Arbitrary Planes and Calibrated Camera , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Dieter Schmalstieg,et al.  Liver Surgery Planning Using Virtual Reality , 2006, IEEE Computer Graphics and Applications.

[4]  Ivan Poupyrev,et al.  An Introduction to 3D User Interface Design , 2001 .

[5]  Ivan Poupyrev,et al.  An Introduction to 3-D User Interface Design , 2001, Presence: Teleoperators & Virtual Environments.

[6]  Eric Maisel,et al.  Using vanishing points for camera calibration and coarse 3D reconstruction from a single image , 2000, The Visual Computer.

[7]  C Baur,et al.  A non-contact mouse for surgeon-computer interaction. , 2004, Technology and health care : official journal of the European Society for Engineering and Medicine.

[8]  Michael Bosse,et al.  Vanishing points and three-dimensional lines from omni-directional video , 2003, The Visual Computer.

[9]  Joni-Kristian Kämäräinen,et al.  Projector Calibration by "Inverse Camera Calibration" , 2011, SCIA.

[10]  Michael Bosse,et al.  Vanishing points and three-dimensional lines from omni-directional video , 2003, The Visual Computer.

[11]  Jeremy R. Cooperstock,et al.  Stereoscopic display technologies, interaction paradigms, and rendering approaches for neurosurgical visualization , 2009, Electronic Imaging.

[12]  Xu Zhang,et al.  Projector calibration from the camera image point of view , 2009 .

[13]  Mario Ciampi,et al.  Wii Remote-enhanced Hand-Computer interaction for 3D medical image analysis , 2009, 2009 International Conference on the Current Trends in Information Technology (CTIT).

[14]  Carsten Rother.  A new approach to vanishing point detection in architectural environments , 2002, Image Vis. Comput..

[15]  Radu Orghidan,et al.  Fuzzy versus crisp stereo calibration: A comparative study , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[16]  Yael Edan,et al.  A Real-Time Hand Gesture Interface for Medical Visualization Applications , 2006 .

[17]  Richard I. Hartley,et al.  Sensitivity of Calibration to Principal Point Position , 2002, ECCV.

[18]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[19]  Jean-Philippe Tardif,et al.  Non-iterative approach for fast and accurate vanishing point detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Jana Kosecka,et al.  Efficient computation of vanishing points , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[21]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[22]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[23]  Rahul Sukthankar,et al.  Smarter Presentations: Exploiting Homography in Camera-Projector Systems , 2001, ICCV.

[24]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[25]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[26]  Joaquim Salvi,et al.  A new optimised De Bruijn coding strategy for structured light patterns , 2004, ICPR 2004.

[27]  Marco Pulimeno,et al.  Advanced Visualization and Interaction Systems for Surgical Pre-operative Planning , 2010, J. Comput. Inf. Technol..