A Solution to Face-to-Face Contact in Tele-presence Systems

In tele-presence systems, direct face-to-face contact, is essential for emotional communication as it carries non-verbal clues. In commercial products, face-to-face contact is approximated by using either a large semi-transparent mirror to project an image of the remote participant and capture the local participant image by using a video camera aiming at the centre of the screen or by using low profile cameras. These systems are very cumbersome and require complex hardware and software setups. In this paper, we propose a low cost solution to face-to-face contact correction problem in tele-presence systems using active stereo triangulation.

[1]  Long Quan,et al.  Region-based progressive stereo matching , 2004, CVPR 2004.

[2]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[3]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Junchul Chun,et al.  Image-Based 3D Face Modeling from Stereo Images , 2006, ICCSA.

[5]  Vamshhi Pavan Kumar Varma Vegeshna,et al.  Stereo Matching with Color-Weighted Correlation, Hierachical Belief Propagation and Occlusion Handling , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Kentaro Toyama,et al.  Gaze Awareness for Video-Conferencing: A Software Approach , 2000, IEEE Multim..

[7]  Masayuki Tanimoto.  Free-Viewpoint Television , 2010, Image and Geometry Processing for 3-D Cinematography.

[8]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Li Hong,et al.  Segment-based stereo matching using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[11]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[12]  Zhi-Gang Zheng,et al.  A region based stereo matching algorithm using cooperative optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Pierre Boulanger,et al.  Image matting based on mutual information , 2011, 2011 Visual Communications and Image Processing (VCIP).

[14]  Byung-Uk Lee,et al.  Viewpoint Interpolation Using an Ellipsoid Head Model for Video Teleconferencing , 2005, ISVC.

[15]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[16]  Zheng Zhi.  A Region Based Stereo Matching Algorithm Using Cooperative Optimization , 2009 .

[17]  Ruigang Yang,et al.  Eye gaze correction with stereovision for video-teleconferencing , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tat-Jen Cham,et al.  Analogous view transfer for gaze correction in video sequences , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[19]  Long Quan,et al.  Region-based progressive stereo matching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[20]  Thomas Malzbender,et al.  The Coliseum Immersive Teleconferencing System , 2002 .

[21]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[23]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[24]  Jean-Philippe Pons,et al.  Robust and Efficient Surface Reconstruction From Range Data , 2009, Comput. Graph. Forum.

[25]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.