New Eye Contact Correction Using Radial Basis Function for Wide Baseline Videoconference System

In this paper, we introduce a novel eye contact correction method for videoconference systems with wide baseline. In this system, assistant cameras are installed on each side of the monitor to help capture the views from left side and right side. A pattern with random dots and Radial Basis Function (RBF) interpolation are used to help create precise disparity maps that is then used for re-projection. The interpolated views show a smooth transit among cameras on two sides. The experimental results also demonstrate that the proposed method could be extended to produce more robust and accurate disparity maps than most of the existing algorithms from regular stereo images.

[1]  Oliver SCHREER,et al.  Virtual Team User Environments – A Key Application in Telecommunication , 2002 .

[2]  Pascal Fua,et al.  A parallel stereo algorithm that produces dense depth maps and preserves image features , 1993, Machine Vision and Applications.

[3]  Ruigang Yang,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling , 2006, CVPR.

[4]  Thomas Malzbender,et al.  The Coliseum Immersive Teleconferencing System , 2002 .

[5]  Long Quan,et al.  Region-based progressive stereo matching , 2004, CVPR 2004.

[6]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[7]  David Taniar,et al.  Computational Science and Its Applications - ICCSA 2006, International Conference, Glasgow, UK, May 8-11, 2006, Proceedings, Part I , 2006, ICCSA.

[8]  Adrião Duarte Dória Neto,et al.  Stereo Map Surface Calculus Optimization Using Radial Basis Functions Neural Network Interpolation , 2009, ICONIP.

[9]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Li Hong,et al.  Segment-based stereo matching using graph cuts , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[12]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Junchul Chun,et al.  Image-Based 3D Face Modeling from Stereo Images , 2006, ICCSA.

[14]  Long Quan,et al.  Region-based progressive stereo matching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Jean-Philippe Pons,et al.  Robust and Efficient Surface Reconstruction From Range Data , 2009, Comput. Graph. Forum.

[16]  Zheng Zhi.  A Region Based Stereo Matching Algorithm Using Cooperative Optimization , 2009 .

[17]  Ingemar J. Cox,et al.  Teleconferencing eye contract using a virtual camera , 1993, INTERCHI Adjunct Proceedings.

[18]  Andreas Klaus,et al.  Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  Bang Jun Lei,et al.  Real-Time Multi-Step View Reconstruction for a Virtual Teleconference System , 2002, EURASIP J. Adv. Signal Process..

[20]  Richard K. Beatson,et al.  Surface interpolation with radial basis functions for medical imaging , 1997, IEEE Transactions on Medical Imaging.