Performance characterization of a high-speed stereo vision sensor for acquisition of time-varying 3D shapes

Acquisition of dynamic dense 3D shape data is of increasing importance in computer vision with applications in various disciplines. In this paper, we investigate the performance of a unique high-speed range sensor based on the stereo vision principle for 3D shape acquisition of animals. The investigation reveals some characteristics of the current version of the sensor with respect to its physical parameters, which suggest an more appropriate configuration of the sensor in real data acquisition scenarios. Due to the novelty of the sensor and the application, we believe that our evaluation of the sensor’s performance will inspire new applications to follow using the dynamic 3D acquisition technology of similar types.

[1]  Pascal Müller,et al.  Realistic speech animation based on observed 3-D face dynamics , 2005 .

[2]  Y Xiao.  Segmentation and modelling of whole human body scan data. , 2006 .

[3]  A F Ayoub,et al.  Validation and reproducibility of a high-resolution three-dimensional facial imaging system. , 2008, The British journal of oral & maxillofacial surgery.

[4]  James N Caron.  Rapid supersampling of multiframe sequences by use of blind deconvolution. , 2004, Optics letters.

[5]  Sukhendu Das,et al.  Error analysis in reconstruction of a line in 3-D from two arbitrary perspective views , 2001, Int. J. Comput. Math..

[6]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[7]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[8]  R J Winder,et al.  Technical validation of the Di3D stereophotogrammetry surface imaging system. , 2008, The British journal of oral & maxillofacial surgery.

[9]  John Iselin Woodfill,et al.  Tyzx DeepSea High Speed Stereo Vision System , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[10]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  John P. Lewis,et al.  Perceiving Visual Emotions with Speech , 2006, IVA.

[12]  Alberto Prieto,et al.  Real-Time System for High-Image Resolution Disparity Estimation , 2007, IEEE Transactions on Image Processing.

[13]  Alessio Del Bue,et al.  Non-Rigid Stereo Factorization , 2006, International Journal of Computer Vision.

[14]  S. Chatterjee,et al.  Quantization error analysis in stereo vision , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[15]  Jean-Christophe Nebel,et al.  Study of the breathing pattern based on 4D data collected by a dynamic 3D body scanner , 2002 .

[16]  Sidney Ray,et al.  Applied photographic optics , 1998 .

[17]  Song Zhang,et al.  High-resolution, real-time three-dimensional shape measurement , 2006 .

[18]  Sukhendu Das,et al.  Quantization Error in Stereo Imaging systems , 2002, Int. J. Comput. Math..

[19]  Tai-Pang Wu,et al.  Dense Photometric Stereo by Expectation Maximization , 2006, ECCV.

[20]  Adrian Hilton,et al.  Speech-driven face synthesis from 3D video , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[21]  Alexandru Tupan,et al.  Triangulation , 1997, Comput. Vis. Image Underst..

[22]  Gabriele Guidi,et al.  3D digitization of a large model of imperial Rome , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[23]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[25]  W. P. Cockshott,et al.  Experimental 3-D digital TV studio , 2003 .

[26]  Adrian Hilton,et al.  Video-rate capture of dynamic face shape and appearance , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[27]  Krishnan Ramnath.  On the MultiView Fitting and Construction of Dense Deformable Face Models , 2007 .

[28]  Kun Zhang,et al.  Nonlinear image restoration with adaptive anisotropic regularizing operator , 2006 .

[29]  Kap Luk Chan,et al.  An empirical study on the effects of spatial discretization error in a stereo vision system , 1990, BMVC.

[30]  Balasubramanian Raman,et al.  Error estimation in reconstruction of quadratic curves in 3D space , 2007, Int. J. Comput. Math..

[31]  Adrian Hilton,et al.  Speech-driven face synthesis from 3D video , 2004 .