Dense 3D Reconstruction and Tracking of Dynamic Surface

This essay addresses the problem of dense 3D reconstruction and tracking of dynamic surface from calibrated stereo image sequences. The primary contribution of this research topic is that a novel framework of 3D reconstruction and tracking of dynamic surface is proposed, where a surface is divided into several blocks and block matching in stereo and temporal images is used instead of matching the whole surface, when all the block correspondences are obtained, a special bilinear interpolation is applied to precisely reconstruct and track the integral surface. Performance is evaluated on challenging ground-truth data generated by 3D max, and then different surface materials, such as fish surface, paper and cloth are used to test the actual effect. The research results demonstrate that this framework is an effective and robust method for dynamic surface reconstruction and tracking.

[1]  Pascal Fua,et al.  Convex Optimization for Deformable Surface 3-D Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Frederic Devernay,et al.  A Variational Method for Scene Flow Estimation from Stereo Sequences , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Kun Zhou,et al.  Dynamic hair manipulation in images and videos , 2013, ACM Trans. Graph..

[4]  Cameron N. Riviere,et al.  Robotic Compensation of Biological Motion to Enhance Surgical Accuracy , 2006, Proceedings of the IEEE.

[5]  Ye Liu,et al.  Method for three-dimensional measurement of dynamic deformable surfaces , 2012, J. Electronic Imaging.

[6]  Guang-Zhong Yang,et al.  Soft-Tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures , 2005, MICCAI.

[7]  Christian Rössl,et al.  Dense correspondence finding for parametrization-free animation reconstruction from video , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Chao Liu,et al.  Deformable motion tracking of the heart surface , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Adrian Hilton,et al.  An Empirical Study of Non-Rigid Surface Feature Matching of Human from 3D Video , 2010, J. Virtual Real. Broadcast..

[10]  Hans-Peter Seidel,et al.  Marker-less Deformable Mesh Tracking for Human Shape and Motion Capture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  J. Triboulet,et al.  Efficient Tracking of the Heart Using Texture , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Yinqiang Zheng,et al.  Deformable surface stereo tracking-by-detection using Second Order Cone Programming. , 2008, 2008 19th International Conference on Pattern Recognition.

[13]  Yan Qiu Chen,et al.  Robust framework for three-dimensional measurement of dynamic deformable surface , 2012 .

[14]  Kun Zhou,et al.  Highly Parallel Surface Reconstruction , 2008 .

[15]  Tobias Ortmaier,et al.  Tracking local motion on the beating heart , 2002, SPIE Medical Imaging.

[16]  Anna Hilsmann,et al.  Tracking deformable surfaces with optical flow in the presence of self occlusion in monocular image sequences , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[17]  Craig Gotsman,et al.  Articulated Object Reconstruction and Markerless Motion Capture from Depth Video , 2008, Comput. Graph. Forum.

[18]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[19]  Luca Ballan,et al.  Marker-less motion capture of skinned models in a four camera set-up using optical flow and silhouettes , 2008 .

[20]  Ryan White,et al.  Capturing and animating occluded cloth , 2007, SIGGRAPH 2007.

[21]  Cristian Sminchisescu.  3D Human Motion Analysis in Monocular Video Techniques and Challenges , 2006, AVSS.

[22]  Guido Gerig,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2005, 8th International Conference, Palm Springs, CA, USA, October 26-29, 2005, Proceedings, Part II , 2005, MICCAI.

[23]  Jean Ponce,et al.  Dense 3D motion capture for human faces , 2009, CVPR.