Multi-view passive 3D reconstruction: Comparison and evaluation of three techniques and a new method for 3D object reconstruction

In this article, we focus on the comparison of the passive techniques of multi-view 3D reconstruction, namely the following techniques : Passive Stereo vision, Shape from Silhouette and Space Carving. Available data in the Passive techniques are no more than one or many images taken from different point of views (using one or several cameras). These images will be used in order to render the three-dimensional scene. Our study is based on the quality of the solution (3D Model obtained) and the calculation time. In passive stereo vision, the quality of the results is evaluated in terms of the value of the re-projection error. Also we will evaluate each technique separately. In the end, to enjoy the benefits of the techniques studied we proposed a method based on the extraction of silhouette images and the matching between images to make full 3D object reconstruction. The results of our own implementation of the different techniques studied and the proposed method enable to compare and evaluate these techniques, and to show the quality of the results obtained by the proposed method.

[1]  Long Quan,et al.  Quasi-Dense Reconstruction from Image Sequence , 2002, ECCV.

[2]  Long Quan,et al.  Silhouette Extraction from Multiple Images of Unknown Background , 2004 .

[3]  Khalid Satori,et al.  Euclidean 3D Reconstruction of Unknown Objects from Multiple Images , 2014 .

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[7]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[8]  Feipeng Da,et al.  3D reconstruction of human face based on an improved seeds-growing algorithm , 2011, Machine Vision and Applications.

[9]  O. Bernier,et al.  Multiresolution volumetric 3D object reconstruction for collaborative interactions , 2007, Pattern Recognition and Image Analysis.

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Woontack Woo,et al.  Silhouette Segmentation in Multiple Views , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Nassir Navab,et al.  Efficient visual hull computation for real-time 3D reconstruction using CUDA , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Rozenn Dahyot,et al.  Bayesian 3D shape from silhouettes , 2013, Digit. Signal Process..

[14]  Akram Halli,et al.  Self-calibration using a particular motion of camera , 2008 .

[15]  Luiz Velho,et al.  Adaptive space carving , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[16]  A.A. Alatan,et al.  Outlier Removal for Sparse 3D Reconstruction from Video , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[17]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[19]  Xin Du,et al.  A flexible method for 3D reconstruction of urban building , 2008, 2008 9th International Conference on Signal Processing.

[20]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  Long Quan,et al.  Match Propagation for Image-Based Modeling and Rendering , 2002, IEEE Trans. Pattern Anal. Mach. Intell..