An automatic 3D reconstruction system for texture-less objects

Abstract Structure from Motion (SfM) is an image based method for 3D reconstruction of objects. This method coupled with Dense Multi-View Stereo (DMVS) can be used to generate an accurate point cloud of texture-full objects. Although this process is fully automatic, capturing images in proper locations is hard especially for texture-less objects which need a pattern projection procedure to have a successful matching step in SfM. This study aims to propose an automatic and portable system which can provide a pattern on objects and capture a set of high quality images in a way that a complete and accurate 3D model can be generated by the captured images using SFM and DMVS method. The system consists of three parts including a glassy turntable with a novel pattern projection system, a digital camera located on a mono-pod mounted on a length adjustable bar attached to the box of turntable and a controller system to control two other parts. Given the speed and step parameters for the system in a smart phone as the controller system, the digital camera automatically captures an image after every rotation step of the table. To evaluate the system, five different objects were tested under four criteria including plane fitting, structural resolution test, scale resolving test and comparing with a reference 3D model obtained with a commercial accurate laser scanner known as GOM ATOS Compact laser scanner. The average standard deviation for all the cited criteria was around 0.2 mm which illustrates the ability of the proposed system to capture high quality images for 3D reconstruction of texture-less objects.

[1]  S. Gray,et al.  In virtual fashion , 1998 .

[2]  Nicola D'Apuzzo,et al.  RECENT ADVANCES IN 3D FULL BODY SCANNING WITH APPLICATIONS TO FASHION AND APPAREL , 2009 .

[3]  Minoru Maruyama,et al.  Range Sensing by Projecting Multiple Slits with Random Cuts , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Henrique Lorenzo,et al.  Low-cost documentation of traditional agro-industrial buildings by close-range photogrammetry , 2007 .

[5]  Noah Snavely Photo Tourism : Exploring image collections in 3D , 2006 .

[6]  Masood Varshosaz,et al.  The performance evaluation of multi-image 3D reconstruction software with different sensors , 2018 .

[7]  P. Sapirstein,et al.  Accurate measurement with photogrammetry at large sites , 2016 .

[8]  Soon-Yong Park,et al.  Automatic detection and decoding of photogrammetric coded targets , 2014, 2014 International Conference on Electronics, Information and Communications (ICEIC).

[9]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[10]  Yang Ji,et al.  High-precision Photogrammetric Surface Figure Measurements under Cryogenic Environment , 2017 .

[11]  D. Eberly Least Squares Fitting of Data , 2016 .

[12]  Nelson L. Max,et al.  Structured Light-Based 3D Reconstruction System for Plants , 2015, Sensors.

[13]  Habibollah Haron,et al.  Surface reconstruction techniques: a review , 2012, Artificial Intelligence Review.

[14]  Stuart Robson,et al.  Close Range Photogrammetry , 2007 .

[15]  Shojiro Sakata,et al.  Reconstruction Of Surfaces Of 3-D Objects By M-array Pattern Projection Method , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[16]  Gareth Halfacree,et al.  Raspberry Pi User Guide , 2012 .

[17]  Fabio Remondino,et al.  Heritage Recording and 3D Modeling with Photogrammetry and 3D Scanning , 2011, Remote. Sens..

[18]  Giovanna Sansoni,et al.  State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation , 2009, Sensors.

[19]  A. Hosseininaveh,et al.  A Low-cost and Portable System for 3D Reconstruction of Texture-less Objects , 2015 .

[20]  Marco Gianinetto,et al.  Automatic image-based 3D modeling for medical applications , 2012, 2012 5th International Conference on BioMedical Engineering and Informatics.

[21]  Mona Hess,et al.  Towards fully automatic reliable 3D acquisition: From designing imaging network to a complete and accurate point cloud , 2014, Robotics Auton. Syst..

[22]  Ivan Detchev,et al.  A PHOTOGRAMMETRIC SYSTEM FOR 3D RECONSTRUCTION OF A SCOLIOTIC TORSO , 2009 .

[23]  Ali Hosseininaveh Ahmadabadian,et al.  Clustering and selecting vantage images in a low-cost system for 3D reconstruction of texture-less objects , 2017 .

[24]  Torsten Sattler,et al.  A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[27]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Luciano Silva,et al.  3D reconstruction methods for digital preservation of cultural heritage: A survey , 2014, Pattern Recognit. Lett..

[29]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[30]  Helen C. Shen,et al.  A 3D Reconstruction System for Human Body Modeling , 1998, CAPTECH.

[31]  Seung-Hyun Lee,et al.  3D surface reconstruction of smooth and textureless objects , 2017, 2017 International Conference on Emerging Trends & Innovation in ICT (ICEI).

[32]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Mona Hess,et al.  A contest of sensors in close range 3D imaging: performance evaluation with a new metric test object , 2014 .

[34]  Jan Boehm,et al.  Close-Range Photogrammetry and 3D Imaging , 2013 .

[35]  K. Wenzel,et al.  A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs , 2013 .

[36]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[37]  Luc Van Gool,et al.  A Public System for Image Based 3D Model Generation , 2011, MIRAGE.

[38]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[39]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[40]  V. Barrile,et al.  3D MODELING WITH PHOTOGRAMMETRY BY UAVS AND MODEL QUALITYVERIFICATION , 2017 .

[41]  Jian Xu,et al.  A robust close-range photogrammetric system for industrial metrology , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..