A multi-view stereo based 3D hand-held scanning system using visual-inertial navigation and structured light

3 Production Engineering Research Institute(PRI), LG Electronics, LG-ro 222, Jinwi-myeon, Pyeongtaek 451-713, Korea Abstract. This paper describes the implementation of a 3D handheld scanning system based on visual inertial pose estimation and structured light technique.3D scanning system is composed of stereo camera, inertial navigation system (INS) and illumination projector to collect high resolution data for close range applications. The proposed algorithm for visual pose estimation is either based on feature matching or using accurate target object. The integration of INS enables the scanning system to provide the fast and reliable pose estimation supporting visual pose estimates. Block matching algorithm was used to render two view 3D reconstruction. For multiview 3D approach, rough registration and final alignment of point clouds using iterative closest point algorithm further improves the scanning accuracy. The proposed system is potentially advantageous for the generation of 3D models in bio-medical applications.

[1]  Peihua Gu,et al.  Free-form surface inspection techniques state of the art review , 2004, Comput. Aided Des..

[2]  Peter Kühmstedt,et al.  Handheld 3D Scanning with Automatic Multi-view Registration Based on Optical and Inertial Pose Estimation , 2014 .

[3]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[4]  Liyan Zhang,et al.  A 3D Shape Measurement System Based on Random Pattern Projection , 2010, 2010 Fifth International Conference on Frontier of Computer Science and Technology.

[5]  Jochen Lang,et al.  A Stereo-Based System with Inertial Navigation for Outdoor 3D Scanning , 2009, 2009 Canadian Conference on Computer and Robot Vision.

[6]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[7]  Soon-Yong Park,et al.  Dual pseudorandom array technique for error correction and hole filling of color structured-light three-dimensional scanning , 2015 .

[8]  ZhangZhengyou.  A Flexible New Technique for Camera Calibration , 2000 .

[9]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[10]  Mohammed Bennamoun,et al.  Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[13]  Min Young Kim,et al.  Adaptive 3D sensing system based on variable magnification using stereo vision and structured light , 2014 .

[14]  Martin Schaffer,et al.  High-speed pattern projection for three-dimensional shape measurement using laser speckles. , 2010, Applied optics.

[15]  Darius Burschka,et al.  The self-referenced DLR 3D-modeler , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Peter Kühmstedt,et al.  Handheld 3-D Scanning with Automatic Multi-View Registration Based on Visual-Inertial Navigation , 2014 .

[17]  Sandro Barone,et al.  Experimentation of structured light and stereo vision for underwater 3D reconstruction , 2011 .

[18]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .