A non-contact measurement method of ship block using image-based 3D reconstruction technology

Abstract Nowadays, the traditional measurement methods applied in ship sections/blocks are heavily relied on years of experiences and could hardly meet the shipbuilding requirements due to their complicated and time-consuming processes. Furthermore, along with the development of photogrammetry, the image-based three-dimensional (3D) reconstruction technology has emerged and become flourishing. In this paper, we propose a novel measurement method based on image-based 3D reconstruction technology to measure the construction deformation of ship blocks with high accuracy in a simple way. The scheme only needs photos to rebuild the 3D model of ship block. It includes the camera calibration, the image preprocessing, the feature points matching followed by the steps of dense point cloud generation, meshes partition and 3D reconstruction with texture mapping. In the step of feature points matching, the scale-invariant feature transform (SIFT) algorithm is used and optimized with the addition of the global vector to reduce the mismatch and enhance the reconstruction accuracy. The shipyard experiments with shooting photos of arbitrary steel parts proved that the proposed image-based 3D reconstruction technology is able to be applied to measure the ship blocks with satisfied accuracy and less time in shipbuilding industry or other industries with large-scale one-of-a-kind product as well.

[1]  G. Caroti,et al.  Accuracy Assessment in Structure from Motion 3d Reconstruction from Uav-Born Images: the Influence of the Data Processing Methods , 2015 .

[2]  Sang Wook Lee,et al.  Structured-light stereo: Comparative analysis and integration of structured-light and active stereo , 2013 .

[3]  J. Brasington,et al.  Modeling the topography of shallow braided rivers using Structure-from-Motion photogrammetry , 2014 .

[4]  Yunhui Liu,et al.  3D reconstruction based on SIFT and Harris feature points , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[5]  S. Padmavathi,et al.  Analysis of Harris corner detection for color images , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[6]  Albert Dipanda,et al.  Towards a real-time 3D shape reconstruction using a structured light system , 2005, Pattern Recognit..

[7]  Zhen Li,et al.  Deviation diagnosis and analysis of hull flat block assembly based on a state space model , 2012 .

[8]  Hiroshi Date,et al.  Update on three-dimensional image reconstruction for preoperative simulation in thoracic surgery. , 2016, Journal of thoracic disease.

[9]  Horst Wildenauer,et al.  Structure from Motion with Line Segments under Relaxed Endpoint Constraints , 2014, 3DV.

[10]  Hitoshi Habe,et al.  Appearance-based parameter optimization for accurate stereo camera calibration , 2011, Machine Vision and Applications.

[11]  Fernanda Leite,et al.  Evaluation of accuracy of as-built 3D modeling from photos taken by handheld digital cameras , 2012 .

[12]  Byung-Chul Kim,et al.  A vision-based system for monitoring block assembly in shipbuilding , 2015, Comput. Aided Des..

[13]  Stefan B. Williams,et al.  Biometric assessment of deep-sea vent megabenthic communities using multi-resolution 3D image reconstructions , 2016 .

[14]  Erdal Oruklu,et al.  3D image reconstruction and human body tracking using stereo vision and Kinect technology , 2012, 2012 IEEE International Conference on Electro/Information Technology.

[15]  J. Sarvaiya,et al.  Image Registration by Template Matching Using Normalized Cross-Correlation , 2009, 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies.

[16]  Yasuhisa Okumoto,et al.  Prediction of Welding Distortion and Panel Buckling of Car Carrier Decks using Database Generated by FEA , 2007 .

[17]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[18]  Hujun Bao,et al.  Robust 3D Reconstruction With an RGB-D Camera , 2014, IEEE Transactions on Image Processing.

[19]  Herbert J. Koelman,et al.  Application of a photogrammetry-based system to measure and re-engineer ship hulls and ship parts: An industrial practices-based report , 2010, Comput. Aided Des..

[20]  Faouzi Ghorbel,et al.  Combining contour matching and visual hull information for 3D reconstruction of archeological objects , 2014, 2014 1st International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[21]  Michalis E. Zervakis,et al.  Precise 3D Reconstruction of Cultural Objects Using Combined Multi-component Image Matching and Active Contours Segmentation , 2013, ISVC.

[22]  Jean Ponce,et al.  Carved Visual Hulls for Image-Based Modeling , 2006, International Journal of Computer Vision.

[23]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[24]  José Henrique Brito.  Autocalibration for Structure from Motion , 2017, Comput. Vis. Image Underst..

[25]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Victor Hugo C. de Albuquerque,et al.  Adaptive Crisp Active Contour Method for Segmentation and Reconstruction of 3D Lung Structures , 2015 .

[27]  Jiri Matas,et al.  Locally Optimized RANSAC , 2003, DAGM-Symposium.

[28]  Shuai Liu,et al.  The Applications and Summary of Three Dimensional Reconstruction Based on Stereo Vision , 2012, 2012 International Conference on Industrial Control and Electronics Engineering.

[29]  Manolis I. A. Lourakis,et al.  Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges , 2015, Adv. Eng. Informatics.

[30]  Burcu Akinci,et al.  Quantification of edge loss of laser scanned data at spatial discontinuities , 2009 .

[31]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Jian Liu,et al.  Improving histogram-based image contrast enhancement using gray-level information histogram with application to X-ray images , 2012 .

[33]  Pierre Alliez,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017, Comput. Graph. Forum.

[34]  Bei Cao,et al.  Affine-invariant SIFT descriptor with global context , 2010, 2010 3rd International Congress on Image and Signal Processing.

[35]  Luc Van Gool,et al.  Stratified Self-Calibration with the Modulus Constraint , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Guangming Shi,et al.  Semi-automatic image registration using harris corner detection and RANdom SAmple Consensus (RANSAC) , 2013 .

[37]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Collin H. H. Tang,et al.  Low cost digital close range photogrammetric measurement of an as-built anchor handling tug hull , 2016 .

[39]  Gamini Dissanayake,et al.  L2-SIFT: SIFT feature extraction and matching for large images in large-scale aerial photogrammetry , 2014 .

[40]  J. Ortega-Casanova,et al.  Low cost 3D underwater surface reconstruction technique by image processing , 2016 .

[41]  Zhu Zunshang,et al.  Vision navigation for aircrafts based on 3D reconstruction from real-time image sequences , 2015 .

[42]  Philippe De Smedt,et al.  On introducing an image-based 3D reconstruction method in archaeological excavation practice , 2014 .

[43]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[44]  Linda G. Shapiro,et al.  A SIFT descriptor with global context , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Frédéric Bosché,et al.  The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components , 2015 .

[46]  Albert Dipanda,et al.  Evolutionary algorithms for a mixed stereovision uncalibrated 3D reconstruction , 2014, Multimedia Tools and Applications.

[47]  Frédéric Hauville,et al.  Full-scale flying shape measurement of offwind yacht sails with photogrammetry , 2016 .

[48]  Aleksander Kniat,et al.  Optimization of transformation of measurements of ship hull blocks , 2009 .

[49]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[50]  Christoph Schmalz,et al.  An endoscopic 3D scanner based on structured light , 2012, Medical Image Anal..