A multi-vision-based system for tube inspection

Geometric errors are common in metallic bent tubular parts. Thus, tubes should be inspected and fixed before welding with the joints first. After welding, the relative position of the joints is also necessary to be inspected to judge whether the tube can be assembled reliably. Therefore, the inspection plays an important role in the tube’s assembly. The purpose of this paper is to propose a multi-vision-based system designed to inspect the tube and the relative position of the joints.,For the tube inspection, the small cylinders are taken as the primitives to reconstruct the tube using the multi- vision-based system. Then, any geometric error in the tube can be inspected by comparing the reconstructed models and designed ones. For joints’ inspection, authors designed an adapter with marked points, by which the system can calculate the relative position of the joints.,The reconstruction idea can recognise the line and arc segments of a tube automatically and resolve the textureless deficiency of the tube’s surface. The joints’ inspection method is simple in operation, and any kinds of joints can be inspected by designing the structure of the adapters accordingly.,By experimental verification, the inspection precision of the proposed system was 0.17 mm; the inspection time was within 2 min. Thus, the system developed can inspect a tube effectively and automatically. Moreover, authors can determine how the springback of the arcs behaves, allowing in-process springback prediction and compensation, which can reduce geometric errors in the tubes given the present bending machine accuracy.

[1]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[2]  Stelios Kyriakides,et al.  Yield anisotropy effects on buckling of circular tubes under bending , 2006 .

[3]  Frédéric Barlat,et al.  A Semi‐Analytic Model to Predict and Compensate Springback in the 3D Stretch Bending Process , 2014 .

[4]  Ioannis K. Brilakis,et al.  Automated sparse 3D point cloud generation of infrastructure using its distinctive visual features , 2011, Adv. Eng. Informatics.

[5]  François Goulette,et al.  Automatic CAD modeling of industrial pipes from range images , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[6]  Lei Jiang,et al.  Computer-integrated manufacturing system for tube bending , 2012, Int. J. Comput. Integr. Manuf..

[7]  Seyed Habib A. Rahmati,et al.  Fuzzy Gauge Capability (Cg and Cgk) through Buckley Approach , 2015 .

[8]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Raphael H. Grzebieta,et al.  Plastic mechanism analysis of circular tubes under pure bending , 2002 .

[10]  George Vosselman,et al.  3D Reconstruction of Industrial Installations by Constrained Fitting of CAD Models to Images , 2000, DAGM-Symposium.

[11]  Janne Heikkilä,et al.  Calibration procedure for short focal length off-the-shelf CCD cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[12]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[13]  Luca Lucchese,et al.  Geometric calibration of digital cameras through multi-view rectification , 2005, Image Vis. Comput..

[14]  Malte Brettel,et al.  How Virtualization, Decentralization and Network Building Change the Manufacturing Landscape: An Industry 4.0 Perspective , 2014 .

[15]  D. A. Gibbon,et al.  The Design, Development and Testing of a Propulsion System for the SNAP-1 Nanosatellite , 2000 .

[16]  Andrea Torsello,et al.  A Robust Multi-camera 3D Ellipse Fitting for Contactless Measurements , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[17]  Cihan Altuntas Keypoint based automatic image orientation and skew investigation on tie points , 2013, Kybernetes.

[18]  Chung-Yen Su,et al.  Sub-pixel Edge Detection of LED Probes Based on Canny Edge Detection and Iterative Curve Fitting , 2014, 2014 International Symposium on Computer, Consumer and Control.

[19]  Ioannis K. Brilakis,et al.  Automated vision tracking of project related entities , 2011, Adv. Eng. Informatics.

[20]  Yuehong Yin,et al.  Pipe assembly planning algorithm by imitating human imaginal thinking , 2010 .

[21]  Steven Mills,et al.  Design and Calibration of Multi-camera Systems for 3D Computer Vision: Lessons Learnt from Two Case Studies , 2015, PSIVT Workshops.

[22]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  D. Nistér Automatic passive recovery of 3D from images and video , 2004 .

[24]  Thomas Luhmann,et al.  Close range photogrammetry for industrial applications , 2010 .

[25]  He Yang,et al.  Advances and Trends on Tube Bending Forming Technologies , 2012 .

[26]  W Skalli,et al.  Fast 3D reconstruction of the lower limb using a parametric model and statistical inferences and clinical measurements calculation from biplanar X-rays , 2012, Computer methods in biomechanics and biomedical engineering.

[27]  In-Kwon Lee,et al.  Shrinking: another method for surface reconstruction , 2004, Geometric Modeling and Processing, 2004. Proceedings.

[28]  Paulo Jorge Da Silva bartolo,et al.  Automatic 3D shape recovery for rapid prototyping , 2008 .

[29]  R. Shojaei,et al.  Statistical measurement system analysis of Ruston TA1750 gas turbine 1st stage nozzle , 2010 .

[30]  Kim A. Stelson,et al.  Three-Dimensional Tube Geometry Control for Rotary Draw Tube Bending, Part 2: Statistical Tube Tolerance Analysis and Adaptive Bend Correction , 2000 .

[31]  In-Kwon Lee,et al.  Curve reconstruction from unorganized points , 2000, Comput. Aided Geom. Des..

[32]  Mark A. Fonstad,et al.  Topographic structure from motion: a new development in photogrammetric measurement , 2013 .

[33]  Daniel Cremers,et al.  Fast Joint Estimation of Silhouettes and Dense 3D Geometry from Multiple Images , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  David Nist Automatic Passive Recovery of 3D from Images and Video , 2004 .

[35]  Qiang Liu,et al.  Pipe‐assembly approach for aero‐engines by modified particle swarm optimization , 2010 .

[36]  Ulrich Bauer,et al.  Generating parametric models of tubes from laser scans , 2009, Comput. Aided Des..

[37]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[38]  Jim Graham,et al.  Robust and Accurate 3D Measurement of Formed Tube Using Trinocular Stereo Vision , 1997, BMVC.

[39]  Mei Zhan,et al.  Springback characterization and behaviors of high-strength Ti–3Al–2.5V tube in cold rotary draw bending , 2012 .

[40]  George Vosselman,et al.  CAD-Based Photogrammetry for Reverse Engineering of Industrial Installations , 2003 .

[41]  Xiao Wang,et al.  Accurate measurement method for tube’s endpoints based on machine vision , 2017 .