Fast Registration Methodology for Fastener Assembly of Large-Scale Structure

Fastener assembly is a tedious and time-consuming work because operators have to check assembly manuals and find right fastener for each hole. Hence, this paper aims to develop a three-dimensional (3-D) projection system that projects assembly instruction onto the work piece surface directly to guide operators to assemble. However, in order to project the instruction accurately, the corresponding part of the computer-aided design model of the physical scanned area needs to be attained through the rapid and accurate registration. In order to achieve this goal, first, a high-accuracy and rapid 3-D measurement system is developed; second, a fast registration method based on local multiscale geometric feature vector is proposed to accelerate the registration speed and improve the registration reliability. Experimental results demonstrate the measurement accuracy of the developed system, and verify the feasibility of the proposed registration method. Hence, the proposed method can lead to improved assembly efficiency and decreased error probability, making great contributions to large-scale structure assembly.

[1]  Song Zhang,et al.  Superfast phase-shifting method for 3-D shape measurement. , 2010, Optics express.

[2]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[3]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[4]  Raul Wirz,et al.  A multimodal interface to control a robot arm via the web: a case study on remote programming , 2005, IEEE Transactions on Industrial Electronics.

[5]  Daniel Cernea,et al.  Real-Time Scale Invariant 3D Range Point Cloud Registration , 2010, ICIAR.

[6]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[7]  Wenjing Chen,et al.  Dynamic 3-D shape measurement method based on FTP , 2001 .

[8]  Nico Blodow,et al.  Learning informative point classes for the acquisition of object model maps , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[9]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[10]  Yan Jin,et al.  Intelligent Assembly Time Analysis Using a Digital Knowledge-Based Approach , 2009, J. Aerosp. Comput. Inf. Commun..

[11]  Ye Jin,et al.  Accurate calibration for a camera-projector measurement system based on structured light projection , 2009 .

[12]  Adrian David Cheok,et al.  Combined Wireless Hardware and Real-Time Computer Vision Interface for Tangible Mixed Reality , 2007, IEEE Transactions on Industrial Electronics.

[13]  Wolfram Burgard,et al.  Point feature extraction on 3D range scans taking into account object boundaries , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Xiangyu Wang,et al.  Using Augmented Reality to Facilitate Piping Assembly: An Experiment-Based Evaluation , 2015, J. Comput. Civ. Eng..

[15]  Achim J. Lilienthal,et al.  On the accuracy of the 3D Normal Distributions Transform as a tool for spatial representation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[17]  Reinhard Koch,et al.  Visualisation Techniques for Using Spatial Augmented Reality in the Design Process of a Car , 2011, Comput. Graph. Forum.

[18]  Díbio Leandro Borges,et al.  A dynamic approach for approximate pairwise alignment based on 4-points congruence sets of 3D points , 2011, 2011 18th IEEE International Conference on Image Processing.

[19]  F. Mas,et al.  Assembly Work Instruction Deployment Using Augmented Reality , 2012 .

[20]  Michael F. Zäh,et al.  Interactive laser-projection for programming industrial robots , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[21]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[23]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[25]  Reinhold Ritter,et al.  3-D shape measurement of complex objects by combining photogrammetry and fringe projection , 2000 .

[26]  Bruce H. Thomas,et al.  In-Situ Support for Automotive Manufacturing Using Spatial Augmented Reality , 2012, Int. J. Virtual Real..

[27]  Ross T. Smith,et al.  Validating Spatial Augmented Reality for interactive rapid prototyping , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[28]  Min Yang,et al.  Segmentation of measured point data using a parametric quadric surface approximation , 1999, Comput. Aided Des..

[29]  Ernest M. Stokely,et al.  Surface Parametrization and Curvature Measurement of Arbitrary 3-D Objects: Five Practical Methods , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Weiyin Ma,et al.  Parameterization of randomly measured points for least squares fitting of B-spline curves and surfaces , 1995, Comput. Aided Des..

[31]  Alex Olwal,et al.  Spatial augmented reality on industrial CNC-machines , 2008, Electronic Imaging.

[32]  Harris Drucker,et al.  Support vector machines for spam categorization , 1999, IEEE Trans. Neural Networks.

[33]  Qi Hao,et al.  Dual-frequency pattern scheme for high-speed 3-D shape measurement. , 2010, Optics express.

[34]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.