Sensing and responding to the changes of geometric surfaces in flexible manufacturing and assembly

A flexible manufacturing system is capable of dealing with changes and uncertainties occurring in a manufacturing environment. A rigid automation system adapts changes through reconfiguration or manual modification of its control programmes. In contrast, an advanced system responds to the changes autonomously or with a minimal manual intervention. One critical technology for a flexible manufacturing system is to detect or predict the changes and uncertainties and take them into account for the control of the manufacturing system. In this paper, an intelligent manufacturing system is proposed to accommodate product geometric variants autonomously by integrating a 3D vision system into manufacturing processes. The proposed system is capable of acquiring vision sensor data, detecting the geometric changes, and modifying the control programmes of the machine in response to the changes. In this innovative work, a new method for converting the raw vision sensor data into a surface model of the product is presented. A new surface reconstruction algorithm is proposed to generate the surface model directly from the raw 3D point-cloud data of a product. In addition, an advanced programming algorithm that uses acquired surface models to automatically update robot programmes for a new task with minimal manual intervention is presented.

[1]  Lihui Wang,et al.  Reconfigurable manufacturing systems: the state of the art , 2008 .

[2]  K. Klein,et al.  Adaptive Triangulation Of Objects Reconstructed From Multiple Range Images , 2001 .

[3]  Rüdiger Westermann,et al.  Isosurface extraction techniques for Web-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[4]  Als-Nscort.  Eclipse Platform Technical Overview , 2003 .

[5]  Lihui Wang,et al.  Review: Advances in 3D data acquisition and processing for industrial applications , 2010 .

[6]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[7]  Ling X. Li.  An analysis of sources of competitiveness and performance of Chinese manufacturers , 2000 .

[8]  Nadia Magnenat-Thalmann,et al.  Surface from Scattered Points: A Brief Survey of Recent Developments , 2005 .

[9]  Thomas C. Henderson,et al.  Feature-based reverse engineering of mechanical parts , 1999, IEEE Trans. Robotics Autom..

[10]  Miroslav Marić,et al.  Matlab toolbox for analysis of 3D images , 2004 .

[11]  F. Tang,et al.  A polychromatic sets approach to the conceptual design of machine tools , 2005 .

[12]  Hugues Hoppe.  Surface Reconstruction from Unorganized Points (PhD Thesis) , 1994 .

[13]  Ling Li,et al.  Supply Chain Management: Concepts, Techniques And Practices: Enhancing The Value Through Collaboration , 2007 .

[14]  Edward P. Markowski,et al.  Assessing the effects of manufacturing infrastructure preparation prior to enterprise information-systems implementation , 2008 .

[15]  Z. M. Bi,et al.  A Framework for CAD- and Sensor-Based Robotic Coating Automation , 2007, IEEE Transactions on Industrial Informatics.

[16]  A. Galip Ulsoy,et al.  Reconfigurable manufacturing systems: Key to future manufacturing , 2000, J. Intell. Manuf..

[17]  Franz Pernkopf.  3D surface acquisition and reconstruction for inspection of raw steel products , 2005, Comput. Ind..

[18]  Lynn Ling X. Li,et al.  Manufacturing capability development in a changing business environment , 2000, Ind. Manag. Data Syst..

[19]  Luis Ibáñez,et al.  The ITK Software Guide , 2005 .

[20]  Z. M. Bi,et al.  Modularity Technology in Manufacturing: Taxonomy and Issues , 2001 .

[21]  Mariette Yvinec,et al.  Delaunay Triangulation Based Surface Reconstruction : a short survey , 2004 .

[22]  Naai-Jung Shih,et al.  Point-Cloud-Based Comparison between Construction Schedule and As-Built Progress: Long-Range Three-Dimensional Laser Scanner’s Approach , 2004 .

[23]  Yi Zhang,et al.  A new method for automatic synthesis of tolerances for complex assemblies based on polychromatic sets , 2011, Enterp. Inf. Syst..

[24]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[25]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[26]  Willem F. Bronsvoort,et al.  Fitting and Manipulating Freeform Shapes Using Templates , 2005, J. Comput. Inf. Sci. Eng..

[27]  Daniel Freedman.  Surface reconstruction, one triangle at a time , 2004, CCCG.

[28]  Hoda A. ElMaraghy,et al.  Flexible and reconfigurable manufacturing systems paradigms , 2005 .

[29]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[30]  Sunghee Choi,et al.  The power crust, unions of balls, and the medial axis transform , 2001, Comput. Geom..

[31]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[32]  Lihui Wang,et al.  Current status of reconfigurable assembly systems , 2007, Int. J. Manuf. Res..

[33]  Lida Xu,et al.  A decision support system for product design in concurrent engineering , 2007, Decis. Support Syst..

[34]  Yue-Hong Yin,et al.  Reconfigurable manufacturing execution system for pipe cutting , 2011, Enterp. Inf. Syst..

[35]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[36]  Sherman Y. T. Lang,et al.  Automated robotic programming for products with changes , 2007 .

[37]  E. Allgower,et al.  An Algorithm for Piecewise-Linear Approximation of an Implicitly Defined Manifold , 1985 .

[38]  David P. Dobkin,et al.  Contour tracing by piecewise linear approximations , 1990, TOGS.

[39]  Robert B. Fisher.  Applying knowledge to reverse engineering problems , 2004, Comput. Aided Des..

[40]  Lida Xu,et al.  EMG and EPP-Integrated Human–Machine Interface Between the Paralyzed and Rehabilitation Exoskeleton , 2012, IEEE Transactions on Information Technology in Biomedicine.

[41]  Ralph R. Martin,et al.  Reverse engineering of geometric models - an introduction , 1997, Comput. Aided Des..

[42]  Danijel Rebolj,et al.  Automated construction activity monitoring system , 2008, Adv. Eng. Informatics.

[43]  Ole Madsen,et al.  Automatic Robotic Spray Painting of Low Volume High Variant Parts , 2002 .