Multisensor integration and discrete geometry processing for coordinate metrology

Multisensor integration systems are used to fulfill the increasing requirements on the complexity and accuracy of coordinate metrology. This thesis investigates on the achievement of multisensor integration in coordinate metrology from two main parts: function and data modeling; and discrete geometry processing. Function and data modeling allow obtaining clear understanding of the system and guiding the system development. Hierarchical function models of the system are built using IDEF0 methodology. An ontology based method is employed to model the various data and their relationships in the system with structured representation. Efficient methods for discrete geometry processing to support multisensor integration are the main focus of this dissertation. Reliable estimation of the curvatures is essential for discrete shapes processing. A tensor based method is proposed for discrete curvature estimation. The proposed method provides better performance according to a comparative analysis. Registration is one of the most important and decisive steps of multisensor integration. Registration algorithms enable to align the different point data captured in the respective sensor's coordinate systems. A registration method is proposed to align different discrete shapes with unknown correspondences. A combination of curvature information and Euclidean distance is used to improve the registration performance. A new method is developed for shape recognition and segmentation based on shape index and curvedness. The local surface type of a vertex is recognized according to its shape index and curvedness. The vertices are then clustered according to their local surfaces. A connected region generation algorithm is then implemented to generate the segmentation results. Considerable cases are tested and the method provides satisfying results. A new software framework DSP-COMS is developed as the testing platform of the developed methods. A detailed case study of an industrial workpiece digitized by laser scanning and touch probing is presented. The measured point data are then processed using DSP-COMS. The results show that the proposed methods can provide satisfying results for the studied case.

[1]  Tilo Pfeifer,et al.  Optical Methods for Dimensional Metrology in Production Engineering , 2002 .

[2]  Heinz Hügli,et al.  Multi-feature matching algorithm for free-form 3D surface registration , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[3]  S. S. Pande,et al.  Automatic recognition of features from freeform surface CAD models , 2008, Comput. Aided Des..

[4]  Zone-Ching Lin,et al.  Integration Planning Model of IDEF0 and STEP Product Data Representation Methods in a CMM Measuring System , 2001 .

[5]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[6]  Paul J. Besl,et al.  Direct construction of polynomial surfaces from dense range images through region growing , 1995, TOGS.

[7]  Jianmei Wang,et al.  A PLM-based automated inspection planning system for coordinate measuring machine , 2006, International Symposium on Instrumentation and Control Technology.

[8]  Yu Song,et al.  Freeform Object Positioning by 3D Shape Matching Without Artificial Feature Points , 2004, WSCG.

[9]  John Williams.  A system for multiple view 3D acquisition and registration incorporating statistical error models , 2001 .

[10]  Alla Sheffer,et al.  Model simplification for meshing using face clustering , 2001, Comput. Aided Des..

[11]  Aly A. Farag,et al.  A NEW VARIATIONAL APPROACH FOR 3D SHAPE REGISTRATION , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[12]  Joachim Hertzberg,et al.  Cached k-d tree search for ICP algorithms , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[13]  Lewis D. Griffin,et al.  Statistics and category systems for the shape index descriptor of local 2nd order natural image structure , 2009, Image Vis. Comput..

[14]  Dirk Roose,et al.  Detection of closed sharp edges in point clouds using normal estimation and graph theory , 2007, Comput. Aided Des..

[15]  Shugui Liu,et al.  Measuring information integration model for CAD/CMM , 2003 .

[16]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[17]  Zhang ZhaoHui,et al.  An automatic method of coarse registration between multi-source satellite images , 2004, Proceedings of the 2004 Intelligent Sensors, Sensor Networks and Information Processing Conference, 2004..

[18]  Pierre Bourdet,et al.  Digitised point quality in relation with point exploitation , 2002 .

[19]  Helmut Pottmann,et al.  Registration of point cloud data from a geometric optimization perspective , 2004, SGP '04.

[20]  Dieter Roller,et al.  An approach to computer-aided quality control based on 3D coordinate metrology , 2000 .

[21]  Prabhjot Singh,et al.  Multimodal Industrial Inspection and Analysis , 2007, J. Comput. Inf. Sci. Eng..

[22]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Heinz Hügli,et al.  A multi-resolution scheme ICP algorithm for fast shape registration , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[24]  Ross T. Whitaker,et al.  Partitioning 3D Surface Meshes Using Watershed Segmentation , 1999, IEEE Trans. Vis. Comput. Graph..

[25]  Yunbao Huang,et al.  Multi-sensor calibration through iterative registration and fusion , 2009, Comput. Aided Des..

[26]  Chia-Hsiang Menq,et al.  Automatic data segmentation for geometric feature extraction from unorganized 3-D coordinate points , 2001, IEEE Trans. Robotics Autom..

[27]  Jianfeng Xu,et al.  Medical Image Alignment by Normal Vector Information , 2005, CIS.

[28]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[29]  Chia-Hsiang Menq,et al.  Multiple-sensor integration for rapid and high-precision coordinate metrology , 2000, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[30]  Tae-wan Kim,et al.  Simultaneous registration of multiple views with markers , 2009, Comput. Aided Des..

[31]  Martin D. Levine,et al.  Registering Multiview Range Data to Create 3D Computer Objects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Ralph R. Martin,et al.  Rapid and effective segmentation of 3D models using random walks , 2009, Comput. Aided Geom. Des..

[33]  Mohamed A. Deriche,et al.  3D registration using a new implementation of the ICP algorithm based on a comprehensive lookup matrix: Application to medical imaging , 2007, Pattern Recognit. Lett..

[34]  Ayellet Tal,et al.  Metamorphosis of Polyhedral Surfaces using Decomposition , 2002, Comput. Graph. Forum.

[35]  Semyung Wang,et al.  A new segmentation method for point cloud data , 2002 .

[36]  Eric L. Miller,et al.  Three-Dimensional Surface Mesh Segmentation Using Curvedness-Based Region Growing Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[38]  Claire Lartigue,et al.  Scan Planning Strategy for a General Digitized Surface , 2006, J. Comput. Inf. Sci. Eng..

[39]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[40]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[41]  Michael J. Wozny,et al.  Generating Topological Information from a "Bucket of Facets" , 1992 .

[42]  Zexiao Xie,et al.  Development of a multi-view laser scanning sensor for reverse engineering , 2006 .

[43]  Jason Jianjun Gu,et al.  Data Fusion with Different Accuracy , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[44]  Hartmut Ernst,et al.  Three-dimensional surface test with "Shape-from-Shading" , 2007 .

[45]  Liu Xiaoli,et al.  Model-based optical metrology and visualization of 3-D complex objects , 2007 .

[46]  Bernard Chazelle,et al.  Strategies for Polyhedral Surface Decomposition: an Experimental Study , 1997, Comput. Geom..

[47]  P. Rousseeuw.  Least Median of Squares Regression , 1984 .

[48]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Alexandru Telea,et al.  Skeleton-based Hierarchical Shape Segmentation , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[50]  Lutz Kettner,et al.  Using generic programming for designing a data structure for polyhedral surfaces , 1999, Comput. Geom..

[51]  Zone-Ching Lin,et al.  IDEF0 Model of the Measurement Planning for a Workpiece Machined by a Machining Centre , 2000 .

[52]  Peer Stelldinger,et al.  Provably correct reconstruction of surfaces from sparse noisy samples , 2009, Pattern Recognit..

[53]  José Ramón Perán González,et al.  Automated 3D surface scanning based on CAD model , 2005 .

[54]  Joonki Paik,et al.  Simple and efficient algorithm for part decomposition of 3-D triangulated models based on curvature analysis , 2002, Proceedings. International Conference on Image Processing.

[55]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[56]  Soon-Yong Park,et al.  An accurate and fast point-to-plane registration technique , 2003, Pattern Recognit. Lett..

[57]  K. Shi,et al.  Chromatic confocal microscopy using supercontinuum light. , 2004, Optics express.

[58]  Ralph R. Martin,et al.  Reverse engineering of geometric models - an introduction , 1997, Comput. Aided Des..

[59]  Nancy M. Amato,et al.  Approximate convex decomposition of polyhedra and its applications , 2008, Comput. Aided Geom. Des..

[60]  Kevin W. Bowyer,et al.  Improved range image segmentation by analyzing surface fit patterns , 2005, Comput. Vis. Image Underst..

[61]  Ø. Hjelle,et al.  Triangulations and Applications (Mathematics and Visualization) , 2006 .

[62]  Andrea J. van Doorn,et al.  Local structure of gaussian texture , 2003 .

[63]  Xiangqian Jiang,et al.  Multisensor data fusion in dimensional metrology , 2009 .

[64]  Juan J. Marquez,et al.  Modeling the integration between technological product specifications and inspection process , 2007 .

[65]  Atilla Baskurt,et al.  A new CAD mesh segmentation method, based on curvature tensor analysis , 2005, Comput. Aided Des..

[66]  Enrico Savio,et al.  Metrology of freeform shaped parts , 2007 .

[67]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[68]  Karthik Ramani,et al.  Robust principal axes determination for point-based shapes using least median of squares , 2009, Comput. Aided Des..

[69]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[70]  Paul J. Walmsley,et al.  Bayesian Approaches to Multi-Sensor Data Fusion , 1999 .

[71]  Robert G. Wilhelm,et al.  Software Frameworks for Integrated Measurement Processes , 2001 .

[72]  Hans-Ulrich Danzebrink,et al.  Development of a combined interference microscope objective and scanning probe microscope , 2004 .

[73]  Hans-Peter Seidel,et al.  Exact and interpolatory quadratures for curvature tensor estimation , 2007, Comput. Aided Geom. Des..

[74]  Wang Jianguo,et al.  Complete 3D measurement in reverse engineering using a multi-probe system , 2005 .

[75]  Antony R Mileham,et al.  A New Data Fusion Method for Scanned Models , 2006, J. Comput. Inf. Sci. Eng..

[76]  Yueh-Jaw Lin,et al.  CAD-based CMM dimensional inspection path planning - a generic algorithm , 2001, Robotica.

[77]  Heinrich Niemann,et al.  A refined ICP algorithm for robust 3-D correspondence estimation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[78]  Shugui Liu,et al.  The study of dual camera 3D coordinate vision measurement system using a special probe , 2006, International Symposium on Instrumentation and Control Technology.

[79]  D. Saupe,et al.  Efficient 3D Shape Acquisition and Registration Using Hybrid Scanning Data , 2008 .

[80]  Charyar Mehdi-Souzani,et al.  ALGORITHMS FOR THE CALIBRATION OF LASER-PLANE SENSORS ON CMMS , 2004 .

[81]  Zhanfeng Wang,et al.  The Study of the Fusion Estimation and the Fault Diagnosis Method Based on Multi-speed Sensor , 2009, CSIE.

[82]  Francis Schmitt,et al.  Fast global registration of 3D sampled surfaces using a multi-z-buffer technique , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[83]  Chia-Hsiang Menq,et al.  Multiple-Sensor Planning and Information Integration for Automatic Coordinate Metrology , 2001, J. Comput. Inf. Sci. Eng..

[84]  C. Mersmann,et al.  A method for the automated positioning and alignment of fibre-reinforced plastic structures based on machine vision , 2008 .

[85]  Konrad Polthier,et al.  Anisotropic Filtering of Non‐Linear Surface Features , 2004, Comput. Graph. Forum.

[86]  Dereck S. Meek,et al.  On surface normal and Gaussian curvature approximations given data sampled from a smooth surface , 2000, Comput. Aided Geom. Des..

[87]  Eitan Grinspun,et al.  Discrete quadratic curvature energies , 2006, Comput. Aided Geom. Des..

[88]  Min Yang,et al.  Segmentation of measured point data using a parametric quadric surface approximation , 1999, Comput. Aided Des..

[89]  Denis Zorin,et al.  Curvature-based energy for simulation and variational modeling , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[90]  Sang-chul Lee,et al.  Registering 3D Scanned Point Cloud Using Markers International Joint Conference 2006 (SICE-ICCAS 2006) , 2006, 2006 SICE-ICASE International Joint Conference.

[91]  A. Pressley.  Elementary Differential Geometry , 2000 .

[92]  Hsi-Yung Feng,et al.  On the normal vector estimation for point cloud data from smooth surfaces , 2005, Comput. Aided Des..

[93]  Nasser Khalili,et al.  Multi-scale free-form 3D object recognition using 3D models , 2001, Image Vis. Comput..

[94]  Anikó Ekárt,et al.  Fully automatic, robust and precise alignment of measured 3D surfaces for arbitrary orientations , 2004 .

[95]  P Yuen,et al.  Recovery of Curvature and Torsion Features from Free-form 3D Meshes at Multiple Scales , 2000 .

[96]  Anshuman Razdan,et al.  A hybrid approach to feature segmentation of triangle meshes , 2003, Comput. Aided Des..

[97]  Sören Kammel,et al.  Inspection of specular and painted surfaces with centralized fusion techniques , 2006 .

[98]  Joonki Paik,et al.  Triangle mesh-based edge detection and its application to surface segmentation and adaptive surface smoothing , 2002, Proceedings. International Conference on Image Processing.

[99]  Vijay Srinivasan.  Standardizing the specification, verification, and exchange of product geometry: Research, status and trends , 2008, Comput. Aided Des..

[100]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[101]  A. Weckenmann,et al.  Precision Measurement of Cutting Tools with two Matched Optical 3D-Sensors , 2003 .

[102]  Hong Qin,et al.  Surface reconstruction of noisy and defective data sets , 2004, IEEE Visualization 2004.

[103]  Yung-Chou Kao,et al.  A study on the computer-aided measuring integration system for the sheet metal stamping die , 2006 .

[104]  Hans-Peter Seidel,et al.  Feature sensitive mesh segmentation with mean shift , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[105]  Reinhold Ritter,et al.  3-D shape measurement of complex objects by combining photogrammetry and fringe projection , 2000 .

[106]  Youfu Li,et al.  Method for determining the probing points for efficient measurement and reconstruction of freeform surfaces , 2003 .

[107]  William G. Rippey,et al.  Unique sensor fusion system for coordinate-measuring machine tasks , 1997, Other Conferences.

[108]  Bernd Hamann,et al.  Surface Reconstruction from Unorganized Point Data with Quadrics , 2008 .

[109]  Thomas R. Kramer,et al.  A feature-based inspection and machining system , 2001, Comput. Aided Des..

[110]  Woontack Woo,et al.  Projection-Based Registration Using Color and Texture Information for Virtual Environment Generation , 2004, PCM.

[111]  Bin Liu,et al.  Transferring Landmarks to Individual Foot Using Deformable Template Models , 2008, 2008 The 9th International Conference for Young Computer Scientists.

[112]  Marshall Burns,et al.  Automated Fabrication: Improving Productivity in Manufacturing , 1993 .

[113]  Ram D. Sriram,et al.  Ontology Formalization of Product Semantics for Product Lifecycle Management , 2005 .