Watertight Surface Reconstruction for Uncertain Data

For simple pick and place tasks, a robot needs to be able to recognise objects. In order to avoid scanning all objects by hand, an automatic modelling approach is necessary. Considering space and price restrictions on a robotic platform, the quality of perceiving devices suffers from this restrictions. Consequently modelling approaches need to cope with pose errors and noisy data that usually result in displaced surfaces incorporating a lot of artefacts. In this work, we focus on creating a watertight surface representation that is automatically built by a robot. Therefore, we develop a next best viewpoint planning method that fits to an afterwards applied filtering stage for improving measurement confidence. Using the resulting data, a mesh growing approach reconstructs the surface of the to be scanned object incorporating an inflating and a detailing stage. Our approach is able to roughly estimate the objects surfaces using inaccurate hardware and even to reconstruct small details for precise laser scanning devices. Small areas that are not scanned can be filled and highlighted by utilizing the near neighbourhood of measurements.

[1]  Robert M. O'Bara,et al.  Geometrically deformed models: a method for extracting closed geometric models form volume data , 1991, SIGGRAPH.

[2]  Nanning Zheng,et al.  Point-to-line metric based Iterative Closest Point with bounded scale , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.

[3]  Takeo Kanade,et al.  Fast and accurate shape-based registration , 1996 .

[4]  Michael A. Greenspan,et al.  An automation system for industrial 3-D laser digitizing , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[5]  Gerd Hirzinger,et al.  Next-best-scan planning for autonomous 3D modeling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  John B. Moore,et al.  Global registration of multiple 3D point sets via optimization-on-a-manifold , 2005, SGP '05.

[7]  Helmut Pottmann,et al.  Registration of point cloud data from a geometric optimization perspective , 2004, SGP '04.

[8]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[9]  Michael Suppa,et al.  Efficient next-best-scan planning for autonomous 3D surface reconstruction of unknown objects , 2013, Journal of Real-Time Image Processing.

[10]  Gérard G. Medioni,et al.  Description of Complex Objects from Multiple Range Images Using an Inflating Balloon Model , 1995, Comput. Vis. Image Underst..

[11]  R. Siegwart,et al.  Noise characterization of depth sensors for surface inspections , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).

[12]  Demetri Terzopoulos,et al.  Adaptive meshes and shells: irregular triangulation, discontinuities, and hierarchical subdivision , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[14]  Robert B. Fisher,et al.  A Best Next View Selection Algorithm Incorporating a Quality Criterion , 1998, BMVC.

[15]  Silvio Savarese,et al.  Visually bootstrapped generalized ICP , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[17]  Jacques-Olivier Lachaud,et al.  Deformable meshes with automated topology changes for coarse-to-fine three-dimensional surface extraction , 1999, Medical Image Anal..

[18]  Gerd Hirzinger,et al.  A surface-based Next-Best-View approach for automated 3D model completion of unknown objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Peter Johannes Neugebauer,et al.  Geometrical cloning of 3D objects via simultaneous registration of multiple range images , 1997, Proceedings of 1997 International Conference on Shape Modeling and Applications.

[20]  Roberto Toldo,et al.  Global registration of multiple point clouds embedding the Generalized Procrustes Analysis into an ICP framework , 2010 .

[21]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[22]  Katsuhiko Sakaue,et al.  Registration and integration of multiple range images for 3-D model construction , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Kamal K. Gupta,et al.  Octree-based hierarchical distance maps for collision detection , 1997, J. Field Robotics.

[24]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Pavel Krsek,et al.  The Trimmed Iterative Closest Point algorithm , 2002, Object recognition supported by user interaction for service robots.

[26]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[27]  Michael Suppa,et al.  Autonomous robot work cell exploration using multisensory eye-in-hand systems , 2008 .

[28]  Rachid Deriche,et al.  3D edge detection using recursive filtering: Application to scanner images , 1991, CVGIP Image Underst..

[29]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[30]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[31]  David Fofi,et al.  View Planning Approach for Automatic 3D Digitization of Unknown Objects , 2012, ECCV Workshops.

[32]  Benjamin Loriot,et al.  Non-Model Based Method for an Automation of 3D Acquisition and Post-Processing , 2009 .

[33]  Myoung-Hee Kim,et al.  A non-self-intersecting adaptive deformable surface for complex boundary extraction from volumetric images , 2001, Comput. Graph..

[34]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.