Survey on the View Planning Problem for Reverse Engineering and Automated Control Applications

Abstract At present, optical sensors are being widely used to realize high quality control or reverse engineering of products, systems, buildings, environments or human bodies. Although the intrinsic characteristics of such breakthrough technologies may vary, ensuring complete acquisition relies on the definition of the optimal acquisition planning. To this end, the view planning problem (VPP) must be solved to automatically determine the optimal positions and/or trajectories of the acquisition devices to fully cover the part to be digitized. Such an automatization of the entire acquisition process is of considerably interest in the context of Industry 4.0. The aim of this paper is to review the state of the art works addressing the view planning problem and to identify the future challenges and possible research directions. First, the paper introduces a set of criteria to analyze the available methods, grouped into several macrocategories. The categories are presented and formalized to clearly understand the backbone and similarities of the grouped methods. Second, the paper describes and characterizes the available methods, based on their analysis according to the adopted criteria. The results of this extensive analysis clearly highlight the open issues and future challenges.

[1]  Wei Lin,et al.  Sampling-based view planning for 3D visual coverage task with Unmanned Aerial Vehicle , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Kwan H. Lee,et al.  Automated inspection planning of free-form shape parts by laser scanning , 2000 .

[3]  Reinaldo J. Moraga,et al.  Meta-RaPS: a simple and effective approach for solving the traveling salesman problem , 2005 .

[4]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[5]  Luis Enrique Sucar,et al.  Supervised Learning of the Next-Best-View for 3D Object Reconstruction , 2019, Pattern Recognit. Lett..

[6]  Keld Helsgaun,et al.  An effective implementation of the Lin-Kernighan traveling salesman heuristic , 2000, Eur. J. Oper. Res..

[7]  Claire Lartigue,et al.  Scanner path planning with the control of overlap for part inspection with an industrial robot , 2018, The International Journal of Advanced Manufacturing Technology.

[8]  Wei Jing,et al.  Coverage Planning for Robotic Vision Applications in Complex 3D Environment , 2017 .

[9]  William R. Scott,et al.  Model-based view planning , 2007, Machine Vision and Applications.

[10]  Taua M. Cabreira,et al.  Survey on Coverage Path Planning with Unmanned Aerial Vehicles , 2019, Drones.

[11]  Andreas Krause,et al.  Robust sensor placements at informative and communication-efficient locations , 2011, TOSN.

[12]  Li-jun Ding,et al.  CAD-Based Path Planning for 3D Laser Scanning of Complex Surface , 2016 .

[13]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Gerd Hirzinger,et al.  Next-best-scan planning for autonomous 3D modeling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Richard Anthony Pito Automated surface acquisition using range cameras , 1997 .

[16]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[17]  Yong Liu,et al.  A Computational Framework for Automatic Online Path Generation of Robotic Inspection Tasks via Coverage Planning and Reinforcement Learning , 2018, IEEE Access.

[18]  Luis Enrique Sucar,et al.  View/state planning for three-dimensional object reconstruction under uncertainty , 2017, Auton. Robots.

[19]  Wei Jing,et al.  Model-based view planning for building inspection and surveillance using voxel dilation, Medial Objects, and Random-Key Genetic Algorithm , 2018, J. Comput. Des. Eng..

[20]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Michele Germani,et al.  Automation of 3D view acquisition for geometric tolerances verification , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[22]  Sungho Jo,et al.  Online coverage and inspection planning for 3D modeling , 2020, Autonomous Robots.

[23]  Ashish Kapoor,et al.  Learn-to-Score: Efficient 3D Scene Exploration by Predicting View Utility , 2018, ECCV.

[24]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[25]  Seokbae Son,et al.  Automated laser scanning system for reverse engineering and inspection , 2002 .

[26]  Tomáš Koutecký,et al.  Sensor planning system for fringe projection scanning of sheet metal parts , 2016 .

[27]  Michele Germani,et al.  CAD-based environment to bridge the gap between product design and tolerance control , 2010 .

[28]  Yong-Jin Liu,et al.  View planning in robot active vision: A survey of systems, algorithms, and applications , 2020, Computational Visual Media.

[29]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[30]  De Xu,et al.  Path planning for surface inspection on a robot-based scanning system , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[31]  Michael Suppa,et al.  Efficient next-best-scan planning for autonomous 3D surface reconstruction of unknown objects , 2015, Journal of Real-Time Image Processing.

[32]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[33]  Jürgen Beyerer,et al.  Inspection Planning for Optimized Coverage of Geometrically Complex Surfaces , 2018, 2018 Workshop on Metrology for Industry 4.0 and IoT.

[34]  Jean-Francois Rivest,et al.  Performance-oriented view planning for automated object reconstruction , 2002 .

[35]  Guanghui Lan,et al.  An effective and simple heuristic for the set covering problem , 2007, Eur. J. Oper. Res..

[36]  Michele Germani,et al.  Context dependent automatic view planning: the inspection of mechanical components , 2013 .

[37]  Rafael Murrieta-Cid,et al.  Tree-based search of the next best view/state for three-dimensional object reconstruction , 2018 .

[38]  Claire Lartigue,et al.  Scan Planning Strategy for a General Digitized Surface , 2006, J. Comput. Inf. Sci. Eng..

[39]  Kenji Shimada,et al.  Bubble mesh: automated triangular meshing of non-manifold geometry by sphere packing , 1995, SMA '95.

[40]  Gil-Sang Yoon,et al.  A feature-based inspection planning system for coordinate measuring machines , 2005 .

[41]  Glenn H. Tarbox,et al.  Planning for Complete Sensor Coverage in Inspection , 1995, Comput. Vis. Image Underst..

[42]  Claire Lartigue,et al.  Computer-Aided Inspection Planning: A Multisensor High-Level Inspection Planning Strategy , 2019, J. Comput. Inf. Sci. Eng..

[43]  Christopher R. Houck,et al.  A Genetic Algorithm for Function Optimization: A Matlab Implementation , 2001 .

[44]  Ning Xi,et al.  A feedback design to a CAD-guided area sensor planning system for automated 3D shape inspection , 2007 .

[45]  Charyar Mehdi-Souzani,et al.  Voxel-based Path Planning for 3D Scanning of Mechanical Parts , 2014 .

[46]  Michele Germani,et al.  Computation of optimal acquisition viewpoints for the 3D optical inspection of mechanical components , 2011 .

[47]  Roland Siegwart,et al.  Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics , 2015, ICRA 2015.

[48]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[49]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction with a mobile manipulator robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Ser-Nam Lim,et al.  A Reinforcement Learning Approach to the View Planning Problem , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  José Ramón Perán González,et al.  Automated 3D surface scanning based on CAD model , 2005 .

[52]  Rafael Murrieta-Cid,et al.  Volumetric Next-best-view Planning for 3D Object Reconstruction with Positioning Error , 2014 .

[53]  Xiaobu Yuan,et al.  A Mechanism of Automatic 3D Object Modeling , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Matthias Nießner,et al.  Plan3D , 2017, ACM Trans. Graph..

[55]  Kwan H. Lee,et al.  A Framework for Laser Scan Planning of Freeform Surfaces , 2001 .

[56]  Flavio Prieto Métrologie assistée par ordinateur : apport des capteurs 3D sans contact , 2000 .

[57]  Michaël Roy,et al.  3D part inspection path planning of a laser scanner with control on the uncertainty , 2011, Comput. Aided Des..