Volumetric Next-best-view Planning for 3D Object Reconstruction with Positioning Error

Three-dimensional (3D) object reconstruction is the process of building a 3D model of a real object. This task is performed by taking several scans of an object from different locations (views). Due to the limited field of view of the sensor and the object's self-occlusions, it is a difficult problem to solve. In addition, sensor positioning by robots is not perfect, making the actual view different from the expected one. We propose a next best view (NBV) algorithm that determines each view to reconstruct an arbitrary object. Furthermore, we propose a method to deal with the uncertainty in sensor positioning. The algorithm fulfills all the constraints of a reconstruction process, such as new information, positioning constraints, sensing constraints and registration constraints. Moreover, it improves the scan's quality and reduces the navigation distance. The algorithm is based on a search-based paradigm where a set of candidate views is generated and then each candidate view is evaluated to determine which one is the best. To deal with positioning uncertainty, we propose a second stage which re-evaluates the views according to their neighbours, such that the best view is that which is within a region of the good views. The results of simulation and comparisons with previous approaches are presented.

[1]  Christophe Dumont,et al.  A next-best-view system for autonomous 3-D object reconstruction , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Michel Devy,et al.  Perception planning for an exploration task of a 3D environment , 2002, Object recognition supported by user interaction for service robots.

[3]  Shengyong Chen,et al.  Active Sensor Planning for Multiview Vision Tasks , 2008 .

[4]  B. Siciliano,et al.  Visual Grasp Planning for Unknown Objects Using a Multifingered Robotic Hand , 2013, IEEE/ASME Transactions on Mechatronics.

[5]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Mongi A. Abidi,et al.  Best-next-view algorithm for three-dimensional scene reconstruction using range images , 1995, Other Conferences.

[7]  Kamal K. Gupta,et al.  An autonomous six-DOF eye-in-hand system for in situ 3D object modeling , 2012, Int. J. Robotics Res..

[8]  G. Roth,et al.  Pose Error Effects on Range Sensing * , 2002 .

[9]  Christophe Dumont,et al.  Next best view system in a 3D object modeling task , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[10]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[11]  A. Lastra,et al.  An Adaptive Hierarchical Next-Best-View Algorithm for 3D Reconstruction of Indoor Scenes , 2006 .

[12]  Peter K. Allen,et al.  Data acquisition and view planning for 3-D modeling tasks , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Gerd Hirzinger,et al.  Next-best-scan planning for autonomous 3D modeling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Luis Enrique Sucar,et al.  Next-Best-View Planning for 3D Object Reconstruction under Positioning Error , 2011, MICAI.

[15]  Dieter Fox,et al.  Autonomous generation of complete 3D object models using next best view manipulation planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Robert B. Fisher,et al.  A Best Next View Selection Algorithm Incorporating a Quality Criterion , 1998, BMVC.

[17]  Olivier Stasse,et al.  A next-best-view algorithm for autonomous 3D object modeling by a humanoid robot , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[18]  C. Ian Connolly,et al.  The determination of next best views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[19]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[20]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[21]  Robert B. Fisher,et al.  A Next-Best-View Algorithm for 3D Scene Recovery with 5 Degrees of Freedom , 1999, BMVC.

[22]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Heiko Wersing,et al.  Active 3D Object Localization Using a Humanoid Robot , 2011, IEEE Transactions on Robotics.

[24]  M. Devy,et al.  Perception planning for an exploration task of a 3D environment , 2002, Object recognition supported by user interaction for service robots.