Decomposing CAD models of objects of daily use and reasoning about their functional parts

Today's robots are still lacking comprehensive knowledge bases about objects and their properties. Yet, a lot of knowledge is required when performing manipulation tasks to identify abstract concepts like a “handle” or the “blade of a spatula” and to ground them into concrete coordinate frames that can be used to parametrize the robot's actions. In this paper, we present a system that enables robots to use CAD models of objects as a knowledge source and to perform logical inference about object components that have automatically been identified in these models. The system includes several algorithms for mesh segmentation and geometric primitive fitting which are integrated into the robot's knowledge base as procedural attachments to the semantic representation. Bottom-up segmentation methods are complemented by top-down, knowledge-based analysis of the identified components. The evaluation on a diverse set of object models, downloaded from the Internet, shows that the algorithms are able to reliably detect several kinds of object parts.

[1]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[2]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[3]  Michael Garland,et al.  Hierarchical face clustering on polygonal surfaces , 2001, I3D '01.

[4]  Szymon Rusinkiewicz,et al.  Estimating curvatures and their derivatives on triangle meshes , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[5]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[6]  Marco Attene,et al.  Mesh Segmentation - A Comparative Study , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[7]  Ioannis Pratikakis,et al.  3D Mesh Segmentation Methodologies for CAD applications , 2007 .

[8]  三嶋 博之 The theory of affordances , 2008 .

[9]  Boris Motik,et al.  OWL 2 Web Ontology Language: structural specification and functional-style syntax , 2008 .

[10]  Moritz Tenorth,et al.  KNOWROB — knowledge processing for autonomous personal robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Rainer Bischoff,et al.  Robotic Visions to 2020 and beyond -- The strategic research agenda for robotics in Europe , 2009 .

[12]  Moritz Tenorth,et al.  Understanding and executing instructions for everyday manipulation tasks from the World Wide Web , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Matei T. Ciocarlie,et al.  Towards Reliable Grasping and Manipulation in Household Environments , 2010, ISER.

[14]  Sinan Kalkan,et al.  Learning Affordances for Categorizing Objects and Their Properties , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  Gary R. Bradski,et al.  Fast 3D recognition and pose using the Viewpoint Feature Histogram , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  David Vernon,et al.  Research road map , 2010 .

[17]  Dejan Pangercic,et al.  Robotic roommates making pancakes , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[18]  Óscar Martínez Mozos,et al.  Furniture Models Learned from the WWW , 2011, IEEE Robotics & Automation Magazine.

[19]  Federico Tombari Automatic semantic segmentation of 3 D urban scenes , 2011 .

[20]  V. S. Costa,et al.  Theory and Practice of Logic Programming , 2010 .

[21]  Federico Tombari,et al.  Online learning for automatic segmentation of 3D data , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  William Puech,et al.  Recovering primitives in 3D CAD meshes , 2011, Electronic Imaging.

[23]  Tom Schrijvers,et al.  Under Consideration for Publication in Theory and Practice of Logic Programming Swi-prolog , 2022 .

[24]  Danica Kragic,et al.  Visual object-action recognition: Inferring object affordances from human demonstration , 2011, Comput. Vis. Image Underst..

[25]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Michael Beetz,et al.  Multimodal autonomous tool analyses and appropriate application , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[27]  Jörg Stückler,et al.  Shape-Primitive Based Object Recognition and Grasping , 2012, ROBOTIK.

[28]  Markus Vincze,et al.  Supervised learning of hidden and non-hidden 0-order affordances and detection in real scenes , 2012, 2012 IEEE International Conference on Robotics and Automation.

[29]  Sukhan Lee,et al.  Surface Patch Primitive Based Object Modeling from CAD Data , 2012 .

[30]  Nancy M. Amato,et al.  A Roadmap for US Robotics - From Internet to Robotics 2020 Edition , 2021, Found. Trends Robotics.