Functional 3D Object Classification Using Simulation of Embodied Agent

This paper presents a cognitive-motivated approach for classification of 3D objects according to the functional paradigm. We hypothesize that classification can be achieved through simulation of actions meant to verify whether a candidate object fulfills a certain functionality. This paper presents ABSV: Agent Based Simulated Vision, a novel approach that tries to imitate the way humans perform certain classification tasks. ABSV can determine the category of a candidate object by verifying certain functional properties that the object should possess. Unlike conventional functional approaches, it uses virtual environment to simulate the interaction between the object and various examination agents to expose those functionalities. To demonstrate our approach we have implemented it for the recognition of several object categories. We achieved promising classification results using both complete CAD models and real 3D scanned data generated from a single view point. We believe that the concepts introduced in ABSV will influence significantly the design of robot classification systems.

[1]  Pietro Perona,et al.  A Probabilistic Approach to Object Recognition Using Local Photometry and Global Geometry , 1998, ECCV.

[2]  D. Perani,et al.  Different neural systems for the recognition of animals and man‐made tools , 1995, Neuroreport.

[3]  A. Sirigu,et al.  The Mental Representation of Hand Movements After Parietal Cortex Damage , 1996, Science.

[4]  Daniel P. Huttenlocher,et al.  Spatial priors for part-based recognition using statistical models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Paul Fitzpatrick,et al.  Object Lesson: Discovering and Learning to Recognize Objects , 2002 .

[6]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  D. Stork Generic object recognition using form & function , 1996 .

[8]  David G. Stork,et al.  Generic object recognition using form and function , 1998, Pattern Analysis and Applications.

[9]  Dan Roth,et al.  Learning a Sparse Representation for Object Detection , 2002, ECCV.

[10]  Ehud Rivlin,et al.  Function From Motion , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[12]  M Jeannerod,et al.  Visual pathways for object-oriented action and object recognition: functional anatomy with PET. , 1997, Cerebral cortex.

[13]  Martial Hebert,et al.  Parts-based 3D object classification , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Martial Hebert,et al.  Parts-based 3D object classification , 2004, CVPR 2004.

[15]  Azriel Rosenfeld,et al.  Recognition by Functional Parts , 1995, Comput. Vis. Image Underst..

[16]  Gino van den Bergen Efficient Collision Detection of Complex Deformable Models using AABB Trees , 1997, J. Graphics, GPU, & Game Tools.