An Active Approach to Functionality Characterization and Recognition

In this paper we focus on understanding and defining a methodology for object description and recognition both in terms of its geometrical, material and functional specifications. We define functionality in an object as its applicability toward the achievement of a task. We emphasize and develop an interactive and performatory approach to functionality recovery. Furthermore, we introduce the distinction between Inherent, Intended and Imposed functionality. By analyzing interaction and manipulation tasks as goal-oriented recognition processes we propose to identify and characterize functionalities of objects. This interaction is not only a means of verification of the hypothesized presence of functionality in objects but also a way to actively and purposively recognize the object. In order to accomplish our goal, we introduce a formal model, based on Discrete Event Dynamic System Theory, to define a task for recovering and describing functionality. We extend the recovery process to an algebra of tasks. We describe how a more complex task call be composed from a set of primitive ones. This constructive approach allows a task to be built from simpler ones in an stepwise fashion. Once the manipulatory task has been described in the formal model, it must be instantiated in a context. In such a context, the behavior of the system in which the interactio between a Manipulator, a Tool and a Target object must be observed. Thus, the description of tasks themselves provide must for means of addressing observability through different sensor modalities. For this purpose, we introduce the notion of Partial Observability of a task. This allows the description of a plant in which not all events and the time of their occurrence might he modelled and therefore predictable in advance. Comments University of Pennsylvania Department of Computer and Information Science Technical Report No. MSCIS-92-37. This technical report is available at ScholarlyCommons: https://repository.upenn.edu/cis_reports/528 An Active Approach to Functionality C hracterization and Recognit ion MS-CIS-92-37 GRASP LAB 315 Luca Bogoni Ruzena Bajcsy University of Pennsylvania School of Engineering and Applied Science Computer and Information Science Department Philadelphia, PA 19104-6380

[1]  Allen Newell,et al.  A Model for Functional Reasoning in Design , 1971, IJCAI.

[2]  Ruzena Bajcsy,et al.  Computer identification of visual surfaces , 1973, Comput. Graph. Image Process..

[3]  S. Lederman,et al.  Perception of texture by vision and touch: multidimensionality and intersensory integration. , 1986, Journal of experimental psychology. Human perception and performance.

[4]  Huan Liu,et al.  The multi-dimensional quality of task requirements for dextrous robot hand control , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[5]  Ravindra Rao Dynamics of Discrete Event Systems , 1991 .