The MACS Project: An Approach to Affordance-Inspired Robot Control

In this position paper, we present an outline of the MACS approach to affordance-inspired robot control. An affordance, a concept from Ecological Psychology, denotes a specific relationship between an animal and its environment. Perceiving an affordance means perceiving an interaction possibility that is specific for the animal's perception and action capabilities. Perceiving an affordance does not include appearance-based object recognition, but rather feature-based perception of object functions. The central hypothesis of MACS is that an affordance-inspired control architecture enables a robot to perceive more interaction possibilities than a traditional architecture that relies on appearance-based object recognition alone. We describe how the concept of affordances can be exploited for controlling a mobile robot with manipulation capabilities. Particularly, we will describe how affordance support can be built into robot perception, how learning mechanisms can generate affordance-like relations, how this affordance-related information is represented, and how it can be used by a planner for realizing goal-directed robot behavior. We present both the MACS demonstrator and simulator, and summarize development and experiments that have been performed so far. By interfacing perception and goal-directed action in terms of affordances, we will provide a new way for reasoning and learning to connect with reactive robot control. We will show the potential of this new methodology by going beyond navigation-like tasks towards goal-directed autonomous manipulation in our project demonstrators.

[1]  Dirk Holz,et al.  Continuous 3D environment sensing for autonomous robot navigation and mapping , 2007, Informatiktage.

[2]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[3]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[4]  Lucas Paletta,et al.  Learning Predictive Features in Affordance based Robotic Perception Systems , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  D. Norman The psychology of everyday things , 1990 .

[6]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[7]  W. Warren,et al.  Visual guidance of walking through apertures: body-scaled information for affordances. , 1987, Journal of experimental psychology. Human perception and performance.

[8]  Simone Frintrop,et al.  VOCUS: A Visual Attention System for Object Detection and Goal-Directed Search , 2006, Lecture Notes in Computer Science.

[9]  Karl F. MacDorman,et al.  Responding to affordances: learning and projecting a sensorimotor mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Mehmet R. Doùgar Affordances as a Framework for Robot Control , 2007 .

[11]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[12]  Leslie Pack Kaelbling,et al.  Ecological Robotics , 1998, Adapt. Behav..

[13]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[14]  Krzysztof Janowicz Extending Semantic Similarity Measurement with Thematic Roles , 2005, GeoS.

[15]  Manish Kumar,et al.  Visual Learning of Affordance Based Cues , 2006, SAB.

[16]  A. Chemero What Events Are , 2000 .

[17]  John Hallam,et al.  From Animals to Animats 10 , 2008 .

[18]  Jonathan H. Connell,et al.  SSS: a hybrid architecture applied to robot navigation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[19]  Roderic A. Grupen,et al.  Learning prospective pick and place behavior , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[20]  Mark Steedman,et al.  Plans, Affordances, And Combinatory Grammar , 2002 .

[21]  E J Gibson,et al.  Detection of the traversability of surfaces by crawling and walking infants. , 1987, Journal of experimental psychology. Human perception and performance.

[22]  U. Neisser Multiple systems: A new approach to cognitive theory , 1994 .

[23]  Maya Cakmak,et al.  The learning and use of traversability affordance using range images on a mobile robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[24]  Robert M. French,et al.  Connectionist Models of Learning, Development and Evolution , 2001, Perspectives in Neural Computing.

[25]  K. MacDorman,et al.  Grounding Symbols through Sensorimotor Integration , 1999 .

[26]  Kevin W. Bowyer,et al.  Function-based generic recognition for multiple object categories , 1994 .

[27]  Ruzena Bajcsy,et al.  Interactive Recognition and Representation of Functionality , 1995, Comput. Vis. Image Underst..

[28]  Robin R. Murphy,et al.  Case studies of applying Gibson's ecological approach to mobile robots , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[29]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[30]  Erich Rome,et al.  GPU-accelerated affordance cueing based on visual attention , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  M. Turvey Affordances and Prospective Control: An Outline of the Ontology , 1992 .

[32]  Thomas A. Stoffregen,et al.  Affordances Are Enough: Reply to Chemero et al. (2003) , 2003 .

[33]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[34]  J. Norman Ecological Psychology and the Two Visual Systems: Not to Worry! , 2001 .

[35]  Tucker R. Balch,et al.  AuRA: principles and practice in review , 1997, J. Exp. Theor. Artif. Intell..

[36]  Dana H. Ballard,et al.  Learning to perceive and act by trial and error , 1991, Machine Learning.

[37]  Maya Cakmak,et al.  From primitive behaviors to goal-directed behavior using affordances , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  David Glasspool,et al.  Learning Action Affordances and Action Schemas , 2000, NCPW.

[39]  Glyn W. Humphreys,et al.  Motor facilitation following action observation: A behavioural study in prehensile action , 2003, Brain and Cognition.

[40]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[41]  L. S. Mark,et al.  Eyeheight-scaled information about affordances: a study of sitting and stair climbing. , 1987, Journal of experimental psychology. Human perception and performance.

[42]  E. Gibson Perceptual Learning in Development: Some Basic Concepts , 2000 .

[43]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[44]  M Jeannerod,et al.  Visual pathways for object-oriented action and object recognition: functional anatomy with PET. , 1997, Cerebral cortex.

[45]  W H Warren,et al.  Perceiving affordances: visual guidance of stair climbing. , 1984, Journal of experimental psychology. Human perception and performance.

[46]  Lucas Paletta,et al.  Reinforcement Learning of Predictive Features in Affordance Perception , 2006, Towards Affordance-Based Robot Control.

[47]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[48]  Christopher Lörken,et al.  Introducing Affordances into Robot Task Execution , 2007 .

[49]  E. Sahin,et al.  Curiosity-driven learning of traversability affordance on a mobile robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[50]  Azriel Rosenfeld,et al.  Recognition by Functional Parts , 1995, Comput. Vis. Image Underst..

[51]  Robin R. Murphy,et al.  Sfx: An Architecture For Action-oriented Sensor Fusion , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[53]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[54]  C. Michaels,et al.  To Cross or Not to Cross: The Effect of Locomotion on Street-Crossing Behavior , 1996 .

[55]  Lola Cañamero,et al.  Using a SOFM to learn Object Affordances , 2004 .

[56]  U. Neisser Cognition and reality: principles and implications , 1976 .

[57]  M. Turvey,et al.  Perceiving 'Walk-on-able' Slopes , 1992 .

[58]  G. Dorffner,et al.  Learning to perceive affordances in a framework of developmental embodied cognition , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[59]  Michael A. Arbib,et al.  A formal model of computation for sensory-based robotics , 1989, IEEE Trans. Robotics Autom..

[60]  A. Chemero An Outline of a Theory of Affordances , 2003, How Shall Affordances be Refined? Four Perspectives.