Affordances for robots: a brief survey

In this paper, we consider the influence of Gibson's affordance theory on the design of robotic agents. Affordance theory (and the ecological approach to agent design in gen- eral) has in many cases contributed to the development of successful robotic systems; we provide a brief survey of AI research in this area. However, there remain signifi- cant issues that complicate discussions on this topic, particularly in the exchange of ideas between researchers in artificial intelligence and ecological psychology. We identify some of these issues, specifically the lack of a generally accepted definition of "affordance" and fundamental differences in the current approaches taken in AI and ecological psychology. While we consider reconciliation between these fields to be possible and mutually beneficial, it will require some flexibility on the issue of direct perception.

[1]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[2]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[3]  J. Gyr Is a theory of direct visual perception adequate? , 1972, Psychological bulletin.

[4]  Earl D. Sacerdoti,et al.  Planning in a Hierarchy of Abstraction Spaces , 1974, IJCAI.

[5]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[6]  S. Ullman Against direct perception , 1980, Behavioral and Brain Sciences.

[7]  J. Fodor,et al.  How direct is visual perception?: Some reflections on Gibson's “ecological approach” , 1981, Cognition.

[8]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[9]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[10]  Allen Newell,et al.  GPS, a program that simulates human thought , 1995 .

[11]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[12]  David Chapman,et al.  Vision, instruction, and action , 1990 .

[13]  Ronald C. Arkin,et al.  The impact of cybernetics on the design of a mobile robot system: a case study , 1990, IEEE Trans. Syst. Man Cybern..

[14]  D. Norman The psychology of everyday things , 1990 .

[15]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[16]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[17]  Herbert A. Simon,et al.  Situated Action: A Symbolic Interpretation , 1993, Cogn. Sci..

[18]  Shlomo Zilberstein,et al.  Anytime Sensing Planning and Action: A Practical Model for Robot Control , 1993, IJCAI.

[19]  Rodney A. Brooks,et al.  Building brains for bodies , 1995, Auton. Robots.

[20]  Maja J. Mataric,et al.  Interaction and intelligent behavior , 1994 .

[21]  Anthony Stentz,et al.  The Focussed D* Algorithm for Real-Time Replanning , 1995, IJCAI.

[22]  Active Stereo Vision System with Foveated Wide Angle Lenses , 1995, ACCV.

[23]  Rodney A. Brooks,et al.  From earwigs to humans , 1997, Robotics Auton. Syst..

[24]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[25]  Leslie Pack Kaelbling,et al.  Ecological Robotics , 1998, Adapt. Behav..

[26]  E. Gat On Three-Layer Architectures , 1997 .

[27]  Brian Scassellati A Binocular, Foveated Active Vision System , 1998 .

[28]  Robin R. Murphy,et al.  Case studies of applying Gibson's ecological approach to mobile robots , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[29]  Joseph Y. Halpern,et al.  Reasoning about Noisy Sensors and Effectors in the Situation Calculus , 1999, Artif. Intell..

[30]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[31]  C. Michaels Affordances: Four Points of Debate , 2003, How Shall Affordances be Refined? Four Perspectives.

[32]  Keith S. Jones,et al.  What Is an Affordance? , 2003, How Shall Affordances be Refined? Four Perspectives.

[33]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[34]  Lynn Nadel,et al.  Encyclopedia of Cognitive Science , 2003 .

[35]  T. Stoffregen Affordances as Properties of the Animal-Environment System , 2003, How Shall Affordances be Refined? Four Perspectives.

[36]  Harry Heft Affordances, Dynamic Experience, and the Challenge of Reification , 2003, How Shall Affordances be Refined? Four Perspectives.

[37]  A. Chemero An Outline of a Theory of Affordances , 2003, How Shall Affordances be Refined? Four Perspectives.

[38]  Lola Cañamero,et al.  Using a SOFM to learn Object Affordances , 2004 .

[39]  M. Srinivasan,et al.  Visual motor computations in insects. , 2004, Annual review of neuroscience.

[40]  T. Stoffregen Breadth and Limits of the Affordance Concept , 2004 .

[41]  Alex Kirlik,et al.  On Stoffregen's Definition of Affordances , 2004 .

[42]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[43]  A.B. Wood,et al.  Effective tool use in a habile agent , 2005, 2005 IEEE Design Symposium, Systems and Information Engineering.

[44]  Alexander Stoytchev,et al.  Learning the Affordances of Tools Using a Behavior-Grounded Approach , 2006, Towards Affordance-Based Robot Control.

[45]  Lucas Paletta,et al.  Learning Predictive Features in Affordance based Robotic Perception Systems , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Joachim Hertzberg,et al.  The MACS Project: An Approach to Affordance-Inspired Robot Control , 2006, Towards Affordance-Based Robot Control.

[47]  Manish Kumar,et al.  Visual Learning of Affordance Based Cues , 2006, SAB.

[48]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[49]  Mehmet R. Doùgar Affordances as a Framework for Robot Control , 2007 .

[50]  J. Sinapov,et al.  Learning and generalization of behavior-grounded tool affordances , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[51]  Michael T. Turvey,et al.  Gibsonian Affordances for Roboticists , 2007, Adapt. Behav..

[52]  Gary R. Bradski,et al.  Peripheral-Foveal Vision for Real-time Object Recognition and Tracking in Video , 2007, IJCAI.

[53]  J. Sinapov,et al.  Detecting the functional similarities between tools using a hierarchical representation of outcomes , 2008, 2008 7th IEEE International Conference on Development and Learning.

[54]  Thomas E. Horton,et al.  Visual Affordances and Symmetries in Canis habilis: A Progress Report , 2008, AAAI Fall Symposium: Naturally-Inspired Artificial Intelligence.

[55]  Kazuhiko Kawamura,et al.  Towards a cognitive robot that uses internal rehearsal to learn affordance relations , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  K. Kawamura,et al.  A robot rehearses internally and learns an affordance relation , 2008, 2008 7th IEEE International Conference on Development and Learning.

[57]  N. Kruger,et al.  Learning object-specific grasp affordance densities , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[58]  Justus H. Piater,et al.  Learning Objects and Grasp Affordances through Autonomous Exploration , 2009, ICVS.

[59]  Emre Ugur,et al.  Predicting future object states using learned affordances , 2009, 2009 24th International Symposium on Computer and Information Sciences.

[60]  Sinan Kalkan,et al.  Affordances and Emergence of Concepts , 2010, EpiRob.

[61]  Sinan Kalkan,et al.  Learning Affordances for Categorizing Objects and Their Properties , 2010, 2010 20th International Conference on Pattern Recognition.

[62]  James M. Rehg,et al.  Learning Visual Object Categories for Robot Affordance Prediction , 2010, Int. J. Robotics Res..

[63]  Oliver Kroemer,et al.  Learning Continuous Grasp Affordances by Sensorimotor Exploration , 2010, From Motor Learning to Interaction Learning in Robots.

[64]  Emre Ugur,et al.  Traversability: A Case Study for Learning and Perceiving Affordances in Robots , 2010, Adapt. Behav..

[65]  Emre Ugur,et al.  Goal emulation and planning in perceptual space using learned affordances , 2011, Robotics Auton. Syst..

[66]  Oliver Kroemer,et al.  Learning grasp affordance densities , 2011, Paladyn J. Behav. Robotics.

[67]  Tetsunari Inamura,et al.  Learning of Tool Affordances for autonomous tool manipulation , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[68]  Sinan Kalkan,et al.  Learning Adjectives and Nouns from Affordances on the iCub Humanoid Robot , 2012, SAB.

[69]  Jivko Sinapov,et al.  A Behavior-Grounded Approach to Forming Object Categories: Separating Containers From Noncontainers , 2012, IEEE Transactions on Autonomous Mental Development.

[70]  A. Borghi,et al.  Object Affordances Tune Observers' Prior Expectations about Tool-Use Behaviors , 2012, PloS one.

[71]  Dirk Kraft,et al.  A Survey of the Ontogeny of Tool Use: From Sensorimotor Experience to Planning , 2013, IEEE Transactions on Autonomous Mental Development.