On the Ecological Approach to Information and Control for Roboticists

The ongoing and increasingly important trend in robotics to conceive designs that decentralize control is paralleled by currently active research paradigms in the study of perception and action. James Gibson's ecological approach is one of these paradigms. Gibson's approach emerged in part as a reaction to representationalist and computationalist approaches, which devote the bulk of their resources to the study of internal processes. The ecological approach instead focuses on constraints and ambient energy patterns in the animal-environment coalition. The present article reviews how the emphasis on the environment by ecological psychologists has given rise to the concepts of direct perception, higher order information, active information pick up, information-based control laws, prospective control, and direct learning. Examples are included to illustrate these concepts and to show how they can be applied to the construction of robots. Action is described as emergent and self-organized. It is argued that knowledge about perception, action, and learning as it occurs in living organisms may facilitate the construction of robots, more obviously so if the aim is to construct (to some extent) biologically plausible robots.

[1]  Nikolaos G. Tsagarakis,et al.  iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research , 2007, Adv. Robotics.

[2]  Brett R. Fajen,et al.  Behavioral Dynamics of Human Locomotion , 2004 .

[3]  Judith A. Effken,et al.  Ecological Perspectives on the New Artificial Intelligence , 1992 .

[4]  David M. Jacobs,et al.  An Empirical Illustration and Formalization of the Theory of Direct Learning: The Muscle-Based Perception of Kinetic Properties , 2009 .

[5]  David M Jacobs,et al.  The learning of visually guided action: an information-space analysis of pole balancing. , 2012, Journal of experimental psychology. Human perception and performance.

[6]  W. Warren Action modes and laws of control for the visual guidance of action , 1988 .

[7]  Gilles Montagne,et al.  Perception–action coupling model for human locomotor pointing , 2002, Biological Cybernetics.

[8]  Nicolas H. Franceschini,et al.  Aerial robot piloted in steep relief by optic flow sensors , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  N. A. Bernstein Dexterity and Its Development , 1996 .

[10]  Fumio Miyazaki,et al.  Realization of ball catching task using a mobile robot , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[11]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[12]  J. Bastin,et al.  Prospective strategies underlie the control of interceptive actions. , 2006, Human Movement Science.

[13]  Stéphane Viollet,et al.  Optic Flow Based Visual Guidance: From Flying Insects to Miniature Aerial Vehicles , 2009 .

[14]  David N. Lee,et al.  Plummeting gannets: a paradigm of ecological optics , 1981, Nature.

[15]  D. M. Jacobs,et al.  On Potential-Based and Direct Movements in Information Spaces , 2011 .

[16]  Rodney A. Brooks,et al.  A Robot that Walks; Emergent Behaviors from a Carefully Evolved Network , 1989, Neural Computation.

[17]  David M Jacobs,et al.  Lateral interception I: operative optical variables, attunement, and calibration. , 2006, Journal of experimental psychology. Human perception and performance.

[18]  Gilles Montagne,et al.  Environmental constraints modify the way an interceptive action is controlled , 2010, Experimental Brain Research.

[19]  J. Flach,et al.  Learning to Avoid Collisions: A Functional State Space Approach , 2012 .

[20]  C. Michaels,et al.  The information for catching fly balls: judging and intercepting virtual balls in a CAVE. , 2003, Journal of experimental psychology. Human perception and performance.

[21]  Seville Chapman Catching a Baseball , 1968 .

[22]  Alfred A. Rizzi,et al.  The LittleDog robot , 2011, Int. J. Robotics Res..

[23]  William H. Warren,et al.  Robot navigation from a Gibsonian viewpoint , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[24]  P. N. Kugler,et al.  Information, Natural Law, and the Self-Assembly of Rhythmic Movement , 2015 .

[25]  Jonathan H. Connell Creature Design with the Subsumption Architecture , 1987, IJCAI.

[26]  Leslie Pack Kaelbling,et al.  Ecological Robotics , 1998, Adapt. Behav..

[27]  O. Meijer,et al.  Complex movement behaviour : 'the' motor-action controversy , 1988 .

[28]  David M Jacobs,et al.  Judgements of time to contact are affected by rate of appearance of visible texture , 2010, Quarterly journal of experimental psychology.

[29]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[30]  A. G. Feldman Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[31]  Leslie Pack Kaelbling,et al.  Ecological Robotics: Controlling Behavior with Optical Flow , 1995 .

[32]  R. Beer,et al.  Intelligence as Adaptive Behavior: An Experiment in Computational Neuroethology , 1990 .

[33]  Michael T. Turvey,et al.  Is Tensegrity the Functional Architecture of the Equilibrium Point Hypothesis , 2010 .

[34]  S. Runeson On the possibility of "smart" perceptual mechanisms. , 1977, Scandinavian journal of psychology.

[35]  W. H. Warren The dynamics of perception and action. , 2006, Psychological review.

[36]  R. Olberg,et al.  Prey pursuit and interception in dragonflies , 2000, Journal of Comparative Physiology A.

[37]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[38]  Gentaro Taga,et al.  A model of the neuro-musculo-skeletal system for anticipatory adjustment of human locomotion during obstacle avoidance , 1998, Biological Cybernetics.

[39]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[40]  Jonathan H. Connell,et al.  Minimalist mobile robotics - a colony-style architecture for an artificial creature , 1990, Perspectives in artificial intelligence.

[41]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[42]  J. Fodor,et al.  How direct is visual perception?: Some reflections on Gibson's “ecological approach” , 1981, Cognition.

[43]  M. Srinivasan,et al.  Range perception through apparent image speed in freely flying honeybees , 1991, Visual Neuroscience.

[44]  Brett R Fajen Learning novel mappings from optic flow to the control of action. , 2008, Journal of vision.

[45]  Stefan Schaal,et al.  Forward models in visuomotor control. , 2002, Journal of neurophysiology.

[46]  M. T. Turvey,et al.  Issues in the theory of action : Degree of freedom, coordinative structures and coalitions , 1978 .

[47]  Mindy F Levin,et al.  Threshold position control and the principle of minimal interaction in motor actions. , 2007, Progress in brain research.

[48]  Marion A. Eppler,et al.  Development of Visually Guided Locomotion , 1998 .

[49]  Wendy D. Zosh,et al.  Optic Flow Drives Human Visuo-Locomotor Adaptation , 2007, Current Biology.

[50]  Gilles Montagne,et al.  Intersection crossing considered as intercepting a moving traffic gap: effects of task and environmental constraints. , 2012, Acta psychologica.

[51]  Michael T. Turvey,et al.  Inadequacies of the Computer Metaphor , 1984 .

[52]  Jun Nakanishi,et al.  Operational Space Control: A Theoretical and Empirical Comparison , 2008, Int. J. Robotics Res..

[53]  J. Gibson The perception of the visual world , 1951 .

[54]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[55]  Franck Ruffier,et al.  OCTAVE: a bioinspired visuo-motor control system for the guidance of micro-air-vehicles , 2003, SPIE Microtechnologies.

[56]  William H Warren,et al.  Catching fly balls in virtual reality: a critical test of the outfielder problem. , 2009, Journal of vision.

[57]  M. Turvey,et al.  Ecological laws of perceiving and acting: In reply to Fodor and Pylyshyn (1981) , 1981, Cognition.

[58]  C. Michaels,et al.  Geometric Specification of Dynamics: Learning to Visually Perceive Kinetic Quantities from Static Images , 2012, Perception.

[59]  Mark L Latash,et al.  Motor synergies and the equilibrium-point hypothesis. , 2010, Motor control.

[60]  J. Gibson The Ecological Approach to Visual Perception , 1979 .