Learning Action Affordances and Action Schemas

Several theories of action selection assume that the environment both suggests and constrains possible actions at each moment. We present an interactive activation model (based on an existing model of routine sequential action selection) in which actions are organised into partially ordered schemas for simple task elements, and the current state of the environment contributes to selecting actions and schemas. Previous versions of the model have not accounted for learning. We show that a simple reinforcement learning paradigm allows environment-action associations to be acquired through unguided exploration of the environment. The basic model is limited in the types of environment/action associations that it acquires. We explore ways in which greater diversity of learning (and behaviour) may be achieved, and suggest that, in order to acquire a broad range of environment/action associations, mechanisms for boredom avoidance or novelty seeking are required.

[1]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[2]  Donald A. Norman,et al.  Attention to Action , 1986 .

[3]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[4]  J. J. Gibson The theory of affordances , 1977 .

[5]  F. Lhermitte 'Utilization behaviour' and its relation to lesions of the frontal lobes. , 1983, Brain : a journal of neurology.

[6]  Chris Mellish,et al.  Current research in natural language generation , 1990 .

[7]  K. Lashley The problem of serial order in behavior , 1951 .

[8]  E. Thorndike “Animal Intelligence” , 1898, Nature.

[9]  T. Shallice,et al.  Perseverative and Semantic Influences on Visual Object Naming Errors in Optic Aphasia: A Connectionist Account , 1993, Journal of Cognitive Neuroscience.

[10]  John Fox,et al.  COGENT: A visual design environment for cognitive modeling , 1998 .

[11]  Dw Glasspool,et al.  Modelling serial order in behaviour : studies of spelling , 1998 .

[12]  George Houghton,et al.  The problem of serial order: a neural network model of sequence learning and recall , 1990 .

[13]  G. Schwartz,et al.  Consciousness and Self-Regulation , 1976 .

[14]  Richard P. Cooper,et al.  Symbolic and continuous processes in the automatic selection of actions , 1995 .

[15]  D. Norman,et al.  Attention to Action: Willed and Automatic Control of Behavior Technical Report No. 8006. , 1980 .

[16]  T. Triffet,et al.  Aspects of Consciousness , 1997 .

[17]  John Hallam,et al.  Hybrid problems, hybrid solutions , 1995 .

[18]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.