It's about time : temporal representations for synthetic characters

Inspired by recent work in ethology and animal training, we integrate representations for time and rate into a behavior-based architecture for autonomous virtual creatures. The resulting computational model of affect and action selection allows these creatures to discover and refine their understanding of apparent temporal causality relationships which may or may not involve self-action. The fundamental action selection choice that a creature must make in order to satisfy its internal needs is whether to explore, react or exploit. In this architecture, that choice is informed by an understanding of apparent temporal causality, the representation for which is integrated into the representation for action. The ability to accommodate changing ideas about causality allows the creature to exist in and adapt to a dynamic world. Not only is such a model suitable for computational systems, but its derivation from biological models suggests that it may also be useful for gaining a new perspective on learning in biological systems. The implementation of a complete character built using this architecture is able to reproduce a variety of conditioning phenomena, as well as learn using a training technique used with live animals. It’s about Time: Temporal Representations for Synthetic Characters by Robert Carrington Burke The following people served as readers for this thesis: Reader: Whitman Richards Professor MIT Artificial Intelligence Laboratory Reader: Charles Ransom Gallistel Professor Center for Cognitive Science Rutgers University

[1]  K. Clark.  CONDITIONS FOR VERSATILE LEARNING , HELMHOLTZ ’ S UNCONSCIOUS INFERENCE , AND THE TASK OF PERCEPTION , 2002 .

[2]  E. Spier.  From Reactive Behaviour to Adaptive Behaviour: Motivational Models for Behaviour in Animals and Robo , 1997 .

[3]  M. Minsky.  The Society of Mind , 1986 .

[4]  J. Dekleer.  An assumption-based TMS , 1986 .

[5]  J. Russell.  A circumplex model of affect. , 1980 .

[6]  B. Bernstein,et al.  Animal Behavior , 1927, Japanese Marine Life.

[7]  K. Lorenz,et al.  Motivation of human and animal behavior : an ethological view , 1973 .

[8]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[9]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[10]  Herbert A. Simon,et al.  Causality in Device Behavior , 1989, Artif. Intell..

[11]  J. Stevens,et al.  Animal Intelligence , 1883, Nature.

[12]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[13]  Pattie Maes,et al.  The Dynamics of Action Selection , 1989, IJCAI.

[14]  Allan D. Jepson,et al.  From Features to Perceptual Categories , 1992 .

[15]  Gary L. Drescher,et al.  Made-up minds - a constructivist approach to artificial intelligence , 1991 .

[16]  Richard S. J. Frackowiak,et al.  Navigation-related structural change in the hippocampi of taxi drivers. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[17]  V. Lolordo,et al.  Attention in the pigeon: differential effects of food-getting versus shock-avoidance procedures. , 1973, Journal of comparative and physiological psychology.

[18]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[19]  Andrew McCallum,et al.  Reinforcement learning with selective perception and hidden state , 1996 .

[20]  Michael Patrick Johnson,et al.  Multi-dimensional quaternion interpolation , 1999, SIGGRAPH '99.

[21]  Christopher Kline.  Observation-based expectation generation and response for behavior-based artificial creatures , 1999 .

[22]  C. Gallistel.  The organization of learning , 1990 .

[23]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[24]  M. Domjan.  The principles of learning and behavior , 1982 .

[25]  Marc Downie,et al.  Animation and Music: The Music and Movement of Synthetic Characters , 2001 .

[26]  S. Shettleworth.  Cognition, evolution, and behavior , 1998 .

[27]  Ralph R. Miller,et al.  Temporal encoding in trace conditioning , 1995 .

[28]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[29]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[30]  Johan de Kleer,et al.  Theories of Causal Ordering , 1986, Artif. Intell..

[31]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[32]  Bruce Blumberg,et al.  Motivation driven learning for interactive synthetic characters , 2000, AGENTS '00.

[33]  P. Ekman.  Emotion in the human face , 1982 .

[34]  James F. Allen.  Planning as Temporal Reasoning , 1991, KR.

[35]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[36]  S. Kosslyn,et al.  Findings and current opinion in cognitive neuroscience , 1998 .

[37]  N Moray,et al.  A lattice theory approach to the structure of mental models. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[39]  永福 智志.  The Organization of Learning , 2005, Journal of Cognitive Neuroscience.

[40]  William Michael Tomlinson.  Interactivity and emotion through cinematography , 1999 .

[41]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[42]  V. Braitenberg.  Vehicles, Experiments in Synthetic Psychology , 1984 .

[43]  Mats Gyllenberg,et al.  Testing for Periodicity in Signals:an Application to Detect Partial Upper Airway Obstruction during Sleep , 2000 .

[44]  Steven R. Lindsay.  Adaptation and learning , 2000 .

[45]  K. Haberlandt,et al.  Stimulus selection in animal discrimination learning. , 1968, Journal of experimental psychology.

[46]  Bruce Blumberg,et al.  It ’ s about Time : Temporal Representations for Synthetic Characters by Robert Carrington Burke , 2001 .

[47]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[48]  C. Gallistel.  Classical conditioning as a nonstationary, multivariate time series analysis: A spreadsheet model , 1992 .

[49]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[50]  A. Sinclair.  BEHAVIOUR OF WOLVES, DOGS AND RELATED CANIDS , 1973 .

[51]  Damian A. Isla,et al.  Creature Smarts: The Art and Architecture of a Virtual Brain , 2001 .

[52]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[53]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[54]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[55]  A. Treisman.  The binding problem , 1996, Current Opinion in Neurobiology.

[56]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[57]  W. Ashby,et al.  Every Good Regulator of a System Must Be a Model of That System , 1970 .

[58]  Bruce Blumberg,et al.  Interactive Training for Synthetic Characters , 2000, AAAI/IAAI.

[59]  BodenheimerBobby,et al.  Verbs and Adverbs , 1998 .

[60]  Alex Pentland,et al.  EM for Perceptual Coding and Reinforcement Learning Tasks , 2000 .

[61]  Demetri Terzopoulos,et al.  Artificial fishes: physics, locomotion, perception, behavior , 1994, SIGGRAPH.