Imitation and social learning for synthetic characters

An increasing amount of evidence suggests that in human infants the ability to learn by watching others, and in particular, the ability to imitate, could be crucial precursors to the development of appropriate social behavior, and ultimately the ability to reason about the thoughts, intents, beliefs, and desires of others [6]. We have created a number of imitative characters and robots [2], the latest of which is Max T. Mouse, an anthropomorphic animated mouse character who is able to observe the actions he sees his friend Morris Mouse performing, and compare them to the actions he knows how to perform himself. This matching process allows Max to accurately imitate Morris’s gestures and actions, even when provided with limited synthetic visual input. Furthermore, by using his own perception, motor, and action systems as models for the behavioral and perceptual capabilities of others (a process known as Simulation Theory in the cognitive literature), Max can begin to identify simple goals and motivations for Morris’s behavior, an important step towards developing characters with a full theory of mind.

[1]  Aude Billard,et al.  Grounding communication in autonomous robots: An experimental study , 1998, Robotics Auton. Syst..

[2]  M. Tomasello,et al.  Chimpanzees know what conspecifics do and do not see , 2000, Animal Behaviour.

[3]  Aaron F. Bobick,et al.  Realtime online adaptive gesture recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  D. Keltner,et al.  Social Functions of Emotions at Four Levels of Analysis , 1999 .

[5]  C. Heyes,et al.  Social learning in animals : the roots of culture , 1996 .

[6]  J. Mateo,et al.  Development of alarm-call responses in Belding's ground squirrels: the role of dams , 1997, Animal Behaviour.

[7]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[8]  M. Carpenter,et al.  Three sources of information in social learning , 2002 .

[9]  P. Marler,et al.  Vervet monkey alarm calls: Semantic communication in a free-ranging primate , 1980, Animal Behaviour.

[10]  Andrew Whiten,et al.  Imitation of sequential and hierarchical structure in action: Experimental studies with children and , 2002 .

[11]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[12]  D. Perrett,et al.  Imitation, mirror neurons and autism , 2001, Neuroscience & Biobehavioral Reviews.

[13]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[14]  Dorothy M. Fragaszy,et al.  Imitation is not the “Holy Grail” of comparative cognition , 1998, Behavioral and Brain Sciences.

[15]  Maja J. Matarić,et al.  Making Complex Articulated Agents Dance - An analysis of control methods drawn from robotics, animat , 1999 .

[16]  S. Mineka,et al.  Observational conditioning of fear to fear-relevant versus fear-irrelevant stimuli in rhesus monkeys. , 1989, Journal of abnormal psychology.

[17]  Bruce Blumberg,et al.  Integrated learning for interactive synthetic characters , 2002, SIGGRAPH.

[18]  P. Slater,et al.  Bird song learning: causes and consequences , 1989 .

[19]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[20]  Mark A. Boyer The American heritage dictionary , 1984 .

[21]  Robert Carrington Burke,et al.  It's about time : temporal representations for synthetic characters , 2001 .

[22]  R. Hinde,et al.  The Opening of Milk Bottles by Birds , 1952, Nature.

[23]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[24]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[25]  A. Meltzoff Infant Imitation After a 1-Week Delay: Long-Term Memory for Novel Acts and Multiple Stimuli. , 1988, Developmental psychology.

[26]  Deb Roy,et al.  Mental imagery for a conversational robot , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  R. Byrne,et al.  Priming primates: Human and otherwise , 1998, Behavioral and Brain Sciences.

[28]  Maja J. Matarić,et al.  Primitive-Based Movement Classification for Humanoid Imitation , 2000 .

[29]  Norman I. Badler,et al.  Temporal scene analysis: conceptual descriptions of object movements. , 1975 .

[30]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[31]  Aude Billard,et al.  Imitation: a Means to Enhance Learning of a Synthetic Proto-language in an Autonomous Robot , 1999 .

[32]  Marc Downie,et al.  Animation and Music: The Music and Movement of Synthetic Characters , 2001 .

[33]  Andrea Lockerd Thomaz,et al.  Tutelage and socially guided robot learning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[34]  F. Strack,et al.  Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. , 1988, Journal of personality and social psychology.

[35]  W. Timberlake,et al.  Behavior Systems and Learning: From Misbehavior to General Principles , 2019, Contemporary Learning Theories.

[36]  Norman I. Badler,et al.  Building parameterized action representations from observation , 2000 .

[37]  W. Prinz A common-coding approach to perception and action , 1990 .

[38]  Kerstin Dautenhahn,et al.  Getting to know each other - Artificial social intelligence for autonomous robots , 1995, Robotics Auton. Syst..

[39]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[40]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[41]  Jeff I. Lieberman,et al.  Teaching a robot manipulation skills through demonstration , 2004 .

[42]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[43]  Cynthia Breazeal,et al.  Social interactions in HRI: the robot view , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[44]  U. Ernst,et al.  Cultural Transmission of Enemy Recognition: One Function of Mobbing , 1978, Science.

[45]  A. Meltzoff,et al.  Explaining Facial Imitation: A Theoretical Model. , 1997, Early development & parenting.

[46]  Joseph Terkel,et al.  Cultural Transmission of Feeding Behavior in the Black Rat (Rattus rattus) , 1996 .

[47]  Mitsuo Kawato,et al.  A tennis serve and upswing learning robot based on bi-directional theory , 1998, Neural Networks.

[48]  Bruce Blumberg,et al.  Sympathetic interfaces: using a plush toy to direct synthetic characters , 1999, CHI '99.

[49]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[50]  Gillian M. Hayes,et al.  A Robot Controller Using Learning by Imitation , 1994 .

[51]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[52]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[53]  K HodginsJessica,et al.  Interactive control of avatars animated with human motion data , 2002 .

[54]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[55]  Jodie A. Baird,et al.  Making sense of human behavior: Action parsing and intentional inference , 2001 .

[56]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[57]  C. Breazeal,et al.  Challenges in building robots that imitate people , 2002 .

[58]  Andrew Whiten,et al.  Studies of imitation in chimpanzees and children. , 1996 .

[59]  Yasuharu Koike,et al.  PII: S0893-6080(96)00043-3 , 1997 .

[60]  Bruce Blumberg,et al.  Leashing the AlphaWolves: mixing user direction with autonomous emotion in a pack of semi-autonomous virtual characters , 2002, SCA '02.

[61]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[62]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[63]  Maja J. Mataric,et al.  Experiments in imitation using perceptuo-motor primitives , 2000, AGENTS '00.

[64]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[65]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[66]  Michael A. Huffman,et al.  Acquisition of innovative cultural behaviors in nonhuman primates A case study of stone handling, a socially transmitted behavior in Japanese macaques , 1996 .

[67]  Nadia Magnenat-Thalmann,et al.  Modelling and Motion Capture Techniques for Virtual Environments , 1998, Lecture Notes in Computer Science.

[68]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[69]  S. Klein,et al.  Instrumental conditioning theory and the impact of biological constraints on learning , 2014 .

[70]  Aude Billard,et al.  Experiments on human-robot communication with Robota, an imitative learning and communicating doll robot , 1998 .

[71]  A. Whiten Theories of theories of mind: When does smart behaviour-reading become mind-reading? , 1996 .

[72]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[73]  William Timberlake,et al.  Motivational modes in behavior systems , 2000 .

[74]  G. Carpenter,et al.  Behavioral and Brain Sciences , 1999 .

[75]  R. Gordon Folk Psychology as Simulation , 1986 .

[76]  Cynthia Breazeal,et al.  Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots , 2005, Artificial Life.

[77]  Maja J. Mataric,et al.  Making Complex Articulated Agents Dance , 1999, Autonomous Agents and Multi-Agent Systems.

[78]  M. Tomasello,et al.  Observational learning of tool-use by young chimpanzees , 1987 .

[79]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[80]  Deb Roy,et al.  Conversational Robots: Building Blocks for Grounding Word Meaning , 2003, HLT-NAACL 2003.

[81]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[82]  MICHAEL TOMASELLO,et al.  Five primate species follow the visual gaze of conspecifics , 1998, Animal Behaviour.

[83]  Gillian M. Hayes,et al.  Imitation as a dual-route process featuring prediction and learning components: A biologically plaus , 2002 .

[84]  Damian A. Isla,et al.  Creature Smarts: The Art and Architecture of a Virtual Brain , 2001 .

[85]  H. Evans The Study of Instinct , 1952 .

[86]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[87]  Aaron F. Bobick,et al.  Action recognition using probabilistic parsing , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[88]  MICHAEL TOMASELLO,et al.  Chimpanzees, Pan troglodytes, follow gaze direction geometrically , 1999, Animal Behaviour.

[89]  Bruce Blumberg (void*): a cast of characters , 1999, SIGGRAPH '99.

[90]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[91]  Rosalind W. Picard Affective Computing , 1997 .

[92]  Maja J. Matarić,et al.  Sensory-motor primitives as a basis for imitation: linking perception to action and biology to robotics , 2002 .

[93]  R. Byrne,et al.  Machiavellian intelligence II : extensions and evaluations , 1997 .

[94]  A. Karimi,et al.  Master‟s thesis , 2011 .

[95]  P. Radford,et al.  Imitation , 2023 .

[96]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[97]  Demetri Terzopoulos,et al.  Artificial fishes: physics, locomotion, perception, behavior , 1994, SIGGRAPH.

[98]  What Imitation Tells Us About Social Cognition , 2003 .

[99]  A. Meltzoff Understanding the Intentions of Others: Re-Enactment of Intended Acts by 18-Month-Old Children. , 1995, Developmental psychology.

[100]  Andrea Lockerd Thomaz,et al.  Robot's play: interactive games with sociable machines , 2004, CIE.

[101]  David H. Eberly,et al.  3D Game Engine Design , 2001 .

[102]  G. Csibra Teleological and referential understanding of action in infancy. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[103]  Andrea Lockerd Thomaz,et al.  Teaching and working with robots as a collaboration , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[104]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[105]  Frans B. M. de Waal No imitation without identification , 1998, Behavioral and Brain Sciences.

[106]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[107]  Geir Hovland,et al.  Skill acquisition from human demonstration using a hidden Markov model , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[108]  Norman I. Badler,et al.  Animation control for real-time virtual humans , 1999, CACM.

[109]  William Rowan,et al.  The Study of Instinct , 1953 .

[110]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[111]  Norman I. Badler,et al.  Representing and parameterizing agent behaviors , 2002 .

[112]  M. Tomasello,et al.  Chimpanzees understand psychological states – the question is which ones and to what extent , 2003, Trends in Cognitive Sciences.

[113]  Herbert L. Roitblat Mechanisms of imitation: The relabeled story , 1998, Behavioral and Brain Sciences.

[114]  Bruce Blumberg Go with the flow: synthetic vision for autonomous animated creatures , 1997, AGENTS '97.

[115]  M. Tomasello,et al.  Do chimpanzees know what conspecifics know? , 2001, Animal Behaviour.

[116]  Damian A. Isla,et al.  The virtual hippocampus : spatial common sense for synthetic creatures , 2001 .

[117]  A. Meltzoff,et al.  Imitation, Memory, and the Representation of Persons. , 1994, Infant behavior & development.

[118]  A. Meltzoff Chapter 16 - The Human Infant as Imitative Generalist: A 20-Year Progress Report on Infant Imitation with Implications for Comparative Psychology , 1996 .

[119]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[120]  Martin Davies,et al.  Mental Simulation: Evaluations and Applications - Reading in Mind and Language , 1995 .

[121]  Mikael Heimann When is imitation imitation and who has the right to imitate? , 1998, Behavioral and Brain Sciences.