The cog project: building a humanoid robot

To explore issues of developmental structure, physical embodiment, integration of multiple sensory and motor systems, and social interaction, we have constructed an upper-torso humanoid robot called Cog. The robot has twenty-one degrees of freedom and a variety of sensory systems, including visual, auditory, vestibular, kinesthetic, and tactile senses. This chapter gives a background on the methodology that we have used in our investigations, highlights the research issues that have been raised during this project, and provides a summary of both the current state of the project and our long-term goals. We report on a variety of implemented visual-motor routines (smooth-pursuit tracking, saccades, binocular vergence, and vestibular-ocular and opto-kinetic reflexes), orientation behaviors, motor control techniques, and social behaviors (pointing to a visual target, recognizing joint attention through face and eye finding, imitation of head nods, and regulating interaction through expressive feedback). We further outline a number of areas for future research that will be necessary to build a complete embodied system.

[1]  Kenneth L. Artis.  Design for a Brain , 1961 .

[2]  M. Wertheimer.  Psychomotor Coordination of Auditory and Visual Space at Birth , 1961, Science.

[3]  B. Foss.  New Horizons in Psychology 1 , 1966 .

[4]  M. O’Brien.  “Posture” , 1979 .

[5]  Marvin Minsky,et al.  Proposal to ARPA for Research on Artificial Intelligence at MIT, 1970-1971 , 1970 .

[6]  M. Halliday.  Learning How to Mean: Explorations in the Development of Language , 1975 .

[7]  S. D. Glick,et al.  Changes in sensitivity of morphine-induced circling behaviour after chronic treatment and persistence after withdrawal in rats , 1976, Nature.

[8]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[9]  Joseph E LeDoux,et al.  The Integrated Mind , 1978, Springer US.

[10]  M. Bullowa.  Before Speech: The Beginning of Interpersonal Communication , 1979 .

[11]  C. Trevarthen.  Communication and cooperation in early infancy: a description of primary intersubjectivity , 1979 .

[12]  B. Troost,et al.  The ocular motor system , 1981, Annals of neurology.

[13]  P. H. Greene,et al.  Why is it easy to control your arms ? , 1982, Journal of motor behavior.

[14]  S. Cannon,et al.  The mechanical behavior of active human skeletal muscle in small oscillations. , 1982, Journal of biomechanics.

[15]  R. Karrer,et al.  Movement-related potentials during development: a replication and extension of relationships to age, motor control, mental status and IQ. , 1984, The International journal of neuroscience.

[16]  E I Knudsen,et al.  Vision guides the adjustment of auditory localization in young barn owls. , 1985, Science.

[17]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[19]  L. Weiskrantz.  Blindsight : a case study and implications , 1986 .

[20]  J. Murphy,et al.  Measurements of human forearm viscoelasticity. , 1986, Journal of biomechanics.

[21]  F. Volkmar,et al.  Handbook of Autism and Pervasive Developmental Disorders , 1987 .

[22]  S. Gruber,et al.  Robot hands and the mechanics of manipulation , 1987, Proceedings of the IEEE.

[23]  T. Odlin.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[24]  John Kenneth Salisbury,et al.  Preliminary design of a whole-arm manipulation system (WAMS) , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[25]  M. Wiznitzer,et al.  AIDS and the Nervous System , 1988, Neurology.

[26]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[27]  U. Frrrh.  Autism: explaining the enigma , 1989 .

[28]  F. Zajac.  Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[29]  R. Schmidt,et al.  Changes in limb dynamics during the practice of rapid arm movements. , 1989, Journal of biomechanics.

[30]  A. Diamond.  Developmental Time Course in Human Infants and Infant Monkeys, and the Neural Bases of, Inhibitory Control in Reaching a , 1990, Annals of the New York Academy of Sciences.

[31]  Tad McGeer,et al.  Passive walking with knees , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[32]  Dominic W. Massaro,et al.  Synthesis of visible speech , 1990 .

[33]  Adèle,et al.  The Development and Neural Bases of Higher Cognitive Functions. A conference. May 20-24, 1989, Philadelphia, Pa. , 1990, Annals of the New York Academy of Sciences.

[34]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[35]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[36]  S. G. Lisberger,et al.  Motor learning in a recurrent network model based on the vestibulo–ocular reflex , 1992, Nature.

[37]  Mark H. Johnson.  Brain development and cognition : a reader , 1993 .

[38]  Stefan Schaal,et al.  Open loop stable control strategies for robot juggling , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[39]  Loukia D. Loukopoulos,et al.  Knowledge Model for Selecting and Producing Reaching Movements. , 1993, Journal of motor behavior.

[40]  T. Sejnowski,et al.  A critique of pure vision , 1993 .

[41]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[42]  Rodney A. Brooks,et al.  Building brains for bodies , 1995, Auton. Robots.

[43]  R. Hobson.  Autism and the Development of Mind , 1995 .

[44]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[45]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[46]  Pawan Sinha,et al.  Perceiving and recognizing three-dimensional forms , 1996 .

[47]  Matthew M. Williamson,et al.  Series elastic actuators , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[48]  C. Breazeal,et al.  An Ontogenetic Perspective to Scaling Sensorimotor Intelligence , 1996 .

[49]  Pattie Maes,et al.  Postural primitives: Interactive Behavior for a Humanoid Robot Arm , 1996 .

[50]  W. Warren,et al.  Resonance Tuning in Rhythmic Arm Movements. , 1996, Journal of motor behavior.

[51]  Tom Costello,et al.  Beyond Minimizing Change , 1997, AAAI/IAAI.

[52]  Hudson Turner,et al.  Causal Theories of Action and Change , 1997, AAAI/IAAI.

[53]  Ronen I. Brafman,et al.  Planning with Concurrent Interacting Actions , 1997, AAAI/IAAI.

[54]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[55]  Milos Hauskrecht,et al.  Incremental Methods for Computing Bounds in Partially Observable Markov Decision Processes , 1997, AAAI/IAAI.

[56]  Michael L. Littman,et al.  Probabilistic Propositional Planning: Representations and Complexity , 1997, AAAI/IAAI.

[57]  Manuela M. Veloso,et al.  Analogical Replay for Efficient Conditional Planning , 1997, AAAI/IAAI.

[58]  Ronen I. Brafman,et al.  A Heuristic Variable Grid Solution Method for POMDPs , 1997, AAAI/IAAI.

[59]  Jorge Lobo,et al.  Adding Knowledge to the Action Description Language A , 1997, AAAI/IAAI.

[60]  D. Parmelee,et al.  Handbook of Autism and Pervasive Developmental Disorders, Second Edition , 1998 .

[61]  Brian Scassellati,et al.  Alternative Essences of Intelligence , 1998, AAAI/IAAI.

[62]  Cynthia Breazeal,et al.  A Motivational System for Regulating Human-Robot Interaction , 1998, AAAI/IAAI.

[63]  Giulio Sandini,et al.  Oculo-motor stabilization reflexes: integration of inertial and visual information , 1998, Neural Networks.

[64]  Junji Yamato.  Tracking moving object by stereo vision head with vergence for humanoid robot , 1998 .

[65]  Brian Scassellati.  Mechanisms of Shared Attention for a Humanoid Robot , 1998 .

[66]  Masayuki Inaba,et al.  Development of a remote-brained humanoid for research on whole body action , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[67]  Matthew M. Williamson,et al.  Exploiting Natural Dynamics in Robot Control , 1998 .

[68]  Koji Shibuya,et al.  Design and control of mobile manipulation system for human symbiotic humanoid: Hadaly-2 , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[69]  T. Takenaka,et al.  The development of Honda humanoid robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[70]  B. Scassellati.  Building Behaviors Developmentally: A New Formalism , 1998 .

[71]  Brian Scassellati.  A Binocular, Foveated Active Vision System , 1998 .

[72]  Matthew M. Williamson,et al.  Rhythmic robot arm control using oscillators , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[73]  B. Scassellati.  Imitation and mechanisms of joint attention: a developmental structure for building social skills on a humanoid robot , 1999 .

[74]  Cynthia Breazeal,et al.  Toward Teaching a Robot "Infant" using Emotive Communication Acts , 1999 .

[75]  Brian Scassellati,et al.  Infant-like Social Interactions between a Robot and a Human Caregiver , 2000, Adapt. Behav..

[76]  J. Ridley.  Studies of Interference in Serial Verbal Reactions , 2001 .