Adaptation of orienting behavior: from the barn owl to a robotic system

Autonomous robotic systems need to adjust their sensorimotor coordinations so as to maintain good performance in the presence of changes in their sensory and motor characteristics. Biological systems are able to adapt to large variations in their physical and functional properties. In the last decade, the adjustment of orienting behavior has been carefully investigated in the barn owl, a nocturnal predator with highly developed auditory capabilities. We have previously proposed that the development and maintenance of the barn owl's accurate orienting behavior can be explained through a process of learning based on the saliency of sensorimotor events. In this paper we consider the application of a detailed computer model of the principal neural structures involved in the process of spatial localization in the barn owl to the control of the orienting behavior of a robotic system, in the presence of auditory and visual stimulation. The system is composed of a robotic head equipped with two lateral microphones and a camera. We show that the model produces accurate orienting behavior toward both auditory and visual targets and is able to quickly recover good performance after alterations of the sensory inputs and motor outputs. The results illustrate that an architecture specifically designed to account for biological phenomena can produce flexible and robust motor control of a robotic system operating in the real world.

[1]  E. Knudsen,et al.  Creating a unified representation of visual and auditory space in the brain. , 1995, Annual review of neuroscience.

[2]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[3]  J. Brant Arseneau,et al.  VLSI and neural systems , 1990 .

[4]  M Konishi,et al.  Listening with two ears. , 1993, Scientific American.

[5]  John M. Hollerbach,et al.  Autonomous calibration of single-loop closed kinematic chains formed by manipulators with passive endpoint constraints , 1991, IEEE Trans. Robotics Autom..

[6]  H. Wagner,et al.  Representation of interaural time difference in the central nucleus of the barn owl's inferior colliculus , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  E I Knudsen,et al.  Visual instruction of the neural map of auditory space in the developing optic tectum. , 1991, Science.

[8]  Peter J. Burt,et al.  Smart sensing within a pyramid vision machine , 1988, Proc. IEEE.

[9]  E. Knudsen,et al.  Experience-dependent plasticity in the inferior colliculus: a site for visual calibration of the neural representation of auditory space in the barn owl , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  A. King,et al.  Auditory function: Neurobiological bases of hearing G.M. Edelman W.E. , 1990, Neuroscience.

[11]  M. Konishi,et al.  Selectivity for interaural time difference in the owl's midbrain , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  E I Knudsen,et al.  Receptive fields of auditory neurons in the owl. , 1977, Science.

[13]  D. Taghirad.  Ieee Transactions on Robotics and Automation 1 Robust Torque Control of Harmonic Drive Systems , 1997 .

[14]  B. Stein,et al.  Sources of subcortical projections to the superior colliculus in the cat , 1979, The Journal of comparative neurology.

[15]  Masakazu Konishi.  Centrally synthesized maps of sensory space , 1986, Trends in Neurosciences.

[16]  Ruzena Bajcsy,et al.  Learning visuo-tactile coordination in robotic systems , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[17]  G. C. Thompson,et al.  Serotonin and Serotonin Receptors in the Central Auditory System , 1994, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[18]  Karl J. Friston,et al.  Value-dependent selection in the brain: Simulation in a synthetic neural model , 1994, Neuroscience.

[19]  Irwin Sobel,et al.  On Calibrating Computer Controlled Cameras for Perceiving 3-D Scenes , 1973, IJCAI.

[20]  E. Knudsen.  Subdivisions of the inferior colliculus in the barn owl (Tyto alba) , 1983, The Journal of comparative neurology.

[21]  G. Hirzinger.  The state of the art of robot learning control using artificial neural networks—an overview , 1992 .

[22]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[23]  S DeMa,et al.  A self-calibration technique for active vision systems , 1996 .

[24]  E I Knudsen,et al.  Site of auditory plasticity in the brain stem (VLVp) of the owl revealed by early monaural occlusion. , 1994, Journal of neurophysiology.

[25]  E I Knudsen,et al.  Vision-independent adjustment of unit tuning to sound localization cues in response to monaural occlusion in developing owl optic tectum , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  H. Wagner,et al.  Neurophysiological and anatomical substrates of sound localization in the owl , 1988 .

[27]  B. Stein,et al.  The Merging of the Senses , 1993 .

[28]  Nikolaos Papanikolopoulos,et al.  Six degree-of-freedom hand/eye visual tracking with uncertain parameters , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[29]  W. Singer,et al.  Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation , 1993, Trends in Neurosciences.

[30]  Richard S. Sutton,et al.  Neural networks for control , 1990 .

[31]  Svetha Venkatesh,et al.  From Living Eyes to Seeing Machines , 1997 .

[32]  Nicolas H. Franceschini.  Vision, flies, neurons and robots , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[33]  M Rucci,et al.  Registration of Neural Maps through Value-Dependent Learning: Modeling the Alignment of Auditory and Visual Maps in the Barn Owl’s Optic Tectum , 1997, The Journal of Neuroscience.

[34]  David W. Murray,et al.  Active Camera Calibration for a Head-Eye Platform Using the Variable State-Dimension Filter , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Olaf Sporns,et al.  Synthetic neural modeling: the 'Darwin' series of recognition automata , 1990, Proc. IEEE.

[36]  Paolo Dario,et al.  Attentive behavior in an anthropomorphic robot vision system , 1994, Robotics Auton. Syst..

[37]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Richard I. Hartley.  Self-Calibration from Multiple Views with a Rotating Camera , 1994, ECCV.

[39]  Gregory D. Hager,et al.  A modular system for robust positioning using feedback from stereo vision , 1997, IEEE Trans. Robotics Autom..

[40]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[42]  I. Fujita,et al.  The role of GABAergic inhibition in processing of interaural time difference in the owl's auditory system , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  E. Knudsen,et al.  Adaptive adjustment of unit tuning to sound localization cues in response to monaural occlusion in developing owl optic tectum , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  E. Knudsen,et al.  Vision calibrates sound localization in developing barn owls , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[46]  E I Knudsen,et al.  Neural maps of head movement vector and speed in the optic tectum of the barn owl. , 1990, Journal of neurophysiology.

[47]  M. Konishi,et al.  A circuit for detection of interaural time differences in the brain stem of the barn owl , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[49]  James S. Albus,et al.  Brains, behavior, and robotics , 1981 .

[50]  M. Konishi,et al.  Tolerance to Sound Intensity of Binaural Coincidence Detection in the Nucleus Laminaris of the Owl , 1996, The Journal of Neuroscience.

[51]  Peter K. Allen,et al.  Alignment using an uncalibrated camera system , 1995, IEEE Trans. Robotics Autom..

[52]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[53]  Giulio Sandini,et al.  Robust visual servoing in 3-D reaching tasks , 1996, IEEE Trans. Robotics Autom..

[54]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[55]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[56]  A.L. Abbott,et al.  A survey of selective fixation control for machine vision , 1992, IEEE Control Systems.

[57]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[58]  E I Knudsen,et al.  Early visual deprivation results in a degraded motor map in the optic tectum of barn owls. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[59]  John M. Hollerbach,et al.  Autonomous Robot Calibration for Hand-Eye Coordination , 1991, Int. J. Robotics Res..

[60]  R. Bajcsy.  Active perception , 1988 .

[61]  E I Knudsen,et al.  A neural map of auditory space in the owl. , 1978, Science.

[62]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[63]  Michael Brady,et al.  Self-calibration of the intrinsic parameters of cameras for active vision systems , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.