From biokinematics to a robotic active vision system

Barn owls move their heads in very particular motions, compensating for the quasi-immovability of their eyes. These efficient predators often perform peering side-to-side head motions when scanning their surroundings and seeking prey. In this work, we use the head movements of barn owls as a model to bridge between biological active vision and machine vision. The biomotions are measured and used to actuate a specially built robot equipped with a depth camera for scanning. We hypothesize that the biomotions improve scan accuracy of static objects. Our experiments show that barn owl biomotion-based trajectories consistently improve scan accuracy when compared to intuitive scanning motions. This constitutes proof-of-concept evidence that the vision of robotic systems can be enhanced by bio-inspired viewpoint manipulation. Such biomimetic scanning systems can have many applications, e.g. manufacturing inspection or in autonomous robots.

[1]  Ehud Rivlin,et al.  Head Movements for Depth Perception: Praying Mantis versus Pigeon , 2005 .

[2]  Hermann Wagner,et al.  The Cervical Spine of the American Barn Owl (Tyto furcata pratincola): I. Anatomy of the Vertebrae and Regionalization in Their S-Shaped Arrangement , 2014, PloS one.

[3]  David Eilam,et al.  How barn owls (Tyto alba) visually follow moving voles (Microtus socialis) before attacking them , 2009, Physiology & Behavior.

[4]  H. Wagner,et al.  Muscular Arrangement and Muscle Attachment Sites in the Cervical Region of the American Barn Owl (Tyto furcata pratincola) , 2015, PloS one.

[5]  R. Segev,et al.  Orientation saliency without visual cortex and target selection in archer fish , 2010, Proceedings of the National Academy of Sciences.

[6]  Alon Wolf,et al.  Biokinematic Study of Barn Owl Head Movements for the Development of a Bio-Inspired Active Vision Robotic System , 2012, ARK.

[7]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[8]  Hermann Wagner,et al.  Stereoscopic depth perception in the owl , 1998, Neuroreport.

[9]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[10]  Hermann Wagner,et al.  Visual-auditory integration for visual search: a behavioral study in barn owls , 2015, Front. Integr. Neurosci..

[11]  Thomas S. Collett,et al.  SHORT COMMUNICATION PEERING - A LOCUST BEHAVIOUR PATTERN FOR OBTAINING MOTION PARALLAX INFORMATION , 1978 .

[12]  M J Steinbach,et al.  Eye movements of the owl. , 1973, Vision research.

[13]  H. R. Wallace.  THE MOVEMENT OF EELWORMS IN WATER FILMS , 1959 .

[14]  Ehud Rivlin,et al.  Through a barn owl’s eyes: interactions between scene content and visual attention , 2008, Biological Cybernetics.

[15]  Ehud Rivlin,et al.  On the barn owl’s visual pre-attack behavior: I. Structure of head movements and motion patterns , 2006, Journal of Comparative Physiology A.

[16]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[17]  J. Findlay.  Active vision: Visual activity in everyday life , 1998, Current Biology.

[18]  Daniel Bullock,et al.  Integrating robotics and neuroscience: brains for robots, bodies for brains , 2007, Adv. Robotics.

[19]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[20]  Hermann Wagner,et al.  Depth generalization from stereo to motion parallax in the owl , 2002, Journal of Comparative Physiology A.

[21]  Ohad Ben-Shahar,et al.  Overt attention toward oriented objects in free-viewing barn owls , 2011, Proceedings of the National Academy of Sciences.

[22]  J. Wolfe.  Visual search in continuous, naturalistic stimuli , 1994, Vision Research.

[23]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[24]  Mandyam V. Srinivasan,et al.  Active vision in honeybees: Task-oriented suppression of an innate behaviour , 1994, Vision Research.

[25]  E I Knudsen,et al.  Neural maps of head movement vector and speed in the optic tectum of the barn owl. , 1990, Journal of neurophysiology.

[26]  R. F. van der Willigen,et al.  Owls see in stereo much like humans do , 2011 .

[27]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[28]  Pushmeet Kohli,et al.  When Can We Use KinectFusion for Ground Truth Acquisition , 2012 .