Implementation of Peripheral Vision in a Hybrid Field of View Sensor

In this article we demonstrate a new vision sensor, which mimics the omnidirectional vision capabilities of insects, and the visual attention mechanisms in more complicated animals. The self-contained sensor is based on a recent single-board embedded computer with a Graphics Processing Unit. It employs an omnidirectional camera and a perspective camera, to provide the ability to quickly recognize objects and events in the vicinity, and to focus the visual attention on selected objects in real-time.

[1]  Fadi Dornaika,et al.  Attentive Wide-Field Sensing for Visual Telepresence and Surveillance , 2004 .

[2]  Davide Scaramuzza,et al.  Omnidirectional Vision: From Calibration to Root Motion Estimation , 2007 .

[3]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Iwan Ulrich,et al.  VFH+: reliable obstacle avoidance for fast mobile robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[5]  Giulio Sandini,et al.  Divergent stereo in autonomous navigation: From bees to robots , 1995, International Journal of Computer Vision.

[6]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[7]  Andrzej Kasiński,et al.  Perception network for the team of indoor mobile robots: concept, architecture, implementation , 2001 .

[8]  Piotr Skrzypczynski,et al.  Hybrid field of view vision: From biological inspirations to integrated sensor design , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[9]  Gordon Cheng,et al.  Foveated vision systems with two cameras per eye , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Stefano Cagnoni,et al.  Hybrid Stereo Sensor with Omnidirectional Vision Capabilities: Overview and Calibration Procedures , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[11]  Marta Rostkowska,et al.  Embedded, GPU-based omnidirectional vision for a walking robot , 2017 .

[12]  Huei-Yung Lin,et al.  HOPIS: Hybrid Omnidirectional and Perspective Imaging System for Mobile Robots , 2014, Sensors.

[13]  Tiejun Chen,et al.  A visual tracking control strategy based on human vision physiological mechanisms , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[14]  S. Wehner,et al.  Insect navigation: use of maps or Ariadne's thread ? , 1990 .

[15]  Piotr Skrzypczyński,et al.  Improving Self-Localization Efficiency in a Small Mobile Robot by Using a Hybrid Field of View Vision System , 2015 .