An insect-inspired omnidirectional vision system including UV-sensitivity and polarisation

A major difference between insect vision and that of humans or standard computer vision systems is that insects are sensitive to the polarisation pattern of skylight, and also to the near-UV range of the electromagnetic spectrum. In this paper, we describe a bio-inspired imaging system that allows us to assess to what extent these features could potentially be used for autonomous robot navigation. We first establish that a low-resolution omnidirectional system incorporating a near-UV camera and a linear polariser - a simulacrum of the dorsal rim area of the insect compound eye - can resolve the clear sky natural polarisation pattern with sufficient accuracy to allow its use as a navigational tool. We then extend the bio-mimicry by incorporating an additional RGB camera, allowing us to utilise the full range of the insect's visual spectrum. This enables us to capture and investigate the visual cues insects are employing for flight control and navigation, and paves the way for incorporating a similar system in an autonomous mobile robot. Additionally, we present a robust method for estimating sun position based on the polarisation pattern and thus confirm the utility of the system as a sky compass.

[1]  K. Voss,et al.  Polarized radiance distribution measurements of skylight. I. System description and characterization. , 1997, Applied optics.

[2]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[3]  Hiroshi Kobayashi,et al.  An Autonomous Agent Navigating with a Polarized Light Compass , 1997, Adapt. Behav..

[4]  G. Hass,et al.  Optical Constants and Reflectance and Transmittance of Evaporated Aluminum in the Visible and Ultraviolet , 1961 .

[5]  Thomas Labhart,et al.  Polarization-opponent interneurons in the insect visual system , 1988, Nature.

[6]  W. Marsden I and J , 2012 .

[7]  H. Kwok,et al.  Optical wire-grid polarizers at oblique angles of incidence , 2003 .

[8]  Wolfram Schenck,et al.  Spectral contrasts for landmark navigation. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  A. C. Nyce,et al.  Optical constants of bulk and thin-film aluminum at 6328 Angstroms , 1975 .

[10]  M. E. Cox Handbook of Optics , 1980 .

[11]  R. Siegwart,et al.  A Practical Toolbox for Calibrating Omnidirectional Cameras , 2007 .

[12]  Katsushi Ikeuchi,et al.  Estimating Sunlight Polarization Using a Fish-eye Lens , 2009, IPSJ Trans. Comput. Vis. Appl..

[13]  R. Wehner,et al.  Polarization patterns of the summer sky and its neutral points measured by full–sky imaging polarimetry in Finnish Lapland north of the Arctic Circle , 2001, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[14]  Andrew M. Wallace,et al.  Improving Depth Image Acquisition Using Polarized Light , 1999, International Journal of Computer Vision.

[15]  N. Franceschini,et al.  A Bio-Inspired Flying Robot Sheds Light on Insect Piloting Abilities , 2007, Current Biology.

[16]  J. Bartl,et al.  Emissivity of aluminium and its importance for radiometric measurement , 2004 .

[17]  G Gabrielse,et al.  Measurement of the Stokes parameters of light. , 1977, Applied optics.

[18]  Svetha Venkatesh,et al.  Robot navigation inspired by principles of insect vision , 1999, Robotics Auton. Syst..

[19]  R. K. Hart The oxidation of aluminium in dry and humid oxygen atmospheres , 1956, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[20]  Ronghua Li,et al.  Application of a novel polarization sensor to mobile robot navigation , 2009, 2009 International Conference on Mechatronics and Automation.

[21]  Gert Stange,et al.  Design concepts for a novel attitude sensor for Micro Air Vehicles, based on dragonfly ocellar vision , 2007 .

[22]  M J Duggin,et al.  Stokes vector imaging of the polarized sky-dome. , 1997, Applied optics.

[23]  Andreas Macke,et al.  Total and partial cloud amount detection during summer 2005 at Westerland (Sylt, Germany) , 2008 .