Bioinspired polarization imager with high dynamic range

Polarization is one of the three fundamental properties of light, along with color and intensity, yet most vertebrate species, including humans, are blind with respect to this light modality. In contrast, many invertebrates, including insects, spiders, cephalopods, and stomatopods, have evolved to detect polarization information with high-dynamic-range photosensitive cells and utilize this information in visually guided behavior. In this paper, we present a high-dynamic-range polarization imaging sensor inspired by the visual system of the mantis shrimp. Our bioinspired imager achieves 140 dB dynamic range and 61 dB maximum signal-to-noise ratio across 384×288 pixels equipped with logarithmic photodiodes. Contrary to state-of-the-art active pixel sensors, where photodiodes in individual pixels operate in reverse bias mode and yield up to ∼60  dB dynamic range, our pixel has a logarithmic response by operating individual photodiodes in forward bias mode. This novel pixel circuitry is monolithically integrated with pixelated polarization filters composed of 250-nm-tall × 75-nm-wide aluminum nanowires to enable snapshot polarization imaging at 30 frames per second. This sensor can enable many automotive and remote sensing applications, where high-dynamic-range imaging augmented with polarization information can provide critical information during hazy or rainy conditions.

[1]  Sanshiro Shishido,et al.  Image sensor pixel with on-chip high extinction ratio polarizer based on 65-nm standard CMOS technology. , 2013, Optics express.

[2]  J Scott Tyo,et al.  Review of passive imaging polarimetry for remote sensing applications. , 2006, Applied optics.

[3]  Ronghua Li,et al.  Application of a novel polarization sensor to mobile robot navigation , 2009, 2009 International Conference on Mechatronics and Automation.

[4]  Xiaofeng He,et al.  Design and Calibration of a Novel Bio-Inspired Pixelated Polarized Light Compass , 2017, Sensors.

[5]  B.J. Hosticka,et al.  A high dynamic range CMOS image sensor for automotive applications , 2000, Proceedings of the 25th European Solid-State Circuits Conference.

[6]  V. Neel,et al.  Multimodal polarization system for imaging skin cancer , 2009 .

[7]  Dmitry Vorobiev,et al.  Astronomical Polarimetry with the RIT Polarization Imaging Camera , 2017, 1710.04255.

[8]  Jan Van der Spiegel,et al.  Bioinspired Focal-Plane Polarization Image Sensor Design: From Application to Implementation , 2014, Proceedings of the IEEE.

[9]  V. Gruev,et al.  Characterization of a visible spectrum division-of-focal-plane polarimeter. , 2012, Applied optics.

[10]  S. Tominaga,et al.  Polarization imaging for material classification , 2008 .

[11]  Viktor Gruev,et al.  Bio-inspired color-polarization imager for real-time in situ imaging , 2017 .

[12]  Viktor Gruev,et al.  Bioinspired Polarization Imaging Sensors: From Circuits and Optics to Signal Processing Algorithms and Biomedical Applications , 2014, Proceedings of the IEEE.

[13]  Amine Bermak,et al.  High-resolution thin "guest-host" micropolarizer arrays for visible imaging polarimetry. , 2011, Optics express.

[14]  R. Chipman,et al.  Liquid crystal polymer full-stokes division of focal plane polarimeter. , 2012, Optics express.

[15]  Yusuke Oike,et al.  3.2-MP Back-Illuminated Polarization Image Sensor With Four-Directional Air-Gap Wire Grid and 2.5- $\mu$ m Pixels , 2018, IEEE Transactions on Electron Devices.

[16]  Ye Wang,et al.  Division of focal plane polarimeter-based 3 × 4 Mueller matrix microscope: a potential tool for quick diagnosis of human carcinoma tissues , 2016, Journal of biomedical optics.

[17]  Masaaki Sakakura,et al.  Polarization imaging camera with a waveplate array fabricated with a femtosecond laser inside silica glass. , 2017, Optics express.

[18]  Roman Garnett,et al.  Bioinspired polarization vision enables underwater geolocalization , 2018, Science Advances.

[19]  Hyunsung Park,et al.  Elliptical silicon nanowire photodetectors for polarization-resolved imaging. , 2015, Optics express.

[20]  V. Gruev,et al.  CCD polarization imaging sensor with aluminum nanowire optical filters. , 2010, Optics express.

[21]  Jun Ohta,et al.  Polarisation-analysing CMOS photosensor with monolithically embedded wire grid polariser , 2009 .

[22]  Olivier Morel,et al.  Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging. , 2006, Applied optics.

[23]  J S Tyo,et al.  Target detection in optically scattering media by polarization-difference imaging. , 1996, Applied optics.

[24]  V. Gruev Fabrication of a dual-layer aluminum nanowires polarization filter array. , 2011, Optics express.

[25]  V. Gruev,et al.  Calibration methods for division-of-focal-plane polarimeters. , 2013, Optics express.

[26]  Ralph Etienne-Cummings,et al.  VLSI Implementation of Motion Centroid Localization for Autonomous Navigation , 1998, NIPS.

[27]  R. Pfeifer,et al.  A mobile robot employing insect strategies for navigation , 2000, Robotics Auton. Syst..

[28]  Yoav Y. Schechner,et al.  Blind Haze Separation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[29]  A. J. P. Theuwissen,et al.  Biologically Inspired CMOS Image Sensor for Fast Motion and Polarization Detection , 2013, IEEE Sensors Journal.

[30]  Viktor Gruev,et al.  Bilinear and bicubic interpolation methods for division of focal plane polarimeters. , 2011, Optics express.

[31]  Missael Garcia,et al.  Trimodal color-fluorescence-polarization endoscopy aided by a tumor selective molecular probe accurately detects flat lesions in colitis-associated cancer , 2014, Journal of biomedical optics.

[32]  Shuai Zhang,et al.  A Bionic Camera-Based Polarization Navigation Sensor , 2014, Sensors.

[33]  V. Gruev,et al.  Polarization signaling in swordtails alters female mate preference , 2014, Proceedings of the National Academy of Sciences.

[34]  Igor Meglinski,et al.  Application of circularly polarized light for non‐invasive diagnosis of cancerous tissues and turbid tissue‐like scattering media , 2015, Journal of biophotonics.

[35]  Missael Garcia,et al.  Bio-inspired imager improves sensitivity in near-infrared fluorescence image-guided surgery. , 2018, Optica.

[36]  Shree K. Nayar,et al.  Polarization-based vision through haze , 2003 .

[37]  L. Gonzo,et al.  Novel CMOS image sensor with a 132-dB dynamic range , 2002, IEEE J. Solid State Circuits.

[38]  J Scott Tyo,et al.  Optimizing imaging polarimeters constructed with imperfect optics. , 2006, Applied optics.

[39]  Xiaojin Zhao,et al.  Thin Photo-Patterned Micropolarizer Array for CMOS Image Sensors , 2009, IEEE Photonics Technology Letters.

[40]  V. Gruev,et al.  Surface normal reconstruction using circularly polarized light. , 2015, Optics express.