A Hybrid Bionic Image Sensor Achieving FOV Extension and Foveated Imaging

Based on bionic compound eye and human foveated imaging mechanisms, a hybrid bionic image sensor (HBIS) is proposed in this paper to extend the field of view (FOV) with high resolution. First, the hybrid bionic imaging model was developed and the structure parameters of the HBIS were deduced. Second, the properties of the HBIS were simulated, including FOV extension, super-resolution imaging, foveal ratio and so on. Third, a prototype of the HBIS was developed to validate the theory. Imaging experiments were carried out, and the results are in accordance with the simulations, proving the potential of the HBIS for large FOV and high-resolution imaging with low cost.

[1]  Yaguang Yang.  Analytic Solution of Free Space Optical Beam Steering Using Risley Prisms , 2008, Journal of Lightwave Technology.

[2]  A. Borst,et al.  Optical devices: Seeing the world through an insect's eyes , 2013, Nature.

[3]  Sheng Liu,et al.  Dual-sensor foveated imaging system. , 2008, Applied optics.

[4]  Young Min Song,et al.  COMPU-EYE: a high resolution computational compound eye. , 2016, Optics express.

[5]  Qun Hao,et al.  Reducing defocus aberration of a compound and human hybrid eye using liquid lens. , 2018, Applied optics.

[6]  Rebeca Marfil,et al.  Data-Driven Multiresolution Camera Using the Foveal Adaptive Pyramid , 2016, Sensors.

[7]  Ying Yuan,et al.  Design of microcamera for field curvature and distortion correction in monocentric multiscale foveated imaging system , 2017 .

[8]  Riad Haïdar,et al.  MULTICAM: a miniature cryogenic camera for infrared detection , 2008, SPIE Photonics Europe.

[9]  Guillem Carles,et al.  Multi-aperture foveated imaging. , 2016, Optics letters.

[10]  Viktor Malyarchuk,et al.  Digital cameras with designs inspired by the arthropod eye , 2013, Nature.

[11]  Jie Cao,et al.  Design and realization of retina-like three-dimensional imaging based on a MOEMS mirror , 2016 .

[12]  Andrew R Harvey,et al.  Super-resolution imaging using a camera array. , 2014, Optics letters.

[13]  S. W. Zhang,et al.  Eye-specific learning of routes and “signposts” by walking honeybees , 1998, Journal of Comparative Physiology A.

[14]  Gordon Cheng,et al.  Foveated vision systems with two cameras per eye , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[15]  Benoit Ricard,et al.  Fast Risley prisms camera steering system: calibration and image distortions correction through the use of a three-dimensional refraction model , 2007 .

[16]  David J. Brady,et al.  Multiscale gigapixel photography , 2012, Nature.

[17]  Luigi Fortuna,et al.  An object oriented segmentation on analog CNN chip , 2003 .

[18]  Qun Hao,et al.  Compound eye and retina-like combination sensor with a large field of view based on a space-variant curved micro lens array. , 2017, Applied optics.

[19]  Weixing Yu,et al.  SCECam: a spherical compound eye camera for fast location and recognition of objects at a large field of view , 2017 .

[20]  Heung Cho Ko,et al.  A hemispherical electronic eye camera based on compressible silicon optoelectronics , 2008, Nature.

[21]  Danica Kragic,et al.  An Active Vision System for Detecting, Fixating and Manipulating Objects in the Real World , 2010, Int. J. Robotics Res..

[22]  Kang Wei,et al.  Insect-Human Hybrid Eye (IHHE): an adaptive optofluidic lens combining the structural characteristics of insect and human eyes. , 2014, Lab on a chip.

[23]  G. Y. Belay,et al.  Demonstration of a multichannel, multiresolution imaging system. , 2013, Applied optics.

[24]  Yajun Li.  Closed form analytical inverse solutions for Risley-prism-based beam steering systems in different configurations. , 2011, Applied optics.

[25]  Yi Qin,et al.  Continuously zoom imaging probe for the multi-resolution foveated laparoscope. , 2016, Biomedical optics express.

[26]  Illah Nourbakhsh,et al.  Timelapse GigaPan: Capturing, Sharing, and Exploring Timelapse Gigapixel Imagery , 2010 .

[27]  Ming Zhu,et al.  Artificial compound eye: a survey of the state-of-the-art , 2016, Artificial Intelligence Review.

[28]  Luke P. Lee,et al.  Biologically Inspired Artificial Compound Eyes , 2006, Science.

[29]  P Arena,et al.  Cellular neural networks for real-time DNA microarray analysis. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[30]  Gary D. Bernard,et al.  The effect of motion on visual acuity of the compound eye: A theoretical analysis , 1975, Vision Research.

[31]  Hanspeter A. Mallot,et al.  Hardware Architecture and Cutting-Edge Assembly Process of a Tiny Curved Compound Eye , 2014, Sensors.

[32]  Anhu Li,et al.  Forward and inverse solutions for three-element Risley prism beam scanners. , 2017, Optics express.

[33]  Frank Wippermann,et al.  Micro-optical artificial compound eyes. , 2006 .

[34]  Dario Floreano,et al.  Miniature curved artificial compound eyes , 2013, Proceedings of the National Academy of Sciences.

[35]  R. S. Prabhakara,et al.  Motion Detection: A Biomimetic Vision Sensor Versus a CCD Camera Sensor , 2012, IEEE Sensors Journal.