Bio-inspired pixel-wise adaptive imaging

The range of luminance levels in the natural world varies in the order of 108, significantly larger than the 8-bits employed by most digital imaging systems. To overcome their limited dynamic range traditional systems rely on the fact that the dynamic range of a scene is typically much lower, and by adjusting a global gain factor (shutter speed) it is possible to acquire usable images. However in many situations 8-bits of dynamic range is insufficient, meaning potentially useful information, lying outside of the dynamic range of the device, is lost. Traditional approaches to solving this have involved using nonlinear gamma tables to compress the range, hence reducing contrast in the digitized scene, or using 16-bit imaging devices, which use more bandwidth and are incompatible with most recording media and software post-processing techniques. This paper describes an algorithm, based on biological vision, which overcomes many of these problems. The algorithm reduces the redundancy of visual information and compresses the data observed in the real world into a significantly lower bandwidth signal, better suited for traditional 8-bit image processing and display. However, most importantly, no potentially useful information is lost and the contrast of the scene is enhanced in areas of high informational content (where there are changes) and reduced in areas containing low information content (where there are no changes). Thus making higher-order tasks, such as object identification and tracking, easier as redundant information has already been removed.

[1]  Jordi Madrenas,et al.  Design and basic blocks of a neuromorphic VLSI analogue vision system , 2006, Neurocomputing.

[2]  David C. O'Carroll,et al.  A neuromorphic model for a robust, adaptive photoreceptor reduces variability in correlation based motion detectors , 2006 .

[3]  Sumanta N. Pattanaik,et al.  Adaptive gain control for high dynamic range image display , 2002, SCCG '02.

[4]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[5]  Rob R. de Ruyter van Steveninck,et al.  The metabolic cost of neural information , 1998, Nature Neuroscience.

[6]  Christof Koch,et al.  A Robust Analog VLSI Reichardt Motion Sensor , 2000 .

[7]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[8]  M. Ibbotson,et al.  An adaptive Reichardt detector model of motion adaptation in insects and mammals , 1997, Visual Neuroscience.

[9]  S. Laughlin,et al.  Changes in the intensity-response function of an insect's photoreceptors due to light adaptation , 1981, Journal of comparative physiology.

[10]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[11]  J. Howard,et al.  Response of an insect photoreceptor: a simple log-normal model , 1981, Nature.

[12]  S. Laughlin,et al.  The rate of information transfer at graded-potential synapses , 1996, Nature.

[13]  H. P. Snippe,et al.  Phototransduction in primate cones and blowfly photoreceptors: different mechanisms, different algorithms, similar response , 2005, Journal of Comparative Physiology A.

[14]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[15]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, SIGGRAPH 2004.

[16]  Eng-Leng Mah,et al.  Bio-inspired analog circuitry model of insect photoreceptor cells , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[17]  Patrick A. Shoemaker,et al.  Implementation of visual motion detection with contrast adaptation , 2001, SPIE Micro + Nano Materials, Devices, and Applications.