Vibrating Makes for Better Seeing: From the Fly’s Micro-Eye Movements to Hyperacute Visual Sensors

Active vision means that visual perception not only depends closely on the subject’s own movements, but that these movements actually contribute to the visual perceptual processes. Vertebrates’ and invertebrates’ eye movements are probably part of an active visual process, but their exact role still remains to be determined. In this paper, studies on the retinal micro-movements occurring in the compound eye of the fly are reviewed. Several authors have located and identified the muscles involved in these small retinal movements. Others have established that these retinal micro-movements occur in walking and flying flies, but their exact functional role still remains to be determined. Many robotic studies have been performed in which animals’ (flies’ and spiders’) miniature eye movements have been modeled, simulated, and even implemented mechanically. Several robotic platforms have been endowed with artificial visual sensors performing periodic micro-scanning movements. Artificial eyes performing these active retinal micro-movements have some extremely interesting properties, such as hyperacuity and the ability to detect very slow movements (motion hyperacuity). The fundamental role of miniature eye movements still remains to be described in detail, but several studies on natural and artificial eyes have advanced considerably toward this goal.

[1]  D. Sandeman,et al.  Eye-scanning during walking in the crabLeptograpsus variegatus , 1978, Journal of comparative physiology.

[2]  Isao Shimoyama,et al.  Visual guidance of a small mobile robot using active, biologically-inspired, eye movements , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[3]  Stéphane Viollet,et al.  A miniature bio-inspired position sensing device for the control of micro-aerial robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  R. Gemperlein,et al.  Direkte Beobachtung der Rhabdomere bei Calliphora erythrocephala (Meig.) , 1969, Zeitschrift für vergleichende Physiologie.

[5]  N. Franceschini,et al.  The VODKA Sensor: A Bio-Inspired Hyperacute Optical Position Sensing Device , 2012, IEEE Sensors Journal.

[6]  George Adrian Horridge,et al.  The Action of the Eyecup Muscles of the Crab, Carcinus, During Optokinetic Movements , 1968 .

[7]  Eric M. Yeatman,et al.  Use of scanned detection in optical position encoders , 2004, IEEE Transactions on Instrumentation and Measurement.

[8]  Florentin Wörgötter,et al.  Eye Micro-movements Improve Stimulus Detection Beyond the Nyquist Limit in the Peripheral Retina , 2003, NIPS.

[9]  R. Hengstenberg,et al.  Das augenmuskelsystem der stubenfliege musca domestica , 1971, Kybernetik.

[10]  K. Donner,et al.  Modelling the effect of microsaccades on retinal responses to stationary contrast patterns , 2007, Vision Research.

[11]  Dario Floreano,et al.  Miniature curved artificial compound eyes , 2013, Proceedings of the National Academy of Sciences.

[12]  Michael F. Land,et al.  SCANNING EYE MOVEMENTS IN A HETEROPOD MOLLUSC , 1982 .

[13]  D. Stavenga Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics , 2002, Journal of Comparative Physiology A.

[14]  Ehud Ahissar,et al.  Seeing via Miniature Eye Movements: A Dynamic Hypothesis for Vision , 2012, Front. Comput. Neurosci..

[15]  M. Land Visual acuity in insects. , 1997, Annual review of entomology.

[16]  Michael Pieroni,et al.  Grand Challenges in Bionics , 2013, Front. Bioeng. Biotechnol..

[17]  J. Victor,et al.  Temporal Encoding of Spatial Information during Active Visual Fixation , 2012, Current Biology.

[18]  E. T. BURTT,et al.  Internal Muscle in the Eye of an Insect , 1970, Nature.

[19]  Max-Olivier Hongler,et al.  The Resonant Retina: Exploiting Vibration Noise to Optimally Detect Edges in an Image , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Robert Northrop Large Arrays of Interacting Receptors: The Compound Eye , 2000 .

[21]  Isao Shimoyama,et al.  A one-chip scanning retina with an integrated micromechanical scanning actuator , 2001 .

[22]  I. Shimoyama,et al.  Design and performance of a micro-sized biomorphic compound eye with a scanning retina , 2000, Journal of Microelectromechanical Systems.

[23]  N. Franceschini,et al.  Obstacle avoidance in a terrestrial mobile robot provided with a scanning retina , 1996, Proceedings of Conference on Intelligent Vehicles.

[24]  S. Ando,et al.  Texton Finders Based on Gaussian Curvature Of Correlation With An Application To Rapid Texture Classification , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Nicolas Franceschini,et al.  Hyperacute Edge and Bar Detection in a Bioinspired Optical Position Sensing Device , 2014, IEEE/ASME Transactions on Mechatronics.

[26]  M. Rucci,et al.  Microsaccades Precisely Relocate Gaze in a High Visual Acuity Task , 2010, Nature Neuroscience.

[27]  Stéphane Viollet,et al.  Visual servo system based on a biologically inspired scanning sensor , 1999, Optics East.

[28]  Stéphane Viollet,et al.  A hyperacute optical position sensor based on biomimetic retinal micro-scanning , 2010 .

[29]  M F Land,et al.  Movements of the retinae of jumping spiders (Salticidae: dendryphantinae) in response to visual stimuli. , 1969, The Journal of experimental biology.

[30]  X. Qi,et al.  Dynamic properties of the clock-spike system of the fly , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[31]  Nicolas Franceschini,et al.  High performance optical angular position sensing at low-cost: A bio-inspired approach , 2011, 2011 IEEE SENSORS Proceedings.

[32]  Stéphane Viollet,et al.  Biologically-inspired visual scanning sensor for stabilization and tracking , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[33]  Walter Heiligenberg,et al.  Temporal hyperacuity in single neurons of electric fish , 1988, Nature.

[34]  Ximena J. Nelson,et al.  Hyperacute motion detection by the lateral eyes of jumping spiders , 2012, Vision Research.

[35]  Stéphane Viollet,et al.  A sighted aerial robot with fast gaze and heading stabilization , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  N. Franceschini,et al.  Etude optique in vivo des éléments photorécepteurs dans l'œil composé de Drosophila , 2004, Kybernetik.

[37]  John Patterson,et al.  The Eye Muscle of Calliphora Vomitoria L : I. Spontaneous Activity and the Effects of Light and Dark Adaptation , 1973 .

[38]  S. Martinez-Conde,et al.  The impact of microsaccades on vision: towards a unified theory of saccadic function , 2013, Nature Reviews Neuroscience.

[39]  H. Krapp,et al.  Sensory Systems and Flight Stability: What do Insects Measure and Why? , 2007 .

[40]  T. Collett,et al.  Visual control of flight behaviour in the hoverflySyritta pipiens L. , 1975, Journal of comparative physiology.

[41]  B. Webb What does robotics offer animal behaviour? , 2000, Animal Behaviour.

[42]  John Patterson,et al.  The Eye Muscle of Calliphora Vomitoria L : II. Transient Responses to Changes in the Intensity of Illumination , 1973 .

[43]  Stéphane Viollet,et al.  Steering by Gazing: An Efficient Biomimetic Control Strategy for Visually Guided Micro Aerial Vehicles , 2010, IEEE Transactions on Robotics.

[44]  M. Rolfs Microsaccades: Small steps on a long way , 2009, Vision Research.

[45]  Robert B. Northrop Introduction to Dynamic Modeling of Neuro-Sensory Systems , 2000 .

[46]  Roland Hengstenberg Eye Movements in the housefly, Musca domestica , 1972 .

[47]  Ania Mitros,et al.  Visual Sensor with Resolution Enhancement by Mechanical Vibrations , 2001, Auton. Robots.

[48]  O'Carroll David,et al.  Retinal movements in the blowfly Calliphora Stygia , 2013 .

[49]  Paul R. Cooper,et al.  The dynamic retina: Contrast and motion detection for active vision , 2005, International Journal of Computer Vision.

[50]  H. A. K. Mastebroek,et al.  Receptive field characteristics of a directionally selective movement detector in the visual system of the blowfly , 2004, Journal of comparative physiology.

[51]  J. W. KUIPER,et al.  High-precision Repetitive Firing in the Insect Optic Lobe and a Hypothesis for its Function in Object Location , 1965, Nature.

[52]  Kaps,et al.  Mechanism and possible behavioural relevance of retinal movements in the ctenid spider Cupiennius salei , 1996, The Journal of experimental biology.

[53]  Stéphane Viollet,et al.  Super-accurate Visual Control of an Aerial Minirobot , 2001 .