Spatial Mapping of Distributed Sensors Biomimicking the Human Vision System

Machine vision has been thoroughly studied in the past, but research thus far has lacked an engineering perspective on human vision. This paper addresses the observed and hypothetical neural behavior of the brain in relation to the visual system. In a human vision system, visual data are collected by photoreceptors in the eye, and these data are then transmitted to the rear of the brain for processing. There are millions of retinal photoreceptors of various types, and their signals must be unscrambled by the brain after they are carried through the optic nerves. This work is a forward step toward explaining how the photoreceptor locations and proximities are resolved by the brain. It is illustrated here that unlike in digital image sensors, there is no one-to-one sensor-to-processor identifier in the human vision system. Instead, the brain must go through an iterative learning process to identify the spatial locations of the photosensors in the retina. This involves a process called synaptic pruning, which can be simulated by a memristor-like component in a learning circuit model. The simulations and proposed mathematical models in this study provide a technique that can be extrapolated to create spatial distributions of networked sensors without a central observer or location knowledge base. Through the mapping technique, the retinal space with known configuration generates signals as scrambled data-feed to the logical space in the brain. This scrambled response is then reverse-engineered to map the logical space’s connectivity with the retinal space locations.

[1]  Michael J. Armson,et al.  Vividness of recollection is supported by eye movements in individuals with high, but not low trait autobiographical memory , 2020, Cognition.

[2]  Jacky Emmerton,et al.  Wavelength discrimination in the ‘visible’ and ultraviolet spectrum by pigeons , 1980, Journal of comparative physiology.

[3]  Innes C. Cuthill,et al.  Camouflage, detection and identification of moving targets , 2013, Proceedings of the Royal Society B: Biological Sciences.

[4]  P. Churchland Is the Visual System as Smart as It Looks? , 1982, PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association.

[5]  Oliver Obst,et al.  Complex cells decrease errors for the Müller-Lyer illusion in a model of the visual ventral stream , 2014, Front. Comput. Neurosci..

[6]  Livia S. Carvalho,et al.  The FASEB Journal • Research Communication Functional characterization, tuning, and regulation , 2022 .

[7]  V. Pravosudov,et al.  Birds as a model to study adult neurogenesis: bridging evolutionary, comparative and neuroethological approaches , 2011, The European journal of neuroscience.

[8]  S. Coren,et al.  A comparison of five methods of illusion measurement , 1972 .

[9]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[11]  W E Grimson,et al.  A computational theory of visual surface interpolation. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  Keiko Yoneyama,et al.  The Haptic Müller-Lyer Illusion in Sighted and Blind People , 2002, Perception.

[14]  Kazuo Fujita,et al.  Pigeons perceive a reversed Zöllner illusion , 2011, Cognition.

[15]  William McIlhagga,et al.  Evidence for chromatic edge detectors in human vision using classification images. , 2018, Journal of vision.

[16]  M. Georgeson Human vision combines oriented filters to compute edges , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  Gunnar Rätsch,et al.  Image reconstruction by linear programming , 2003, IEEE Transactions on Image Processing.

[18]  Isaac Abraham,et al.  The case for rejecting the memristor as a fundamental circuit element , 2018, Scientific Reports.

[19]  E. Maguire,et al.  London taxi drivers and bus drivers: A structural MRI and neuropsychological analysis , 2006, Hippocampus.

[20]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  E. Rossi,et al.  The relationship between visual resolution and cone spacing in the human fovea , 2009, Nature Neuroscience.

[22]  Alan E. Robinson,et al.  Explaining brightness illusions using spatial filtering and local response normalization , 2007, Vision Research.

[23]  A. Kitaoka,et al.  Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction , 2018, Front. Psychol..

[24]  Uri Polat,et al.  Training the brain to overcome the effect of aging on the human eye , 2012, Scientific Reports.

[25]  A. Rizzi,et al.  The human visual system described through visual illusions , 2017 .

[26]  Jill Sakai,et al.  Core Concept: How synaptic pruning shapes neural wiring during development and, possibly, in disease , 2020, Proceedings of the National Academy of Sciences.

[27]  Bernd Fritzsch,et al.  Primary sensory map formations reflect unique needs and molecular cues specific to each sensory system , 2019, F1000Research.

[28]  Victor de Lafuente,et al.  The Müller-Lyer illusion as seen by an artificial neural network , 2015, Front. Comput. Neurosci..

[29]  L. Chua Memristor-The missing circuit element , 1971 .

[30]  Donald T. Miller,et al.  Cone photoreceptor classification in the living human eye from photostimulation-induced phase dynamics , 2019, Proceedings of the National Academy of Sciences.

[31]  M.C. Batouche,et al.  A genetic quantum algorithm for image registration , 2004, Proceedings. 2004 International Conference on Information and Communication Technologies: From Theory to Applications, 2004..

[32]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[33]  Humberto Bustince,et al.  Learning ordered pooling weights in image classification , 2020, Neurocomputing.

[34]  Daniel R. Berger,et al.  The Fuzzy Logic of Network Connectivity in Mouse Visual Thalamus , 2016, Cell.

[35]  Gáspár Jékely,et al.  Neuronal connectome of a sensory-motor circuit for visual navigation , 2014, eLife.

[36]  Chiman Kwan,et al.  Further Improvement of Debayering Performance of RGBW Color Filter Arrays Using Deep Learning and Pansharpening Techniques , 2019, J. Imaging.

[37]  F. Nottebohm Why Are Some Neurons Replaced in Adult Brain? , 2002, The Journal of Neuroscience.

[38]  Larry N. Thibos,et al.  Image Processing by the Human Eye , 1989, Other Conferences.

[39]  J. Ryan,et al.  The intersection between the oculomotor and hippocampal memory systems: empirical developments and clinical implications , 2019, Annals of the New York Academy of Sciences.

[40]  V. Hartenstein,et al.  Eye evolution at high resolution: the neuron as a unit of homology. , 2009, Developmental biology.

[41]  Andrew D Huberman,et al.  Assembly and repair of eye-to-brain connections , 2018, Current Opinion in Neurobiology.

[42]  V. Franz,et al.  Manual size estimation: a neuropsychological measure of perception? , 2003, Experimental Brain Research.