Sensory flux from the eye: Biological sensing-of-sensing (veillametrics) for 3D augmented-reality environments

We measure and visualize the ability-to-see, from the human eye, as that ability-to-see propagates through space. "Biological veillance flux" is a metric of sensory precision emitted from the eyes and falling on objects, with much greater detail than merely tracking the center of the eye's field of view. This work makes it possible to "see sight" and "measure sight" as the "sight" travels through three-dimensional space. In earlier work we measured veillance flux from electronic sensors and cameras. Now, we examine biological veillance flux. The result is a method to detect radiation of information-bearing optical sensitivity, as opposed to radiation of ordinary light energy in the opposite direction. These measurements can be used as an augmented-reality visualization of human sight. They can serve as an interactive score tracking how much a target is seen. Additionally, they could serve as a data-rich metric of visual precision directed by human eyes toward control panels in industrial applications, or as a metric of visual precision directed by human eyes towards printed material or digital media, for advertising, arts or entertainment applications. Extramissive optics, as a new field of research, is thus expanded into the biological realm.

[1]  Steve Mann,et al.  Veillance flux, vixels, veillons: An information-bearing extramissive formulation of sensing, to measure surveillance and sousveillance , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[2]  M. López-Aranda,et al.  Role of Layer 6 of V2 Visual Cortex in Object-Recognition Memory , 2009, Science.

[3]  O. Braddick,et al.  Brain Areas Sensitive to Coherent Visual Motion , 2001, Perception.

[4]  Steve Mann,et al.  Wearable Computing, 3D Aug* Reality, Photographic/Videographic Gesture Sensing, and Veillance , 2015, Tangible and Embedded Interaction.

[5]  D. Pollen,et al.  Spatial and temporal frequency selectivity of neurones in visual cortical areas V1 and V2 of the macaque monkey. , 1985, The Journal of physiology.

[6]  I. Cuthill,et al.  Disruptive coloration, crypsis and edge detection in early visual processing , 2006, Proceedings of the Royal Society B: Biological Sciences.

[7]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[8]  E. Wollan,et al.  Photographic film as a pocket radiation dosimeter. , 1944, Atomic energy in biophysics, biology and medicine.

[9]  Velia Cardin,et al.  Sensitivity of human visual and vestibular cortical regions to egomotion-compatible visual stimulation. , 2010, Cerebral cortex.

[10]  Steve Mann,et al.  High dynamic range simultaneous signal compositing, applied to audio , 2012, 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[11]  Steve Mann,et al.  Walking through sight: Seeing the ability to see, in a 3-D augmediated reality environment , 2014, 2014 IEEE Games Media Entertainment.

[12]  Steve Mann,et al.  Veillance dosimeter, inspired by body-worn radiation dosimeters, to measure exposure to inverse light , 2014, 2014 IEEE Games Media Entertainment.

[13]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[14]  S. Petersen,et al.  Visual response properties of neurons in four extrastriate visual areas of the owl monkey (Aotus trivirgatus): a quantitative comparison of medial, dorsomedial, dorsolateral, and middle temporal areas. , 1981, Journal of neurophysiology.

[15]  Daniel Y. Ts’o,et al.  Whither the hypercolumn? , 2009, The Journal of physiology.

[16]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[17]  Steve Mann,et al.  Toposculpting: Computational lightpainting and wearable computational photography for abakographic user interfaces , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).