Gaze Interactive and Attention Aware Low Vision Aids as Future Smart Glasses

We present a working paper on integrating eye tracking with mixed and augmented reality for the benefit of low vision aids. We outline the current state of the art and relevant research and point to further research and development required in order to adapt to individual user, environment, and current task. We outline key technical challenges and possible solutions including calibration, dealing with variant eye data quality, measuring and adapting image processing to low vision within current technical limitations, and outline an experimental approach to designing data-driven solutions using machine learning and artificial intelligence.

[1]  Patricia Grant,et al.  Reading rehabilitation of individuals with AMD: relative effectiveness of training approaches. , 2011, Investigative ophthalmology & visual science.

[2]  M. Steinbach,et al.  Fixation Stability Recording: How Long for Eyes with Central Vision Loss? , 2017, Optometry and vision science : official publication of the American Academy of Optometry.

[3]  Eli Peli,et al.  Image Enhancement For The Visually Impaired , 1984 .

[4]  Vasudevan Lakshminarayanan,et al.  Head-Mounted Display Technology for Low-Vision Rehabilitation and Vision Enhancement. , 2017, American journal of ophthalmology.

[5]  Mark W. Greenlee,et al.  Functional and structural brain modifications induced by oculomotor training in patients with age-related macular degeneration , 2013, Front. Psychol..

[6]  Eli Peli,et al.  Tunnel Vision Prismatic Field Expansion: Challenges and Requirements. , 2015, Translational vision science & technology.

[7]  Kathleen A. Turano,et al.  Optic-flow and egocentric-direction strategies in walking: Central vs peripheral visual field , 2005, Vision Research.

[8]  T Pey,et al.  Visual loss and falls: a review , 2010, Eye.

[9]  S. Miyauchi,et al.  fMRI evidence of improved visual function in patients with progressive retinitis pigmentosa by eye-movement training , 2014, NeuroImage: Clinical.

[10]  Y. Trotter,et al.  Rehabilitation Approaches in Macular Degeneration Patients , 2016, Front. Syst. Neurosci..

[11]  Benjamin T. Backus,et al.  Use of virtual reality to assess and treat weakness in human stereoscopic vision , 2018 .

[12]  Andrew Glennerster,et al.  The Science Behind Virtual Reality Displays. , 2019, Annual review of vision science.

[13]  Samuel A. Titchener,et al.  Head and Gaze Behavior in Retinitis Pigmentosa. , 2019, Investigative ophthalmology & visual science.

[14]  M. Mackeben,et al.  Eye Movement Training and Suggested Gaze Strategies in Tunnel Vision - A Randomized and Controlled Pilot Study , 2016, PloS one.

[15]  R. Rosenholtz,et al.  More than the Useful Field: Considering peripheral vision in driving. , 2017, Applied ergonomics.

[16]  Joshua R. Ehrlich,et al.  Patient-Centered Outcome Measures to Assess Functioning in Randomized Controlled Trials of Low-Vision Rehabilitation: A Review , 2017, The Patient - Patient-Centered Outcomes Research.

[17]  B. Steenbergen,et al.  Rehabilitation of reading in older individuals with macular degeneration: A review of effective training programs , 2011, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[18]  G. Mitchell,et al.  Treatment of Accommodative Dysfunction in Children: Results from a Randomized Clinical Trial , 2011, Optometry and vision science : official publication of the American Academy of Optometry.

[19]  Katarzyna Harezlak,et al.  Application of Eye Tracking to Support Children's Vision Enhancing Exercises , 2016, ITIB.

[20]  D S Loshin,et al.  The programmable remapper: clinical applications for patients with field defects. , 1989, Optometry and vision science : official publication of the American Academy of Optometry.

[21]  Susana T. L. Chung,et al.  Low Vision and Plasticity: Implications for Rehabilitation. , 2016, Annual review of vision science.

[22]  Kursat Cagiltay,et al.  Development of eye movement games for students with low vision: Single-subject design research , 2018, Education and Information Technologies.

[23]  Casimir J. H. Ludwig,et al.  Look-ahead fixations during visuomotor behavior: Evidence from assembling a camping tent , 2021, Journal of vision.

[24]  Katharina Rifai,et al.  Can positions in the visual field with high attentional capabilities be good candidates for a new preferred retinal locus? , 2017, Vision Research.

[25]  Brian D. Dornbos,et al.  Vision Therapy and Virtual Reality Applications , 2018, Advances in Ophthalmology and Optometry.

[26]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[27]  D. Laby.  Case Report: Use of Sports and Performance Vision Training to Benefit a Low Vision Patient's Function. , 2018, Optometry and vision science : official publication of the American Academy of Optometry.

[28]  R. Beck,et al.  Randomized clinical trial of treatments for symptomatic convergence insufficiency in children. , 2008, Archives of ophthalmology.

[29]  Martin J. Steinbach,et al.  Reading Training with Threshold Stimuli in People with Central Vision Loss: A Feasibility Study , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[30]  M. Mandelcorn,et al.  Fixation stability as a goal in the treatment of macular disease. , 2013, Canadian journal of ophthalmology. Journal canadien d'ophtalmologie.

[31]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.