CatARact: Simulating Cataracts in Augmented Reality

For our society to be more inclusive and accessible, the more than 2.2 billion people worldwide with limited vision should be considered more frequently in design decisions, such as architectural planning. To help architects in evaluating their designs and give medical personnel some insight on how patients experience cataracts, we worked with ophthalmologists to develop the first medically-informed, pilot-studied simulation of cataracts in eye-tracked augmented reality (AR). To test our methodology and simulation, we conducted a pilot study with cataract patients between surgeries of their two cataract-affected eyes. Participants compared the vision of their corrected eye, viewing through simulated cataracts, to that of their still affected eye, viewing an unmodified AR view. In addition, we conducted remote experiments via video call, live adjusting our simulation and comparing it to related work, with participants who had cataract surgery a few months before. We present our findings and insights from these experiments and outline avenues for future work.

[1]  H. Taylor,et al.  Number of People Blind or Visually Impaired by Cataract Worldwide and in World Regions, 1990 to 2010. , 2015, Investigative ophthalmology & visual science.

[2]  T. J. T. P. Van Den Berg,et al.  Importance of pathological intraocular light scatter for visual disability , 1986, Documenta Ophthalmologica.

[3]  Manuel Menezes de Oliveira Neto,et al.  CATRA: interactive measuring and modeling of cataracts , 2011, ACM Trans. Graph..

[4]  Jonna Häkkilä,et al.  Head mounted display design tool for simulating visual disabilities , 2016, MUM.

[5]  Jochen Feitsch,et al.  Empathizing Audiovisual Sense Impairments: Interactive Real-Time Illustration of Diminished Sense Perception , 2016, AH.

[6]  Hogervorst,et al.  Visualizing visual impairments , 2006 .

[7]  Michelle Zagar,et al.  Low Vision Simulator Goggles in Pharmacy Education , 2010, American Journal of Pharmaceutical Education.

[8]  Zhuming Ai,et al.  Simulation of Eye Disease in Virtual Reality , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[9]  Katerina Mania,et al.  Near‐Eye Display and Tracking Technologies for Virtual and Augmented Reality , 2019, Comput. Graph. Forum.

[10]  David J. Brown,et al.  Simulating visual impairments using the Unreal Engine 3 game engine , 2011, 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH).

[11]  Michael Wimmer,et al.  A VR-based user study on the effects of vision impairments on recognition distances of escape-route signs in buildings , 2018, The Visual Computer.

[12]  Michael Wimmer,et al.  Gaze-Dependent Simulation of Light Perception in Virtual Reality , 2020, IEEE Transactions on Visualization and Computer Graphics.

[13]  Hans-Peter Seidel,et al.  Temporal Glare: Real‐Time Dynamic Simulation of the Scattering in the Human Eye , 2009, Comput. Graph. Forum.

[14]  Jannick P. Rolland,et al.  Quantitative assessment of visual acuity in projective head-mounted displays , 2003, SPIE Defense + Commercial Sensing.

[15]  Michael Wimmer,et al.  ICthroughVR: Illuminating Cataracts through Virtual Reality , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[16]  Kendall E. Donaldson,et al.  Current Status of Bilateral Same-day Cataract Surgery , 2016, International ophthalmology clinics.

[17]  Rachel McCrindle,et al.  Visual eye disease simulator , 2008 .

[18]  Eelke Folmer,et al.  Immersive Simulation of Visual Impairments Using a Wearable See-through Display , 2015, TEI.

[19]  Steven Feiner,et al.  XREye: Simulating Visual Impairments in Eye-Tracked XR , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW).

[20]  J Lewis,et al.  Development of a visual impairment simulator using the Microsoft XNA Framework , 2012 .

[21]  R. Michael,et al.  The ageing lens and cataract: a model of normal and pathological ageing , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  Henry Fuchs,et al.  FocusAR: Auto-focus Augmented Reality Eyeglasses for both Real World and Virtual Imagery , 2018, IEEE Transactions on Visualization and Computer Graphics.

[23]  M. C. Leske,et al.  The Lens Opacities Classification System III , 1993 .

[24]  Giovanni Ometto,et al.  Degraded Reality: Using VR/AR to simulate visual impairments , 2018, 2018 IEEE Workshop on Augmented and Virtual Realities for Good (VAR4Good).

[25]  Alex Chaparro,et al.  Effect of Simulated Visual Impairment on Nighttime Driving Performance , 2010, Optometry and vision science : official publication of the American Academy of Optometry.