Design of an Augmented Reality Magnification Aid for Low Vision Users

Augmented reality (AR) systems that enhance visual capabilities could make text and other fine details more accessible for low vision users, improving independence and quality of life. Prior work has begun to investigate the potential of assistive AR, but recent advancements enable new AR visualizations and interactions not yet explored in the context of assistive technology. In this paper, we follow an iterative design process with feedback and suggestions from seven visually impaired participants, designing and testing AR magnification ideas using the Microsoft HoloLens. Participants identified several advantages to the concept of head-worn magnification (e.g., portability, privacy, ready availability), and to our AR designs in particular (e.g., a more natural reading experience and the ability to multitask). We discuss the strengths and weaknesses of this AR magnification approach and summarize lessons learned throughout the process.

[1]  Alex D. Hwang,et al.  An Augmented-Reality Edge Enhancement Application for Google Glass , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[2]  R W Massof,et al.  Obstacles encountered in the development of the low vision enhancement system. , 1992, Optometry and vision science : official publication of the American Academy of Optometry.

[3]  Suranga Nanayakkara,et al.  FingerReader: A Wearable Device to Explore Printed Text on the Go , 2015, CHI.

[4]  Yuhang Zhao,et al.  Understanding Low Vision People's Visual Perception on Commercial Augmented Reality Glasses , 2017, CHI.

[5]  Annuska Zolyomi,et al.  Technology-Mediated Sight: A Case Study of Early Adopters of a Low Vision Assistive Technology , 2017, ASSETS.

[6]  Jon Froehlich,et al.  Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras , 2016, ACM Trans. Access. Comput..

[7]  R. Harper,et al.  Head mounted video magnification devices for low vision rehabilitation: a comparison with existing technology , 1999, The British journal of ophthalmology.

[8]  E B Mehr,et al.  Parameters in the Use of CCTV's and Optical Aids , 1980, American journal of optometry and physiological optics.

[9]  Gianni Virgili,et al.  Reading aids for adults with low vision. , 2013, The Cochrane database of systematic reviews.

[10]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[11]  Halley Profita,et al.  The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use , 2016, CHI.

[12]  Sethuraman Panchanathan,et al.  iCARE interaction assistant: a wearable face recognition system for individuals with visual impairments , 2005, Assets '05.

[13]  Morten Kyng,et al.  Design at Work , 1992 .

[14]  Chandra M. Harrison Low-vision reading aids: reading as a pleasurable experience , 2004, Personal and Ubiquitous Computing.

[15]  Yuhang Zhao,et al.  ForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision , 2015, ASSETS.

[16]  Ben D. Sawyer,et al.  Google Glass , 2014, Hum. Factors.

[17]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[18]  Jon Froehlich,et al.  Augmented Reality Magnification for Low Vision Users with the Microsoft Hololens and a Finger-Worn Camera , 2017, ASSETS.

[19]  Jon Froehlich,et al.  TouchCam , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[20]  Suranga Nanayakkara,et al.  EyeRing: a finger-worn input device for seamless interactions with our surroundings , 2013, AH.

[21]  Richard E. Ladner,et al.  Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities , 2009, Assets '09.

[22]  Allen G. Taylor,et al.  What Is the Microsoft HoloLens , 2016 .

[23]  S. Goldenstein,et al.  A Wearable Face Recognition System Built into a Smartwatch and the Blind and Low Vision Users , 2015, ICEIS.

[24]  Gang Luo,et al.  Magnifying Smartphone Screen Using Google Glass for Low-Vision Users , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.