Adaptive Accessible AR/VR Systems

Augmented, virtual and mixed reality technologies offer new ways of interacting with digital media. However, such technologies are not well explored for people with different ranges of abilities beyond a few specific navigation and gaming applications. While new standardization activities are investigating accessibility issues with existing AR/VR systems, commercial systems are still confined to specialized hardware and software limiting their widespread adoption among people with disabilities as well as seniors. This proposal takes a novel approach by exploring the application of user model-based personalization for AR/VR systems to improve accessibility. The workshop will be organized by experienced researchers in the field of human computer interaction, robotics control, assistive technology, and AR/VR systems, and will consist of peer reviewed papers and hands-on demonstrations. Keynote speeches and demonstrations will cover latest accessibility research at Microsoft, Google, Verizon and leading universities.

[1]  T Kuhlen,et al.  Virtual reality for physically disabled people. , 1995, Computers in biology and medicine.

[2]  Benjamin Watson,et al.  A virtual airplane for fear of flying therapy , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[3]  Grigore C. Burdea,et al.  The “Rutgers Ankle” Orthopedic Rehabilitation Interface , 1999, Dynamic Systems and Control.

[4]  Albert A. Rizzo,et al.  The Virtual Classroom: A Virtual Reality Environment for the Assessment and Rehabilitation of Attention Deficits , 2000, Cyberpsychology Behav. Soc. Netw..

[5]  Maureen K. Holden,et al.  Use of Virtual Environments in Motor Learning and Rehabilitation , 2002 .

[6]  Philip Constantinou,et al.  Designing human-computer interfaces for quadriplegic people , 2003, TCHI.

[7]  Martin White,et al.  An Interactive Visualisation Interface for Virtual Museums , 2004, VAST.

[8]  Cecilia Sik-Lányi,et al.  Virtual Reality in Special Needs Early Education , 2006, Int. J. Virtual Real..

[9]  Krzysztof Z. Gajos,et al.  Automatically generating user interfaces adapted to users' motor and vision capabilities , 2007, UIST.

[10]  P. Richard,et al.  Augmented Reality for Rehabilitation of Cognitive Disabled Children: A Preliminary Study , 2007, 2007 Virtual Rehabilitation.

[11]  Pradipta Biswas,et al.  Evaluating Interface Layout for Visually and Mobility Impaired Users through Simulation , 2010 .

[12]  Patrick Langdon,et al.  Towards standardisation of user models for simulation and adaptation purposes , 2016, Universal Access in the Information Society.

[13]  Yu-Ming Chang,et al.  Interactive augmented reality using Scratch 2.0 to improve physical activities for children with developmental disabilities. , 2015, Research in developmental disabilities.

[14]  Meredith Ringel Morris,et al.  SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision , 2019, CHI.

[15]  Pradipta Biswas,et al.  Interactive gaze and finger controlled HUD for cars , 2019, Journal on Multimodal User Interfaces.

[16]  Murthy L R D.  Multimodal Interaction for Real and Virtual Environments , 2020 .

[17]  A. Tyagi,et al.  PoseNet3D: Learning Temporally Consistent 3D Human Pose via Knowledge Distillation , 2020, 2020 International Conference on 3D Vision (3DV).

[18]  Ambrish Tyagi,et al.  PoseNet3D: Unsupervised 3D Human Shape and Pose Estimation , 2020, ArXiv.

[19]  D MurthyL.R.,et al.  Multimodal Interaction for Real and Virtual Environments , 2020, IUI Companion.

[20]  Kathrin Gerling,et al.  Virtual Reality Games for People Using Wheelchairs , 2020, CHI.

[21]  James Adam Jones,et al.  Egocentric Depth Perception in Optical See-Through Augmented Reality , 2020 .

[22]  Pradipta Biswas,et al.  Eye Gaze Controlled Robotic Arm for Persons with Severe Speech and Motor Impairment , 2020, ETRA.