Inclusive Adaptation of Existing Board Games for Gamers with and without Visual Impairments using a Spatial Augmented Reality Framework for Touch Detection and Audio Feedback

Board games allow us to share collective entertainment experiences. They entertain because of the interactions between players, physical manipulation of tokens and decision making. Unfortunately, most board games exclude people with visual impairments as they were not initially designed for players with special needs. Through a user-centered design process with an accessible game library and visually impaired players, we observed challenges and solutions in making existing board games accessible through handcrafted solutions (tactile stickers, braille labels, etc.). In a second step, we used Spatial Augmented Reality (SAR), to make existing board games inclusive by adding interactivity (GameARt). In a case study with an existing board game considered as not accessible (Jamaica), we designed an interactive SAR version with touch detection (JamaicAR). We evaluated this prototype in a user study with 5 groups of 3 players each, including sighted, low vision and blind players. All players, independent of visual status, were able to play the Augmented Reality game. Moreover, the game was rated positively by all players regarding attractiveness, play engrossment, enjoyment and social connectivity. Our work shows that Spatial Augmented Reality has the potential to make board games accessible to people with visual impairments when handcrafted adaptations fall short.

[1]  Tony Morelli,et al.  VI-Tennis: a vibrotactile/audio exergame for players who are visually impaired , 2010, FDG.

[2]  Michael J. Heron,et al.  Eighteen Months of Meeple Like Us: An Exploration into the State of Board Game Accessibility , 2018, The Computer Games Journal.

[3]  Jaime Sánchez,et al.  Usability of a Multimodal Video Game to Improve Navigation Skills for Blind Children , 2010, TACC.

[4]  Jenny Waycott,et al.  Introducing the Gamer Information-Control Framework: Enabling Access to Digital Games for People with Visual Impairment , 2020, CHI.

[5]  Regan L. Mandryk,et al.  Full-body motion-based game interaction for older adults , 2012, CHI.

[6]  Richard E. Ladner,et al.  BraillePlay: educational smartphone games for blind children , 2014, ASSETS.

[7]  George Giannakopoulos,et al.  Accessible games for blind children, empowered by binaural sound , 2015, PETRA.

[8]  Stephen A. Brewster,et al.  Clutching at straws: using tangible interaction to provide non-visual access to graphs , 2010, CHI.

[9]  Constantine Stephanidis,et al.  An Accessible Multimodal Pong Game Space , 2006, Universal Access in Ambient Intelligence Environments.

[10]  Thomas Westin,et al.  Game accessibility case study : Terraformers - a real-time 3D graphic game , 2004 .

[11]  Robin Vivian,et al.  CARDS: A Mixed-Reality System for Collaborative Learning at School , 2019, ISS.

[12]  Bei Yuan,et al.  Blind hero: enabling guitar hero for the visually impaired , 2008, Assets '08.

[13]  Michael J. Heron,et al.  Meeple Centred Design: A Heuristic Toolkit for Evaluating the Accessibility of Tabletop Games , 2018, Comput. Games J..

[14]  Klaus Miesenberger,et al.  Design for All in Information Technology: A Universal Concern , 2005, DEXA.

[15]  Masaki Matsuo,et al.  ShadowRine: Accessible game for blind users, and accessible action RPG for visually impaired gamers , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[16]  Anke M. Brock,et al.  Accessible Interactive Maps for Visually Impaired Users , 2022, ArXiv.

[17]  Matthew K. Miller,et al.  Designing Wheelchair-Based Movement Games , 2015, ACM Trans. Access. Comput..

[18]  Heinz Ulrich Hoppe,et al.  AudioBattleship: blind learners collaboration through sound , 2003, CHI Extended Abstracts.

[19]  S. Natkin,et al.  TAMPOKME : A MULTI-USERS AUDIO GAME ACCESSIBLE TO VISUALLY AND MOTOR IMPAIRED PEOPLE , 2007 .

[20]  Roope Raisamo,et al.  Non-visual Gameplay: Making Board Games Easy and Fun , 2008, ICCHP.

[21]  Gillian R. Hayes,et al.  Evaluating a Collaborative iPad Game's Impact on Social Relationships for Children with Autism Spectrum Disorder , 2015, TACC.

[22]  Sri Hastuti Kurniawan,et al.  Rock Vibe: Rock Band® computer games for people with no or limited vision , 2009, Assets '09.

[23]  Shai Avidan,et al.  Blind Vision , 2006, ECCV.

[24]  Mizue Kayama,et al.  A Multimodal Board Game System Interface Using Finger Input for Visually Impaired Computer Users , 2009, HCI.

[25]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[26]  Constantine Stephanidis,et al.  Designing universally accessible games , 2009, CIE.

[27]  Richard E. Ladner,et al.  VBGhost: a braille-based educational smartphone game for children , 2013, ASSETS.

[28]  Gazihan Alankus,et al.  Stroke therapy through motion-based games: a case study , 2011, ASSETS '10.

[29]  Woontack Woo,et al.  TARBoard: Tangible Augmented Reality System for Table-top Game Environment ∗ , 2005 .

[30]  Gabriel Zachmann,et al.  Kinaptic - Techniques and insights for creating competitive accessible 3D games for sighted and visually impaired users , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[31]  Mads Møller Jensen,et al.  ChillFish: A Respiration Game for Children with ADHD , 2016, TEI.

[32]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.

[33]  Deborah I. Fels,et al.  Accessible Play in Everyday Spaces , 2016, ACM Trans. Comput. Hum. Interact..

[34]  Gazihan Alankus,et al.  Stroke Therapy through Motion-Based Games: A Case Study , 2010, TACC.

[35]  Vlado Delic,et al.  Stereo Presentation and Binaural Localization in a Memory Game for the Visually Impaired , 2009, COST 2102 Training School.

[36]  Kyle Rector,et al.  Virtual Showdown: An Accessible Virtual Reality Game with Scaffolds for Youth with Visual Impairments , 2019, CHI.

[37]  Daniel Cermak-Sassenrath.  AirKanoid – Visual Presentation vs . Physical Proximity in Mixed Reality Entertainment Applications , 2005 .

[38]  Shaun K. Kane,et al.  Game changer: accessible audio and tactile guidance for board and card games , 2020, W4A.

[39]  Trond Nilsen,et al.  Tankwar-Tabletop war gaming in augmented reality , 2005 .

[40]  Michael Crabb,et al.  Projection mapping as a method to improve board game accessibility , 2016, ASAC.

[41]  Jaime Sánchez,et al.  Audio haptic videogaming for developing wayfinding skills in learners who are blind , 2014, IUI.

[42]  Effie Lai-Chong Law,et al.  Systematic Review and Validation of the Game Experience Questionnaire (GEQ) - Implications for Citation and Reporting Practice , 2018, CHI PLAY.

[43]  Barbara S. Chaparro,et al.  The Development and Validation of the Game User Experience Satisfaction Scale (GUESS) , 2016, Hum. Factors.

[44]  Martin Hachet,et al.  Creating Accessible Interactive Audio-Tactile Drawings using Spatial Augmented Reality , 2019, ISS.

[45]  Ivan Poupyrev,et al.  Augmented Groove: Collaborative Jamming in Augmented Reality , 2000, SIGGRAPH 2000.

[46]  Tony Morelli,et al.  Real-time sensory substitution to enable players who are blind to play video games using whole body gestures , 2014, Entertain. Comput..

[47]  Sven Bertel,et al.  Navigation and immersion of blind players in text-based games , 2014, The Computer Games Journal.

[48]  Shannon Walters,et al.  Toward an Accessible Pedagogy: Dis/ability, Multimodality, and Universal Design in the Technical Communication Classroom , 2010 .

[49]  Z. Míkovec,et al.  Problems of blind chess players , 2015, 2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom).

[50]  Bill Kapralos,et al.  Let's Play Together: Adaptation Guidelines of Board Games for Players with Visual Impairment , 2019, CHI.

[51]  Julie A. Kientz,et al.  Eyes-free yoga: an exergame using depth cameras for blind & low vision exercise , 2013, ASSETS.

[52]  Hirokazu Kato,et al.  Touch-Space: Mixed Reality Game Space Based on Ubiquitous, Tangible, and Social Computing , 2002, Personal and Ubiquitous Computing.

[53]  Tony Morelli,et al.  Real-time sensory substitution to enable players who are blind to play video games using whole body gestures , 2011, Entertain. Comput..

[54]  T. Vecchi,et al.  Blind Vision: The Neuroscience of Visual Impairment , 2011 .

[55]  Martin Hachet,et al.  PapARt: Interactive 3D graphics and multi-touch augmented paper for artistic creation , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[56]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[57]  Charlotte Magnusson,et al.  Navigating the world and learning to like it: mobility training through a pervasive game , 2011, Mobile HCI.

[58]  Anke M. Brock,et al.  Interactivity Improves Usability of Geographic Maps for Visually Impaired People , 2015, Hum. Comput. Interact..

[59]  Anke M. Brock,et al.  Towards a Multisensory Augmented Reality Map for Blind and Low Vision People: a Participatory Design Approach , 2018, CHI.

[60]  Tony Morelli,et al.  Vi-bowling: a tactile spatial exergame for individuals with visual impairments , 2010, ASSETS '10.

[61]  Niels Henze,et al.  AuditoryPong – Playing PONG in the Dark , 2007 .

[62]  Oussama Metatla,et al.  Robots for Inclusive Play: Co-designing an Educational Game With Visually Impaired and sighted Children , 2020, CHI.