"If you've gone straight, now, you must turn left" - Exploring the use of a tangible interface in a collaborative treasure hunt for people with visual impairments

Tangible User Interfaces (TUI) have been found to be relevant tools for collaborative learning by providing a shared workspace and enhancing joint visual attention. Researchers have explored the use of TUIs in a variety of curricular activities and found them particularly interesting for spatial exploration. However, very few studies have explored how TUIs could be used as a collaborative medium for people with visual impairments (VIs). In this study, we investigated the effect of tangible interaction (a small tangible robot) in a spatial collaborative task (a treasure hunt) involving two people with VIs. The aim was to evaluate the impact of the design of the TUI on the collaboration and the strategies used to perform the task. The experiment involved six dyads of people with VIs. The results showed that the collaboration was impacted by the interaction design and open interesting perspectives on the design of collaborative games for people with VIs.

[1]  G. Sandini,et al.  Direct and Indirect Haptic Calibration of Visual Size Judgments , 2011, PloS one.

[2]  Tohru Ifukube,et al.  Utilization of auditory perceptions of sounds and silent objects for orientation and mobility by visually-impaired people , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[3]  Ana Paiva,et al.  What My Eyes Can't See, A Robot Can Show Me: Exploring the Collaboration Between Blind People and Robots , 2018, ASSETS.

[4]  Wiebke Köhlmann,et al.  Identifying Barriers to Collaborative Learning for the Blind , 2012, ICCHP.

[5]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[6]  Julie Ducasse.  Construction and exploration of an interactive and collaborative map for the visually impaired , 2016, ASAC.

[7]  Patrick Jermann,et al.  Task Performance vs. Learning Outcomes: A Study of a Tangible User Interface in the Classroom , 2010, EC-TEL.

[8]  Masahiko Inami,et al.  Remote active tangible interactions , 2007, TEI.

[9]  Timo Götzelmann,et al.  Visually Augmented Audio-Tactile Graphics for Visually Impaired People , 2018, ACM Trans. Access. Comput..

[10]  Wafa Johal,et al.  Iterative Design and Evaluation of a Tangible Robot-Assisted Handwriting Activity for Special Education , 2020, Frontiers in Robotics and AI.

[11]  Enrico Pontelli,et al.  MICOO (multimodal interactive cubes for object orientation): a tangible user interface for the blind and visually impaired , 2011, ASSETS '11.

[12]  David J. Shernoff,et al.  Student engagement in high school classrooms from the perspective of flow theory. , 2003 .

[13]  Shu-Ching Chen,et al.  Multimedia Big Data Analytics , 2018, ACM Comput. Surv..

[14]  Anke M. Brock,et al.  Map Learning with a 3D Printed Interactive Small-Scale Model: Improvement of Space and Text Memorization in Visually Impaired Students , 2017, Front. Psychol..

[15]  Mauro Ávila-Soto,et al.  TanMath: A Tangible Math Application to support children with visual impairment to learn basic Arithmetic , 2017, PETRA.

[16]  Wafa Johal,et al.  Using tabletop robots to promote inclusive classroom experiences , 2020, IDC.

[17]  Wafa Johal,et al.  Haptic-Enabled Handheld Mobile Robots: Design and Analysis , 2017, CHI.

[18]  Pierre Dillenbourg,et al.  Grounding in Multi-modal Task-Oriented Collaboration , 1999 .

[19]  Mi Jeong Kim,et al.  The impact of tangible user interfaces on spatial cognition during collaborative design , 2008 .

[20]  Zheng Pan,et al.  Hungry Cat—A Serious Game for Conveying Spatial Information to the Visually Impaired , 2019 .

[21]  Stephen A. Brewster,et al.  Clutching at straws: using tangible interaction to provide non-visual access to graphs , 2010, CHI.

[22]  Oussama Metatla.  Co-designing Inclusive Mobility With Visually-Impaired and Sighted Children , 2019 .

[23]  Aurélie Vallée,et al.  A study of collaboration via a digital space accessible to adolescents with visual impairment , 2016 .

[24]  G. M. Wittenbaum,et al.  Coordination in Task-Performing Groups , 2002 .

[25]  Hugo Simão,et al.  Exploring accessible programming with educators and visually impaired children , 2020, IDC.

[26]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[27]  Aaron Steinfeld,et al.  Go That Way: Exploring Supplementary Physical Movements by a Stationary Robot When Providing Navigation Instructions , 2019, ASSETS.

[28]  Vincent Koenig,et al.  How Could an Intranet be Like a Friend to Me?: Why Standardized UX Scales Don't Always Fit , 2017, ECCE.

[29]  Gerry Stahl,et al.  Group cognition in computer-assisted collaborative learning , 2005, J. Comput. Assist. Learn..

[30]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[31]  Roberta L Klatzky,et al.  Functional equivalence of spatial representations derived from vision and language: evidence from allocentric judgments. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[32]  A. Koenig,et al.  Foundations of Education, Volume II: Instructional Strategies for Teaching Children and Youths with Visual Impairments. Second Edition. , 2000 .

[33]  Monica Gori,et al.  Auditory and proprioceptive spatial impairments in blind children and adults. , 2017, Developmental science.

[34]  Nicolas Villar,et al.  Enabling Collaboration in Learning Computer Programing Inclusive of Children with Vision Impairments , 2017, Conference on Designing Interactive Systems.

[35]  Cesare Cornoldi,et al.  Developing Spatial Knowledge in the Absence of Vision: Allocentric and Egocentric Representations Generated by Blind People When Supported by Auditory Cues , 2010 .

[36]  Sheila Clark,et al.  Town and gown: A collaborative venture in grief education , 1996 .

[37]  Shaun K. Kane,et al.  "It Broadens My Mind": Empowering People with Cognitive Disabilities through Computing Education , 2019, CHI.

[38]  Vicente Nacher,et al.  Design and evaluation of a tangible-mediated robot for kindergarten instruction , 2015, Advances in Computer Entertainment.

[39]  Wafa Johal,et al.  Cellulo: Versatile Handheld Robots for Education , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[40]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[41]  Wafa Johal,et al.  Windfield: Learning Wind Meteorology with Handheld Haptic Robots , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[42]  Zdenek Míkovec,et al.  Collaborative navigation of visually impaired , 2013, Journal on Multimodal User Interfaces.

[43]  J. Feigenbaum,et al.  Allocentric versus egocentric spatial memory after unilateral temporal lobectomy in humans. , 2004, Neuropsychology.

[44]  Stephanie D. Teasley,et al.  The Construction of Shared Knowledge in Collaborative Problem Solving , 1995 .

[45]  Pierre Dillenbourg,et al.  The Benefits and Limitations of Distributing a Tangible Interface in a Classroom , 2013, CSCL.

[46]  Jaime Sánchez,et al.  Teaching the Blind to Find Their Way by Playing Video Games , 2012, PloS one.

[47]  John Bowers,et al.  Assembling the senses: towards the design of cooperative interfaces for visually impaired users , 2004, CSCW.

[48]  Jaime Sánchez,et al.  Usability of a Multimodal Video Game to Improve Navigation Skills for Blind Children , 2010, TACC.

[49]  P. Dillenbourg.  What do you mean by collaborative learning , 1999 .

[50]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[51]  Gilles Bailly,et al.  An Exploratory Study of the Uses of a Multisensory Map - With Visually Impaired Children , 2018, Multimodal Technol. Interact..

[52]  Ana Paiva,et al.  Exploring Collaborative Interactions Between Robots and Blind People , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Frédéric Valentin,et al.  MapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments , 2016, CHI.

[54]  Oussama Metatla,et al.  Robots for Inclusive Play: Co-designing an Educational Game With Visually Impaired and sighted Children , 2020, CHI.

[55]  Leona Holloway,et al.  3D Printed Maps and Icons for Inclusion: Testing in the Wild by People who are Blind or have Low Vision , 2019, ASSETS.