Using Sonification and Haptics to Represent Overlapping Spatial Objects: Effects on Accuracy

For blind and visually impaired people, the access to spatial information is crucial. Therefore, the development of non-visual interfaces to spatial representations, e.g. maps and floor plans, are important tasks. In earlier empirical work [19], we investigated virtual haptic floor plans, accessible through a Phantomforce feedback device, which allows haptic exploration of virtual objects (walls), in combination with sonification for representing overlapping objects (windows). In the following we present an empirical study on multiple-overlap constellations (in the room-plan scenario: walls, windows and radiators). We reduced the complexity of the environments from complete apartments to only one wall and overlapping subsections, to focus on the spatial accuracy of acquired knowledge. This one-wall experiment has two goals: to compare the accuracy of size and position estimation with the experiment with complete apartments and to investigate the usability of sonification to represent overlapping entities at walls. Qualitative measures on the correctness of overlap-relationship identification and quantitative investigation on the accuracy of size and position estimations are discussed. The results can be extended to the use of sonification to represent overlapping entities in general.

[1]  Bruce N. Walker,et al.  Auditory Interfaces and Sonification , 2009, The Universal Access Handbook.

[2]  S. Shamma,et al.  Temporal coherence and attention in auditory scene analysis , 2011, Trends in Neurosciences.

[3]  Wilfried Brauer,et al.  Spatial Cognition II , 2000, Lecture Notes in Computer Science.

[4]  Niels Ole Bernsen,et al.  Foundations of Multimodal Representations: A Taxonomy of Representational Modalities , 1994, Interact. Comput..

[5]  Densil Cabrera,et al.  Evaluation of Spatial Presentation in Sonification for Identifying Concurrent Audio Streams , 2007 .

[6]  ChoiSeungmoon,et al.  Perceived Instability of Virtual Haptic Texture , 2007 .

[7]  T. Vecchi,et al.  Blind Vision: The Neuroscience of Visual Impairment , 2011 .

[8]  Charlotte Magnusson,et al.  Phantom-based haptic line graphics for blind persons , 2003 .

[9]  Stephan Winter,et al.  Spatial Information Theory, 8th International Conference, COSIT 2007, Melbourne, Australia, September 19-23, 2007, Proceedings , 2007, COSIT.

[10]  Constantine Stephanidis,et al.  The Universal Access Handbook , 2009 .

[11]  Stephen Brewster,et al.  Using non-speech sound to overcome information overload , 1997 .

[12]  David Mioduser,et al.  Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind , 2008, Int. J. Hum. Comput. Stud..

[13]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[14]  Helen Petrie,et al.  Use of a haptic device by blind and sighted people : perception of virtual textures and objects , 1998 .

[15]  Rolf Nordahl,et al.  Haptic and Audio Interaction Design - 5th International Workshop, HAID 2010, Copenhagen, Denmark, September 16-17, 2010. Proceedings , 2010, HAID.

[16]  Christopher Habel,et al.  Linking Spatial Haptic Perception to Linguistic Representations: Assisting Utterances for Tactile-Map Explorations , 2011, COSIT.

[17]  Lars Kulik,et al.  The Influence of Linear Shapes on Solving Interval-Based Configuration Problems , 2000, Spatial Cognition.

[18]  Kirsten Rassmus-Gröhn,et al.  User Centered Design of Non-Visual Audio-Haptics , 2008 .

[19]  Mark Blades,et al.  The reliability of data collected from sketch maps , 1990 .

[20]  I. Placencia Porrero,et al.  Improving the Quality of Life for the European Citizen: Technology for Inclusive Design and Equality , 1998 .

[21]  R. Klatzky,et al.  Similarity of Tactual and Visual Picture Recognition with Limited Field of View , 1991, Perception.

[22]  Christopher Habel,et al.  A Haptic-Audio Interface for Acquiring Spatial Knowledge about Apartments , 2012, HAID.

[23]  Hong Z. Tan,et al.  Perceived Instability of Virtual Haptic Texture. I. Experimental Studies , 2004, Presence: Teleoperators & Virtual Environments.