A Mouse With Ears Explores Maps

This paper describes a set of techniques designed to assist visually impaired and blind users build mental models of geographic maps without the use of special hardware beyond what is needed to support a web browser, mouse, and sound card. The methods described make use of auditory signals which serve as corrective feedback information for users as they attempt to learn geographic data from these maps. The mental model is built by tracing paths and locating objects on the maps. We claim that the user's activity of tracing and location discovery constructs a mental model through motion of the hand - the reverse of the process by which blind users draw objects which they have never seen. Experiments evaluating these methods will be reported in a subsequent paper.

[1]  L. Kay,et al.  A sonar aid to enhance spatial perception of the blind: engineering design and evaluation , 1974 .

[2]  Lorna M. Brown,et al.  DRAWING BY EAR: INTERPRETING SONIFIED LINE GRAPHS , 2003 .

[3]  R. Dan Jacobson Navigating maps with little or no sight: An audio-tactile approach , 1998 .

[4]  David A. Ross,et al.  Wearable interfaces for orientation and wayfinding , 2000, Assets '00.

[5]  Peter Gorny,et al.  TYPOGRAPHIC SEMANTICS OF WEBPAGES ACCESSIBLE FOR VISUALLY IMPAIRED USERS Mapping Layout and Interaction Objects to an Auditory Interaction Space , 2000 .

[6]  John H. Flowers,et al.  Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples , 1997, Hum. Factors.

[7]  Igor Juricevic,et al.  Haptics and Projection: Drawings by Tracy, a Blind Adult , 2003, Perception.

[8]  Catherine Plaisant,et al.  Information Visualization and the Challenge of Universal Usability , 2005 .

[9]  G. Bishop,et al.  BATS: The Blind Audio Tactile Mapping System , 2003 .

[10]  Abdelsalam Helal,et al.  Drishti: an integrated navigation system for visually impaired and disabled , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[11]  Rick Kazman,et al.  Audio enhanced 3D interfaces for visually impaired users , 1996, CHI '96.

[12]  Iwan Ulrich,et al.  The GuideCane-a computerized travel aid for the active guidance of blind pedestrians , 1997, Proceedings of International Conference on Robotics and Automation.

[13]  Terri L. Bonebright,et al.  Testing the effectiveness of sonified graphs for education: A programmatic research project , 2001 .

[14]  Peter Gorny,et al.  Auditory direct manipulation of acoustical objects by blind computer users , 1994 .

[15]  James A. Landay,et al.  Sketching images eyes-free: a grid-based dynamic drawing tool for the blind , 2002, Assets '02.

[16]  Ben Shneiderman,et al.  "I hear the pattern": interactive sonification of geographical data patterns , 2005, CHI EA '05.

[17]  Ben Shneiderman,et al.  Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study , 2004, ICAD.

[18]  James A. Landay,et al.  A study of blind drawing practice: creating graphical information without the visual channel , 2000, Assets '00.