Auditory menus are not just spoken visual menus: a case study of "unavailable" menu items

Auditory menus can supplement or replace visual menus to enhance usability and accessibility. Despite the rapid increase of research on auditory displays, more is still needed to optimize the auditory-specific aspects of these implementations. In particular, there are several menu attributes and features that are often displayed visually, but that are not or poorly conveyed in the auditory version of the menu. Here, we report on two studies aimed at determining how best to render the important concept of an unavailable menu item. In Study 1, 23 undergraduates navigated a Microsoft Word-like auditory menu with a mix of available and unavailable items. For unavailable items, using whisper was favored over attenuated voice or saying "unavailable". In Study 2, 26 undergraduates navigated a novel auditory menu. With practice, whispering unavailable items was more effective than skipping unavailable items. Results are discussed in terms of acoustic theory and cognitive menu selection theory.

[1]  Bruce N. Walker,et al.  Advanced auditory menus: design and evaluation of auditory scroll bars , 2008, Assets '08.

[2]  Elizabeth D. Mynatt,et al.  The design and evaluation of an auditory-enhanced scrollbar , 1994, CHI '94.

[3]  Stephen A. Brewster,et al.  The design of sonically-enhanced widgets , 1998, Interact. Comput..

[4]  Takashi Itoh,et al.  User interface of a Home Page Reader , 1998, Assets '98.

[5]  Gregory Kramer,et al.  An introduction to auditory display , 1994 .

[6]  William W. Gaver.  The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[7]  Myounghoon Jeon,et al.  “Spindex”: Accelerated Initial Speech Sounds Improve Navigation Performance in Auditory Menus , 2009 .

[8]  Ben Shneiderman,et al.  The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface , 1991 .

[9]  Pierre Dragicevic,et al.  Earpod: eyes-free menu selection using touch input and reactive audio feedback , 2007, CHI.

[10]  Stephen Brewster,et al.  Designing non-speech sounds to support navigation in mobile phone menus , 2000 .

[11]  Joanna McGrenere,et al.  A comparison of static, adaptive, and adaptable menus , 2004, CHI.

[12]  Bruce N. Walker,et al.  Auditory Interfaces and Sonification , 2009, The Universal Access Handbook.

[13]  Alistair D. N. Edwards,et al.  Improving the usability of speech-based interfaces for blind users , 1996, Assets '96.

[14]  Tilman Dingler,et al.  Learnabiltiy of Sound Cues for Environmental Features: Auditory Icons, Earcons, Spearcons, and Speech , 2008 .

[15]  Bruce N. Walker,et al.  LEARNING RATES FOR AUDITORY MENUS ENHANCED WITH SPEARCONS VERSUS EARCONS , 2007 .

[16]  Bruce N. Walker,et al.  Navigation Efficiency of Two Dimensional Auditory Menus Using Spearcon Enhancements , 2008 .

[17]  Stephen Brewster,et al.  Using non-speech sound to overcome information overload , 1997 .

[18]  Stephen A. Brewster,et al.  Maximising screen-space on mobile computing devices , 1999, CHI Extended Abstracts.

[19]  Stephen A. Brewster,et al.  Investigating touchscreen accessibility for people with visual impairments , 2008, NordiCHI.

[20]  Frankie James,et al.  Lessons from developing audio HTML interface , 1998, Assets '98.

[21]  Myounghoon Jeon,et al.  Enhanced auditory menu cues improve dual task performance and are preferred with in-vehicle technologies , 2009, AutomotiveUI.

[22]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[23]  Bruce N. Walker,et al.  Advanced Auditory Menus , 2007 .

[24]  William W. Gaver.  Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[25]  Stephen A. Brewster,et al.  Using nonspeech sounds to provide navigation cues , 1998, TCHI.

[26]  Elizabeth D. Mynatt,et al.  Mapping GUIs to auditory interfaces , 1992, UIST '92.

[27]  Bruce N. Walker,et al.  SPEARCONS: SPEECH-BASED EARCONS IMPROVE NAVIGATION PERFORMANCE IN AUDITORY MENUS , 2006 .

[28]  Benjamin K. Davison,et al.  AudioPlusWidgets: Bringing Sound to Software Widgets and Interface Components , 2008 .

[29]  Eric S. Lee,et al.  "The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface, " by Kent L. Norman (Book Review) , 1993, Int. J. Man Mach. Stud..

[30]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[31]  Myounghoon Jeon,et al.  Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance , 2011, TACC.

[32]  Helen Petrie,et al.  Auditory navigation in hyperspace: Design and evaluation of a non-visual hypermedia system for blind users , 1999, Behav. Inf. Technol..

[33]  Peer Shajahan,et al.  Manipulating synthetic voice parameters for navigation in hierarchical structures , 2005 .

[34]  C. Hall.  Lessons from Developing Audio HTML Interfaces , 1998 .

[35]  Ephraim P. Glinert,et al.  Computers and People with Disabilities , 2008, TACC.

[36]  Aidan Kehoe,et al.  Designing help topics for use with text-to-speech , 2006, SIGDOC '06.

[37]  T. V. Raman.  Auditory User Interfaces: Toward the Speaking Computer , 1997 .

[38]  Li Gong,et al.  Shall we mix synthetic speech and human speech?: impact on users' performance, perception, and attitude , 2001, CHI.

[39]  E. Gilder,et al.  The Authors , 1977 .

[40]  Stephen A. Brewster,et al.  Earcons as a Method of Providing Navigational Cues in a Menu Hierarchy , 1996, BCS HCI.

[41]  James Thatcher.  Screen reader/2: access to OS/2 and the graphical user interface , 1994, Assets '94.

[42]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[43]  A BrewsterStephen.  Using nonspeech sounds to provide navigation cues , 1998 .

[44]  Elizabeth D. Mynatt.  Transforming Graphical Interfaces Into Auditory Interfaces for Blind Users , 1997, Hum. Comput. Interact..

[45]  Michael Cohen,et al.  Extending the notion of a window system to audio , 1990, Computer.

[46]  Alistair D. N. Edwards,et al.  Soundtrack: An Auditory Interface for Blind Users (Abstract Only) , 1989, SGCH.