“Voice-First Interfaces in a GUI-First Design World”: Barriers and Opportunities to Supporting VUI Designers On-the-Job

Voice user interfaces (VUIs) are currently experiencing rapid growth as commercial devices like Google Home, Amazon Echo, and Apple Homepod are adopted by users. However, due to the pace of this growth, the tech industry has had to adapt quickly and vigorously to keep up with demand. Due to this, we currently have limited understanding of the environment of VUI design in industry, including the various multitude of practices and tools that are used. We also have a limited understanding of the barriers VUI designers currently still face. To address such knowledge gaps, we conducted a large-scale online survey to explore the design practices employed by VUI industry designers on-the-job, and the barriers and needs of VUI designers. We found that despite the availability of a wide range of guidelines, textbooks, tools, etc, there are significant gaps in the adoption of these tools within VUI industry design, and that designers rely on their previous experience in developing GUIs when designing VUIs. Based on our survey findings, we provide recommendations for how the HCI community may direct research efforts in developing tools to assist designers in overcoming existing barriers and build usable and adoptable VUIs.

[1]  Benjamin R. Cowan,et al.  Finding a New Voice: Transitioning Designers from GUI to VUI Design , 2021, CUI.

[2]  Benjamin R. Cowan,et al.  Let’s Talk About CUIs: Putting Conversational User Interface Design Into Practice , 2021, CHI Extended Abstracts.

[3]  Benjamin R. Cowan,et al.  Heuristic Evaluation of Conversational Agents , 2021, CHI.

[4]  Cosmin Munteanu,et al.  Alexa, How Do I Build a VUI Curriculum? , 2020, CIU.

[5]  Joel E. Fischer,et al.  NottReal: A Tool for Voice-based Wizard of Oz studies , 2020, CIU.

[6]  Christine Murad,et al.  Designing Voice Interfaces: Back to the (Curriculum) Basics , 2020, CHI.

[7]  Christine Murad,et al.  "I don't know what you're talking about, HALexa": the case for voice user interface guidelines , 2019, CUI.

[8]  Jichen Zhu,et al.  The Impact of User Characteristics and Preferences on Performance with an Unfamiliar Voice User Interface , 2019, CHI.

[9]  Frank Bentley,et al.  Music, Search, and IoT , 2019, ACM Trans. Comput. Hum. Interact..

[10]  Benjamin R. Cowan,et al.  Revolution or Evolution? Speech Interaction and HCI Design Guidelines , 2019, IEEE Pervasive Computing.

[11]  Benjamin R. Cowan,et al.  Design guidelines for hands-free speech interaction , 2018, MobileHCI Adjunct.

[12]  James A. Landay,et al.  Evaluating Speech-Based Smart Devices Using New Usability Heuristics , 2018, IEEE Pervasive Computing.

[13]  Benjamin R. Cowan,et al.  "What can i help you with?": infrequent users' experiences of intelligent personal assistants , 2017, MobileHCI.

[14]  Jichen Zhu,et al.  Learnability through Adaptive Discovery Tools in Voice User Interfaces , 2017, CHI Extended Abstracts.

[15]  Sarah Mennicken,et al.  "It's like living with a friendly stranger": perceptions of personality traits in a smart home , 2016, UbiComp.

[16]  Astrid Weber,et al.  What can I say?: addressing user experience challenges of a mobile voice user interface for accessibility , 2016, MobileHCI.

[17]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[18]  J. Ponto Understanding and Evaluating Survey Research , 2015, Journal of the advanced practitioner in oncology.

[19]  Zeljko Obrenovic,et al.  Rethinking HCI education: teaching interactive computing concepts based on the experiential learning paradigm , 2012, INTR.

[20]  Spyros Vosinakis,et al.  Rethinking HCI Education for Design: Problem-Based Learning and Virtual Worlds at an HCI Design Studio , 2012, Int. J. Hum. Comput. Interact..

[21]  Virginica Rusu,et al.  A Methodology to Establish Usability Heuristics , 2011, ACHI 2011.

[22]  Renata Pontin de Mattos Fortes,et al.  A survey on the accessibility awareness of people involved in web development projects in Brazil , 2008, W4A '08.

[23]  Mary Czerwinski,et al.  Voicepedia: towards speech-based access to unstructured information , 2007, INTERSPEECH.

[24]  Jonathan Lazar,et al.  Improving web accessibility: a study of webmaster perceptions , 2004, Comput. Hum. Behav..

[25]  Sarah A. Douglas,et al.  Teaching HCI Design With the Studio Approach , 2003, Comput. Sci. Educ..

[26]  Bernhard Suhm,et al.  Towards best practices for speech user interface design , 2003, INTERSPEECH.

[27]  Ben Shneiderman,et al.  The limits of speech recognition , 2000, CACM.

[28]  Gina-Anne Levow,et al.  Designing SpeechActs: issues in speech user interfaces , 1995, CHI '95.

[29]  Christine Murad “I Don’t KnowWhat You’re Talking About, HALexa”: , 2019 .

[30]  Aaron Sedley,et al.  Survey Research in HCI , 2014, Ways of Knowing in HCI.

[31]  Alexander I. Rudnicky Speech Interface Guidelines , 1996 .