"All Rise for the AI Director": Eliciting Possible Futures of Voice Technology through Story Completion

How might the capabilities of voice assistants several decades in the future shape human society? To anticipate the space of possible futures for voice assistants, we asked 149 participants to each complete a story based on a brief story stem set in the year 2050 in one of five different contexts: the home, doctor's office, school, workplace, and public transit. Story completion as a method elicits participants' visions of possible futures, unconstrained by their understanding of current technological capabilities, but still reflective of current sociocultural values. Through a thematic analysis, we find these stories reveal the extremes of the capabilities and concerns of today's voice assistants---and artificial intelligence---such as improving efficiency and offering instantaneous support, but also replacing human jobs, eroding human agency, and causing harm through malfunction. We conclude by discussing how these speculative visions might inform and inspire the design of voice assistants and other artificial intelligence.

[1]  Gina-Anne Levow,et al.  Designing SpeechActs: issues in speech user interfaces , 1995, CHI '95.

[2]  Virpi Roto,et al.  The role of design fiction in participatory design processes , 2018, NordiCHI.

[3]  Gavin Wood,et al.  "They're Just Tixel Pits, Man": Disputing the 'Reality' of Virtual Reality Pornography through the Story Completion Method , 2017, CHI.

[4]  Richmond Y. Wong,et al.  When BCIs have APIs: Design Fictions of Everyday Brain-Computer Interface Adoption , 2018, Conference on Designing Interactive Systems.

[5]  Kun-Pyo Lee,et al.  Once a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home are Forgotten , 2019, Conference on Designing Interactive Systems.

[6]  Emily Jennings,et al.  Breaking gendered boundaries? Exploring constructions of counter-normative body hair practices in Āotearoa/New Zealand using story completion , 2019, Qualitative Research in Psychology.

[7]  Lone Koefoed Hansen,et al.  Intimate Futures: Staying with the Trouble of Digital Personal Assistants through Design Fiction , 2018, Conference on Designing Interactive Systems.

[8]  Mark West,et al.  I'd blush if I could: closing gender divides in digital skills through education , 2019 .

[9]  Hannah Frith,et al.  Editorial Introduction to the Special Issue: Using Story Completion Methods in Qualitative Research , 2019, Qualitative Research in Psychology.

[10]  J. G. Tanenbaum,et al.  Design fictional interactions , 2014, Interactions.

[11]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[12]  Jens Edlund,et al.  The State of Speech in HCI: Trends, Themes and Challenges , 2018, Interact. Comput..

[13]  Leah Findlater,et al.  "Phantom Friend" or "Just a Box with Information" , 2019, Proc. ACM Hum. Comput. Interact..

[14]  Celia Kitzinger,et al.  Engendering Infidelity: Essentialist and Social Constructionist Readings of a Story Completion Task , 1995 .

[15]  Matthew P. Aylett,et al.  The right kind of unnatural: designing a robot voice , 2019, CUI.

[16]  Roger K. Moore.  Appropriate Voices for Artefacts: Some Key Insights , 2017 .

[17]  Jason C. Yip,et al.  Communication Breakdowns Between Families and Alexa , 2019, CHI.

[18]  Virginia Braun,et al.  Thou Shalt Not Covet Another Man? Exploring Constructions of Same‐Sex and Different‐Sex Infidelity Using Story Completion , 2015 .

[19]  Shaun W. Lawson,et al.  Voice as a Design Material: Sociophonetic Inspired Design Strategies in Human-Computer Interaction , 2019, CHI.

[20]  Christian Dindler,et al.  Fictional Inquiry—design collaboration in a shared narrative space , 2007 .

[21]  Chinmay Kulkarni,et al.  One Voice Fits All? Social Implications and Research Challenges of Designing Voices for Smart Devices , 2019 .

[22]  Anne Marie Piper,et al.  "Siri, is this you?": Understanding young children's interactions with voice input systems , 2015, IDC.

[23]  Benjamin R. Cowan,et al.  Design guidelines for hands-free speech interaction , 2018, MobileHCI Adjunct.

[24]  Virginia Braun,et al.  Collecting Qualitative Data: A Practical Guide to Textual, Media and Virtual Techniques , 2017 .

[25]  Ben Shneiderman,et al.  The limits of speech recognition , 2000, CACM.

[26]  Jichen Zhu,et al.  Patterns for How Users Overcome Obstacles in Voice User Interfaces , 2018, CHI.

[27]  M RussellDaniel,et al.  Can we look to science fiction for innovation in HCI , 2018 .

[28]  Benjamin R. Cowan,et al.  "What can i help you with?": infrequent users' experiences of intelligent personal assistants , 2017, MobileHCI.

[29]  Sarah Sharples,et al.  Voice Interfaces in Everyday Life , 2018, CHI.

[30]  Shruti Sannon,et al.  "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo , 2017, CHI Extended Abstracts.

[31]  Allison Druin,et al.  CHI 2039: speculative research visions , 2014, CHI Extended Abstracts.

[32]  Flavio Figueiredo,et al.  The Effect of Audiences on the User Experience with Conversational Interfaces in Physical Spaces , 2019, CHI.

[33]  Jodi Forlizzi,et al.  "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage , 2018, Conference on Designing Interactive Systems.

[34]  W. Keith Edwards,et al.  Intersectional HCI: Engaging Identity through Gender, Race, and Class , 2017, CHI.

[35]  Paul Dourish,et al.  “Resistance is futile”: reading science fiction alongside ubiquitous computing , 2014, Personal and Ubiquitous Computing.

[36]  Mark Blythe,et al.  Imaginary Design Workbooks: Constructive Criticism and Practical Provocation , 2018, CHI.

[37]  Benjamin R. Cowan,et al.  Revolution or Evolution? Speech Interaction and HCI Design Guidelines , 2019, IEEE Pervasive Computing.

[38]  M. Six Silberman,et al.  Reading Elinor Ostrom In Silicon Valley: Exploring Institutional Diversity on the Internet , 2016, GROUP.

[39]  Anthony Dunne,et al.  Speculative Everything: Design, Fiction, and Social Dreaming , 2013 .

[40]  Astrid Weber,et al.  What can I say?: addressing user experience challenges of a mobile voice user interface for accessibility , 2016, MobileHCI.

[41]  Miriam Sturdee,et al.  Implications for Adoption , 2017, CHI.

[42]  Elke E. Mattheiss,et al.  From Awareness to Empowerment: Using Design Fiction to Explore Paths towards a Sustainable Energy Future , 2015, CSCW.

[43]  Chinmay Kulkarni,et al.  Vitro: Designing a Voice Assistant for the Scientific Lab Workplace , 2019, Conference on Designing Interactive Systems.

[44]  Henriette Cramer,et al.  "Play PRBLMS": Identifying and Correcting Less Accessible Content in Voice Interfaces , 2018, CHI.

[45]  Alessandro Soro,et al.  The Adventures of Older Authors: Exploring Futures through Co-Design Fictions , 2019, CHI.

[46]  Martin Porcheron.  Conversational agent use in a café , 2017 .

[47]  Mark Blythe,et al.  Research through design fiction: narrative in real and imaginary abstracts , 2014, CHI.

[48]  Selma Sabanovic,et al.  I Beg to Differ: Soft Conflicts in Collaborative Design Using Design Fictions , 2019, Conference on Designing Interactive Systems.

[49]  Sarah Sharples,et al.  "Do Animals Have Accents?": Talking with Agents in Multi-Party Conversation , 2017, CSCW.

[50]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .