Voices and Voids: Subverting Voice Assistant Systems through Performative Experiments

Responding to concerns such as privacy, surveillance, and the commodification of personal data with regards to voice assistants, this artistic research focuses on creating performative artifacts and vignettes that challenge artificial intelligence (AI) and machine learning (ML) technologies. By allowing AI voice assistants to listen to our most private conversations, we become receptive to their mediated care, while forgetting or ignoring how much these automated interactions have been pre-scripted. With our project Voices and Voids, we reclaim, examine, and ultimately transcode these voice assistant data through interdisciplinary performance and Post-Internet Art. In this paper, we thematically describe 12 vignettes which represent embodied and sonic experiments using a combination of design, data-driven art, cyber crafts, found-object and traditional percussion instruments, spoken word, and movement. We conclude with a discussion of how the experiments worked as a multifaceted whole, and how we used interdisciplinary methods as a central approach.

[1]  Natalia Kovalyova,et al.  Data feminism , 2020, Information, Communication & Society.

[2]  K. Crawford,et al.  Anatomy of an AI System , 2019 .

[3]  Chinmay Kulkarni,et al.  "All Rise for the AI Director": Eliciting Possible Futures of Voice Technology through Story Completion , 2020, Conference on Designing Interactive Systems.

[4]  Frank Bentley,et al.  Understanding the Long-Term Use of Smart Speaker Assistants , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[5]  R. Gonzales Dark matters: on the surveillance of blackness , 2016 .

[6]  Lorrie Faith Cranor,et al.  Your Location has been Shared 5,398 Times!: A Field Study on Mobile App Privacy Nudging , 2015, CHI.

[7]  Sarah Sharples,et al.  Voice Interfaces in Everyday Life , 2018, CHI.

[8]  William W. Gaver What should we expect from research through design? , 2012, CHI.

[9]  Jennifer Thom-Santelli,et al.  Giving Voice to Silent Data: Designing with Personal Music Listening History , 2020, CHI.

[10]  Paul Coulton,et al.  Researching AI Legibility through Design , 2020, CHI.

[11]  Afroditi Psarra,et al.  Moving Design Research: GIFs as Research Tools , 2021, Conference on Designing Interactive Systems.

[12]  Richmond Y. Wong,et al.  An Interface without A User: An Exploratory Design Study of Online Privacy Policies and Digital Legalese , 2018, Conference on Designing Interactive Systems.

[13]  R. Donald The age of surveillance capitalism: the fight for a human future at the new frontier of power , 2020, Journal of Information Technology Case and Application Research.

[14]  Cynthia Breazeal,et al.  "Hey Google is it OK if I eat you?": Initial Explorations in Child-Agent Interaction , 2017, IDC.

[15]  Mary L. Gray,et al.  Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass , 2019 .

[16]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[17]  Eugene Cho,et al.  Hey Google, Can I Ask You Something in Private? , 2019, CHI.

[18]  Pete G. Thomas,et al.  Our Friends Electric: Reflections on Advocacy and Design Research for the Voice Enabled Internet , 2019, CHI.

[19]  Cayla Key,et al.  IoT Data in the Home: Observing Entanglements and Drawing New Encounters , 2020, CHI.

[20]  Emmi Parviainen,et al.  Experiential Qualities of Whispering with Voice Assistants , 2020, CHI.

[21]  Ben Shneiderman,et al.  Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy , 2020, Int. J. Hum. Comput. Interact..

[22]  Matt Ratto,et al.  Critical Making: Conceptual and Material Studies in Technology and Social Life , 2011, Inf. Soc..

[23]  Mohan S. Kankanhalli,et al.  Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda , 2018, CHI.

[24]  Elaheh Sanoubari,et al.  A need for trust in conversational interface research , 2019, CUI.

[25]  Ben Matthews,et al.  Speculative Designs for Emergent Personal Data Trails: Signs, Signals and Signifiers , 2020, CHI Extended Abstracts.

[26]  William Seymour,et al.  How loyal is your Alexa?: Imagining a Respectful Smart Assistant , 2018, CHI Extended Abstracts.

[27]  Lynne Baillie,et al.  Stop annoying me!: an empirical investigation of the usability of app privacy notifications , 2017, OZCHI.

[28]  Richmond Y. Wong,et al.  Real-Fictional Entanglements: Using Science Fiction and Design Fiction to Interrogate Sensing Technologies , 2017, Conference on Designing Interactive Systems.

[29]  M. Søndergaard,et al.  More-Than-Human Design and AI: In Conversation with Agents , 2020, Conference on Designing Interactive Systems.

[30]  Stuart Reeves Conversation considered harmful? , 2019, CUI.

[31]  James Pierce,et al.  Smart Home Security Cameras and Shifting Lines of Creepiness: A Design-Led Inquiry , 2019, CHI.