Exploring the Use of a Voice-based Conversational Agent to Empower Adolescents with Autism Spectrum Disorder

Voice-based Conversational Agents (VCA) have served as personal assistants that support individuals with special needs. Adolescents with Autism Spectrum Disorder (ASD) may also benefit from VCAs to deal with their everyday needs and challenges, ranging from self-care to social communications. In this study, we explored how VCAs could encourage adolescents with ASD in navigating various aspects of their daily lives through the two-week use of VCAs and a series of participatory design workshops. Our findings demonstrated that VCAs could be an engaging, empowering, emancipating tool that supports adolescents with ASD to address their needs, personalities, and expectations, such as promoting self-care skills, regulating negative emotions, and practicing conversational skills. We propose implications of using off-the-shelf technologies as a personal assistant to ASD users in Assistive Technology design. We suggest design implications for promoting positive opportunities while mitigating the remaining challenges of VCAs for adolescents with ASD.

[1]  Jodi Forlizzi,et al.  Understanding my data, myself: supporting self-reflection with ubicomp technologies , 2011, UbiComp '11.

[2]  Robert E. Kraut,et al.  Social capital on facebook: differentiating uses and users , 2011, CHI.

[3]  Ole Iversen,et al.  Scandinavian participatory design: dialogic curation with teenagers , 2012, IDC '12.

[4]  Margot Brereton,et al.  Co-Design Beyond Words: 'Moments of Interaction' with Minimally-Verbal Children on the Autism Spectrum , 2019, CHI.

[5]  Hilary Johnson,et al.  Developing IDEAS: supporting children with autism within a participatory design team , 2012, CHI.

[6]  Anne Marie Piper,et al.  Making as Expression: Informing Design with People with Complex Communication Needs through Art Therapy , 2018, CHI.

[7]  Jodi Forlizzi,et al.  "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage , 2018, Conference on Designing Interactive Systems.

[8]  Jon Whittle,et al.  Prototyping 'clasp': implications for designing digital technology for and with adults with autism , 2014, Conference on Designing Interactive Systems.

[9]  Christoph Bartneck,et al.  Anthropomorphism: Opportunities and Challenges in Human–Robot Interaction , 2014, International Journal of Social Robotics.

[10]  E LadnerRichard,et al.  Increasing the participation of individuals with disabilities in computing , 2015 .

[11]  Christopher Frauenberger,et al.  Embodied Companion Technologies for Autistic Children , 2016, TEI.

[12]  Gillian R. Hayes,et al.  Interactive visual supports for children with autism , 2010, Personal and Ubiquitous Computing.

[13]  Richard E. Ladner,et al.  Increasing the Participation of People with Disabilities in Computing Fields , 2007, Computer.

[14]  Yeoreum Lee,et al.  Design Opportunities in Three Stages of Relationship Development between Users and Self-Tracking Devices , 2016, CHI.

[15]  B Phillips,et al.  Predictors of assistive technology abandonment. , 1993, Assistive technology : the official journal of RESNA.

[16]  R. Ladner.  Accessible Technology and Models of Disability , 2011 .

[17]  Apoorva Bhalla,et al.  An exploratory study understanding the appropriated use of voice-based Search and Assistants , 2018, IndiaHCI.

[18]  Benjamin R. Cowan,et al.  What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents , 2019, CHI.

[19]  L. R. Sutton,et al.  Understanding the Self in Individuals with Autism Spectrum Disorders (ASD): A Review of Literature , 2017, Front. Psychol..

[20]  Paul Dourish,et al.  The Appropriation of Interactive Technologies: Some Lessons from Placeless Documents , 2003, Computer Supported Cooperative Work (CSCW).

[21]  Christopher Frauenberger,et al.  Thinking OutsideTheBox - Designing Smart Things with Autistic Children , 2018, Int. J. Hum. Comput. Interact..

[22]  Cynthia Breazeal,et al.  "Hey Google is it OK if I eat you?": Initial Explorations in Child-Agent Interaction , 2017, IDC.

[23]  Minji Cho,et al.  "Nobody Speaks that Fast!" An Empirical Study of Speech Rate in Conversational Agents for People with Vision Impairments , 2020, CHI.

[24]  Gregory D. Abowd,et al.  Interactive technologies for autism , 2007, CHI Extended Abstracts.

[25]  Margot Brereton,et al.  Use of voice activated interfaces by people with intellectual disability , 2018, OZCHI.

[26]  Bung-Nyun Kim,et al.  A Randomized Controlled Trial of the Korean Version of the PEERS® Parent‐Assisted Social Skills Training Program for Teens With ASD , 2014, Autism research : official journal of the International Society for Autism Research.

[27]  S. Shyam Sundar,et al.  What drives customization?: control or identity? , 2011, CHI.

[28]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[29]  C. Gillberg.  Autistic Children Growing Up: Problems during Puberty and Adolescence , 1984, Developmental medicine and child neurology.

[30]  Christopher Frauenberger,et al.  Designing Smart Objects with Autistic Children: Four Design Exposès , 2016, CHI.

[31]  Lizbeth Escobedo,et al.  MOSOCO: a mobile assistive tool to support children with autism practicing social skills in real-life situations , 2012, CHI.

[32]  S. Shyam Sundar,et al.  Alexa as Coach: Leveraging Smart Speakers to Build Social Agents that Reduce Public Speaking Anxiety , 2020, CHI.

[33]  Richard E. Ladner,et al.  Increasing the participation of individuals with disabilities in computing , 2015, Commun. ACM.

[34]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[35]  Richard E. Ladner,et al.  Design for user empowerment , 2014, CHI Extended Abstracts.

[36]  Alessandro Soro,et al.  Beyond Independence: Enabling Richer Participation through Relational Technologies , 2019, OZCHI.

[37]  Greg Walsh,et al.  Factors Affecting Seniors' Perceptions of Voice-enabled User Interfaces , 2018, CHI Extended Abstracts.

[38]  Krzysztof Z. Gajos,et al.  Ability-Based Design: Concept, Principles and Examples , 2011, TACC.

[39]  R. Koller.  Sexuality and Adolescents with Autism , 2000 .

[40]  Radhika Garg,et al.  Conversational Technologies for In-home Learning: Using Co-Design to Understand Children's and Parents' Perspectives , 2020, CHI.

[41]  Bert Massie,et al.  The Social Model of Disability , 1993 .

[42]  Robert E. Kraut,et al.  Social use of computer-mediated communication by adults on the autism spectrum , 2010, CSCW '10.

[43]  Sarah Sharples,et al.  Voice Interfaces in Everyday Life , 2018, CHI.

[44]  Verena Rieser,et al.  #MeToo Alexa: How Conversational Systems Respond to Sexual Harassment , 2018, EthNLP@NAACL-HLT.

[45]  M. Seltzer,et al.  Employment and Post-Secondary Educational Activities for Young Adults with Autism Spectrum Disorders During the Transition to Adulthood , 2011, Journal of autism and developmental disorders.

[46]  Amy Hurst,et al.  Empowering individuals with do-it-yourself assistive technology , 2011, ASSETS.

[48]  Mark Warschauer,et al.  What Are You Talking To?: Understanding Children's Perceptions of Conversational Agents , 2020, CHI.

[49]  Fumio Hara,et al.  A basic study on dynamic control of facial expressions for Face Robot , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[50]  Youn-kyung Lim,et al.  Investigating User Expectations on the Roles of Family-shared AI Speakers , 2020, CHI.

[51]  Hwajung Hong,et al.  Graphical Social Scenarios: Toward Intervention and Authoring for Adolescents with High Functioning Autism , 2009, AAAI Fall Symposium: Virtual Healthcare Interaction.

[52]  Gillian R. Hayes,et al.  Would You Be Mine: Appropriating Minecraft as an Assistive Technology for Youth with Autism , 2016, ASSETS.

[53]  Christopher Frauenberger,et al.  Challenges, opportunities and future perspectives in including children with disabilities in the design of interactive technology , 2012, IDC '12.

[54]  G. Dichter,et al.  A Nexus Model of Restricted Interests in Autism Spectrum Disorder , 2020, Frontiers in Human Neuroscience.

[55]  Annika Silvervarg,et al.  Building a Social Conversational Pedagogical Agent: Design Challenges and Methodological approaches , 2010 .

[56]  Sangsu Lee,et al.  "What does your Agent look like?": A Drawing Study to Understand Users' Perceived Persona of Conversational Agent , 2019, CHI Extended Abstracts.

[57]  P. Jaeger.  Disability and the Internet: Confronting a Digital Divide , 2011 .

[58]  L. Marcus,et al.  Families of Adults with Autism Spectrum Disorders , 2014 .

[59]  Sonya S. Kwak,et al.  Evaluation of the expressions of robotic emotions of the emotional robot, "Mung" , 2009, ICUIMC '09.

[60]  R. Hobson,et al.  What is autism? , 1991, The Psychiatric clinics of North America.

[61]  Lola Cannery,et al.  I Show You how I Like You-Can You Read it in My Face , 2001 .

[62]  Christopher Frauenberger,et al.  Blending Methods: Developing Participatory Design Sessions for Autistic Children , 2017, IDC.

[63]  Mun Yong Yi,et al.  Empathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse , 2020, CHI.

[64]  Robin R. Murphy,et al.  Survey of Non-facial/Non-verbal Affective Expressions for Appearance-Constrained Robots , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[65]  Aung Pyae,et al.  Investigating the usability and user experiences of voice user interface: a case of Google home smart speaker , 2018, MobileHCI Adjunct.

[66]  Gillian R. Hayes.  Inclusive and engaged HCI , 2020, Interactions.

[67]  Margot Brereton,et al.  Digital Strategies for Supporting Strengths- and Interests-based Learning with Children with Autism , 2017, ASSETS.

[68]  Lola Cañamero,et al.  I show you how I like you - can you read it in my face? [robotics] , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[69]  Christoph Stahl,et al.  Maintaining multiple sclerosis patients' quality of life: a case study on environment control assistance in a smart home , 2017, PETRA.

[71]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[72]  Shruti Sannon,et al.  "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo , 2017, CHI Extended Abstracts.

[73]  Cynthia Breazeal,et al.  Social interactions in HRI: the robot view , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[74]  Leah Findlater,et al.  "Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities , 2018, CHI.

[75]  Gregory D. Abowd,et al.  Designing a social network to support the independence of young adults with autism , 2012, CSCW.