From Research to Practice: Informing the Design of Autism Support Smart Technology

Smart technologies (wearable and mobile devices) show tremendous potential in the detection, diagnosis, and management of Autism Spectrum Disorder (ASD) by enabling continuous real-time data collection, identifying effective treatment strategies, and supporting intervention design and delivery. Though promising, effective utilization of smart technology in aiding ASD is still limited. We propose a set of implications to guide the design of ASD-support technology by analyzing 149 peer-reviewed articles focused on children with autism from ACM Digital Library, IEEE Xplore, and PubMed. Our analysis reveals that technology should facilitate real-time detection and identification of points-of-interest, adapt its behavior driven by the real-time affective state of the user, utilize familiar and unfamiliar features depending on user-context, and aid in revealing even minuscule progress made by children with autism. Our findings indicate that such technology should strive to blend-in with everyday objects. Moreover, gradual exposure and desensitization may facilitate successful adaptation of novel technology.

[1]  Sri Hastuti Kurniawan,et al.  Online learning system for teaching basic skills to people with developmental disabilities , 2014, ASSETS.

[2]  Maryse Lavoie,et al.  A Tool to Diagnose Autism in Children Aged Between Two to Five Old: An Exploratory Study with the Robot QueBall , 2015, HRI.

[3]  Eija Kärnä,et al.  Review of Research on Children with Autism Spectrum Disorder and the Use of Technology , 2015 .

[4]  Catherine Lord,et al.  1 Autism Spectrum Disorders: Phenotype and Diagnosis , 2006 .

[5]  Antonio Coronato,et al.  Towards a Personal Health Records system for patients with Autism Spectrum Disorders , 2014, 2014 IEEE Symposium on Computational Intelligence in Healthcare and e-health (CICARE).

[6]  Changchun Liu,et al.  Online Affect Detection and Robot Behavior Adaptation for Intervention of Children With Autism , 2008, IEEE Transactions on Robotics.

[7]  Gregory D. Abowd,et al.  Prototyping and sampling experience to evaluate ubiquitous computing privacy in the real world , 2006, CHI.

[8]  Marc Langheinrich,et al.  Encountering SenseCam: personal recording technologies in everyday life , 2009, UbiComp.

[9]  Alex Martin,et al.  Facial Emotion Recognition in Autism Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies , 2010, Neuropsychology Review.

[10]  N. Sarkar,et al.  Design of a Virtual Reality Based Adaptive Response Technology for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Agata Rozga,et al.  Towards in-home collection of behavior specimens: Within the cultural context of autism in Pakistan , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[12]  Changchun Liu,et al.  Affect Recognition in Robot Assisted Rehabilitation of Children with Autism Spectrum Disorder , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Xi Wang,et al.  A real-time selective speaker cancellation system for relieving social anxiety in autistics , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[14]  Roger Pierangelo,et al.  Teaching Students With Autism Spectrum Disorders , 2008 .

[15]  F. Keller,et al.  Sensor-based technology in the study of motor skills in infants at risk for ASD , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[16]  Fei Tang,et al.  Development of a low-cost tactile sleeve for autism intervention , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[17]  Uttama Lahiri,et al.  Dynamic gaze measurement with adaptive response technology in Virtual Reality based social communication for autism , 2011, 2011 International Conference on Virtual Rehabilitation.

[18]  Steve Warren,et al.  Design projects motivated and informed by the needs of severely disabled autistic children , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Paul Wehman,et al.  Reducing the Need for Personal Supports Among Workers with Autism Using an iPod Touch as an Assistive Technology: Delayed Randomized Control Trial , 2015, Journal of autism and developmental disorders.

[20]  Mirko Gelsomini,et al.  Wildcard: A wearable virtual reality storytelling tool for children with intellectual developmental disability , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Aude Billard,et al.  A Wearable Camera Detects Gaze Peculiarities during Social Interactions in Young Children with Pervasive Developmental Disorders , 2014, IEEE Transactions on Autonomous Mental Development.

[22]  Karrie Karahalios,et al.  Skin Conductance as an InSitu Marker for Emotional Arousal in Children with Neurodevelopmental Communication Impairments: Methodological Considerations and Clinical Implications , 2022 .

[23]  Matthew S. Goodwin,et al.  A non-homogeneous poisson process model of Skin Conductance Responses integrated with observed regulatory behaviors for Autism intervention , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Rune Roswall,et al.  Views on service individualization and support for autistic people , 2009, 2009 1st International Conference on Wireless Communication, Vehicular Technology, Information Theory and Aerospace & Electronic Systems Technology.

[25]  N. Sarkar,et al.  Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Karla Conn Welch,et al.  Physiological signals of autistic children can be useful , 2012, IEEE Instrumentation & Measurement Magazine.

[27]  Filomena O. Soares,et al.  Automatic detection of stereotyped hand flapping movements: Two different approaches , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[28]  I. V. Kooten,et al.  Understanding Autism from Basic Neuroscience to Treatment, Steven O. Moldin, John L.R. Rubenstein (Eds.). Taylor & Francis (2006), ISBN: 0849327326 , 2008 .

[29]  Leslie Ann Bross Autism spectrum disorders: identification, education, and treatment , 2018 .

[30]  L. Schieve,et al.  Estimated Prevalence of Autism and Other Developmental Disabilities Following Questionnaire Changes in the 2014 National Health Interview Survey. , 2015, National health statistics reports.

[31]  Maja J. Matarić,et al.  B3IA: A control architecture for autonomous robot-assisted behavior intervention for children with Autism Spectrum Disorders , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[32]  J. Nadel,et al.  Brief Report: Imitation Effects on Children with Autism , 2002, Journal of autism and developmental disorders.

[33]  Begoña García Zapirain,et al.  Serious Game based on first aid education for individuals with Autism Spectrum Disorder (ASD) using android mobile devices , 2011, 2011 16th International Conference on Computer Games (CGAMES).

[34]  Ambreen Zaman,et al.  Usabilty evaluation of the MumIES (Multimodal Interface based Education and Support) system for the children with special needs in Bangladesh , 2014, 2014 International Conference on Informatics, Electronics & Vision (ICIEV).

[35]  Camellia Zakaria,et al.  Demo: Wearable Application to Manage Problem Behavior in Children with Neurodevelopmental Disorders , 2016, MobiSys '16 Companion.

[36]  M. Bellani,et al.  Virtual reality in autism: state of the art , 2011, Epidemiology and Psychiatric Sciences.

[37]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[38]  Abdul Rahman Omar,et al.  A questionnaire-based survey: Therapist's response on emotions gestures using humanoid robot for autism , 2015, 2015 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[39]  Bassem Alhalabi,et al.  Activity Analysis and Detection of Repetitive Motion in Autistic Patients , 2014, 2014 IEEE International Conference on Bioinformatics and Bioengineering.

[40]  Camellia Zakaria,et al.  Seeking Independent Management of Problem Behavior: A Proof-of-Concept Study with Children and their Teachers , 2016, IDC.

[41]  Svetha Venkatesh,et al.  Randomised controlled trial of an iPad based early intervention for autism: TOBY playpad study protocol , 2016, BMC Pediatrics.

[42]  Jeff Sigafoos,et al.  Assessing the acquisition of requesting a variety of preferred items using different speech generating device formats for children with autism spectrum disorder , 2017, Assistive technology : the official journal of RESNA.

[43]  Lauren M. Schmitt,et al.  The Clinical Use of Robots for Individuals with Autism Spectrum Disorders: A Critical Review. , 2012, Research in autism spectrum disorders.

[44]  Antonio Coronato,et al.  Intelligent Monitoring of Stereotyped Motion Disorders in Case of Children with Autism , 2013, 2013 9th International Conference on Intelligent Environments.

[45]  Michael L. Wehmeyer,et al.  Handbook of Adolescent Transition Education for Youth with Disabilities , 2011, Handbook of Adolescent Transition Education for Youth with Disabilities.

[46]  Bimlesh Wadhwa,et al.  Collaborative tablet applications to enhance language skills of children with autism spectrum disorder , 2013, APCHI.

[47]  Changchun Liu,et al.  Affect-sensitive assistive intervention technologies for children with autism: An individual-specific approach , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[48]  Jordi Albo-Canals,et al.  A Cloud Robotic System based on Robot Companions for Children with Autism Spectrum Disorders to Perform Evaluations during LEGO Engineering Workshops , 2015, HRI.

[49]  Pamela Jordan Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[50]  B. Nehme,et al.  Developing a skin conductance device for early Autism Spectrum Disorder diagnosis , 2016, 2016 3rd Middle East Conference on Biomedical Engineering (MECBME).

[51]  Gillian R. Hayes,et al.  Evaluating a Collaborative iPad Game's Impact on Social Relationships for Children with Autism Spectrum Disorder , 2015, TACC.

[52]  M. F. Kamaruzaman,et al.  Embedded visual schedule application towards autistic children development: A prelimenary study , 2014, 2014 IEEE 6th Conference on Engineering Education (ICEED).

[53]  Shrikanth S. Narayanan,et al.  EDA-gram: Designing electrodermal activity fingerprints for visualization and feature extraction , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[54]  Margot Brereton,et al.  MyCalendar: Fostering Communication for Children with Autism Spectrum Disorder through Photos and Videos , 2015, OZCHI.

[55]  Jasper A. J. Smits,et al.  DISORDERS : A META-ANALYSIS OF RANDOMIZED PLACEBO-CONTROLLED TRIALS , 2008 .

[56]  Aude Billard,et al.  WearCam: A head mounted wireless camera for monitoring gaze attention and for the diagnosis of developmental disorders in young children , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[57]  Matthew S. Goodwin,et al.  iSET: interactive social-emotional toolkit for autism spectrum disorder , 2008, IDC.

[58]  Neil Davey,et al.  Designing & developing QueBall, a robotic device for autism therapy , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[59]  J. Nadel,et al.  Children with Autism Display more Social Behaviors after Repeated Imitation Sessions , 2001, Autism : the international journal of research and practice.

[60]  K. Thomson,et al.  A Systematic Literature Review of Emotion Regulation Measurement in Individuals With Autism Spectrum Disorder , 2014, Autism research : official journal of the International Society for Autism Research.

[61]  Kenji Suzuki,et al.  Design of a robotic agent that measures smile and facing behavior of children with Autism Spectrum Disorder , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[62]  Anind K. Dey,et al.  Parent-driven use of wearable cameras for autism support: a field study with families , 2012, UbiComp.

[63]  Kenji Suzuki,et al.  EnhancedTouch: A Smart Bracelet for Enhancing Human-Human Physical Touch , 2016, CHI.

[64]  C. Deruelle,et al.  Typical Emotion Processing for Cartoon but not for Real Faces in Children with Autistic Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[65]  Tracy L. Westeyn,et al.  ActionGSR: A Combination Galvanic Skin Response-Accelerometer for Physiological Measurements in Active Environments , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[66]  Benny P. L. Lo,et al.  A wearable sensing framework for improving personal and oral hygiene for people with developmental disabilities , 2016, 2016 IEEE Wireless Health (WH).

[67]  Brenda Smith Myles,et al.  Sensory Issues in Children with Asperger Syndrome and Autism , 2004 .

[68]  Uttama Lahiri,et al.  Design of Eyegaze-Sensitive Virtual Reality Based Social Communication Platform for Individuals with Autism , 2016, 2016 7th International Conference on Intelligent Systems, Modelling and Simulation (ISMS).

[69]  T. F. McLaughlin,et al.  EDUCATIONAL GAMES: A TECHNIQUE TO ACCELERATE THE ACQUISITION OF READING SKILLS OF CHILDREN WITH LEARNING DISABILITIES , 2005 .

[70]  Matthew S. Goodwin,et al.  iCalm: Wearable Sensor and Network Architecture for Wirelessly Communicating and Logging Autonomic Activity , 2010, IEEE Transactions on Information Technology in Biomedicine.

[71]  Kenji Suzuki,et al.  Affective communication aid using wearable devices based on biosignals , 2014, IDC.

[72]  M. Chuah,et al.  A hybrid solution for monitoring conversational skills of children with special needs , 2015, Wireless Health.

[73]  Yiqiang Chen,et al.  ProCom: designing a mobile and wearable system to support proximity awareness for people with autism , 2016, UbiComp Adjunct.

[74]  P. Dario,et al.  Towards Development of Biomechatronic Tools for Early Diagnosis of Neurodevelopmental Disorders , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[75]  Mirko Gelsomini An Affordable Virtual Reality Learning Framework for Children with Neuro-Developmental Disorder , 2016, ASSETS.

[76]  Jim Lagopoulos,et al.  A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders , 2014, Social neuroscience.

[77]  Habib Hamam,et al.  Design of emotional educational system mobile games for autistic children , 2016, 2016 2nd International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[78]  Kunal Mankodiya,et al.  WearSense: Detecting Autism Stereotypic Behaviors through Smartwatches , 2017, Healthcare.

[79]  Ahmed H. Tewfik,et al.  Semi-supervised event detection using higher order statistics for multidimensional time series accelerometer data , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[80]  Sofiane Boucenna,et al.  Interactive Technologies for Autistic Children: A Review , 2014, Cognitive Computation.

[81]  Guang-Zhong Yang,et al.  Toward Pervasive Gait Analysis With Wearable Sensors: A Systematic Review , 2016, IEEE Journal of Biomedical and Health Informatics.

[82]  Uttama Lahiri,et al.  Gaze-Sensitive Virtual Reality Based Social Communication Platform for Individuals with Autism , 2018, IEEE Transactions on Affective Computing.

[83]  Han Z. Li CULTURE AND GAZE DIRECTION IN CONVERSATION , 2012 .

[84]  Jin Guo,et al.  Ambient Intelligence Based Context-Aware Assistive System to Improve Independence for People with Autism Spectrum Disorder , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[85]  Azadeh Kushki,et al.  A Kalman Filtering Framework for Physiological Detection of Anxiety-Related Arousal in Children With Autism Spectrum Disorder , 2015, IEEE Transactions on Biomedical Engineering.

[86]  Cesare Furlanello,et al.  Stereotypical Motor Movement Detection in Dynamic Feature Space , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[87]  Juan Pablo Hourcade,et al.  Evaluation of tablet apps to encourage social interaction in children with autism spectrum disorders , 2013, CHI.

[88]  Linda Little,et al.  The impact of using location-based services with a behaviour-disordered child: a case study , 2010, NordiCHI.

[89]  Peter Washington,et al.  A Wearable Social Interaction Aid for Children with Autism , 2016, CHI Extended Abstracts.

[90]  Antonio Cisternino,et al.  The FACE of autism , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[91]  Kenji Suzuki,et al.  An approach to facilitate turn-taking behavior with paired devices for children with Autism Spectrum Disorder , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[92]  Emre Ertin,et al.  Are we there yet?: feasibility of continuous stress assessment via wireless physiological sensors , 2014, BCB.

[93]  Enzo Pasquale Scilingo,et al.  Robotic Social Therapy on Children with Autism: Preliminary Evaluation through Multi-parametric Analysis , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[94]  Charles Consel,et al.  Tablet-Based Activity Schedule in Mainstream Environment for Children with Autism and Children with ID , 2015, ACM Transactions on Accessible Computing.

[95]  Svetha Venkatesh,et al.  TOBY: early intervention in autism through technology , 2013, CHI.

[96]  Oren Zuckerman,et al.  TangiPlan: designing an assistive technology to enhance executive functioning among children with adhd , 2014, IDC.

[97]  Reyes Juárez-Ramírez,et al.  Towards a User Model for the Design of Adaptive Interfaces for Autistic Users , 2014, 2014 IEEE 38th International Computer Software and Applications Conference Workshops.

[98]  M. F. Kamaruzaman,et al.  Form design development study on autistic counting skill learning application , 2014, 2014 International Conference on Computer, Communications, and Control Technology (I4CT).

[99]  P. Mitchell,et al.  The potential of virtual reality in social skills training for people with autistic spectrum disorders. , 2002, Journal of intellectual disability research : JIDR.

[100]  Y. S. Kim,et al.  Global Prevalence of Autism and Other Pervasive Developmental Disorders , 2012, Autism research : official journal of the International Society for Autism Research.

[101]  Gondy Leroy,et al.  Smartphones to facilitate communication and improve social skills of children with severe autism spectrum disorder: special education teachers as proxies , 2008, IDC.

[102]  Talles Marcelo G. de A. Barbosa,et al.  Developing an affective Point-of-Care technology , 2014, 2014 IEEE Symposium on Computational Intelligence in Healthcare and e-health (CICARE).

[103]  Helen Koo 'TellMe': therapeutic clothing for children with autism spectrum disorder (ASD) in daily life , 2014, ISWC '14 Adjunct.

[104]  E. Guglielmelli,et al.  A novel technological approach towards the early diagnosis of neurodevelopmental disorders , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[105]  Lucy E. Dunne,et al.  Active "hugging" vest for deep touch pressure therapy , 2016, UbiComp Adjunct.

[106]  Domenico Formica,et al.  An experimental protocol for the definition of upper limb anatomical frames on children using magneto-inertial sensors , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[107]  Gregory D. Abowd,et al.  Pervasive Computing and Autism: Assisting Caregivers of Children with Special Needs , 2007, IEEE Pervasive Computing.

[108]  Maureen S. Durkin,et al.  Prevalence and Characteristics of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2012 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[109]  Peishi Wang,et al.  Stresses and Coping Strategies of Chinese Families with Children with Autism and Other Developmental Disabilities , 2011, Journal of autism and developmental disorders.

[110]  B. T. Lau,et al.  A mobile communicator with meta communicator for children with Asperger Syndrome , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[111]  Gemma Hornero,et al.  A Wireless Augmentative and Alternative Communication System for People With Speech Disabilities , 2015, IEEE Access.

[112]  M. O'Reilly,et al.  Use of Computer-Based Interventions to Teach Communication Skills to Children with Autism Spectrum Disorders: A Systematic Review , 2011 .

[113]  Flaminia L. Luccio,et al.  A Review of Websites and Mobile Applications for People with Autism Spectrum Disorders: Towards Shared Guidelines , 2016, GOODTECHS.

[114]  Adel Al-Jumaily,et al.  Upper limb motor coordination based early diagnosis in high risk subjects for Autism , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[115]  Kenji Suzuki Social imaging technology to identify and represent social behaviors , 2015, UbiComp/ISWC Adjunct.

[116]  Cristina P. Santos,et al.  Building a game scenario to encourage children with autism to recognize and label emotions using a humanoid robot , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[117]  Mirko Gelsomini,et al.  Wearable Immersive Storytelling for Disabled Children , 2016, AVI.

[118]  M. Chuah,et al.  Smartphone Based Autism Social Alert System , 2012, 2012 8th International Conference on Mobile Ad-hoc and Sensor Networks (MSN).

[119]  Peter Washington,et al.  Superpower glass: delivering unobtrusive real-time social cues in wearable systems , 2016, UbiComp Adjunct.

[120]  Arif Raza,et al.  Usability issues for smartphone users with special needs — Autism , 2013, 2013 International Conference on Open Source Systems and Technologies.

[121]  Jörg Müller,et al.  Changing Family Practices with Assistive Technology: MOBERO Improves Morning and Bedtime Routines for Children with ADHD , 2016, CHI.

[122]  Gillian R. Hayes,et al.  SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism , 2016, CHI.

[123]  Melissa Morgenlander,et al.  uChoose by InteractAble: learning social skills via game play , 2015, IDC.

[124]  Kaj Grønbæk,et al.  Designing Real Time Assistive Technologies: A Study of Children with ADHD , 2015, OZCHI.

[125]  Nilanjan Sarkar,et al.  Understanding How Adolescents with Autism Respond to Facial Expressions in Virtual Reality Environments , 2013, IEEE Transactions on Visualization and Computer Graphics.

[126]  Tanjir Rashid Soron,et al.  Autism, Stigma and Achievements of Bangladesh , 2015 .

[127]  Cheryl Z. Qian,et al.  Literacy LABELS: emergent literacy application design for children with autism , 2013, SIGGRAPH '13.

[128]  Christopher Frauenberger,et al.  Embodied Companion Technologies for Autistic Children , 2016, TEI.