CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders

In this paper, we propose a new mobile system to support therapists for teaching and tracking socio-communicative behaviors in children with neurodevelopmental disorders during music therapy sessions. The CHIMELIGHT system was designed to deal with the current issues in conventional therapies, such as the difficulty in both evaluating the performance and maintaining engagement of these children during therapeutic activities. The system evaluated movements made by a child with neurodevelopmental disorders playing a musical instrument while delivering contingent visual feedback based on real-time motion analysis. A set of metrics was implemented to evaluate the performance during the therapy activity and quantify specific target behaviors. An evaluation study performed during music therapy group sessions showed that the CHIMELIGHT-delivered visual feedback increased the engagement of children in the activity and decreased targeted negative behaviors. In some participants, we observed potential changes in their positive behaviors. Interviews and questionnaires provided to therapists showed that the developed system was effective for supporting evidence-based music therapy. Accordingly, our research enables new methods for both interactive therapy and mediation of the interaction between therapists and children with neurodevelopmental disorders.

[1]  Karrie Karahalios,et al.  Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays , 2012, DIS '12.

[2]  Jun-Ichi Yamamoto,et al.  Contingent imitation increases verbal interaction in children with autism spectrum disorders , 2016, Autism : the international journal of research and practice.

[3]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[4]  F. Michaud,et al.  Mobile Robotic Toys and Autism , 2002 .

[5]  N. Sriram,et al.  Enhancing Vocal Imitations in Children with Autism Using the IBM Speech Viewer , 1999 .

[6]  Petri Toiviainen,et al.  Predicting Music Therapy Clients’ Type of Mental Disorder Using Computational Feature Extraction and Statistical Modelling Techniques , 2007 .

[7]  Lilia B. Villafuerte,et al.  Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable , 2012, CHI Extended Abstracts.

[8]  Stoyan R. Stoyanov,et al.  Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS) , 2016, JMIR mHealth and uHealth.

[9]  Rebecca Schnall,et al.  Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study , 2018, JMIR mHealth and uHealth.

[10]  C. Lee.  A method of analyzing improvisations in music therapy. , 2000, Journal of music therapy.

[11]  Narcís Parés,et al.  Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment , 2005, IDC '05.

[12]  Alaine E Reschke-Hernández.  History of music therapy treatment interventions for children with autism. , 2011, Journal of music therapy.

[13]  G. Dingle.  Microanalysis in Music Therapy: Methods, Techniques and Applications for Clinicians, Researchers, Educators and Students , 2007 .

[14]  Monica Tentori,et al.  BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy , 2017, Int. J. Hum. Comput. Stud..

[15]  Hayoung A Lim,et al.  The effects of music therapy incorporated with applied behavior analysis verbal behavior approach for children with autism spectrum disorders. , 2011, Journal of music therapy.

[16]  Amy Kalas,et al.  Joint attention responses of children with autism spectrum disorder to simple versus complex music. , 2012, Journal of music therapy.

[17]  Henrik Hautop Lund,et al.  Social playware for mediating tele-play interaction over distance , 2012, Artificial Life and Robotics.

[18]  Susan Hadley,et al.  Music technology usage in music therapy: A survey of practice , 2012 .

[19]  John Habron,et al.  Book Review: Bio-Guided Music Therapy: A Practitioner's Guide to the Clinical Integration of Music and Biofeedback , 2012 .

[20]  Bruce Edmonds,et al.  Socially Intelligent Agents: Creating Relationships With Computers And Robots , 2013 .

[21]  Christian Gold,et al.  Music therapy for people with autism spectrum disorder. , 2014, The Cochrane database of systematic reviews.

[22]  Avi Gilboa.  Testing the MAP: A graphic method for describing and analyzing music therapy sessions , 2007 .

[23]  L. Gallagher,et al.  Developing and using a computerized database for music therapy in palliative medicine. , 2001, Journal of palliative care.

[24]  Hayoung A. Lim,et al.  Developmental Speech-Language Training through Music for Children with Autism Spectrum Disorders , 2011 .

[25]  Richard A. Magill,et al.  Motor Learning. Concepts and Applications , 1998 .

[26]  Kenji Suzuki,et al.  Designing Social Playware Mediated Communication with Contingent Feedback Devices , 2018, Conference on Designing Interactive Systems.

[27]  Joshua M. Hailpern.  Encouraging speech and vocalization in children with autistic spectrum disorder , 2007, ASAC.

[28]  John McGowan,et al.  CymaSense: A Novel Audio-Visual Therapeutic Tool for People on the Autism Spectrum , 2017, ASSETS.