An Interactive Multimedia System for Treating Autism Spectrum Disorder

A system for real-time gesture tracking is presented, used in active well-being self-assessment activities and in particular applied to medical coaching and music-therapy. The system is composed of a gestural interface and a computer running own (custom) developed software. During the test sessions a person freely moves his body inside a specifically designed room. The algorithms detect and extrapolate features from the human figure, such us spatial position, arms and legs angles, etc. An operator can link these features to sounds synthesized in real time, following a predefined schema. The augmented interaction with the environment helps to improve the contact with reality in subjects having autism spectrum disorders (ASD). The system has been tested on a set of young subjects and a team of psychologists has analyzed the results of this experimentation. Moreover, we started to work on graphical feedback in order to realize a multichannel system.

[1]  Ovidio Salvetti,et al.  An Auditory Feedback based system for treating Autism Spectrum Disorder , 2015, REHAB.

[2]  Lilia B. Villafuerte,et al.  Acquisition of social abilities through musical tangible user interface: children with autism spectrum condition and the reactable , 2012, CHI Extended Abstracts.

[3]  S. Rogers,et al.  Behavioral treatments in autism spectrum disorder: what do we know? , 2010, Annual review of clinical psychology.

[4]  S. Greenspan,et al.  The child with special needs , 1998 .

[5]  Karim Sehaba,et al.  Attention analysis in interactive software for children with autism , 2006, Assets '06.

[6]  L. Kanner.  Autistic disturbances of affective contact. , 1968, Acta paedopsychiatrica.

[7]  David Bruckman,et al.  Pilot study of a parent training program for young children with autism , 2007, Autism : the international journal of research and practice.

[8]  L. Wing,et al.  Severe impairments of social interaction and associated abnormalities in children: Epidemiology and classification , 1979, Journal of autism and developmental disorders.

[9]  Pierluigi Politi,et al.  Development of the "Playing-in-Touch" (PiT) questionnaire: a measure of musical intouchness in people with low-functioning autism. , 2012, Neuro endocrinology letters.

[10]  Hideki Kozima,et al.  Interactive robots for communication-care: a case-study in autism therapy , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  Kingkaew Pajareya,et al.  A pilot randomized controlled trial of DIR/Floortime™ parent training intervention for pre-school children with autistic spectrum disorders , 2011, Autism : the international journal of research and practice.