Biomusic: An Auditory Interface for Detecting Physiological Indicators of Anxiety in Children

For children with profound disabilities affecting communication, it can be extremely challenging to identify salient emotions such as anxiety. If left unmanaged, anxiety can lead to hypertension, cardiovascular disease, and other psychological diagnoses. Physiological signals of the autonomic nervous system are indicative of anxiety, but can be difficult to interpret for non-specialist caregivers. This paper evaluates an auditory interface for intuitive detection of anxiety from physiological signals. The interface, called “Biomusic,” maps physiological signals to music (i.e., electrodermal activity to melody; skin temperature to musical key; heart rate to drum beat; respiration to a “whooshing” embellishment resembling the sound of an exhalation). The Biomusic interface was tested in two experiments. Biomusic samples were generated from physiological recordings of typically developing children (n = 10) and children with autism spectrum disorders (n = 5) during relaxing and anxiety-provoking conditions. Adult participants (n = 16) were then asked to identify “anxious” or “relaxed” states by listening to the samples. In a classification task with 30 Biomusic samples (1 relaxed state, 1 anxious state per child), classification accuracy, sensitivity, and specificity were 80.8% [standard error (SE) = 2.3], 84.9% (SE = 3.0), and 76.8% (SE = 3.9), respectively. Participants were able to form an early and accurate impression of the anxiety state within 12.1 (SE = 0.7) seconds of hearing the Biomusic with very little training (i.e., < 10 min) and no contextual information. Biomusic holds promise for monitoring, communication, and biofeedback systems for anxiety management.

[1]  Penelope M. Sanderson,et al.  Intelligibility of Sonifications for Respiratory Monitoring in Anesthesia , 2001 .

[2]  Daniel D. Holt,et al.  Inhibitory Control in Children with Autism Spectrum Disorder , 2007, Journal of autism and developmental disorders.

[3]  S. Ozonoff,et al.  Brief Report: Specific Executive Function Profiles in Three Neurodevelopmental Disorders , 1999, Journal of autism and developmental disorders.

[4]  Z. Shahrivar,et al.  EFFECT OF PREOPERATIVE PLAY INTERVENTIONS ON POST SURGERY ANXIETY , 2008 .

[5]  J. Hogg,et al.  Consistency, context and confidence in judgements of affective communication in adults with profound intellectual and multiple disabilities. , 2001, Journal of intellectual disability research : JIDR.

[6]  Wanhui Wen,et al.  Emotion Recognition Based on Multi-Variant Correlation of Physiological Signals , 2014, IEEE Transactions on Affective Computing.

[7]  D. Cicchetti,et al.  The Yale Preoperative Anxiety Scale: How Does It Compare with a "Gold Standard"? , 1997, Anesthesia and analgesia.

[8]  C. Spielberger State‐Trait Anxiety Inventory , 2010 .

[9]  J. Kagan,et al.  The psychological significance of changes in skin temperature , 1996 .

[10]  Penelope Sanderson,et al.  The multimodal world of medical monitoring displays. , 2006, Applied ergonomics.

[11]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[12]  W. Silverman,et al.  Children's depressive symptoms, negative self-statements, and causal attributions for success and failure , 1987, Cognitive Therapy and Research.

[13]  Tom Chau,et al.  Investigating the Autonomic Nervous System Response to Anxiety in Children with Autism Spectrum Disorders , 2013, PloS one.

[14]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[15]  A. Cowley,et al.  Autonomic Control of Cardiac Function , 2004 .

[16]  J. Woodruff‐Borden,et al.  Parental Perfectionism and Overcontrol: Examining Mechanisms in the Development of Child Anxiety , 2014, Journal of Abnormal Child Psychology.

[17]  Thomas Hermann,et al.  TAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY , 2008 .

[18]  J. Bregman,et al.  Exploring the Manifestations of Anxiety in Children with Autism Spectrum Disorders , 2013, Journal of Autism and Developmental Disorders.

[19]  R. VetrugnoMD,et al.  Sympathetic skin response , 2003 .

[20]  R. Lang,et al.  Treatment of anxiety in autism spectrum disorders using cognitive behaviour therapy: A systematic review , 2010, Developmental neurorehabilitation.

[21]  M. Seligman,et al.  Problem-solving deficits and depressive symptoms among children , 1983, Journal of abnormal child psychology.

[22]  P. Cortelli,et al.  Sympathetic skin response , 2003, Clinical Autonomic Research.

[23]  C. Martyn,et al.  Sympathetic skin response. , 1985, Journal of neurology, neurosurgery, and psychiatry.

[24]  T. Kamarck,et al.  Alternate cardiovascular baseline assessment techniques: vanilla or resting baseline. , 2007, Psychophysiology.

[25]  De-zhong Yao,et al.  Scale-Free Music of the Brain , 2009, PLoS ONE.

[26]  C. Jarrold,et al.  Inhibition and the Validity of the Stroop Task for Children with Autism , 2009, Journal of autism and developmental disorders.

[27]  Changchun Liu,et al.  An empirical study of machine learning techniques for affect recognition in human–robot interaction , 2006, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Bea Maes,et al.  The tell-tale: what do heart rate; skin temperature and skin conductance reveal about emotions of people with severe and profound intellectual disabilities? , 2012, Research in developmental disabilities.

[29]  福田 博一 State-Trait Anxiety Inventoryによるペインクリニック外来患者の不安の評価 , 1994 .

[30]  Chris Oliver,et al.  The expression and assessment of emotions and internal states in individuals with severe or profound intellectual disabilities. , 2011, Clinical psychology review.

[31]  E. Biddiss,et al.  Biomusic: A Novel Technology for Revealing the Personhood of People with Profound Multiple Disabilities , 2013, Augmentative and alternative communication.

[32]  Kiyoko Yokoyama,et al.  Heart rate indication using musical data , 2002, IEEE Transactions on Biomedical Engineering.

[33]  Roberto Bresin,et al.  A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities , 2013, PloS one.