Examining Human-Horse Interaction by Means of Affect Recognition via Physiological Signals

For some time, equine-assisted therapy (EAT), i.e., the use of horse-related activities for therapeutic reasons, has been recognised as a useful approach in the treatment of many mental health issues such as post-traumatic stress disorder (PTSD), depression, and anxiety. However, despite the interest in EAT, few scientific studies have focused on understanding the complex emotional response that horses seem to elicit in human riders and handlers. In this work, the potential use of affect recognition techniques based on physiological signals is examined for the task of assessing the interaction between humans and horses in terms of the emotional response of the humans to this interaction. Electroencephalography (EEG), electrocardiography (ECG), and electromyography (EMG) signals were captured from humans interacting with horses, and machine learning techniques were applied in order to predict the self-reported emotional states of the human subjects in terms of valence and arousal. Supervised classification experiments demonstrated the potential of this approach for affect recognition during human–horse interaction, reaching an F1-score of 78.27% for valence and 65.49% for arousal.

[1]  J. Russell A circumplex model of affect. , 1980 .

[2]  A. Damasio,et al.  Basic emotions are associated with distinct patterns of cardiorespiratory activity. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  H. Hama,et al.  Effects of Stroking Horses on Both Humans' and Horses' Heart Rate Responses , 1996 .

[4]  Elizabeth Kendall,et al.  Hypotheses about the psychological benefits of horses. , 2014, Explore.

[5]  P. Mundy,et al.  Resting cortical brain activity and social behavior in higher functioning children with autism. , 2005, Journal of child psychology and psychiatry, and allied disciplines.

[6]  Cindy Davis,et al.  Equine-assisted therapy and its impact on cortisol levels of children and horses: a pilot study and meta-analysis , 2013 .

[7]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[8]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Xenophon,et al.  The Art of Horsemanship , 1893 .

[10]  Ioannis Patras,et al.  AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups , 2017, IEEE Transactions on Affective Computing.

[11]  Kenneth P. Camilleri,et al.  Steady-State Visual Evoked Potentials for EEG-Based Biometric Identification , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[12]  Rosalind W. Picard Affective Computing: From Laughter to IEEE , 2010 .

[13]  Rafael A. Calvo,et al.  Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[14]  M R Haskin,et al.  Therapeutic horseback riding for the handicapped. , 1974, Archives of physical medicine and rehabilitation.

[15]  Heather A. Henderson,et al.  Anterior EEG Asymmetry and the Modifier Model of Autism , 2010, Journal of autism and developmental disorders.

[16]  Pablo Casaseca-de-la-Higuera,et al.  A Machine Hearing System for Robust Cough Detection Based on a High-Level Representation of Band-Specific Audio Features , 2019, IEEE Transactions on Biomedical Engineering.

[17]  Tania Signal,et al.  Equine Facilitated Therapy with Children and Adolescents Who Have Been Sexually Abused: A Program Evaluation Study , 2014 .

[18]  Byoung-Jun Park,et al.  Classification of Human Emotions from Physiological signals using Machine Learning Algorithms , 2013, ACHI 2013.

[19]  Enzo Pasquale Scilingo,et al.  A wearable system for the evaluation of the human-horse interaction: A preliminary study , 2016 .

[20]  R P Mayberry The mystique of the horse is strong medicine: riding as therapeutic recreation. , 1978, Rehabilitation literature.

[21]  Kimberly Hoagwood,et al.  Equine-assisted activities and therapies: enhancing the social worker’s armamentarium , 2016 .

[22]  Jasjit S. Suri,et al.  Analysis of Electrocardiograms , 2007 .

[23]  Angela Masini,et al.  Equine-assisted psychotherapy in clinical practice. , 2010, Journal of psychosocial nursing and mental health services.

[24]  Naeem Ramzan,et al.  DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices , 2018, IEEE Journal of Biomedical and Health Informatics.

[25]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[26]  Dharmendra Sharma,et al.  A Proposed Feature Extraction Method for EEG-based Person Identification , 2012 .

[27]  Abbes Amira,et al.  Emotion Recognition by Physiological Signals , 2016, HVEI.

[28]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[29]  Katy Schroeder,et al.  Equine-Facilitated Group Work for Women Survivors of Interpersonal Violence , 2015 .

[30]  D Woods Horseriding catching on as a therapy for the disabled. , 1979, Canadian Medical Association journal.

[31]  Manuel Blanco-Velasco,et al.  ECG signal denoising and baseline wander correction based on the empirical mode decomposition , 2008, Comput. Biol. Medicine.

[32]  Kyungmin Su,et al.  The PREP pipeline: standardized preprocessing for large-scale EEG analysis , 2015, Front. Neuroinform..

[33]  Daune West,et al.  Affect Detection for Human-Horse Interaction , 2018, 2018 21st Saudi Computer Society National Computer Conference (NCC).

[34]  Enzo Pasquale Scilingo,et al.  Quantitative heartbeat coupling measures in human-horse interaction , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  Bradley T. Klontz,et al.  The Effectiveness of Equine-Assisted Experiential Therapy: Results of an Open Clinical Trial , 2007 .

[36]  Enzo Pasquale Scilingo,et al.  The role of nonlinear coupling in Human-Horse Interaction: A preliminary study , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[37]  J. Russell,et al.  Evidence for a three-factor theory of emotions , 1977 .

[38]  Julie L Earles,et al.  Equine-assisted therapy for anxiety and posttraumatic stress symptoms. , 2015, Journal of traumatic stress.

[39]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[40]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[41]  Miguel Arevalillo-Herráez,et al.  Fusing highly dimensional energy and connectivity features to identify affective states from EEG signals , 2017, Neurocomputing.

[42]  B. Bastian,et al.  Toward a psychology of human-animal relations. , 2015, Psychological bulletin.

[43]  Björn W. Schuller,et al.  Categorical and dimensional affect analysis in continuous input: Current trends and future directions , 2013, Image Vis. Comput..

[44]  William Benda,et al.  Improvements in muscle symmetry in children with cerebral palsy after equine-assisted therapy (hippotherapy). , 2003, Journal of alternative and complementary medicine.

[45]  Alexa Smith-Osborne,et al.  A systematic review of effectiveness of complementary and adjunct therapies and interventions involving equines. , 2013, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[46]  Milos Manic,et al.  Human machine interaction via brain activity monitoring , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[47]  Michele L. Morrison,et al.  Health Benefits of Animal-Assisted Interventions , 2007 .

[48]  Subramanian Ramanathan,et al.  DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses , 2015, IEEE Transactions on Affective Computing.

[49]  R. Davidson Affective neuroscience and psychophysiology: toward a synthesis. , 2003, Psychophysiology.

[50]  G. McArthur,et al.  Validation of the Emotiv EPOC® EEG gaming system for measuring research quality auditory ERPs , 2013, PeerJ.

[51]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[52]  Debbie Crews,et al.  Effects of equine interaction on EEG asymmetry in children with autism spectrum disorder: a pilot study , 2015 .