Developing an affective Point-of-Care technology

Mobile intelligent clinical monitoring systems provide mobility and out of hospital monitoring. It can be used in the follow-up of high-risk patients in out of hospital situations and to monitor “healthy” persons to prevent medical events. The inherent characteristics of local diagnosis and actuation permit an improvement and advance in the diagnosis and emergency decision support. Additionally, Affective Systems have been used in different applications, such as stress monitoring in aircraft seats and managing sensitivity in autism spectrum disorder. Although many scientific progresses have been made there are many computational challenges in order to embedded affectivity into traditional user interfaces. For example, context-sensitive algorithms, low-complexity pattern recognition models and hardware customizations are requirements to support the simplification of user's experience becoming more intuitive, transparent and less obstructive. In this paper a multiparametric affective monitor is presented. The Emopad acquisition system has been developed to analyze user's biofeedback particularly when they are playing games. It is able to capture Galvanic Skin Response (GSR), Temperature, Force, Heart Rate (HR) and its variability (HRV) while complementary algorithms are executed to recognize events related to user's emotional states. Also, in this paper a sliding window-based algorithm is presented and evaluated to detect specific events related to emotional responses. The success of multiparametric affective monitors can lead to a paradigm shift, establishing new scenarios for the Point-of-Care technologies applications.

[1]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[2]  Talles Marcelo G. de A. Barbosa,et al.  Emopad: An Affective Gamepad , 2014 .

[3]  Cynthia Breazeal,et al.  Towards leveraging the driver's mobile device for an intelligent, sociable in-car robotic assistant , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[4]  Wayne H. Wolf,et al.  Computers as components - principles of embedded computing system design , 2005 .

[5]  Daniel McDuff,et al.  AutoEmotive: bringing empathy to the driving experience to manage stress , 2014, DIS Companion '14.

[6]  Rosalind W. Picard,et al.  Multiple Arousal Theory and Daily-Life Electrodermal Activity Asymmetry , 2016 .

[7]  Regan L. Mandryk,et al.  Biofeedback game design: using direct and indirect physiological control to enhance game interaction , 2011, CHI.

[8]  Brian McDonald,et al.  Intelligent Biofeedback using an Immersive Competitive Environment , 2001 .

[9]  Marc Thomas Philipp Adam,et al.  Measuring Emotional Arousal for Online Applications: Evaluation of Ultra-short Term Heart Rate Variability Measures , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[10]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[11]  Daniel McDuff,et al.  A medical mirror for non-contact health monitoring , 2011, SIGGRAPH '11.

[12]  W PicardRosalind,et al.  Modeling drivers' speech under stress , 2003 .

[13]  Charles R. Crowell,et al.  Enhanced feedback in balance rehabilitation using the Nintendo Wii Balance Board , 2011, 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services.

[14]  Ricardo Gutierrez-Osuna,et al.  A Control-Theoretic Approach to Adaptive Physiological Games , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[15]  Juliane Junker,et al.  Medical Instrumentation Application And Design , 2016 .

[16]  Rana El Kaliouby,et al.  Why, When, and How Much to Entertain Consumers in Advertisements? A Web-Based Facial Tracking Field Study , 2014, Mark. Sci..

[17]  Gerhard Tröster,et al.  Unobtrusive physiological monitoring in an airplane seat , 2009, Personal and Ubiquitous Computing.

[18]  Rosalind W. Picard,et al.  Heartphones: Sensor Earphones and Mobile Application for Non-obtrusive Health Monitoring , 2009, 2009 International Symposium on Wearable Computers.

[19]  Matthew S. Goodwin,et al.  iCalm: Wearable Sensor and Network Architecture for Wirelessly Communicating and Logging Autonomic Activity , 2010, IEEE Transactions on Information Technology in Biomedicine.

[20]  A. El Saddik,et al.  EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion , 2012, 2012 International Conference on Innovations in Information Technology (IIT).

[21]  Cynthia Breazeal,et al.  MeBot: A robotic platform for socially embodied telepresence , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Rosalind W. Picard,et al.  Modeling drivers' speech under stress , 2003, Speech Commun..

[23]  Adson Ferreira da Rocha,et al.  Affective Embedded Systems: a Requirement Engineering Approach , 2014 .