Review of Consumer Wearables in Emotion, Stress, Meditation, Sleep, and Activity Detection and Analysis

Wearables equipped with pervasive sensors enable us to monitor physiological and behavioral signals. In this study, we revised 55 off-the-shelf devices in recognition and analysis of emotion, stress, meditation, sleep, and physical activity, especially in field studies. Their usability directly comes from the types of sensors they possess as well as the quality and availability of raw signals. We found there is no versatile device suitable for all purposes. Empatica E4 and Microsoft Band 2 are good at emotion, stress, and together with Oura Ring at sleep research. Apple, Samsung, Garmin, and Fossil smart watches are proper in activity examination, while Muse and DREEM EEG headbands are suitable for meditation.

[1]  Manolis Tsiknakis,et al.  Review on Psychological Stress Detection Using Biosignals , 2019, IEEE Transactions on Affective Computing.

[2]  Lorenzo Scalise,et al.  Wrist-worn and chest-strap wearable devices: Systematic review on accuracy and metrological characteristics , 2020 .

[3]  M Bhaskar,et al.  Heart rate estimation from wrist-type photoplethysmography signals during physical exercise , 2020, Biomed. Signal Process. Control..

[4]  Cristina E Davis,et al.  Wearable Sensor System to Monitor Physical Activity and the Physiological Effects of Heat Exposure , 2020, Sensors.

[5]  L. Burke,et al.  Feasible but Not Yet Efficacious: a Scoping Review of Wearable Activity Monitors in Interventions Targeting Physical Activity, Sedentary Behavior, and Sleep , 2020, Current Epidemiology Reports.

[6]  Robert Weibel,et al.  Using Accelerometer and GPS Data for Real-Life Physical Activity Type Detection , 2020, Sensors.

[7]  Przemyslaw Kazienko,et al.  Emotion Recognition Using Wearables: A Systematic Literature Review - Work-in-progress , 2019, 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[8]  Masayuki Numao,et al.  Deep Visual Models for EEG of Mindfulness Meditation in a Workplace Setting , 2019, Precision Health and Medicine.

[9]  Anil Hiwale,et al.  SVM classification of EEG signal to analyze the effect of OM Mantra meditation on the brain , 2019, 2019 IEEE 16th India Council International Conference (INDICON).

[10]  Erdenebayar Urtnasan,et al.  Deep learning approaches for automatic detection of sleep apnea events from an electrocardiogram , 2019, Comput. Methods Programs Biomed..

[11]  Timo Leppänen,et al.  Artificial neural network analysis of the oxygen saturation signal enables accurate diagnostics of sleep apnea , 2019, Scientific Reports.

[12]  Chuen Seng Tan,et al.  Heart Rate Measures From Wrist-Worn Activity Trackers in a Laboratory and Free-Living Setting: Validation Study , 2019, JMIR mHealth and uHealth.

[13]  Eman M. G. Younis,et al.  Deep learning analysis of mobile physiological, environmental and location sensor data for emotion detection , 2019, Inf. Fusion.

[14]  Mamta Juneja,et al.  EEG signal based classification before and after combined Yoga and Sudarshan Kriya , 2019, Neuroscience Letters.

[15]  Shigeho Tanaka,et al.  Accuracy of 12 Wearable Devices for Estimating Physical Activity Energy Expenditure Using a Metabolic Chamber and the Doubly Labeled Water Method: Validation Study , 2019, JMIR mHealth and uHealth.

[16]  Zaher Dawy,et al.  A Real-Time ECG Feature Extraction Algorithm for Detecting Meditation Levels within a General Measurement Setup , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Cem Ersoy,et al.  Abnormal respiratory event detection in sleep: A prescreening system with smart wearables , 2019, J. Biomed. Informatics.

[18]  Milind Y Desai,et al.  Accuracy of commercially available heart rate monitors in athletes: a prospective study. , 2019, Cardiovascular diagnosis and therapy.

[19]  J. Boger,et al.  You Are How You Sleep: Personalized Sleep Monitoring Based on Wrist Temperature and Accelerometer Data , 2019, Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare - Demos and Posters.

[20]  Bahram Tarvirdizadeh,et al.  Fabrication of a portable device for stress monitoring using wearable sensors and soft computing algorithms , 2019, Neural Computing and Applications.

[21]  Antonio Fernández-Caballero,et al.  Emotion Detection in Aging Adults Through Continuous Monitoring of Electro-Dermal Activity and Heart-Rate Variability , 2019, IWINAC.

[22]  Grzegorz J. Nalepa,et al.  Analysis and Use of the Emotional Context with Wearable Devices for Games and Intelligent Assistants , 2019, Sensors.

[23]  A. Leonard,et al.  Changes in Heart Rate Variability During Heartfulness Meditation: A Power Spectral Analysis Including the Residual Spectrum , 2019, Front. Cardiovasc. Med..

[24]  Marco Maier,et al.  DeepFlow: Detecting Optimal User Experience From Physiological Data Using Deep Neural Networks , 2019, AAMAS.

[25]  Reddipogu Pavani,et al.  STUDY OF EFFECT OF MEDITATION ON GALVANIC SKIN RESPONSE IN HEALTHY INDIVIDUALS , 2019, International Journal of Medical and Biomedical Studies.

[26]  David Harrison,et al.  Review on Wearable Technology Sensors Used in Consumer Sport Applications , 2019, Sensors.

[27]  L. Pecchia,et al.  Investigating the Use of Wearables for Monitoring Circadian Rhythms: A Feasibility Study , 2019, IFMBE Proceedings.

[28]  Cem Ersoy,et al.  Stress detection in daily life scenarios using smart phones and wearable sensors: A survey , 2019, J. Biomed. Informatics.

[29]  Cem Ersoy,et al.  Continuous Stress Detection Using Wearable Sensors in Real Life: Algorithmic Programming Contest Case Study , 2019, Sensors.

[30]  Thomas Penzel,et al.  A Review of Obstructive Sleep Apnea Detection Approaches , 2019, IEEE Journal of Biomedical and Health Informatics.

[31]  Magdalena Punceva,et al.  Sleep Detection Using Physiological Signals from a Wearable Device , 2018, 5th EAI International Conference on IoT Technologies for HealthCare.

[32]  Mary Rosenberger,et al.  Actigraphic sleep tracking and wearables: Historical context, scientific applications and guidelines, limitations, and considerations for commercial sleep devices , 2019, Sleep and Health.

[33]  Abdulmotaleb El Saddik,et al.  iAware: A Real-Time Emotional Biofeedback System Based on Physiological Signals , 2018, IEEE Access.

[34]  Kristof Van Laerhoven,et al.  Labelling Affective States "in the Wild": Practical Guidelines and Lessons Learned , 2018, UbiComp/ISWC Adjunct.

[35]  Kristof Van Laerhoven,et al.  Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection , 2018, ICMI.

[36]  Bernardo Nugroho Yahya,et al.  A Framework for Real Time Emotion Recognition Based on Human ANS Using Pervasive Device , 2018, 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC).

[37]  John P. Sullivan,et al.  A Critical Review of Consumer Wearables, Mobile Applications, and Equipment for Providing Biofeedback, Monitoring Stress, and Sleep in Physically Active Populations , 2018, Front. Physiol..

[38]  Jun Hu,et al.  Unwind: a musical biofeedback for relaxation assistance , 2018, Behav. Inf. Technol..

[39]  José Manuel Pastor,et al.  Estimation of Mental Distress from Photoplethysmography , 2018 .

[40]  Andry Rakotonirainy,et al.  Long Short Term Memory Hyperparameter Optimization for a Neural Network Based Emotion Recognition Framework , 2018, IEEE Access.

[41]  I. Colrain,et al.  The Sleep of the Ring: Comparison of the ŌURA Sleep Tracker Against Polysomnography , 2019, Behavioral sleep medicine.

[42]  M. Z. Soroush,et al.  A Review on EEG Signals Based Emotion Recognition , 2017 .

[43]  José Manuel Pastor,et al.  Electrodermal Activity Sensor for Classification of Calm/Distress Condition , 2017, Sensors.

[44]  Cheng He,et al.  An Emotion Recognition System Based on Physiological Signals Obtained by Wearable Sensors , 2017 .

[45]  Arindam Ghosh,et al.  Annotation and prediction of stress and workload from physiological and inertial signals , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[46]  Paul J. M. Havinga,et al.  Fusion of Smartphone Motion Sensors for Physical Activity Recognition , 2014, Sensors.