Using smart offices to predict occupational stress

Abstract Occupational stress is increasingly present in our society. Usually, it is detected too late, resulting in physical and mental health problems for the worker, as well as economic losses for the companies due to the consequent absenteeism, presenteeism, reduced motivation or staff turnover. Therefore, the development of early stress detection systems that allow individuals to take timely action and prevent irreversible damage is required. To address this need, we investigate a method to analyze changes in physiological and behavioral patterns using unobtrusively and ubiquitously gathered smart office data. The goal of this paper is to build models that predict self-assessed stress and mental workload scores, as well as models that predict workload conditions based on physiological and behavior data. Regression models were built for the prediction of the self-reported stress and mental workload scores from data based on real office work settings. Similarly, classification models were employed to detect workload conditions and change in these conditions. Specific algorithms to deal with class-imbalance (SMOTEBoost and RUSBoost) were also tested. Results confirm the predictability of behavioral changes for stress and mental workload levels, as well as for change in workload conditions. Results also suggest that computer-use patterns together with body posture and movements are the best predictors for this purpose. Moreover, the importance of self-reported scores' standardization and the suitability of the NASA Task Load Index test for workload assessment is noticed. This work contributes significantly towards the development of an unobtrusive and ubiquitous early stress detection system in smart office environments, whose implementation in the industrial environment would make a great beneficial impact on workers’ health status and on the economy of companies.

[1]  Tamás D. Gedeon,et al.  Hybrid Genetic Algorithms for Stress Recognition in Reading , 2013, EvoBIO.

[2]  Carlos Ramos,et al.  Smart Offices and Intelligent Decision Rooms , 2010, Handbook of Ambient Intelligence and Smart Environments.

[3]  Gerhard Tröster,et al.  What Does Your Chair Know About Your Stress Level? , 2010, IEEE Transactions on Information Technology in Biomedicine.

[4]  E. Poutsma,et al.  EUROPEAN FOUNDATION for the Improvement of Living and Working Conditions , 1999 .

[5]  Matevz Pogacnik,et al.  A Presence-Based Context-Aware Chronic Stress Recognition System , 2012, Sensors.

[6]  Adrian Basarab,et al.  Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review , 2016, J. Biomed. Informatics.

[7]  Fukuhito Ooshita,et al.  Owens Luis - A context-aware multi-modal smart office chair in an ambient environment , 2012, VR.

[8]  Il-Woo Lee,et al.  Smart Office Energy-Saving Service Using Bluetooth Low Energy Beacons and Smart Plugs , 2015, 2015 IEEE International Conference on Data Science and Data Intensive Systems.

[9]  Klaus Moessner,et al.  Contextual occupancy detection for smart office by pattern recognition of electricity consumption data , 2015, 2015 IEEE International Conference on Communications (ICC).

[10]  Gintautas Dzemyda,et al.  Web-based Biometric Computer Mouse Advisory System to Analyze a User's Emotions and Work Productivity , 2011, Engineering applications of artificial intelligence.

[11]  Il-Woo Lee,et al.  Smart office energy management system using bluetooth low energy based beacons and a mobile app , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[12]  Gintautas Dzemyda,et al.  Web-based Biometric Computer Mouse Advisory System to Analyze a User's Emotions and Work Productivity , 2011, Eng. Appl. Artif. Intell..

[13]  Agata Kolakowska,et al.  A review of emotion recognition methods based on keystroke dynamics and mouse movements , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[14]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[15]  Rohit Prasad,et al.  Automatic Detection of Psychological Distress Indicators and Severity Assessment from Online Forum Posts , 2012, COLING.

[16]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[17]  Zhiwei Zhu,et al.  A Real-Time Human Stress Monitoring System Using Dynamic Bayesian Network , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[18]  Maizura Mokhtar,et al.  Sensor Failure Detection, Identification, and Accommodation Using Fully Connected Cascade Neural Network , 2015, IEEE Transactions on Industrial Electronics.

[19]  Sankar K. Pal,et al.  Perception and Machine Intelligence , 2012, Lecture Notes in Computer Science.

[20]  Ivan Marsá-Maestre,et al.  A Hierarchical, Agent-based Approach to Security in Smart Offices , 2006, ICUC.

[21]  S. Carpenter,et al.  Methods for Detecting Early Warnings of Critical Transitions in Time Series Illustrated Using Simulated Ecological Data , 2012, PloS one.

[22]  Koichi Yamada,et al.  Evaluating Instantaneous Psychological Stress from Emotional Composition of a Facial Expression , 2013, J. Adv. Comput. Intell. Intell. Informatics.

[23]  Subhas Mukhopadhyay,et al.  Smart Sensing System for Human Emotion and Behaviour Recognition , 2012, PerMIn.

[24]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[25]  Veikko Ikonen,et al.  Interactive scenarios—building ubiquitous computing concepts in the spirit of participatory design , 2004, Personal and Ubiquitous Computing.

[26]  Wessel Kraaij,et al.  Detecting Work Stress in Offices by Combining Unobtrusive Sensors , 2018, IEEE Transactions on Affective Computing.

[27]  Daniel McDuff,et al.  AffectAura: an intelligent system for emotional memory , 2012, CHI.

[28]  Mykola Pechenizkiy,et al.  Stress detection from speech and Galvanic Skin Response signals , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[29]  Abdulmotaleb El-Saddik,et al.  U-biofeedback: a multimedia-based reference model for ubiquitous biofeedback systems , 2013, Multimedia Tools and Applications.

[30]  Dimitris N. Metaxas,et al.  Optical computer recognition of facial expressions associated with stress induced by performance demands. , 2005, Aviation, space, and environmental medicine.

[31]  GedeonTom,et al.  Objective measures, sensors and computational techniques for stress recognition and classification , 2012 .

[32]  Jorge L. Mendoza,et al.  A method of assessing change in a single subject: An alteration of the RC index , 1986 .

[33]  Fabrício F. Costa Big data in biomedicine. , 2014, Drug discovery today.

[34]  P. Lang Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[35]  Thomas Addison Ray The construction of a scale to measure attitudes of college freshman toward their high school music group experiences , 1965 .

[36]  Tamás D. Gedeon,et al.  Objective measures, sensors and computational techniques for stress recognition and classification: A survey , 2012, Comput. Methods Programs Biomed..

[37]  Hao Liu,et al.  Wearable Physiological Sensors Reflect Mental Stress State in Office-Like Situations , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[38]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[39]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[40]  C. Cashman [European agency for safety and health at work]. , 2013, Archivos de prevencion de riesgos laborales.

[41]  Tom Cox,et al.  Calculating the cost of work-related stress and psychosocial risks , 2014 .

[42]  Taghi M. Khoshgoftaar,et al.  Experimental perspectives on learning from imbalanced data , 2007, ICML '07.

[43]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[44]  Taghi M. Khoshgoftaar,et al.  RUSBoost: A Hybrid Approach to Alleviating Class Imbalance , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[45]  Shu-Ching Chen,et al.  Computational Health Informatics in the Big Data Age , 2016, ACM Comput. Surv..

[46]  Wessel Kraaij,et al.  The SWELL Knowledge Work Dataset for Stress and User Modeling Research , 2014, ICMI.

[47]  A. Muaremi,et al.  Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep , 2013, BioNanoScience.

[48]  Jack T Dennerlein,et al.  Office workers' computer use patterns are associated with workplace stressors. , 2014, Applied ergonomics.

[49]  ChenShu-Ching,et al.  Computational Health Informatics in the Big Data Age , 2016 .

[50]  Nitesh V. Chawla,et al.  SMOTEBoost: Improving Prediction of the Minority Class in Boosting , 2003, PKDD.

[51]  Maureen Schmitter-Edgecombe,et al.  Automated Cognitive Health Assessment From Smart Home-Based Behavior Data , 2016, IEEE Journal of Biomedical and Health Informatics.

[52]  Juan Carlos Augusto,et al.  Handbook of Ambient Intelligence and Smart Environments , 2009, HAIS 2010.

[53]  H. Hotelling The Generalization of Student’s Ratio , 1931 .

[54]  Prafulla N. Dawadi,et al.  Automated Clinical Assessment from Smart home-based Behavior Data , 2015 .

[55]  Andrew Sears,et al.  Automated stress detection using keystroke and linguistic features: An exploratory study , 2009, Int. J. Hum. Comput. Stud..

[56]  K. Sato,et al.  Analysis of psychological stress factors and facial parts effect on intentional facial expressions , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[57]  Vernoi Battiste,et al.  Transport Pilot Workload: A Comparison of Two Subjective Techniques , 1988 .

[58]  Giacomo Verticale,et al.  An Energy Management Service for the Smart Office , 2015 .

[59]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[60]  A. Barreto,et al.  Stress Detection in Computer Users Based on Digital Signal Processing of Noninvasive Physiological Variables , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.