Stress Detection via Keyboard Typing Behaviors by Using Smartphone Sensors and Machine Learning Techniques

Stress is one of the biggest problems in modern society. It may not be possible for people to perceive if they are under high stress or not. It is important to detect stress early and unobtrusively. In this context, stress detection can be considered as a classification problem. In this study, it was investigated the effects of stress by using accelerometer and gyroscope sensor data of the writing behavior on a smartphone touchscreen panel. For this purpose, smartphone data including two states (stress and calm) were collected from 46 participants. The obtained sensor signals were divided into 5, 10 and 15 s interval windows to create three different data sets and 112 different features were defined from the raw data. To obtain more effective feature subsets, these features were ranked by using Gain Ratio feature selection algorithm. Afterwards, writing behaviors were classified by C4.5 Decision Trees, Bayesian Networks and k-Nearest Neighbor methods. As a result of the experiments, 74.26%, 67.86%, and 87.56% accuracy classification results were obtained respectively.

[1]  Purnendu Shekhar Pandey,et al.  Machine Learning and IoT for prediction and detection of stress , 2017, 2017 17th International Conference on Computational Science and Its Applications (ICCSA).

[2]  Pradipta De,et al.  TapSense: combining self-report patterns and typing characteristics for smartphone based emotion detection , 2017, MobileHCI.

[3]  Matevz Pogacnik,et al.  Noninvasive stress recognition considering the current activity , 2015, Personal and Ubiquitous Computing.

[4]  S. Dickerson,et al.  Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. , 2004, Psychological bulletin.

[5]  Ulrich Reimer,et al.  SmartCoping - A Mobile Solution for Stress Recognition and Prevention , 2014, HEALTHINF.

[6]  Rana Fayyaz Ahmad,et al.  Feature extraction and classification for EEG signals using wavelet transform and machine learning techniques , 2015, Australasian Physical & Engineering Sciences in Medicine.

[7]  Roy Francis Navea,et al.  Stress Detection using Galvanic Skin Response: An Android Application , 2019 .

[8]  W. Sturm,et al.  Neuropsychological assessment , 2007, Journal of Neurology.

[9]  Pradipta De,et al.  EmoKey: An Emotion-aware Smartphone Keyboard for Mental Health Monitoring , 2019, 2019 11th International Conference on Communication Systems & Networks (COMSNETS).

[10]  Nisha Raichur,et al.  Detection of Stress Using Image Processing and Machine Learning Techniques , 2017 .

[11]  Ricardo Gutierrez-Osuna,et al.  Development and Evaluation of an Ambulatory Stress Monitor Based on Wearable Sensors , 2012, IEEE Transactions on Information Technology in Biomedicine.

[12]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[13]  Rosalind W. Picard Automating the Recognition of Stress and Emotion: From Lab to Real-World Impact , 2016, IEEE Multim..

[14]  David Ellis,et al.  Stress Detection Using Wearable Physiological and Sociometric Sensors , 2017, Int. J. Neural Syst..

[15]  Simon J. Julier,et al.  DeepBreath: Deep learning of breathing patterns for automatic stress recognition using low-cost thermal imaging in unconstrained settings , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[16]  Hjp Harry Timmermans,et al.  Comparative evaluation of algorithms for GPS data imputation , 2013 .

[17]  A. Karegowda,et al.  COMPARATIVE STUDY OF ATTRIBUTE SELECTION USING GAIN RATIO AND CORRELATION BASED FEATURE SELECTION , 2010 .

[18]  Geoff Holmes,et al.  Benchmarking Attribute Selection Techniques for Discrete Class Data Mining , 2003, IEEE Trans. Knowl. Data Eng..

[19]  K. V. N. Sunitha,et al.  Machine Learning Approach for Stress Detection using Wireless Physical Activity Tracker , 2018 .

[20]  P. Sleight,et al.  Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability. , 2000, Journal of the American College of Cardiology.

[21]  Georgy L. Gimel'farb,et al.  Unobtrusive stress detection on the basis of smartphone usage data , 2018, Personal and Ubiquitous Computing.

[22]  Henner Gimpel,et al.  myStress: Unobtrusive Smartphone-Based Stress Detection , 2015, ECIS.

[23]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[24]  Oya Kalipsiz,et al.  Veri Madenciliğinde Özellik Seçim Tekniklerinin Bankacılık Verisine Uygulanması Üzerine Araştırma ve Karşılaştırmalı Uygulama , 2015, UYMS.

[25]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[26]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[27]  Yuan Gao,et al.  What Does Touch Tell Us about Emotions in Touchscreen-Based Gameplay? , 2012, TCHI.

[28]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[29]  Mahesh Sooriyabandara,et al.  HealthyOffice: Mood recognition at work using smartphones and wearable sensors , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[30]  Musa Peker,et al.  Predicting Human Actions Using a Hybrid of ReliefF Feature Selection and Kernel-Based Extreme Learning Machine , 2018 .

[31]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[32]  Ibrahim Arda Cankaya,et al.  Classification of Soft Keyboard Typing Behaviors Using Mobile Device Sensors with Machine Learning , 2019, Arabian Journal for Science and Engineering.

[33]  Francisco J. Pelayo,et al.  Portable System for Real-Time Detection of Stress Level , 2018, Sensors.

[34]  A. Muaremi,et al.  Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep , 2013, BioNanoScience.

[35]  Paul Lukowicz,et al.  Can smartphones detect stress-related changes in the behaviour of individuals? , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications Workshops.

[36]  Katarzyna Wac,et al.  iSensestress: Assessing stress through human-smartphone interaction analysis , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[37]  Javier Hernandez,et al.  Affective keys: towards unobtrusive stress sensing of smartphone users , 2018, MobileHCI Adjunct.

[38]  Peter A. Dinda,et al.  UStress: Understanding college student subjective stress using wrist-based passive sensing , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[39]  Alex Pentland,et al.  Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits , 2014, ACM Multimedia.

[40]  Musa Peker,et al.  Human activity recognition from smart watch sensor data using a hybrid of principal component analysis and random forest algorithm , 2018, Measurement and Control.

[41]  Musa Peker,et al.  A new approach for automatic sleep scoring: Combining Taguchi based complex-valued neural network and complex wavelet transform , 2016, Comput. Methods Programs Biomed..

[42]  Nida Meddouri,et al.  A New Feature Selection Method for Nominal Classifier based on Formal Concept Analysis , 2017, KES.

[43]  Matjaz Gams,et al.  Continuous stress detection using a wrist device: in laboratory and real life , 2016, UbiComp Adjunct.

[44]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[45]  Cem Ersoy,et al.  Stress detection in daily life scenarios using smart phones and wearable sensors: A survey , 2019, J. Biomed. Informatics.

[46]  Athanasios I. Kyritsis,et al.  Stress Detection Using Smart Phone Data , 2016, eHealth 360°.

[47]  Hyun-Jun Kim,et al.  Exploring emotional preference for smartphone applications , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[48]  M. L. Valarmathi,et al.  GAIN RATIO BASED FEATURE SELECTION METHOD FOR PRIVACY PRESERVATION , 2011 .

[49]  Hosub Lee,et al.  Towards unobtrusive emotion recognition for affective social communication , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[50]  Serkan Balli,et al.  Transportation mode detection by using smartphone sensors and machine learning , 2016 .

[51]  Hong-Goo Kang,et al.  A Deep Learning-based Stress Detection Algorithm with Speech Signal , 2018, AVSU@MM.

[52]  Shing-hon Lau,et al.  Stress Detection for Keystroke Dynamics , 2018 .

[53]  Matjaz Gams,et al.  Monitoring stress with a wrist device using context , 2017, J. Biomed. Informatics.