Intervention of Wearables and Smartphones in Real Time Monitoring of Sleep and Behavioral Health: An Assessment Using Adaptive Neuro-Fuzzy Technique

Wearable devices equipped with sensors popularly used for health monitoring are capable of accumulating motion data providing objective measures of various physical activity and sleep attributes. Also, smartphone usage has grown to an extent where phones have become an integral part of lifestyle contributing to users’ screen viewing time. Behavior and behavioral attributes of individuals’ personal characteristics are significant components of lifestyle of which sleep, physical activity and screen viewing correspond to the most occupied time throughout the day and among the major lifestyle patterns affecting overall health. This study aims to assess sleep quality and behavioral health from wearables and smartphones using an Adaptive Neuro-Fuzzy Inference System (ANFIS). Real time physical activity and sleep data have been collected from users’ smartwatches. A smartphone application is built to collect real time smartphone usage data. Sleep quality indicator (SleepQual) for assessment of daily sleep quality is calculated using sleep attributes collected from smartwatches. Correlation of SleepQual is evaluated with physical activity attributes and smartphone usage attributes using Pearson’s correlation. Highly correlated attributes along with sleep attributes are used to train the ANFIS model for sleep quality assessment. A novel behavioral health indicator (B. Health) is proposed which is evaluated using real time physical activity, sleep and screen time data. Attributes are ranked on the basis of Pearson’s correlation with B. Health to identify the most important contributors to behavioral health. Top ranked features are selected to train the ANFIS model for behavioral health assessment. Systematic Minority Oversampling Technique has been used for data augmentation. The ANFIS model achieves an accuracy of 91.69% for sleep quality assessment and 85.79% for behavioral health assessment.

[1]  Beatriz Ortega,et al.  Low-cost plastic optical fiber sensor embedded in mattress for sleep performance monitoring , 2021, Optical Fiber Technology.

[2]  L. Sylvia,et al.  Practical guide to measuring physical activity. , 2014, Journal of the Academy of Nutrition and Dietetics.

[3]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[4]  Robert Simon Sherratt,et al.  Low-power Wearable Healthcare Sensors , 2020, Electronics.

[5]  Catrine Tudor-Locke,et al.  Accelerometer profiles of physical activity and inactivity in normal weight, overweight, and obese U.S. men and women , 2010, The international journal of behavioral nutrition and physical activity.

[6]  Kimberly A. Smith,et al.  Development of the physical activity index as a measure of total activity load and total kilocalorie expenditure during submaximal walking. , 2012, Journal of physical activity & health.

[7]  David Alexander Ellis,et al.  Do smartphone usage scales predict behavior? , 2019, Int. J. Hum. Comput. Stud..

[8]  B. Barber,et al.  Mobile Phones in the Bedroom: Trajectories of Sleep Habits and Subsequent Adolescent Psychosocial Development. , 2018, Child development.

[9]  A. Chang,et al.  Digital Media and Sleep in Childhood and Adolescence , 2017, Pediatrics.

[10]  Yasue Mitsukura,et al.  Evaluating depression with multimodal wristband-type wearable device: screening and assessing patient severity utilizing machine-learning , 2020, Heliyon.

[11]  S. Grant,et al.  Objective measurement of physical activity and sedentary behaviour: review with new data , 2008, Archives of Disease in Childhood.

[12]  G. Faulkner,et al.  Maintaining recommended sleep throughout the week is associated with increased physical activity in children. , 2013, Preventive medicine.

[13]  Sue K. Adams,et al.  Relationship between Physical Activity, Screen Time, and Sleep Quantity and Quality in US Adolescents Aged 16–19 , 2019, International journal of environmental research and public health.

[14]  Juan M. Santos-Gago,et al.  Calculation of Sleep Indicators in Students Using Smartphones and Wearables , 2016, WorldCIST.

[15]  M. Mital,et al.  E-health and wellbeing monitoring using smart healthcare devices: An empirical investigation , 2020, Technological Forecasting and Social Change.

[16]  M. Ma,et al.  Healthcare Applications of Smart Watches , 2016, Applied Clinical Informatics.

[17]  Akane Sano,et al.  Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones , 2015, 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[18]  Abdulmotaleb El-Saddik,et al.  CASP: context-aware stress prediction system , 2019, Multimedia Tools and Applications.

[19]  Adrian B. R. Shatte,et al.  Machine learning in mental health: a scoping review of methods and applications , 2019, Psychological Medicine.

[20]  E. Chasens,et al.  Adolescent Sleep and the Impact of Technology Use Before Sleep on Daytime Function. , 2016, Journal of pediatric nursing.

[21]  Fanglin Chen,et al.  Unobtrusive sleep monitoring using smartphones , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[22]  B E Ainsworth,et al.  A simultaneous evaluation of 10 commonly used physical activity questionnaires. , 1993, Medicine and science in sports and exercise.

[23]  Lili Wang,et al.  Reviews of wearable healthcare systems: Materials, devices and system integration , 2020 .

[24]  H. Wong,et al.  Association between Screen Viewing Duration and Sleep Duration, Sleep Quality, and Excessive Daytime Sleepiness among Adolescents in Hong Kong , 2014, International journal of environmental research and public health.

[25]  Jian Shen,et al.  Wearable EEG-Based Real-Time System for Depression Monitoring , 2017, BI.

[26]  M. Hagberg,et al.  Mobile phone use and stress, sleep disturbances, and symptoms of depression among young adults - a prospective cohort study , 2011, BMC public health.

[27]  Daniel J Buysse,et al.  The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research , 1989, Psychiatry Research.

[28]  M. Buman,et al.  Associations of overall sedentary time and screen time with sleep outcomes. , 2015, American journal of health behavior.

[29]  Nirmalya Roy,et al.  An Active Sleep Monitoring Framework Using Wearables , 2018, ACM Trans. Interact. Intell. Syst..

[30]  Pengbo Wan,et al.  A wearable breathable pressure sensor from metal-organic framework derived nanocomposites for highly sensitive broad-range healthcare monitoring , 2020 .

[31]  R. Shephard.  Limits to the measurement of habitual physical activity by questionnaires , 2003, British journal of sports medicine.

[32]  P. Chakraborty,et al.  Problematic Use of Digital Technologies and Its Impact on Mental Health During COVID-19 Pandemic: Assessment Using Machine Learning , 2021, Emerging Technologies During the Era of COVID-19 Pandemic.

[33]  N. Lovato,et al.  A pilot study of a novel smartphone application for the estimation of sleep onset , 2018, Journal of sleep research.

[34]  Wai Lok Woo,et al.  Attention-Block Deep Learning Based Features Fusion in Wearable Social Sensor for Mental Wellbeing Evaluations , 2020, IEEE Access.

[35]  Pablo Hernandez-Leal,et al.  Using Intermediate Models and Knowledge Learning to Improve Stress Prediction , 2017 .

[36]  D. Hellberg,et al.  Behavioral and other characteristics of relevance for health in adolescents with self-perceived sleeping problems , 2008, International journal of adolescent medicine and health.

[37]  Sheng Li,et al.  Advanced Wearable Microfluidic Sensors for Healthcare Monitoring. , 2020, Small.

[38]  Monica Anderson,et al.  Teens, Social Media & Technology 2018 , 2018 .

[39]  J. Olgin,et al.  Direct Measurements of Smartphone Screen-Time: Relationships with Demographics and Sleep , 2016, PloS one.

[40]  L. Hale,et al.  Association Between Portable Screen-Based Media Device Access or Use and Sleep Outcomes: A Systematic Review and Meta-analysis. , 2016, JAMA pediatrics.

[41]  J. Jakicic,et al.  The influence of exercise and BMI on injuries and illnesses in overweight and obese individuals: a randomized control trial , 2010, The international journal of behavioral nutrition and physical activity.

[42]  Akshi Kumar,et al.  Website Quality Analytics Using Metaheuristic Based Optimization , 2019 .

[43]  L. Brooks,et al.  Accuracy of a smartphone application in estimating sleep in children , 2017, Sleep and Breathing.

[44]  Anind K. Dey,et al.  Automatically detecting problematic use of smartphones , 2013, UbiComp.

[45]  Megan A. Moreno,et al.  Children, Adolescents, and the Media , 2013, Pediatrics.

[46]  D. Eaton,et al.  Sufficient sleep, physical activity, and sedentary behaviors. , 2011, American journal of preventive medicine.

[47]  Sudhansu Chokroverty,et al.  Is There a Clinical Role For Smartphone Sleep Apps? Comparison of Sleep Cycle Detection by a Smartphone Application to Polysomnography. , 2015, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[48]  Niclas Palmius,et al.  SleepAp: An automated obstructive sleep apnoea screening application for smartphones , 2013, Computing in Cardiology 2013.

[49]  Maya Samaha Rupert,et al.  To excel or not to excel: Strong evidence on the adverse effect of smartphone addiction on academic performance , 2016, Comput. Educ..

[50]  Akshi Kumar,et al.  A Filter-Wrapper based Feature Selection for Optimized Website Quality Prediction , 2019, 2019 Amity International Conference on Artificial Intelligence (AICAI).

[51]  Z. Shinar,et al.  Validation of Contact-Free Sleep Monitoring Device with Comparison to Polysomnography. , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[52]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[53]  Yong-ling Ye,et al.  Associations of Physical Activity, Screen Time with Depression, Anxiety and Sleep Quality among Chinese College Freshmen , 2014, PloS one.

[54]  Hang-Bong Kang,et al.  An analysis of smartphone overuse recognition in terms of emotions using brainwaves and deep learning , 2018, Neurocomputing.

[55]  Akshi Kumar,et al.  Hierarchical deep neural network for mental stress state detection using IoT based biomarkers , 2021, Pattern Recognit. Lett..

[56]  M. A. Kredlow,et al.  The effects of physical activity on sleep: a meta-analytic review , 2015, Journal of Behavioral Medicine.

[57]  Søren Brage,et al.  Accelerometers and pedometers: methodology and clinical application , 2007, Current opinion in clinical nutrition and metabolic care.

[58]  Muthuraman Thangaraj,et al.  Classification Algorithms with Attribute Selection:An Evaluation Study using WEKA , 2018 .

[59]  Martin Gjoreski,et al.  Monitoring Physical Activity and Mental Stress Using Wrist-Worn Device and a Smartphone , 2017, ECML/PKDD.

[60]  Thomas Stütz,et al.  Smartphone Based Stress Prediction , 2015, UMAP.

[61]  H. Montgomery-Downs,et al.  Movement toward a novel activity monitoring device , 2012, Sleep and Breathing.

[62]  Maulik R. Kamdar,et al.  PRISM: A Data-Driven Platform for Monitoring Mental Health , 2016, PSB.

[63]  Tracy L. Washington,et al.  Practical physical activity measurement in youth: a review of contemporary approaches , 2012, World Journal of Pediatrics.

[64]  Lei Zheng,et al.  DeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection , 2017, KDD.

[65]  J. Beck,et al.  High exercise levels are related to favorable sleep patterns and psychological functioning in adolescents: a comparison of athletes and controls. , 2010, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[66]  Akshi Kumar,et al.  An ANFIS-based compatibility scorecard for IoT integration in websites , 2019, The Journal of Supercomputing.

[67]  David Ellis,et al.  Stress Detection Using Wearable Physiological Sensors , 2015, IWINAC.

[68]  Scott E. Crouter,et al.  Step Counting: A Review of Measurement Considerations and Health-Related Applications , 2016, Sports Medicine.

[69]  Nathan K. Cobb,et al.  Effectiveness of an Activity Tracker- and Internet-Based Adaptive Walking Program for Adults: A Randomized Controlled Trial , 2016, Journal of medical Internet research.

[70]  Akshi Kumar,et al.  Systematic literature review of sentiment analysis on Twitter using soft computing techniques , 2019, Concurr. Comput. Pract. Exp..

[71]  Yi Yang,et al.  Wearable Electronics Based on 2D Materials for Human Physiological Information Detection. , 2020, Small.

[72]  T. Olds,et al.  Sleep duration or bedtime? Exploring the relationship between sleep habits and weight status and activity patterns. , 2011, Sleep.

[73]  F. Tao,et al.  Low Physical Activity and High Screen Time Can Increase the Risks of Mental Health Problems and Poor Sleep Quality among Chinese College Students , 2015, PloS one.

[74]  Shafiq R. Joty,et al.  Impact of Physical Activity on Sleep: A Deep Learning Based Exploration , 2016, ArXiv.

[75]  Alexander Russell,et al.  Multi-view Bi-clustering to Identify Smartphone Sensing Features Indicative of Depression , 2016, 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[76]  Matjaz Gams,et al.  Continuous stress detection using a wrist device: in laboratory and real life , 2016, UbiComp Adjunct.

[77]  Tanzeem Choudhury,et al.  Passive and In-Situ assessment of mental and physical well-being using mobile sensors , 2011, UbiComp '11.

[78]  Juan M. Santos-Gago,et al.  How do you sleep? Using off the shelf wrist wearables to estimate sleep quality, sleepiness level, chronotype and sleep regularity indicators , 2018, J. Ambient Intell. Humaniz. Comput..

[79]  C. Tudor-Locke,et al.  How Many Steps/Day Are Enough? , 2004, Sports medicine.

[80]  Margot J Davey,et al.  Comparison of Commercial Wrist-Based and Smartphone Accelerometers, Actigraphy, and PSG in a Clinical Cohort of Children and Adolescents. , 2016, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[81]  Yunhao Liu,et al.  Big Data: A Survey , 2014, Mob. Networks Appl..

[82]  Masahiro Inoue,et al.  A Development of Classification Model for Smartphone Addiction Recognition System Based on Smartphone Usage Data , 2017, KES-IDT.

[83]  Pinaki Chakraborty,et al.  Analysis of Data from Wearable Sensors for Sleep Quality Estimation and Prediction Using Deep Learning , 2020, Arabian Journal for Science and Engineering.

[84]  H. Nakano,et al.  Monitoring sound to quantify snoring and sleep apnea severity using a smartphone: proof of concept. , 2014, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.