Investigating the Relationship between Sleep and Wake Behavior using Machine Learning and Smart Home Sensors

by Jennifer Ashleigh Williams, Ph.D. Washington State University May 2017 Chair: Diane J. Cook Smart home technologies offer a unique opportunity to monitor individuals in a noninvasive manner. Because of this, they provide an ideal opportunity for pervasive healthcare. Smart homes provide the resident the freedom of being at home while still providing monitoring and analysis of any health issues that may arise. The ultimate goal is to use smart home technology to enable people recovering from injuries or coping with disabilities (i.e., PostTraumatic Stress Disorder, or dementia) to live independently. The immediate goal of this dissertation is to monitor, analyze, and predict the overall behavior of the individual in a smart home environment for correlation with a range of chronic and sudden health issues. We accomplish this goal by designing computational approaches to analyze and forecast daily behavior. Additionally, we quantify daily behavior exhibited by an individual while they are both awake and asleep based on data collected in CASAS smart homes. Sleep is an important element in our everyday lives. In this dissertation we hypothesize that wake behavior has an impact on both current and future sleep and vice versa. To analyze the relationship between sleep and wake activity we consider sleep separately from other activities within the smart home. We examine the relationship based on prior studies and using our novel v computational methods. To computationally evaluate the relationship between wake and sleep behavior, we explore three main elements: 1) behavior cycle detection, 2) behavior quantification methods, and 3) behavior forecasting. We provide validation for these approaches by using data collected in actual smart home test sites. In addition to analyzing the relationship between wake and sleep behaviors, we propose that a reliable sleep quality analysis can be achieved using the CASAS smart home system. We pursue this goal by performing a pilot study in which wearable sensors are used in conjunction with the CASAS smart home sensors. We use the data from this pilot study to validate the use of smart home sensors as a tool for the analysis of sleep patterns.

[1]  Steven R. Rick,et al.  SleepBot , 2019, Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion.

[2]  Laurel Snyder,et al.  Sense , 1997, The Dramatic Text Workbook and Video.

[3]  C. Seiler.  ANOVA , 2019, Springer Reference Medizin.

[4]  Kirsten Huby,et al.  Sleep Cycle alarm clock , 2017 .

[5]  Andrea M. Comptour,et al.  Validity and reliability of Fitbit activity monitors compared to ActiGraph GT3X+ with female adults in a free-living environment. , 2017, Journal of science and medicine in sport.

[6]  Alvaro Gauterin,et al.  Comparison of wrist-worn Fitbit Flex and waist-worn ActiGraph for measuring steps in free-living adults , 2017, PloS one.

[7]  Margaret Schneider,et al.  Validation of the Fitbit Zip for monitoring physical activity among free-living adolescents , 2016, BMC Research Notes.

[8]  Diane J. Cook,et al.  Modeling patterns of activities using activity curves , 2016, Pervasive Mob. Comput..

[9]  H. In,et al.  PT663. Comparison of wearable activity tracker to actigraphy for sleep evaluation and circadian rhythm measurement. , 2016, International Journal of Neuropsychopharmacology.

[10]  Rebecca M. C. Spencer,et al.  Reliability of Sleep Measures from Four Personal Health Monitoring Devices Compared to Research-Based Actigraphy and Polysomnography , 2016, Sensors.

[11]  M. Hirshkowitz,et al.  National Sleep Foundation's updated sleep duration recommendations: final report. , 2015, Sleep health.

[12]  Nawel Yala,et al.  Feature extraction for human activity recognition on streaming data , 2015, 2015 International Symposium on Innovations in Intelligent SysTems and Applications (INISTA).

[13]  Niall Twomey,et al.  Bayesian Modelling of the Temporal Aspects of Smart Home Activity with Circular Statistics , 2015, ECML/PKDD.

[14]  J. Best,et al.  Measuring sleep quality in older adults: a comparison using subjective and objective methods , 2015, Front. Aging Neurosci..

[15]  Ian M Colrain,et al.  Validation of Sleep-Tracking Technology Compared with Polysomnography in Adolescents. , 2015, Sleep.

[16]  Massimiliano de Zambotti,et al.  Evaluation of a consumer fitness-tracking device to assess sleep in adults , 2015, Chronobiology international.

[17]  Adriana M. Seelye,et al.  Pervasive Computing Technologies to Continuously Assess Alzheimer’s Disease Progression and Intervention Efficacy , 2015, Front. Aging Neurosci..

[18]  M. Hirshkowitz,et al.  National Sleep Foundation's sleep time duration recommendations: methodology and results summary. , 2015, Sleep health.

[19]  C. Czeisler.  Duration, timing and quality of sleep are each vital for health, performance and safety. , 2015, Sleep health.

[20]  A. Sadeh.  Iii. Sleep assessment methods. , 2015, Monographs of the Society for Research in Child Development.

[21]  Adriana M. Seelye,et al.  The Impact of Sleep on Neuropsychological Performance in Cognitively Intact Older Adults Using a Novel In-Home Sensor-Based Sleep Assessment Approach , 2015, The Clinical neuropsychologist.

[22]  Prafulla N. Dawadi,et al.  Automated Clinical Assessment from Smart home-based Behavior Data , 2015 .

[23]  Gregory M. P. O'Hare,et al.  Dynamic sensor event segmentation for real-time activity recognition in a smart home context , 2014, Personal and Ubiquitous Computing.

[24]  Diane J. Cook,et al.  Smart home-based longitudinal functional assessment , 2014, UbiComp Adjunct.

[25]  John Zimmerman,et al.  Toss 'n' turn: smartphone as sleep and sleep quality detector , 2014, CHI.

[26]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[27]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[28]  Alois Knoll,et al.  Gradient boosting machines, a tutorial , 2013, Front. Neurorobot..

[29]  Jim Esch,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proc. IEEE.

[30]  Guoliang Xing,et al.  iSleep: unobtrusive sleep quality monitoring using smartphones , 2013, SenSys '13.

[31]  J. Solet,et al.  Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. , 2013, Sleep.

[32]  Subhas Mukhopadhyay,et al.  Forecasting the behavior of an elderly using wireless sensors data in a smart home , 2013, Eng. Appl. Artif. Intell..

[33]  M. Echteld,et al.  Comparison of two types of Actiwatch with polysomnography in older adults with intellectual disability: A pilot study , 2013, Journal of intellectual & developmental disability.

[34]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[35]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[36]  Didier Stricker,et al.  Towards robust activity recognition for everyday life: Methods and evaluation , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[37]  Diane J. Cook,et al.  Activity Discovery and Activity Recognition: A New Partnership , 2013, IEEE Transactions on Cybernetics.

[38]  K. J. Miller,et al.  Smart-Home Technologies to Assist Older People to Live Well at Home , 2013 .

[39]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[40]  OpenStaxCollege.  Testing the Significance of the Correlation Coefficient , 2013 .

[41]  Diane J. Cook,et al.  Behaviometrics for Identifying Smart Home Residents , 2013 .

[42]  Anupam Agrawal,et al.  A survey on activity recognition and behavior understanding in video surveillance , 2012, The Visual Computer.

[43]  June Gruber,et al.  Evaluating sleep in bipolar disorder: comparison between actigraphy, polysomnography, and sleep diary , 2012, Bipolar disorders.

[44]  Miao Yu,et al.  A Posture Recognition-Based Fall Detection System for Monitoring an Elderly Person in a Smart Home Environment , 2012, IEEE Transactions on Information Technology in Biomedicine.

[45]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[46]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[47]  Hassan Ghasemzadeh,et al.  Automatic Segmentation and Recognition in Body Sensor Networks Using a Hidden Markov Model , 2012, TECS.

[48]  T. Balkin,et al.  Sleep disorders and work performance: findings from the 2008 National Sleep Foundation Sleep in America poll , 2011, Journal of sleep research.

[49]  Liming Chen,et al.  Activity Recognition: Approaches, Practices and Trends , 2011 .

[50]  P. Genta,et al.  Comparison of full versus short induced‐sleep polysomnography for the diagnosis of sleep apnea , 2011, The Laryngoscope.

[51]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[52]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[53]  D. Auckley,et al.  Evaluation of sleep disorders in the primary care setting: history taking compared to questionnaires. , 2011, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[54]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[55]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[56]  Diane J. Cook,et al.  Automated Prompting in a Smart Home Environment , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[57]  Plamen P. Angelov,et al.  Human Activity Recognition Based on Evolving Fuzzy Systems , 2010, Int. J. Neural Syst..

[58]  Susan Redline,et al.  Validity of activity-based devices to estimate sleep. , 2010, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[59]  Diane J. Cook,et al.  A Data Mining Framework for Activity Recognition in Smart Environments , 2010, 2010 Sixth International Conference on Intelligent Environments.

[60]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[61]  Kathryn Moynihan Ramsey,et al.  Circadian Rhythms and Metabolic Syndrome: From Experimental Genetics to Human Disease , 2010, Circulation research.

[62]  M. Chan,et al.  Smart homes - current features and future perspectives. , 2009, Maturitas.

[63]  Ching-Wu Chu,et al.  A comparison of univariate methods for forecasting container throughput volumes , 2009, Math. Comput. Model..

[64]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Duanping Liao,et al.  Insomnia With Objective Short Sleep Duration Is Associated With Type 2 Diabetes , 2009, Diabetes Care.

[66]  Duanping Liao,et al.  Insomnia with objective short sleep duration is associated with a high risk for hypertension. , 2009, Sleep.

[67]  Allen Y. Yang,et al.  Distributed recognition of human actions using wearable motion sensor networks , 2009, J. Ambient Intell. Smart Environ..

[68]  Norbert Gyorbíró,et al.  An Activity Recognition System For Mobile Phones , 2009, Mob. Networks Appl..

[69]  D. Cook,et al.  Smart Home-Based Health Platform for Behavioral Monitoring and Alteration of Diabetes Patients , 2009, Journal of diabetes science and technology.

[70]  Erich Neuwirth,et al.  One-Way ANOVA , 2009 .

[71]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[72]  A. Krystal,et al.  Measuring sleep quality. , 2008, Sleep medicine.

[73]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[74]  Daniel J Buysse,et al.  Self-reported sleep duration is associated with the metabolic syndrome in midlife adults. , 2008, Sleep.

[75]  Carla L Graf,et al.  The Lawton Instrumental Activities of Daily Living Scale , 2008, The American journal of nursing.

[76]  Sanjay R. Patel,et al.  Short Sleep Duration and Weight Gain: A Systematic Review , 2008, Obesity.

[77]  Carla L Graf.  Best Practices in Nursing Care to Older Adults general assessment series , 2008 .

[78]  J. Carrier,et al.  Wake detection capacity of actigraphy during sleep. , 2007, Sleep.

[79]  Hani Hagras,et al.  An Incremental Adaptive Life Long Learning Approach for Type-2 Fuzzy Embedded Agents in Ambient Intelligent Environments , 2007, IEEE Transactions on Fuzzy Systems.

[80]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[81]  Hamid Aghajan,et al.  Smart home care network using sensor fusion and distributed vision-based reasoning , 2006, VSSN '06.

[82]  J. Wardle,et al.  Sleep duration and health in young adults. , 2006, Archives of internal medicine.

[83]  Susan Redline,et al.  Association of usual sleep duration with hypertension: the Sleep Heart Health Study. , 2006, Sleep.

[84]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[85]  David Murray,et al.  Actigraphy validation with insomnia. , 2006, Sleep.

[86]  Abdenour Bouzouane,et al.  A Smart Home Agent for Plan Recognition of Cognitively-impaired Patients , 2006, J. Comput..

[87]  H. Colten,et al.  Ensuring Adequate Diagnosis and Treatment: Access, Capacity, and Technology Development , 2006 .

[88]  Henry A. Kautz,et al.  Location-Based Activity Recognition using Relational Markov Networks , 2005, IJCAI.

[89]  J. Weir.  Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. , 2005, Journal of strength and conditioning research.

[90]  Jay Stewart,et al.  The American Time Use Survey , 2005 .

[91]  T. Young,et al.  Short Sleep Duration Is Associated with Reduced Leptin, Elevated Ghrelin, and Increased Body Mass Index , 2004, PLoS medicine.

[92]  Jessica D. Payne,et al.  Sleep, dreams, and memory consolidation: the role of the stress hormone cortisol. , 2004, Learning & memory.

[93]  W. F. Waters,et al.  Wrist Actigraph Versus Self-Report in Normal Sleepers: Sleep Schedule Adherence and Self-Report Validity , 2004, Behavioral sleep medicine.

[94]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[95]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[96]  A. Barsevick,et al.  Psychometric evaluation of the Pittsburgh Sleep Quality Index in cancer patients. , 2004, Journal of pain and symptom management.

[97]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[98]  C. Pollak,et al.  The role of actigraphy in the study of sleep and circadian rhythms. , 2003, Sleep.

[99]  Luciane L. de Souza,et al.  Further validation of actigraphy for sleep studies. , 2003, Sleep.

[100]  Dana R Epstein,et al.  Sleep disorders , 2018, Oxford Scholarship Online.

[101]  K. Junghanns,et al.  Test-retest reliability and validity of the Pittsburgh Sleep Quality Index in primary insomnia. , 2002, Journal of psychosomatic research.

[102]  Yaron Dagan,et al.  Circadian rhythm sleep disorders (CRSD). , 2002, Sleep medicine reviews.

[103]  J. Trinder,et al.  Detecting insomnia: comparison of four self‐report measures of sleep in a young adult population , 2001, Journal of sleep research.

[104]  C. Guilleminault,et al.  Comparison of actigraphic, polysomnographic, and subjective assessment of sleep parameters in sleep-disordered patients. , 2001, Sleep medicine.

[105]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[106]  G. Jean-Louis,et al.  Sleep detection with an accelerometer actigraph: comparisons with polysomnography , 2001, Physiology & Behavior.

[107]  Bernhard Schölkopf,et al.  Comparing support vector machines with Gaussian kernels to radial basis function classifiers , 1997, IEEE Trans. Signal Process..

[108]  W C Dement,et al.  The Sleep Disorders Questionnaire. I: Creation and multivariate structure of SDQ. , 1994, Sleep.

[109]  M. Bursztyn,et al.  Siesta and ambulatory blood pressure monitoring. Comparability of the afternoon nap and night sleep. , 1994, American journal of hypertension.

[110]  T. Roth,et al.  The sleep-wake activity inventory: A self-report measure of daytime sleepiness , 1993, Biological Psychiatry.

[111]  N. Altman.  An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[112]  Aram Karalic.  Linear Regression in Regression Tree Leaves , 1992 .

[113]  J. Wiener,et al.  Measuring the activities of daily living: comparisons across national surveys. , 1990, Journal of gerontology.

[114]  Robert L. Spitzer,et al.  User's guide for the Structured clinical interview for DSM-III-R : SCID , 1990 .

[115]  Daniel J Buysse,et al.  The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research , 1989, Psychiatry Research.

[116]  B. Hofmann-Wellenhof,et al.  Introduction to spectral analysis , 1986 .

[117]  J. Scargle.  Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .