Adaptive wake and sleep detection for wearable systems

Sleep problems and disorders have a serious impact on human health and wellbeing. The rising costs for treating sleep-related chronic diseases in industrialized countries demands efficient prevention. Low-cost, wearable sleep / wake detection systems which give feedback on the wearer's "sleep performance" are a promising approach to reduce the risk of developing serious sleep disorders and fatigue. Not all bio-medical signals that are useful for sleep / wake discrimination can be easily recorded with wearable systems. Sensors often need to be placed in an obtrusive location on the body or cannot be efficiently embedded into a wearable frame. Furthermore, wearable systems have limited computational and energetic resources, which restrict the choice of sensors and algorithms for online processing and classification. Since wearable systems are used outside the laboratory, the recorded signals tend to be corrupted with additional noise that influences the precision of classification algorithms. In this thesis we present the research on a wearable sleep / wake classifier system that relies on cardiorespiratory (ECG and respiratory effort) and activity recordings and that works autonomously with minimal user interaction. This research included the selection of optimal signals and sensors, the development of a custom-tailored hardware demonstrator with embedded classification algorithms, and the realization of experiments in real-world environments for the customization and validation of the system. The processing and classification of the signals were based on Fourier transformations and artificial neural networks that are efficiently implementable into digital signal controllers. Literature analysis and empiric measurements revealed that cardiorespiratory signals are more promising for a wearable sleep / wake classification than clinically used signals such as brain potentials. The experiments conducted during this thesis showed that inter-subject differences within the recorded physiological signals make it difficult to design a sleep / wake classification model that can generalize to a group of subjects. This problem was addressed in two ways: First by adding features from another signal to the classifier, that is, measuring the behavioral quiescence during sleep using accelerometers. Conducted research on different feature extraction methods from accelerometer data showed that this data generalizes well for distinct subjects in the study group. In addition, research on user-adaptation methods was conducted. Behavioral sleep and wake measures, notably the measurement of reactivity and activity, were developed to build up a priori knowledge that was used to adapt the classification algorithm automatically to new situations. This thesis demonstrates the design and development of a low-cost, wearable hardware and embedded software for on-line sleep / wake discrimination. The proposed automatic user-adaptive classifier is advantageous compared to previously suggested classification methods that generalize over multiple subjects, because it can take changes in the wearer's physiology and sleep / wake behavior into account without adjustment from a human expert. The results of this thesis contribute to the development of smart, wearable, bio-physiological monitoring systems which require a high degree of autonomy and have only low computational resources available. We believe that the proposed sleep / wake classification system is a first promising step toward a context-aware system for sleep management, sleep disorder prevention, and reduction of fatigue.

[1]  Robert E Chapman,et al.  Monitoring the Drowsiness of Drivers: A New Method Based on the Velocity of Eyelid Movements , 2005 .

[2]  Luca Chittaro,et al.  MOPET: A context-aware and user-adaptive wearable system for fitness training , 2008, Artif. Intell. Medicine.

[3]  S. Cerutti,et al.  Vegetative Background of Sleep Spectral Analysis of the Heart Rate Variability , 1997, Physiology & Behavior.

[4]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[5]  R. Bashirullah,et al.  Technology and Signal Processing for Brain-Machine Interfaces , 2008, IEEE Signal Processing Magazine.

[6]  T. Davidson,et al.  Home sleep testing in the diagnosis and treatment of sleep disordered breathing. , 2007, Otolaryngologic clinics of North America.

[7]  Joseph L. Jones,et al.  Mobile robots , 1993 .

[8]  A A Borbély,et al.  Simulation of Human Sleep: Ultradian Dynamics of Electroencephalographic Slow-Wave Activity , 1990, Journal of biological rhythms.

[9]  J. Hobson Sleep is of the brain, by the brain and for the brain , 2005, Nature.

[10]  Conor Heneghan,et al.  Cardiorespiratory-based sleep staging in subjects with obstructive sleep apnea , 2006, IEEE Transactions on Biomedical Engineering.

[11]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[12]  R. Ogilvie The process of falling asleep. , 2001, Sleep medicine reviews.

[13]  J. Siegel Clues to the functions of mammalian sleep , 2005, Nature.

[14]  D. J. Mullaney,et al.  An activity-based sleep monitor system for ambulatory use. , 1982, Sleep.

[15]  C. Robert,et al.  Electroencephalogram processing using neural networks , 2002, Clinical Neurophysiology.

[16]  J. Sheridan,et al.  Effect of Sleep Deprivation on Response to Immunizaton , 2002 .

[17]  Albrecht Schmidt,et al.  Advanced Interaction in Context , 1999, HUC.

[18]  R. Ogilvie,et al.  The detection of sleep onset: behavioral and physiological convergence. , 1984, Psychophysiology.

[19]  N. Saranummi,et al.  Personal health systems - need, market place and challenges to their wide scale adoption , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Jyrki Lötjönen,et al.  Automatic sleep-wake and nap analysis with a new wrist worn online activity monitoring device vivago WristCare. , 2003, Sleep.

[21]  R. Karakiewicz,et al.  On-Silicon Neural Activity Monitoring and Time-Frequency Analysis for Early Detection of Epileptic Seizures , 2022 .

[22]  R T Wilkinson,et al.  The detection of sleep onset: behavioral, physiological, and subjective convergence. , 1989, Sleep.

[23]  Joseph D. Bronzino,et al.  The Biomedical Engineering Handbook , 1995 .

[24]  R. Roos,et al.  Where to record motor activity: an evaluation of commonly used sites of placement for activity monitors. , 1993, Electroencephalography and clinical neurophysiology.

[25]  Paul Lukowicz,et al.  Design of the QBIC wearable computing platform , 2004, Proceedings. 15th IEEE International Conference on Application-Specific Systems, Architectures and Processors, 2004..

[26]  J. Trinder,et al.  Correlation between ventilation and EEG-defined arousal during sleep onset in young subjects. , 1997, Journal of applied physiology.

[27]  David F. Dinges,et al.  Assessing performance upon abrupt awakening from naps during quasi-continuous operations , 1985 .

[28]  D. J. Mullaney,et al.  Automatic sleep/wake identification from wrist activity. , 1992, Sleep.

[29]  José del R. Millán,et al.  You Are Wrong! - Automatic Detection of Interaction Errors from Brain Waves , 2005, IJCAI.

[30]  J. C. Principe,et al.  Performance and training strategies in feedforward neural networks: an application to sleep scoring , 1989, International 1989 Joint Conference on Neural Networks.

[31]  D. K. Mooney Activity Measurement in Psychology and Medicine. , 1993 .

[32]  Lieva Van Langenhove,et al.  SMART TEXTILES FOR MEDICINE AND HEALTHCARE , 2007 .

[33]  D. Dinges An overview of sleepiness and accidents , 1995, Journal of sleep research.

[34]  Reinhold Weiss,et al.  Wearable alertness monitoring for industrial applications , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[35]  Gerald P. Krueger,et al.  Pilot Test of Fatigue Management Technologies , 2005 .

[36]  Anna Wirz-Justice,et al.  Chronotherapeutics (light and wake therapy) in affective disorders , 2005, Psychological Medicine.

[37]  A. Rechtschaffen,et al.  A manual of standardized terminology, technique and scoring system for sleep stages of human subjects , 1968 .

[38]  R. Burr,et al.  Interpretation of normalized spectral heart rate variability indices in sleep research: a critical review. , 2007, Sleep.

[39]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[40]  A. M. Taylor,et al.  Discriminative responses to stimulation during human sleep. , 1960, Brain : a journal of neurology.

[41]  P. Silva,et al.  ENOBIO dry electrophysiology electrode; first human trial plus wireless electrode system , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  C. Shapiro,et al.  Distinguishing sleepiness and fatigue: focus on definition and measurement. , 2006, Sleep medicine reviews.

[43]  Tony R. Martinez,et al.  The Inefficiency of Batch Training for Large Training Sets , 2000, IJCNN.

[44]  Ricardo Chavarriaga,et al.  To Err Is Human: Learning from Error Potentials in Brain-Computer Interfaces , 2007 .

[45]  Jan Born,et al.  Sleep loss alters basal metabolic hormone secretion and modulates the dynamic counterregulatory response to hypoglycemia. , 2007, The Journal of clinical endocrinology and metabolism.

[46]  M. Ritsch-Marte,et al.  Can one detect sleep stage transitions for on-line sleep scoring by monitoring the heart rate variability? , 2004 .

[47]  Paul Lukowicz Wearable computing and artificial intelligence for healthcare applications , 2008, Artif. Intell. Medicine.

[48]  Emil Jovanov,et al.  Issues in wearable computing for medical monitoring applications: a case study of a wearable ECG monitoring device , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[49]  Paul Lukowicz,et al.  Wearable Activity Tracking in Car Manufacturing , 2008, IEEE Pervasive Computing.

[50]  F. Harris On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[51]  A. Schlögl,et al.  Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders , 2004, Journal of sleep research.

[52]  H. Middelkoop,et al.  45-hour continuous quintuple-site actimetry: relations between trunk and limb movements and effects of circadian sleep-wake rhythmicity. , 1997, Psychophysiology.

[53]  Soichiro Matsushita,et al.  A wearable fatigue monitoring system: application of human-computer interaction evaluation , 2006, AUIC.

[54]  Melissa M. Mallis,et al.  MANAGING FATIGUE BY DROWSINESS DETECTION: CAN TECHNOLOGICAL PROMISES BE REALIZED? , 1998 .

[55]  M. Morari,et al.  On-line estimation of propofol pharmacodynamic parameters , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[56]  Anna Wirz-Justice,et al.  Waking up properly: is there a role of thermoregulation in sleep inertia? , 2004, Journal of sleep research.

[57]  Melina Rauch,et al.  De-individualized psychophysiological strain assessment during a flight simulation test—Validation of a space methodology , 2008 .

[58]  G. Pillar,et al.  Forty- versus 20-minute trials of the maintenance of wakefulness test regimen for licensing of drivers. , 2009, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[59]  G. Tononi,et al.  Is Sleep Essential? , 2008, PLoS biology.

[60]  Tim Horberry,et al.  REVIEW OF FATIGUE DETECTION AND PREDICTION TECHNOLOGIES , 2000 .

[61]  Dario Floreano,et al.  Analog Genetic Encoding for the Evolution of Circuits and Networks , 2007, IEEE Transactions on Evolutionary Computation.

[62]  A Williamson,et al.  Review of on-road driver fatigue monitoring devices , 2005 .

[63]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[64]  David F Dinges,et al.  Sleep debt and scientific evidence. , 2004, Sleep.

[65]  P Lavie,et al.  Periodic, profound peripheral vasoconstriction--a new marker of obstructive sleep apnea. , 1999, Sleep.

[66]  J. Walsh,et al.  The direct economic costs of insomnia in the United States for 1995. , 1999, Sleep.

[67]  S. Closs Assessment of sleep in hospital patients: a review of methods. , 1988, Journal of advanced nursing.

[68]  E. Stepanski,et al.  Use of sleep hygiene in the treatment of insomnia. , 2003, Sleep medicine reviews.

[69]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[70]  H. Nagaraja,et al.  How accurately does wrist actigraphy identify the states of sleep and wakefulness? , 2001, Sleep.

[71]  Nancy J. Wesensten,et al.  SUSTAINING PERFORMANCE DURING CONTINUOUS OPERATIONS: THE U.S. ARMY'S SLEEP MANAGEMENT SYSTEM , 1998 .

[72]  Y. Ohno,et al.  Examination of non-restrictive and non-invasive sleep evaluation technique for children using difference images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[73]  Alex Pentland,et al.  Mobile-IT Education (MIT. EDU): m-learning applications for classroom settings , 2005, J. Comput. Assist. Learn..

[74]  Drew Dawson,et al.  Thermoregulation as a sleep signalling system. , 2004, Sleep medicine reviews.

[75]  Paolo Bonato,et al.  Advances in wearable technology and applications in physical medicine and rehabilitation , 2005, Journal of NeuroEngineering and Rehabilitation.

[76]  Sarah Herscovici,et al.  Detecting REM sleep from the finger: an automatic REM sleep algorithm based on peripheral arterial tone (PAT) and actigraphy , 2007, Physiological measurement.

[77]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[78]  C. Mattiussi,et al.  Adaptive Sleep/Wake Classification Based on Cardiorespiratory Signals for Wearable Devices , 2007, 2007 IEEE Biomedical Circuits and Systems Conference.

[79]  Heidi D. Howarth,et al.  An Evaluation of Emerging Driver Fatigue Detection Measures and Technologies , 2009 .

[80]  Ralph W. Gerard,et al.  Factors influencing brain potentials during sleep. , 1939 .

[81]  S. Cerutti,et al.  Signal Processing and Feature Extraction for Sleep Evaluation in Wearable Devices , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[82]  I Korhonen,et al.  Acquisition of biomedical signals databases. , 2001, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[83]  J. Wardle,et al.  Sleep duration and health in young adults. , 2006, Archives of internal medicine.

[84]  H. L. Williams,et al.  Instrumental behavior during sleep. , 1966, Psychophysiology.

[85]  D. White,et al.  A novel adaptive wrist actigraphy algorithm for sleep-wake assessment in sleep apnea patients. , 2004, Sleep.

[86]  T. Åkerstedt,et al.  Consensus Statement: Fatigue and accidents in transport operations , 2000, Journal of sleep research.

[87]  C. Guilleminault,et al.  Comparison of actigraphic, polysomnographic, and subjective assessment of sleep parameters in sleep-disordered patients. , 2001, Sleep medicine.

[88]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[89]  H. Colten,et al.  Sleep Disorders and Sleep Deprivation: An Unmet Public Health Problem , 2006 .

[90]  C. Pollak,et al.  The role of actigraphy in the study of sleep and circadian rhythms. , 2003, Sleep.

[91]  Tadao Hori,et al.  Topographical EEG changes and the hypnagogic experience. , 1994 .

[92]  S. Wilson,et al.  Why We Nap: Evolution, Chronobiology and Functions of Polyphasic and Ultrashort Sleep , 1995, Journal of psychopharmacology.

[93]  G. Jean-Louis,et al.  Determination of sleep and wakefulness with the actigraph data analysis software (ADAS). , 1996, Sleep.

[94]  D. Dinges,et al.  Sleep debt: Theoretical and empirical issues , 2003 .

[95]  R. T. Pivik,et al.  Heart rate associated with sleep onset in preadolescent , 1996, Journal of sleep research.

[96]  H. Colten,et al.  Sleep Disorders and Sleep Deprivation , 2006 .

[97]  C. Robert,et al.  Review of neural network applications in sleep research , 1998, Journal of Neuroscience Methods.

[98]  G. Pfurtscheller,et al.  EEG-based communication: presence of an error potential , 2000, Clinical Neurophysiology.

[99]  M. Bonnet,et al.  Heart rate variability: sleep stage, time of night, and arousal influences. , 1997, Electroencephalography and clinical neurophysiology.

[100]  S. Akselrod,et al.  Autonomic changes during wake–sleep transition: A heart rate variability based approach , 2006, Autonomic Neuroscience.

[101]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[102]  Simon Folkard,et al.  Predictions from the three-process model of alertness. , 2004, Aviation, space, and environmental medicine.

[103]  T. Åkerstedt,et al.  Validation of the S and C components of the three-process model of alertness regulation. , 1995, Sleep.

[104]  Luciane L. de Souza,et al.  Further validation of actigraphy for sleep studies. , 2003, Sleep.

[105]  Alain Muzet,et al.  Sleep inertia. , 2000, Sleep medicine reviews.

[106]  A. Schlögl,et al.  An E-Health Solution for Automatic Sleep Classification according to Rechtschaffen and Kales: Validation Study of the Somnolyzer 24 × 7 Utilizing the Siesta Database , 2005, Neuropsychobiology.

[107]  A. Buttfield,et al.  Towards a robust BCI: error potentials and online learning , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[108]  Dr. Thomas J. Balkin,et al.  Managing Sleep and Alertness to Sustain Performance in the Operational Environment , 2005 .

[109]  Walter Bender,et al.  Every sign of life , 2003 .

[110]  J. Kamiya,et al.  The nature of respiratory changes associated with sleep onset. , 1981, Sleep.

[111]  S. Intille,et al.  User-adaptive reminders for home-based medical tasks. A case study. , 2008, Methods of information in medicine.

[112]  Dario Floreano,et al.  Improving actigraph sleep/wake classification with cardio-respiratory signals , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[113]  T Hori,et al.  Electrodermal and electro-oculographic activity in a hypnagogic state. , 1982, Psychophysiology.

[114]  Göran Kecklund,et al.  Predicting road crashes from a mathematical model of alertness regulation--The Sleep/Wake Predictor. , 2008, Accident; analysis and prevention.

[115]  C A Czeisler,et al.  Timing of REM sleep is coupled to the circadian rhythm of body temperature in man. , 1980, Sleep.

[116]  Rachel Leproult,et al.  HIGHLIGHTED TOPIC Physiology and Pathophysiology of Sleep Apnea Sleep loss: a novel risk factor for insulin resistance and Type 2 diabetes , 2022 .

[117]  E. Hirt,et al.  Wearable devices for emerging healthcare applications , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[118]  M. Kodama,et al.  Evaluation of sleep using ambulatory skin potential recording:Differences between morning and evening type , 1998, Psychiatry and clinical neurosciences.

[119]  P. Davis,et al.  CHANGES IN HUMAN BRAIN POTENTIALS DURING THE ONSET OF SLEEP. , 1937, Science.

[120]  M. Bresler,et al.  Differentiating between light and deep sleep stages using an ambulatory device based on peripheral arterial tonometry , 2008, Physiological measurement.

[121]  Andreas Krause,et al.  Context-aware mobile computing: learning context- dependent personal preferences from a wearable sensor array , 2006, IEEE Transactions on Mobile Computing.

[122]  Mitsuo Kawato Brain-controlled robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[123]  Edward Sazonov,et al.  Activity-based sleep-wake identification in infants. , 2004, Physiological measurement.

[124]  T. Penzel,et al.  Computer based sleep recording and analysis. , 2000, Sleep medicine reviews.

[125]  P. Achermann,et al.  Trait-like individual differences in the human sleep electroencephalogram , 2006, Neuroscience.

[126]  P. Achermann,et al.  Mathematical models of sleep regulation. , 2003, Frontiers in bioscience : a journal and virtual library.

[127]  Vinod Venkatraman,et al.  Sleep deprivation elevates expectation of gains and attenuates response to losses following risky decisions. , 2007, Sleep.

[128]  R. Ogilvie,et al.  Sleep onset: Normal and abnormal processes. , 1994 .

[129]  A. Borbély A two process model of sleep regulation. , 1982, Human neurobiology.

[130]  Frank Dellaert,et al.  SWAN: System for Wearable Audio Navigation , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[131]  K.-R. Muller,et al.  Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[132]  David F. Dinges,et al.  Perclos: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance , 1998 .

[133]  Bernt Schiele,et al.  Unsupervised Discovery of Structure in Activity Data Using Multiple Eigenspaces , 2006, LoCA.

[134]  E. Wolpert A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[135]  E. van Cauter,et al.  Effect of sleep deprivation on response to immunization. , 2002, JAMA.

[136]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[137]  A. Sadeh,et al.  The role of actigraphy in sleep medicine. , 2002, Sleep medicine reviews.

[138]  A. Sadeh,et al.  Activity-based sleep-wake identification: an empirical test of methodological issues. , 1994, Sleep.

[139]  Dario Floreano,et al.  Sleep and Wake Classification With ECG and Respiratory Effort Signals , 2009, IEEE Transactions on Biomedical Circuits and Systems.