Hearables: Multimodal physiological in-ear sensing

Future health systems require the means to assess and track the neural and physiological function of a user over long periods of time, and in the community. Human body responses are manifested through multiple, interacting modalities – the mechanical, electrical and chemical; yet, current physiological monitors (e.g. actigraphy, heart rate) largely lack in cross-modal ability, are inconvenient and/or stigmatizing. We address these challenges through an inconspicuous earpiece, which benefits from the relatively stable position of the ear canal with respect to vital organs. Equipped with miniature multimodal sensors, it robustly measures the brain, cardiac and respiratory functions. Comprehensive experiments validate each modality within the proposed earpiece, while its potential in wearable health monitoring is illustrated through case studies spanning these three functions. We further demonstrate how combining data from multiple sensors within such an integrated wearable device improves both the accuracy of measurements and the ability to deal with artifacts in real-world scenarios.

[1]  James J. S. Norton,et al.  Soft, curved electrode systems capable of integration on the auricle as a persistent brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[2]  Christos Papavassiliou,et al.  Co-Located Multimodal Sensing: A Next Generation Solution for Wearable Health , 2015, IEEE Sensors Journal.

[3]  K. Lee,et al.  Self-adhesive epidermal carbon nanotube electronics for tether-free long-term continuous recording of biosignals , 2014, Scientific Reports.

[4]  Yong Zhu,et al.  Wearable silver nanowire dry electrodes for electrophysiological sensing , 2015 .

[5]  Daniel Sánchez Morillo,et al.  Dry EEG Electrodes , 2014, Sensors.

[6]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[7]  Ki-Young Jung,et al.  A dry and flexible electrode for continuous-EEG monitoring using silver balls based polydimethylsiloxane (PDMS) , 2012 .

[8]  S. Debener,et al.  Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear , 2015, Scientific Reports.

[9]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .

[10]  Esther Rodríguez-Villegas,et al.  Breathing Detection: Towards a Miniaturized, Wearable, Battery-Operated Monitoring System , 2008, IEEE Transactions on Biomedical Engineering.

[11]  Steffen Leonhardt,et al.  Advances in Reflective Oxygen Saturation Monitoring With a Novel In-Ear Sensor System: Results of a Human Hypoxia Study , 2012, IEEE Transactions on Biomedical Engineering.

[12]  Preben Kidmose,et al.  A Study of Evoked Potentials From Ear-EEG , 2013, IEEE Transactions on Biomedical Engineering.

[13]  C Gabriel,et al.  The dielectric properties of biological tissues: I. Literature survey. , 1996, Physics in medicine and biology.

[14]  H. Pasterkamp,et al.  Detection of respiratory sounds within the ear canal , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[15]  Joong Hoon Lee,et al.  CNT/PDMS-based canal-typed ear electrodes for inconspicuous EEG recording , 2014, Journal of neural engineering.

[16]  Danilo P. Mandic,et al.  A machine learning enhanced empirical mode decomposition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  M. Scherg,et al.  Intracerebral Sources of Human Auditory Steady-State Responses , 2004, Brain Topography.

[18]  Preben Kidmose,et al.  Subspace denoising of EEG artefacts via multivariate EMD , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Pietro Salvo,et al.  A 3D printed dry electrode for ECG/EEG recording , 2012 .

[20]  R. Kubichek,et al.  Mel-cepstral distance measure for objective speech quality assessment , 1993, Proceedings of IEEE Pacific Rim Conference on Communications Computers and Signal Processing.

[21]  Michael Schrauf,et al.  EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions , 2011, Clinical Neurophysiology.

[22]  C. Grozea,et al.  Bristle-sensors—low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications , 2011, Journal of neural engineering.

[23]  Tzyy-Ping Jung,et al.  Dry-Contact and Noncontact Biopotential Electrodes: Methodological Review , 2010, IEEE Reviews in Biomedical Engineering.

[24]  T. Jung,et al.  Using novel MEMS EEG sensors in detecting drowsiness application , 2006, 2006 IEEE Biomedical Circuits and Systems Conference.

[25]  D. P. Mandic,et al.  The In-the-Ear Recording Concept: User-Centered and Wearable Brain Monitoring , 2012, IEEE Pulse.

[26]  R. W. Lau,et al.  The dielectric properties of biological tissues: III. Parametric models for the dielectric spectrum of tissues. , 1996, Physics in medicine and biology.

[27]  R. W. Lau,et al.  The dielectric properties of biological tissues: II. Measurements in the frequency range 10 Hz to 20 GHz. , 1996, Physics in medicine and biology.

[28]  A. Simonds,et al.  Changes in Neurocognitive Architecture in Patients with Obstructive Sleep Apnea Treated with Continuous Positive Airway Pressure , 2016, EBioMedicine.

[29]  D. Mandic,et al.  A wearable in-ear encephalography sensor for monitoring sleep: preliminary observations from nap studies , 2016 .

[30]  Preben Kidmose,et al.  In-Ear EEG From Viscoelastic Generic Earpieces: Robust and Unobtrusive 24/7 Monitoring , 2016, IEEE Sensors Journal.