Towards Respiration Rate Monitoring Using an In-Ear Headphone Inertial Measurement Unit

State-of-the-art respiration tracking devices require specialized equipment, making them impractical for every day at-home respiration sensing. In this paper, we present the first system for sensing respiratory rates using in-ear headphone inertial measurement units (IMU). The approach is based on technology already available in commodity devices: the eSense headphones. Our processing pipeline combines several existing approaches to clean noisy data and calculate respiratory rates on 20-second windows. In a study with twelve participants, we compare accelerometer and gyroscope based sensing and employ pressure-based measurement with nasal cannulas as ground truth. Our results indicate a mean absolute error of 2.62 CPM (acc) and 2.55 CPM (gyro). This overall accuracy is comparable to previous approaches using accelerometer-based sensing, but we observe a higher relative error for the gyroscope. In contrast to related work using other sensor positions, we can not report significant differences between the two modalities or the three postures standing, sitting, and lying on the back (supine). However, in general, performance varies drastically between participants.

[1]  R. Stiefelhagen,et al.  Breath rate monitoring during sleep using near-ir imagery and PCA , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  Janice J Eng,et al.  Pedometer accuracy in slow walking older adults. , 2012, International journal of therapy and rehabilitation.

[3]  Shiwei Ma,et al.  A Clock Synchronization Method for Molecular Nanomachines in Bionanosensor Networks , 2016, IEEE Sensors Journal.

[4]  S. Venkatesh,et al.  Implementation and analysis of respiration-rate estimation using impulse-based UWB , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[5]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[6]  David Da He,et al.  A wearable heart monitor at the ear using ballistocardiogram (BCG) and electrocardiogram (ECG) with a nanowatt ECG heartbeat detection circuit , 2013 .

[7]  Kristof Van Laerhoven,et al.  Using Wrist-Worn Activity Recognition for Basketball Game Analysis , 2018, iWOAR.

[8]  Daniel McDuff,et al.  Biowatch: Estimation of heart and breathing rates from wrist motions , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[9]  Paul Lukowicz,et al.  Where am I: Recognizing On-body Positions of Wearable Sensors , 2005, LoCA.

[10]  Guoliang Xing,et al.  MindfulWatch: A Smartwatch-Based System For Real-Time Respiration Monitoring During Meditation , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[11]  Matthias Budde,et al.  VOCNEA: sleep apnea and hypopnea detection using a novel tiny gas sensor , 2018, UbiComp.

[12]  Henning Trsek,et al.  Clock Synchronization Over IEEE 802.11—A Survey of Methodologies and Protocols , 2017, IEEE Transactions on Industrial Informatics.

[13]  Timothy W. Bickmore,et al.  Breathe Deep: A Breath-Sensitive Interactive Meditation Coach , 2018, PervasiveHealth.

[14]  Khaled A. Harras,et al.  UbiBreathe: A Ubiquitous non-Invasive WiFi-based Breathing Estimator , 2015, MobiHoc.

[15]  J C Leong,et al.  Kinematics of the chest cage and spine during breathing in healthy individuals and in patients with adolescent idiopathic scoliosis. , 1999, Spine.

[16]  Joseph A. Paradiso,et al.  SensorTape: Modular and Programmable 3D-Aware Dense Sensor Network on a Tape , 2015, UIST.

[17]  Chris Baber,et al.  The comfort assessment of wearable computers , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[18]  Marian Haescher,et al.  SeismoTracker: Upgrade any Smart Wearable to enable a Sensing of Heart Rate, Respiration Rate, and Microvibrations , 2016, CHI Extended Abstracts.

[19]  Christoph Sens-Schönfelder,et al.  Synchronizing seismic networks with ambient noise , 2008 .

[20]  G. Welk,et al.  How valid are wearable physical activity trackers for measuring steps? , 2017, European journal of sport science.

[21]  Subi J. George,et al.  Ultrafast response humidity sensor using supramolecular nanofibre and its application in monitoring breath humidity and flow , 2014, Scientific Reports.

[22]  E. Williams Experimental Designs Balanced for the Estimation of Residual Effects of Treatments , 1949 .

[23]  D. K. Arvind,et al.  Respiratory Rate and Flow Waveform Estimation from Tri-axial Accelerometer Data , 2010, 2010 International Conference on Body Sensor Networks.

[24]  Bernt Schiele,et al.  Standing on the Shoulders of Other Researchers - A Position Statement , 2010, Pervasive 2010.

[25]  Christoph Lenzen,et al.  PulseSync: An Efficient and Scalable Clock Synchronization Protocol , 2015, IEEE/ACM Transactions on Networking.

[26]  A. Sheel,et al.  Measurement of exercise ventilation by a portable respiratory inductive plethysmograph , 2006, Respiratory Physiology & Neurobiology.

[27]  D. Rapoport,et al.  Detection of respiratory events during NPSG: nasal cannula/pressure sensor versus thermistor. , 1997, Sleep.

[28]  Guohong Cao,et al.  SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[29]  James M. Rehg,et al.  Cardiac and Respiratory Parameter Estimation Using Head-mounted Motion-sensitive Sensors , 2015, EAI Endorsed Trans. Pervasive Health Technol..

[30]  Chulhong Min,et al.  Earables for Personal-Scale Behavior Analytics , 2018, IEEE Pervasive Computing.

[31]  D. Bassett,et al.  Use of pedometers and accelerometers in clinical populations: validity and reliability issues , 2010 .

[32]  Ki H. Chon,et al.  Estimation of Respiratory Rates Using the Built-in Microphone of a Smartphone or Headset , 2016, IEEE Journal of Biomedical and Health Informatics.

[33]  Romit Roy Choudhury,et al.  Closing the Gaps in Inertial Motion Tracking , 2018, MobiCom.

[34]  B. Milosevic,et al.  Wearable Inertial Sensor for Jump Performance Analysis , 2015, WearSys '15.

[35]  Jérémie Voix,et al.  In-Ear Audio Wearable: Measurement of Heart and Breathing Rates for Health and Safety Monitoring , 2018, IEEE Transactions on Biomedical Engineering.

[36]  Ricardo Gutierrez-Osuna,et al.  Sonic respiration: controlling respiration rate through auditory biofeedback , 2014, CHI Extended Abstracts.