WearBreathing: Real World Respiratory Rate Monitoring Using Smartwatches

Respiratory rate is a vital physiological signal that may be useful for a multitude of clinical applications, especially if measured in the wild rather than controlled settings. In-the-wild respiratory rate monitoring is currently done using dedicated chest band sensors, but these devices are specialized, expensive and cumbersome to wear day after day. While recent works have proposed using smartwatch based accelerometer and gyroscope data for respiratory rate monitoring, current methods are unreliable and inaccurate in the presence of motion and have therefore only been applied in controlled or low-motion settings. Thus, measuring respiratory rate in the wild remains a challenge. We observe that for many applications, having fewer accurate readings is better than having more, less accurate readings. Based on this, we develop WearBreathing, a novel system for respiratory rate monitoring. WearBreathing consists of a machine learning based filter that detects and rejects sensor data that are not suitable for respiratory rate extraction and a convolutional neural network model for extracting respiratory rate from accelerometer and gyroscope data. Using a diverse, out-of-the-lab dataset that we collected, we show that WearBreathing has a 2.5 to 5.8 times lower mean absolute error (MAE) than existing approaches. We show that WearBreathing is tunable and by changing a single threshold value, it can, for example, deliver a reading every 50 seconds with a MAE of 2.05 breaths/min or a reading every 5 minutes with an MAE of 1.09 breaths/min. Finally, we evaluate power consumption and find that with some power saving measures, WearBreathing can run on a smartwatch while providing a full day's worth of battery life.

[1]  Nima Hatami,et al.  Classification of time-series images using deep convolutional neural networks , 2017, International Conference on Machine Vision.

[2]  Andrew E. Kilding,et al.  Reliability and Validity of the Zephyr™ BioHarness™ to Measure Respiratory Responses to Exercise , 2011 .

[3]  Suvrit Sra,et al.  Fast Newton-type Methods for Total Variation Regularization , 2011, ICML.

[4]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[5]  D. Wakefield,et al.  Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients , 1993, Journal of General Internal Medicine.

[6]  H. Ghezzo,et al.  Orthopnea and tidal expiratory flow limitation in patients with stable COPD. , 2001, Chest.

[7]  Suvrit Sra,et al.  Modular Proximal Optimization for Multidimensional Total-Variation Regularization , 2014, J. Mach. Learn. Res..

[8]  A. Johansson Neural network for photoplethysmographic respiratory rate monitoring , 2003, Medical and Biological Engineering and Computing.

[9]  U. Koehler,et al.  [Respiratory Rate - a Neglected Vital Sign]. , 2017, Deutsche medizinische Wochenschrift.

[10]  Daniel McDuff,et al.  Biowatch: Estimation of heart and breathing rates from wrist motions , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[11]  John W. Severinghaus,et al.  Effect of anemia on pulse oximeter accuracy at low saturation , 1990, Journal of Clinical Monitoring.

[12]  Christopher J Weir,et al.  Home monitoring of breathing rate in people with chronic obstructive pulmonary disease: observational study of feasibility, acceptability, and change after exacerbation , 2017, International journal of chronic obstructive pulmonary disease.

[13]  E. Hari Krishna,et al.  Robust Extraction of Respiratory Activity From PPG Signals Using Modified MSPCA , 2013, IEEE Transactions on Instrumentation and Measurement.

[14]  Jie Liu,et al.  LittleRock: Enabling Energy-Efficient Continuous Sensing on Mobile Phones , 2011, IEEE Pervasive Computing.

[15]  Guoliang Xing,et al.  MindfulWatch: A Smartwatch-Based System For Real-Time Respiration Monitoring During Meditation , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[16]  Sneha Kumar Kasera,et al.  Monitoring Breathing via Signal Strength in Wireless Networks , 2011, IEEE Transactions on Mobile Computing.

[17]  G. Dumont,et al.  Extracting Instantaneous Respiratory Rate From Multiple Photoplethysmogram Respiratory-Induced Variations , 2018, Front. Physiol..

[18]  Jichao Zhao and Haihong Tao Quaternion based joint DOA and polarization parameters estimation with stretched three-component electromagnetic vector sensor array , 2017 .

[19]  Marcin Korytkowski,et al.  Convolutional Neural Networks for Time Series Classification , 2017, ICAISC.

[20]  Zhen Wang,et al.  K2 , 2015, False Summit.

[21]  K. P. Hui,et al.  Factors influencing pulse oximetry as compared to functional arterial saturation in multi-ethnic Singapore. , 1993, Singapore medical journal.

[22]  J R Emery,et al.  Skin pigmentation as an influence on the accuracy of pulse oximetry. , 1987, Journal of perinatology : official journal of the California Perinatal Association.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Karl Swedberg,et al.  Six minute walk test. , 2005, European heart journal.

[25]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[26]  A. McGinley,et al.  A physiologically‐based early warning score for ward patients: the association between score and outcome * , 2005, Anaesthesia.

[27]  Eyal de Lara,et al.  Sidewinder: An Energy Efficient and Developer Friendly Heterogeneous Architecture for Continuous Mobile Sensing , 2016, ASPLOS.

[28]  Guohong Cao,et al.  SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[29]  Ki H. Chon,et al.  Estimation of Respiratory Rate From Photoplethysmogram Data Using Time–Frequency Spectral Estimation , 2009, IEEE Transactions on Biomedical Engineering.

[30]  Gerwyn Hughes,et al.  Bioharness(™) multivariable monitoring device: part. I: validity. , 2012, Journal of sports science & medicine.

[31]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[32]  Feng Qian,et al.  Characterizing Smartwatch Usage in the Wild , 2017, MobiSys.

[33]  T. Watson,et al.  Bioharness(™) Multivariable Monitoring Device: Part. II: Reliability. , 2012, Journal of sports science & medicine.