How Nonlinear-Type Time-Frequency Analysis Can Help in Sensing Instantaneous Heart Rate and Instantaneous Respiratory Rate from Photoplethysmography in a Reliable Way

Despite the population of the noninvasive, economic, comfortable, and easy-to-install photoplethysmography (PPG), it is still lacking a mathematically rigorous and stable algorithm which is able to simultaneously extract from a single-channel PPG signal the instantaneous heart rate (IHR) and the instantaneous respiratory rate (IRR). In this paper, a novel algorithm called deppG is provided to tackle this challenge. deppG is composed of two theoretically solid nonlinear-type time-frequency analyses techniques, the de-shape short time Fourier transform and the synchrosqueezing transform, which allows us to extract the instantaneous physiological information from the PPG signal in a reliable way. To test its performance, in addition to validating the algorithm by a simulated signal and discussing the meaning of “instantaneous,” the algorithm is applied to two publicly available batch databases, the Capnobase and the ICASSP 2015 signal processing cup. The former contains PPG signals relative to spontaneous or controlled breathing in static patients, and the latter is made up of PPG signals collected from subjects doing intense physical activities. The accuracies of the estimated IHR and IRR are compared with the ones obtained by other methods, and represent the state-of-the-art in this field of research. The results suggest the potential of deppG to extract instantaneous physiological information from a signal acquired from widely available wearable devices, even when a subject carries out intense physical activities.

[1]  Sylvain Meignen,et al.  Second-Order Synchrosqueezing Transform or Invertible Reassignment? Towards Ideal Time-Frequency Representations , 2015, IEEE Transactions on Signal Processing.

[2]  G. Giorgi,et al.  Efficient tracking of heart rate under physical exercise from photoplethysmographic signals , 2015, 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI).

[3]  Bin Liu,et al.  MICROST: A mixed approach for heart rate monitoring during intensive physical exercise using wrist-type PPG Signals , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Zhilin Zhang,et al.  Photoplethysmography-Based Heart Rate Monitoring Using Asymmetric Least Squares Spectrum Subtraction and Bayesian Decision Theory , 2015, IEEE Sensors Journal.

[5]  L. Sörnmo,et al.  Sampling rate and the estimation of ensemble variability for repetitive signals , 2006, Medical and Biological Engineering and Computing.

[6]  Md. Kamrul Hasan,et al.  A Robust Heart Rate Monitoring Scheme Using Photoplethysmographic Signals Corrupted by Intense Motion Artifacts , 2016, IEEE Transactions on Biomedical Engineering.

[7]  E. Hari Krishna,et al.  Robust Extraction of Respiratory Activity From PPG Signals Using Modified MSPCA , 2013, IEEE Transactions on Instrumentation and Measurement.

[8]  S Nakajimi,et al.  [New pulsed-type earpiece oximeter (author's transl)]. , 1975, Kokyu to junkan. Respiration & circulation.

[9]  P. Mannheimer,et al.  The Light–Tissue Interaction of Pulse Oximetry , 2007, Anesthesia and analgesia.

[10]  Jesús Lázaro,et al.  Cross Time-Frequency Analysis for Combining Information of Several Sources: Application to Estimation of Spontaneous Respiratory Rate from Photoplethysmography , 2013, Comput. Math. Methods Medicine.

[11]  Prasanta Kumar Ghosh,et al.  Multiple Spectral Peak Tracking for Heart Rate Monitoring from Photoplethysmography Signal During Intensive Physical Exercise , 2015, IEEE Signal Processing Letters.

[12]  Yong-Ping Zheng,et al.  Extraction of Respiratory Activity from Photoplethysmographic Signals Based on an Independent Component Analysis Technique: Preliminary Report , 2006 .

[13]  R.W. Schafer,et al.  From frequency to quefrency: a history of the cepstrum , 2004, IEEE Signal Processing Magazine.

[14]  Priyadip Ray,et al.  Heart rate estimation from photoplethysmogram during intensive physical exercise using non-parametric Bayesian factor analysis , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[15]  K. Nakajima,et al.  Monitoring of heart and respiratory rates by photoplethysmography using a digital filtering technique. , 1996, Medical engineering & physics.

[16]  I. Daubechies,et al.  Synchrosqueezed wavelet transforms: An empirical mode decomposition-like tool , 2011 .

[17]  Michael Muma,et al.  A new method for heart rate monitoring during physical exercise using photoplethysmographic signals , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[18]  L. Nilsson.  Respiration Signals from Photoplethysmography , 2013, Anesthesia and analgesia.

[19]  Andriy Temko,et al.  Estimation of heart rate from photoplethysmography during physical exercise using Wiener filtering and the phase vocoder , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Antonio Cicone,et al.  Hyperspectral chemical plume detection algorithms based on multidimensional iterative filtering decomposition , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[21]  Li Su,et al.  Extract Fetal ECG from Single-Lead Abdominal ECG by De-Shape Short Time Fourier Transform and Nonlocal Median , 2016, Front. Appl. Math. Stat..

[22]  David A. Clifton,et al.  Probabilistic Estimation of Respiratory Rate from Wearable Sensors , 2015 .

[23]  Guy Albert Dumont,et al.  Estimating instantaneous respiratory rate from the photoplethysmogram , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  H. Malberg,et al.  Automated identification of cardiac signals after blind source separation for camera-based photoplethysmography , 2015, 2015 IEEE 35th International Conference on Electronics and Nanotechnology (ELNANO).

[25]  Walter Karlen,et al.  Empirical mode decomposition for respiratory and heart rate estimation from the photoplethysmogram , 2013, Computing in Cardiology 2013.

[26]  Ki H. Chon,et al.  An Autoregressive Model-Based Particle Filtering Algorithms for Extraction of Respiratory Rates as High as 90 Breaths Per Minute From Pulse Oximeter , 2010, IEEE Transactions on Biomedical Engineering.

[27]  J. Michael.  Textbook of Medical Physiology , 2005 .

[28]  Quan Ding,et al.  Respiratory rate monitoring from the photoplethysmogram via sparse signal reconstruction , 2016, Physiological measurement.

[29]  Haomin Zhou,et al.  Multidimensional Iterative Filtering method for the decomposition of high-dimensional non-stationary signals , 2015, 1507.07173.

[30]  Zhilin Zhang,et al.  Photoplethysmography-Based Heart Rate Monitoring in Physical Activities via Joint Sparse Spectrum Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[31]  W. Karlen,et al.  Estimating Respiratory and Heart Rates from the Correntropy Spectral Density of the Photoplethysmogram , 2014, PloS one.

[32]  Sylvain Meignen,et al.  A New Algorithm for Multicomponent Signals Analysis Based on SynchroSqueezing: With an Application to Signal Sampling and Denoising , 2012, IEEE Transactions on Signal Processing.

[33]  Hans-Andrea Loeliger,et al.  Estimation of heart rate and heart rate variability from pulse oximeter recordings using localized model fitting , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  Yong-Seok Park,et al.  Beat-to-Beat Tracking of Systolic Blood Pressure Using Noninvasive Pulse Transit Time During Anesthesia Induction in Hypertensive Patients , 2013, Anesthesia and analgesia.

[35]  Hau-tieng Wu,et al.  Nonparametric and adaptive modeling of dynamic seasonality and trend with heteroscedastic and dependent errors , 2012, 1210.4672.

[36]  Roozbeh Jafari,et al.  Robust heart rate estimation using wrist-based PPG signals in the presence of intense physical activities , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[37]  Walter Karlen,et al.  Multiparameter Respiratory Rate Estimation From the Photoplethysmogram , 2013, IEEE Transactions on Biomedical Engineering.

[38]  Hau-Tieng Wu,et al.  Non‐parametric and adaptive modelling of dynamic periodicity and trend with heteroscedastic and dependent errors , 2014 .

[39]  Ki H. Chon,et al.  Estimation of Respiratory Rate From Photoplethysmogram Data Using Time–Frequency Spectral Estimation , 2009, IEEE Transactions on Biomedical Engineering.

[40]  Ingrid Daubechies,et al.  Optimizing Estimates of Instantaneous Heart Rate from Pulse Wave Signals with the Synchrosqueezing Transform , 2016, Methods of Information in Medicine.

[41]  A. Awad,et al.  The Use of Joint Time Frequency Analysis to Quantify the Effect of Ventilation on the Pulse Oximeter Waveform , 2006, Journal of Clinical Monitoring and Computing.

[42]  Melanie Swan,et al.  Sensor Mania! The Internet of Things, Wearable Computing, Objective Metrics, and the Quantified Self 2.0 , 2012, J. Sens. Actuator Networks.

[43]  Su Li,et al.  Wave-shape function analysis - when cepstrum meets time-frequency analysis , 2016, ArXiv.

[44]  Thomas Penzel,et al.  An Algorithm for Real-Time Pulse Waveform Segmentation and Artifact Detection in Photoplethysmograms , 2017, IEEE Journal of Biomedical and Health Informatics.

[45]  Mehrdad Nourani,et al.  A Motion-Tolerant Adaptive Algorithm for Wearable Photoplethysmographic Biosensors , 2014, IEEE Journal of Biomedical and Health Informatics.

[46]  Choonghee Lee,et al.  Automatic stress-relieving music recommendation system based on photoplethysmography-derived heart rate variability analysis , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  Zhilin Zhang,et al.  TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercise , 2014, IEEE Transactions on Biomedical Engineering.

[48]  Robert Richer,et al.  Unobtrusive heart rate estimation during physical exercise using photoplethysmographic and acceleration data , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[49]  Jesús Lázaro,et al.  Deriving respiration from photoplethysmographic pulse width , 2013, Medical & Biological Engineering & Computing.

[50]  Haomin Zhou,et al.  Adaptive Local Iterative Filtering for Signal Decomposition and Instantaneous Frequency analysis , 2014, 1411.6051.

[51]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[52]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[53]  J. Lee,et al.  Respiratory Rate Extraction Via an Autoregressive Model Using the Optimal Parameter Search Criterion , 2010, Annals of Biomedical Engineering.

[54]  Giuseppe Baselli,et al.  A review of methods for the signal quality assessment to improve reliability of heart rate and blood pressures derived parameters , 2016, Medical & Biological Engineering & Computing.

[55]  Vasu Jindal,et al.  Integrating Mobile and Cloud for PPG Signal Selection to Monitor Heart Rate during Intensive Physical Exercise , 2016, 2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft).

[56]  E. Gil,et al.  Estimation of spontaneous respiratory rate from photoplethysmography by cross time-frequency analysis , 2011, 2011 Computing in Cardiology.

[57]  Per Ask,et al.  Pulse wave transit time for monitoring respiration rate , 2006, Medical and Biological Engineering and Computing.

[58]  Jbam Johan Arends,et al.  Real-time extraction of the respiratory rate from photoplethysmographic signal using wearable devices , 2014 .

[59]  Markus Hülsbusch,et al.  Assessment of Human Hemodynamics under Hyper- and Microgravity: Results of two Aachen University Parabolic Flight Experiments , 2007 .

[60]  Daniel McDuff,et al.  COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera , 2016, CHI.

[61]  Zhilin Zhang,et al.  Combining ensemble empirical mode decomposition with spectrum subtraction technique for heart rate monitoring using wrist-type photoplethysmography , 2015, Biomed. Signal Process. Control..

[62]  Rodica Strungaru,et al.  Recording system and data fusion algorithm for enhancing the estimation of the respiratory rate from photoplethysmogram , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[63]  Gregory F. Lewis,et al.  The PhysioCam: Cardiac Pulse, Continuously Monitored by a Color Video Camera , 2016 .

[64]  Farrokh Marvasti,et al.  Heart Rate Tracking using Wrist-Type Photoplethysmographic (PPG) Signals during Physical Exercise with Simultaneous Accelerometry , 2015, IEEE Signal Processing Letters.

[65]  P. Laguna,et al.  Photoplethysmography pulse rate variability as a surrogate measurement of heart rate variability during non-stationary conditions , 2010, Physiological measurement.

[66]  A. Johansson.  Neural network for photoplethysmographic respiratory rate monitoring , 2003, Medical and Biological Engineering and Computing.

[67]  David A. Clifton,et al.  Bayesian fusion of algorithms for the robust estimation of respiratory rate from the photoplethysmogram , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[68]  Hau-tieng Wu,et al.  Instantaneous frequency and wave shape functions (I) , 2011, 1104.2365.