Estimation of Respiratory Rate From Photoplethysmographic Imaging Videos Compared to Pulse Oximetry

We present a study evaluating two respiratory rate estimation algorithms using videos obtained from placing a finger on the camera lens of a mobile phone. The two algorithms, based on Smart Fusion and empirical mode decomposition (EMD), consist of previously developed signal processing methods to detect features and extract respiratory induced variations in photoplethysmographic signals to estimate respiratory rate. With custom-built software on an Android phone, photoplethysmographic imaging videos were recorded from 19 healthy adults while breathing spontaneously at respiratory rates between 6 to 32 breaths/min. Signals from two pulse oximeters were simultaneously recorded to compare the algorithms' performance using mobile phone data and clinical data. Capnometry was recorded to obtain reference respiratory rates. Two hundred seventy-two recordings were analyzed. The Smart Fusion algorithm reported 39 recordings with insufficient respiratory information from the photoplethysmographic imaging data. Of the 232 remaining recordings, a root mean square error (RMSE) of 6 breaths/min was obtained. The RMSE for the pulse oximeter data was lower at 2.3 breaths/min. RMSE for the EMD method was higher throughout all data sources as, unlike the Smart Fusion, the EMD method did not screen for inconsistent results. The study showed that it is feasible to estimate respiratory rates by placing a finger on a mobile phone camera, but that it becomes increasingly challenging at respiratory rates greater than 20 breaths/min, independent of data source or algorithm tested.

[1]  A. Awad,et al.  The Use of Joint Time Frequency Analysis to Quantify the Effect of Ventilation on the Pulse Oximeter Waveform , 2006, Journal of Clinical Monitoring and Computing.

[2]  PhD David Clifton BEng,et al.  An Algorithm for the Detection of Individual Breaths from the Pulse Oximeter Waveform , 2005, Journal of Clinical Monitoring and Computing.

[3]  Walter Karlen,et al.  Design challenges for camera oximetry on a mobile phone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Susannah G. Fleming Lionel Tarassenko A Comparison of Signal Processing Techniques for the Extraction of Breathing Rate from the Photoplethysmogram , 2007 .

[5]  A. Johansson Neural network for photoplethysmographic respiratory rate monitoring , 2003, Medical and Biological Engineering and Computing.

[6]  José Antonio Fiz,et al.  Estimation of instantaneous frequency from empirical mode decomposition on respiratory sounds analysis , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Walter Karlen,et al.  Adaptive pulse segmentation and artifact detection in photoplethysmography for mobile applications , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[9]  Walter Karlen,et al.  Respiratory rate assessment from photoplethysmographic imaging , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[11]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[12]  Ping Yang,et al.  Artifact reduction based on Empirical Mode Decomposition (EMD) in photoplethysmography for pulse rate detection , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[13]  K. Nakajima,et al.  Monitoring of heart and respiratory rates by photoplethysmography using a digital filtering technique. , 1996, Medical engineering & physics.

[14]  J Thomson,et al.  Pocket book of hospital care for children: guidelines for the management of common illnesses with limited resources , 2006 .

[15]  D. Menicucci,et al.  Deriving the respiratory sinus arrhythmia from the heartbeat time series using empirical mode decomposition , 2003, q-bio/0310002.

[16]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[17]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[18]  Walter Karlen,et al.  Detection of the optimal region of interest for camera oximetry , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[20]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[21]  Gordon Plotkin,et al.  ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? Types and ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? , 2022 .

[22]  Walter Karlen,et al.  Multiparameter Respiratory Rate Estimation From the Photoplethysmogram , 2013, IEEE Transactions on Biomedical Engineering.

[23]  Walter Karlen,et al.  Empirical mode decomposition for respiratory and heart rate estimation from the photoplethysmogram , 2013, Computing in Cardiology 2013.

[24]  W. Karlen,et al.  Usability testing of a prototype Phone Oximeter with healthcare providers in high‐ and low‐medical resource environments * , 2012, Anaesthesia.

[25]  C. Julien The enigma of Mayer waves: Facts and models. , 2006, Cardiovascular research.

[26]  Walter Karlen,et al.  Recognition of correct finger placement for photoplethysmographic imaging , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Guy A. Dumont,et al.  CapnoBase: Signal database and tools to collect, share and annotate respiratory signals , 2010 .

[28]  Ki H. Chon,et al.  Estimation of Respiratory Rate From Photoplethysmogram Data Using Time–Frequency Spectral Estimation , 2009, IEEE Transactions on Biomedical Engineering.

[29]  W. Karlen,et al.  Estimating Respiratory and Heart Rates from the Correntropy Spectral Density of the Photoplethysmogram , 2014, PloS one.

[30]  J A ThomsonChavan,et al.  Pocket book of hospital care for children: guidelines for the management of common illnesses with limited resources , 2006 .

[31]  Timo Tigges,et al.  Camera-based system for contactless monitoring of respiration , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.