Respiratory Rate Estimation from Face Videos

Vital signs, such as heart rate (HR), heart rate variability (HRV), respiratory rate (RR), are important indicators for a person's health. Vital signs are traditionally measured with contact sensors, and may be inconvenient and cause discomfort during continuous monitoring. Commercial cameras are promising contact-free sensors, and remote photoplethysmography (rPPG) have been studied to remotely monitor heart rate from face videos. For remote RR measurement, most prior art was based on small periodical motions of chest regions caused by breathing cycles, which are vulnerable to subjects' voluntary movements. This paper explores remote RR measurement based on rPPG obtained from face videos. The paper employs motion compensation, two-phase temporal filtering, and signal pruning to capture signals with high quality. The experimental results demonstrate that the proposed framework can obtain accurate RR results and can provide HR, HRV and RR measurement synergistically in one framework.

[1]  Nicu Sebe,et al.  Self-Adaptive Matrix Completion for Heart Rate Estimation from Face Videos under Realistic Conditions , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  T. Komatsu,et al.  [Analysis of heart rate variability]. , 2009, Masui. The Japanese journal of anesthesiology.

[3]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  A. Cheng,et al.  Respiratory rate: the neglected vital sign , 2008, The Medical journal of Australia.

[5]  N. Lomb.  Least-squares frequency analysis of unequally spaced data , 1976 .

[6]  Walter Karlen,et al.  Multiparameter Respiratory Rate Estimation From the Photoplethysmogram , 2013, IEEE Transactions on Biomedical Engineering.

[7]  Sander Stuijk,et al.  Algorithmic Principles of Remote PPG , 2017, IEEE Transactions on Biomedical Engineering.

[8]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[9]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[11]  Kjersti Engan,et al.  Motion based detection of respiration rate in infants using video , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[12]  Xiaoou Tang,et al.  Learning Deep Representation for Face Alignment with Auxiliary Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Min Wu,et al.  Fitness heart rate measurement using face videos , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[14]  Steffen Leonhardt,et al.  Remote monitoring of breathing dynamics using infrared thermography. , 2015, Biomedical optics express.

[15]  B. Sayers,et al.  Analysis of heart rate variability. , 1973, Ergonomics.

[16]  Yoshinori Kuno,et al.  Robust Heart Rate Measurement from Video Using Select Random Patches , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  J. Scargle.  Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .

[18]  Parth H. Pathak,et al.  Vital Sign and Sleep Monitoring Using Millimeter Wave , 2017, ACM Trans. Sens. Networks.

[19]  S. Longhi,et al.  Respiratory rate detection algorithm based on RGB-D camera: theoretical background and experimental results. , 2014, Healthcare technology letters.

[20]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[21]  Kirk H. Shelley,et al.  Estimation of Respiratory Rate From ECG, Photoplethysmogram, and Piezoelectric Pulse Transducer Signals: A Comparative Study of Time–Frequency Methods , 2010, IEEE Transactions on Biomedical Engineering.

[22]  Min Wu,et al.  Adaptive Multi-Trace Carving Based on Dynamic Programming , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.