No-contact heart rate monitoring based on channel attention convolution model

No-contact heart rate monitoring like Fig.1 based on remote Photoplethysmography (rPPG) via common camera has drawn more and more attention because of its promising use in patient nursing, telemedicine, fitness, trial. Many traditional signal processing methods (FFT, ICA, PCA) have been proposed to solve this problem, but still subject to interference of motion and lighting conditions. In facial RGB images, the signal-to-noise ratio of green channel is higher than that of the other two channels, and the heart rate can be measured more accurately by assigning different weights to three channels. In this paper we propose a novel deep convolution neural network model based on channel-attention mechanism to extract the heart rate information from each frame of the video. To get more accurate result of the heart rate in the condition of face moving, light change and other interference factors, the model was trained on the newly introduced public challenge ECG-Fitness dataset and the model’s robustness was tested on this dataset. Testing results show that the model outperforms previous methods.

[1]  Toshihiro Kitajima,et al.  Heart rate estimation based on camera image , 2014, 2014 14th International Conference on Intelligent Systems Design and Applications.

[2]  Ashok Veeraraghavan,et al.  DistancePPG: Robust non-contact vital signs monitoring using a camera , 2015, Biomedical optics express.

[3]  Gee-Sern Hsu,et al.  Deep learning with time-frequency representation for pulse estimation from facial videos , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[4]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  T. Pursche,et al.  Video-based heart rate measurement from human faces , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[6]  Shiguang Shan,et al.  SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[7]  Jiri Matas,et al.  Visual Heart Rate Estimation with Convolutional Neural Network , 2018, BMVC.

[8]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Gerard de Haan,et al.  Robust Pulse Rate From Chrominance-Based rPPG , 2013, IEEE Transactions on Biomedical Engineering.

[10]  Jiaqi Liu,et al.  End-to-end Deep Learning from Raw Sensor Data: Atrial Fibrillation Detection using Wearables , 2018, ArXiv.

[11]  Jie Liu,et al.  Non-contact Heart Rate Monitoring by Combining Convolutional Neural Network Skin Detection and Remote Photoplethysmography via a Low-Cost Camera , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[13]  Daniel McDuff,et al.  DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks , 2018, ECCV.

[14]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[15]  Hamidur Rahman,et al.  Real Time Heart Rate Monitoring From Facial RGB Color Video Using Webcam , 2016, SAIS.

[16]  Yoshinori Kuno,et al.  Robust Heart Rate Measurement from Video Using Select Random Patches , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).