Illumination variation interference suppression in remote PPG using PLS and MEMD

A novel framework based on partial least squares (PLS) and multivariate empirical mode decomposition (MEMD) is proposed to effectively evaluate heart rate from webcam videos captured during illumination changing conditions. The framework takes the assumption that both facial region of interest (ROI) and background ROI have the similar illumination variations and the background ROI can be treated as the denoising reference by using PLS to extract the underlying common illumination variation sources existing in both ROIs. Then, a number of intrinsic mode functions are decomposed by applying MEMD to the illumination-variation-suppressed facial ROI and the HR is evaluated. Compared to the experimental results obtained by the recently proposed independent component analysis and the ensemble empirical mode decomposition methods, the proposed method led to a better agreement with HR ground truth (the mean bias was 3.4 bpm with 95% limits of agreement ranging from −13.2 to 19.9 bpm), indicating a promising solution for the realistic HR estimation remotely.

[1]  Philip H. S. Torr,et al.  Approximate structured output learning for Constrained Local Models with application to real-time facial feature detection and tracking on low-power devices , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[2]  Suh-Yin Lee,et al.  Image Sensor-Based Heart Rate Evaluation From Face Reflectance Using Hilbert–Huang Transform , 2015, IEEE Sensors Journal.

[3]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[4]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Cheolsoo Park,et al.  Classification of Motor Imagery BCI Using Multivariate Empirical Mode Decomposition , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Anthony Randal McIntosh,et al.  Partial Least Squares (PLS) methods for neuroimaging: A tutorial and review , 2011, NeuroImage.

[7]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[9]  Lai-Man Po,et al.  Motion-Resistant Remote Imaging Photoplethysmography Based on the Optical Properties of Skin , 2015, IEEE Transactions on Circuits and Systems for Video Technology.