Improved peak detection technique for robust PPG-based heartrate monitoring system on smartphones

Heartrate monitoring can be very decisive in terms of detecting heart-related diseases in early stages. Given that smartphones are used almost ubiquitously by humans on a daily basis and that they are equipped with several sensors and a powerful CPU, they are the ideal tools to accomplish daily heartrate monitoring. Many studies have shown the possibility of monitoring the heartrate in a very accurate way by using smartphone camera and the photo-plethysmography technique. However, in real cases, when using a smartphone camera as the input sensor, the pulse signal usually contains noise caused by fingertip movements, pressure changes between the smartphone camera and the fingertip, or changes in ambient light intensity. Hence, many techniques have been proposed to filter and detect real peaks in the pulse signal and avoid noise peaks. Most of those state-of-the-art techniques rely on the assumption that real peaks are those having the maximum values in their respective cycles. In some cases, the assumption is not correct, which decreases the accuracy of peak detection. Hence, this paper proposes a novel method to detect a pulse signal’s real peaks. The proposed method first smoothens a pulse signal by using a second-order Butterworth band-pass filter over a wide frequency range. Then, it considers the local minima of the signal as peaks and builds an optimization tree based on statistical properties, such as uniformity of peak time locations, peak count within a period, and variance in times elapsed between adjacent peaks, to detect combinations of peaks that optimize the heartrate computation. Results from experiments conducted using synthetic and real signals show that the proposed method can detect a pulse signal’s real peaks with higher precision as compared to conventional methods, and is very robust to signal noises. The proposed method has a significant heartrate estimation accuracy in various real scenarios and across smartphone models; its error rate is as low as 0.8588±0.0653 beats per minute, even in cases of signals with extensive noise.

[1]  Hanhoon Park,et al.  A highly efficient and reliable heart rate monitoring system using smartphone cameras , 2017, Multimedia Tools and Applications.

[2]  Ko Keun Kim,et al.  A Smart Health Monitoring Chair for Nonintrusive Measurement of Biological Signals , 2012, IEEE Transactions on Information Technology in Biomedicine.

[3]  K. Banitsas,et al.  A novel method to detect Heart Beat Rate using a mobile phone , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[4]  D. Cavouras,et al.  A Simple algorithm to monitor HR for real time treatment applications , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[5]  Enzo Pasquale Scilingo,et al.  A Multimodal Transducer for Cardiopulmonary Activity Monitoring in Emergency , 2010, IEEE Transactions on Information Technology in Biomedicine.

[6]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[7]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Martin Leahy,et al.  Investigating a smartphone imaging unit for photoplethysmography , 2010, Physiological measurement.

[9]  Katrien Verbert,et al.  Recommender Systems for Health Informatics: State-of-the-Art and Future Perspectives , 2016, Machine Learning for Health Informatics.

[10]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[11]  A. Muaremi,et al.  Towards Measuring Stress with Smartphones and Wearable Devices During Workday and Sleep , 2013, BioNanoScience.

[12]  J. N. Watson,et al.  An Algorithm for the Detection of Individual Breaths from the Pulse Oximeter Waveform , 2004, Journal of clinical monitoring and computing.

[13]  Liliana Ferreira,et al.  Using the smartphone camera to monitor heart rate and rhythm in heart failure patients , 2014, IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[14]  Carmen C. Y. Poon,et al.  Unobtrusive Sensing and Wearable Devices for Health Informatics , 2014, IEEE Transactions on Biomedical Engineering.

[15]  Daniel McDuff,et al.  A medical mirror for non-contact health monitoring , 2011, SIGGRAPH '11.

[16]  Steffen Leonhardt,et al.  The smart car seat: personalized monitoring of vital signs in automotive applications , 2011, Personal and Ubiquitous Computing.

[17]  Domenico Grimaldi,et al.  Photoplethysmography detection by smartphone's videocamera , 2011, Proceedings of the 6th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems.

[18]  Toshiyo Tamura,et al.  The Advantages of Wearable Green Reflected Photoplethysmography , 2011, Journal of Medical Systems.

[19]  Florian Michahelles,et al.  Less contact: heart-rate detection without even touching the user , 2004, Eighth International Symposium on Wearable Computers.

[20]  Ilya Paramonov,et al.  Improved algorithm for heart rate measurement using mobile phone camera , 2013, 2013 13th Conference of Open Innovations Association (FRUCT).

[21]  Lai-Man Po,et al.  Frame adaptive ROI for photoplethysmography signal extraction from fingertip video captured by smartphone , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[22]  Federico Guede Fernández,et al.  Real time heart rate variability assessment from Android smartphone camera photoplethysmography: Postural and device influences , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Kin-fai Wu,et al.  Contactless and Cuffless Monitoring of Blood Pressure on a Chair Using E-Textile Materials , 2006, 2006 3rd IEEE/EMBS International Summer School on Medical Devices and Biosensors.