HandRate: Heart Rate Monitoring While Simply Holding a Smartphone

We present HandRate, the first smartphone-based system using a standard sensor (accelerometer) for opportunistically computing heart rate while a user holds their phone. Fundamentally, HandRate revisits ballistocardiography (BCG), a century-old technique for monitoring heart activity by measuring the body movement caused by the cardiac cycle. Traditionally performed using custom hardware, attached to a subject’s body, revisiting BCG for the smartphone, held in hand, faces several challenges. The hand is an external organ furthest from the aorta and subject to motion artifacts, leading to a weak and noisy signal, while the position the phone is held in can impact which accelerometer axis best captures BCG. HandRate addresses these challenges by introducing a design involving two modules operating in tandem: the first aimed at transforming the accelerometer readings into a single-dimensional signal oblivious to how the phone is held, while the second module making heartbeat predictions based on this signal. Results from testing HandRate using data collected from 18 subjects show that it can estimate heart rate with accuracy similar to or better than systems requiring special sensors and/or active user participation.

[1]  S. A. Talbot,et al.  Proposals for Ballistocardiographic Nomenclature and Conventions: Revised and Extended Report of Committee on Ballistocardiographic Terminology , 1956, Circulation.

[2]  Gregory T. A. Kovacs,et al.  Ballistocardiography — A method worth revisiting , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Moustafa Youssef,et al.  Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[5]  Lan-Rong Dung,et al.  Measurement of heart rate variability using off-the-shelf smart phones , 2016, BioMedical Engineering OnLine.

[6]  Mikko Peltokangas,et al.  Is 50 Hz high enough ECG sampling frequency for accurate HRV analysis? , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Kwang Suk Park,et al.  Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Martin J Leahy,et al.  Cellular phone‐based photoplethysmographic imaging , 2011, Journal of biophotonics.

[9]  Sabin Tabirca,et al.  A General mHealth Design Pipeline , 2016, MoMM.

[10]  阿诺 Instant Heart Rate , 2013 .

[11]  Federico Guede Fernández,et al.  Real time heart rate variability assessment from Android smartphone camera photoplethysmography: Postural and device influences , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[13]  Miguel A. García-González,et al.  Heart rate variability analysis using a seismocardiogram signal , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  I. Starr,et al.  Studies with the ballistocardiograph in acute cardiac infarction and chronic angina pectoris , 1943 .

[15]  K. Banitsas,et al.  A novel method to detect Heart Beat Rate using a mobile phone , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  James A. J. Heathers,et al.  Smartphone-enabled pulse rate variability: an alternative methodology for the collection of heart rate variability in psychophysiological research. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Aniruddha Sinha,et al.  A robust heart rate detection using smart-phone video , 2013, MobileHealth '13.

[18]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[19]  Michael Marschollek,et al.  HeartBeat the Odds: A Novel Digital Ballistocardiographic Sensor System , 2017, SenSys.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Konstantin Tyapochkin,et al.  Smartphone PPG: signal processing, quality assessment, and impact on HRV parameters , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Martin Leahy,et al.  Investigating a smartphone imaging unit for photoplethysmography , 2010, Physiological measurement.

[23]  S. I. Askovitz,et al.  ITEMS OF PROGNOSTIC VALUE IN THE CLINICAL STUDY. THE RELATIONSHIP OF SYMPTOMS, HEART SIZE, BLOOD PRESSURE, ELECTROCARDIOGRAM, AND BALLISTOCARDIOGRAM TO AFTER-HISTORIES AND TO EACH OTHER. , 1965, JAMA.

[24]  Aniruddha Sinha,et al.  Improved heart rate detection using smart phone , 2014, SAC.

[25]  Charles Sodini,et al.  A wearable vital signs monitor at the ear for continuous heart rate and Pulse Transit Time measurements , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[27]  Mathew Gregoski,et al.  Photoplethysmograph (PPG) derived heart rate (HR) acquisition using an Android smart phone , 2011, Wireless Health.

[28]  H MANDELBAUM,et al.  Studies Utilizing the Portable Electromagnetic Ballistocardiograph: I. Abnormal HIJK Patterns in Hypertensive and Coronary Artery Heart Disease , 1951, Circulation.

[29]  Kouhyar Tavakolian,et al.  Ballistocardiography and Seismocardiography: A Review of Recent Advances , 2015, IEEE Journal of Biomedical and Health Informatics.

[30]  Jont B. Allen,et al.  Short term spectral analysis, synthesis, and modification by discrete Fourier transform , 1977 .

[31]  Youngki Lee,et al.  Sinabro: opportunistic and unobtrusive mobile electrocardiogram monitoring system , 2014, HotMobile.

[32]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[33]  J W Gordon,et al.  Certain Molar Movements of the Human Body produced by the Circulation of the Blood. , 1877, Journal of anatomy and physiology.

[34]  Ki H. Chon,et al.  Physiological Parameter Monitoring from Optical Recordings With a Mobile Phone , 2012, IEEE Transactions on Biomedical Engineering.

[35]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[36]  Esteban Pavan,et al.  Ultra-short-term heart rate variability analysis on accelerometric signals from mobile phone , 2017, 2017 E-Health and Bioengineering Conference (EHB).

[37]  O. Rioul,et al.  Wavelets and signal processing , 1991, IEEE Signal Processing Magazine.

[38]  Richard Kronland-Martinet,et al.  Reading and Understanding Continuous Wavelet Transforms , 1989 .

[39]  S. Eckstein Ethical principles for medical research involving human subjects. , 2001, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[40]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[41]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .