A first step towards on-device monitoring of body sounds in the wild

Body sounds provide rich information about the state of the human body and can be useful in many medical applications. Auscultation, the practice of listening to body sounds, has been used for centuries in respiratory and cardiac medicine to diagnose or track disease progression. To date, however, its use has been confined to clinical and highly controlled settings. Our work addresses this limitation: we devise a chest-mounted wearable for continuous monitoring of body sounds, that leverages data processing algorithms that run on-device. We concentrate on the detection of heart sounds to perform heart rate monitoring. To improve robustness to ambient noise and motion artefacts, our device uses an algorithm that explicitly segments the collected audio into the phases of the cardiac cycle. Our study with 9 users demonstrates that it is possible to obtain heart rate estimates that are competitive with commercial devices, with low enough power consumption for continuous use.

[1]  Mi Zhang,et al.  BodyBeat: a mobile system for sensing non-speech body sounds , 2014, MobiSys.

[2]  Eric C. Larson,et al.  Accurate and privacy preserving cough sensing using a low-cost microphone , 2011, UbiComp '11.

[3]  Kwang Suk Park,et al.  Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Hoda Javadikasgari,et al.  Variable Accuracy of Wearable Heart Rate Monitors during Aerobic Exercise , 2017, Medicine and science in sports and exercise.

[5]  Mike Atkinson,et al.  Heart Rate Variability: Impact of Differences in Outlier Identification and Management Strategies on Common Measures in Three Clinical Populations , 2007, Pediatric Research.

[6]  Lionel Tarassenko,et al.  Robust heart rate estimation from noisy phonocardiograms , 2014, Computing in Cardiology 2014.

[7]  Pubudu N. Pathirana,et al.  Smartwatch: Performance evaluation for long-term heart rate monitoring , 2015, 2015 International Symposium on Bioelectronics and Bioinformatics (ISBB).

[8]  Daniel McDuff,et al.  Biowatch: Estimation of heart and breathing rates from wrist motions , 2015, 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth).

[9]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[10]  Maria Romano,et al.  Monitoring of respiration, seismocardiogram and heart sounds by a PVDF piezo film sensor , 2014 .

[11]  Lionel Tarassenko,et al.  Logistic Regression-HSMM-Based Heart Sound Segmentation , 2016, IEEE Transactions on Biomedical Engineering.

[12]  Takuya Maekawa,et al.  Evaluating tooth brushing performance with smartphone sound data , 2015, UbiComp.

[13]  Ping Wang,et al.  Phonocardiographic Signal Analysis Method Using a Modified Hidden Markov Model , 2007, Annals of Biomedical Engineering.

[14]  Rob Miller,et al.  Smart Homes that Monitor Breathing and Heart Rate , 2015, CHI.

[15]  Wenyao Xu,et al.  PDVocal: Towards Privacy-preserving Parkinson's Disease Detection using Non-speech Body Sounds , 2019, MobiCom.

[16]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[17]  M. Tavel,et al.  Cardiac Auscultation: A Glorious Past—And It Does Have a Future! , 2006, Circulation.

[18]  Kumar Sricharan,et al.  Recognizing Abnormal Heart Sounds Using Deep Learning , 2017, KHD@IJCAI.

[19]  Sama Goliaei,et al.  A Wearable Device for Continuous Cardiorespiratory System Monitoring , 2016, 2016 IEEE 41st Conference on Local Computer Networks Workshops (LCN Workshops).

[20]  C. Boer,et al.  Short‐term heart rate variability in healthy adults , 2013, Anaesthesia.