Human vital sign determination using tactile sensing and fuzzy triage system

Abstract The ability to quickly and accurately triage a person’s medical condition in an emergency situation or other critical scenarios could mean the difference between life and death. Endowing a robotic system with vision and tactile capabilities, similar to those of medical professionals, and thus enabling robots to assess a patient’s status in an emergency is a highly sought after characteristic in healthcare robotics. This paper presents a novel fuzzy triage system exploiting visual and tactile sensing, to equip a robot with the skills to accurately determine key vital signs in humans. There are three key signs of human health: respiratory rate, pulse rate (Beats Per Minute (BPM)) and capillary refill time. Using ground truth from a medical professional, the fuzzy triage system is trained and validated initially with informed synthetic data and then further evaluated using vital signs data collected from subjects in a pilot study. Results from this pilot study indicate that the fuzzy triage system is capable of classifying a patient’s health using the the novel approaches for collecting BPM, Respiratory Rate (RR) and Capillary Refill Time (CRT) which replicate, to some extent, the approaches used by medical professionals for measuring vital signs. Furthermore, the intelligent system proved capable of determining whether a pulse was regular or arrhythmic, whether respiratory rate was regular or irregular, and determining the subject’s capillary refill time. Such results imply that this system could ultimately be used, for example, in a home assistance robot for elderly or disabled persons, or as a first responder robot. Ultimately the aim would be that these methods could be utilised by robotic systems in emergency scenarios or disaster zones.

[1]  Werner Reichardt,et al.  Zur Theorie der lateralen Inhibition , 1962, Kybernetik.

[2]  Sandy Rolfe The importance of respiratory rate monitoring. , 2019, British journal of nursing.

[3]  Changick Kim,et al.  A robust real time system for remote heart rate measurement via camera , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[4]  T. Martin McGinnity,et al.  Towards pulse detection and rhythm analysis using a biomimetic fingertip , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[5]  A. L. Jacobson,et al.  Auto-threshold peak detection in physiological signals , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Andrea Ancillao,et al.  Accuracy of consumer-level and research-grade activity trackers in ambulatory settings in older adults , 2019, PloS one.

[7]  T. Martin McGinnity,et al.  Human Pulse and Respiratory Signal Analysis using a Robot Hand equipped with a Biomimetic Fingertip , 2019 .

[8]  T. Martin McGinnity,et al.  Measurement of Capillary Refill Time (CRT) in Healthy Subjects Using a Robotic Hand , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[10]  Adam Bohr,et al.  The rise of artificial intelligence in healthcare applications , 2020, Artificial Intelligence in Healthcare.

[11]  Ibrahim A. Hameed Using Gaussian membership functions for improving the reliability and robustness of students' evaluation systems , 2011, Expert Syst. Appl..

[12]  Stefan Feuerriegel,et al.  Improving heart rate variability measurements from consumer smartwatches with machine learning , 2019, UbiComp/ISWC Adjunct.

[13]  M. Azizi,et al.  Comparison of Mamdani-Type and Sugeno-Type Fuzzy Inference Systems for Fuzzy Real Time Scheduling , 2016 .

[14]  Anca L. Ralescu,et al.  Fuzzy classifier for classification of medical data , 2011, 2011 11th International Conference on Hybrid Intelligent Systems (HIS).

[15]  Aiguo Song,et al.  Design and realization of an array pulse detecting tactile sensor , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[16]  L. Schwamm,et al.  Digital triage: Novel strategies for population health management in response to the COVID-19 pandemic , 2020, Healthcare.

[17]  Phil Jevon,et al.  The ABCDE approach , 2019, Dental Nursing.

[18]  Tzuen-Hsi Huang,et al.  A 60-GHz CMOS direct-conversion Doppler radar RF sensor with clutter canceller for single-antenna noncontact human vital-signs detection , 2015, 2015 IEEE Radio Frequency Integrated Circuits Symposium (RFIC).

[19]  Robert Morton,et al.  How to use capillary refill time , 2013, Archives of Disease in Childhood: Education & Practice Edition.

[20]  R. Biswas,et al.  Effect of different defuzzification methods in a fuzzy based load balancing application , 2011 .

[21]  Cheng Jinhui,et al.  Application of the wavelet transforms on axial strain calculation in ultrasound elastography , 2006 .

[22]  S. Muthukrishnan,et al.  AGFS: Adaptive Genetic Fuzzy System for medical data classification , 2014, Appl. Soft Comput..

[23]  Takenori Obo,et al.  Vital Sign Detection System during Bathing using Ultrasensitive Vibration Sensor , 2017 .

[24]  S. Pal,et al.  Fuzzy Logic and Approximate Reasoning: An Overview , 1991 .

[25]  Aly A. Farag,et al.  A Fully Automatic Method to Extract the Heart Rate from Thermal Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[26]  Fumihiko Nakazawa,et al.  A multipoint thin film polymer pressure/force sensor to visualize traditional medicine palpations , 2014, IEEE SENSORS 2014 Proceedings.

[27]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[28]  N. Cook,et al.  Essentials of Anatomy and Physiology for Nursing Practice , 2016 .

[29]  Jerry Lopez,et al.  Accurate and continuous non-contact vital signs monitoring using phased array antennas in a clutter-free anechoic chamber , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Debashis Ghosh,et al.  Concurrent multi-band RF system for search and rescue of human life during natural calamities , 2013, IEEE MTT-S International Microwave and RF Conference.

[31]  J.C. Lin Noninvasive microwave measurement of respiration , 1975, Proceedings of the IEEE.

[32]  Hooman Aghaebrahimi Samani,et al.  Robotic Automated External Defibrillator Ambulance for Emergency Medical Service in Smart Cities , 2016, IEEE Access.

[33]  Huey-Ru Chuang,et al.  A Fully Integrated 60-GHz CMOS Direct-Conversion Doppler Radar RF Sensor With Clutter Canceller for Single-Antenna Noncontact Human Vital-Signs Detection , 2016, IEEE Transactions on Microwave Theory and Techniques.

[34]  Jean-Michel Poggi,et al.  Wavelets and their applications , 2007 .

[35]  E. H. Mamdani,et al.  Application of Fuzzy Logic to Approximate Reasoning Using Linguistic Synthesis , 1976, IEEE Transactions on Computers.

[36]  Fang Yang,et al.  Contact-Free Monitoring of Human Vital Signs via a Microwave Sensor , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.

[37]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[38]  H. Tam,et al.  A review of triage accuracy and future direction , 2018, BMC Emergency Medicine.

[39]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Aly E. Fathy,et al.  Non-invasive detection of cardiac and respiratory rates from stepped frequency continuous wave radar measurements using the state space method , 2015, 2015 IEEE MTT-S International Microwave Symposium.

[41]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[42]  H. Emrah Tasli,et al.  Remote PPG based vital sign measurement using adaptive facial regions , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[43]  W. Kibbe,et al.  Investigating sources of inaccuracy in wearable optical heart rate sensors , 2020, npj Digital Medicine.

[44]  Lucy E. Dunne,et al.  Analysis of a coverstitched stretch sensor for monitoring of breathing , 2016, 2016 10th International Conference on Sensing Technology (ICST).

[45]  Changzhan Gu,et al.  From Tumor Targeting to Speech Monitoring: Accurate Respiratory Monitoring Using Medical Continuous-Wave Radar Sensors , 2014, IEEE Microwave Magazine.

[46]  K. B. Gan,et al.  Development of automated triage system for emergency medical service , 2016, 2016 International Conference on Advances in Electrical, Electronic and Systems Engineering (ICAEES).

[47]  Witold Pedrycz,et al.  Presenting the special issue on Rough-neuro computing : Preface , 2001, Neurocomputing.

[48]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[49]  Blaine Reeder,et al.  Health at hand: A systematic review of smart watch uses for health and wellness , 2016, J. Biomed. Informatics.

[50]  Saeid Nahavandi,et al.  Medical data classification using interval type-2 fuzzy logic system and wavelets , 2015, Appl. Soft Comput..

[51]  Hirofumi Tanaka,et al.  Influence of skin type and wavelength on light wave reflectance , 2013, Journal of Clinical Monitoring and Computing.

[52]  Jason J. Saleem,et al.  Wearable Heart Rate Monitor Technology Accuracy in Research: A Comparative Study Between PPG and ECG Technology , 2017 .

[53]  D. Donlagic,et al.  Overnight heartbeat monitoring by using unobtrusive optical interferometric measurements , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[54]  Robin R. Murphy,et al.  Interacting with trapped victims using robots , 2013, 2013 IEEE International Conference on Technologies for Homeland Security (HST).

[55]  Fu-Wei Lee,et al.  Tunneling piezoresistive tactile sensing array for continuous blood pressure monitoring , 2016, 2016 IEEE 29th International Conference on Micro Electro Mechanical Systems (MEMS).