Machine Learning in Rehabilitation Assessment for Thermal and Heart Rate Data Processing

Multimodal signal analysis based on sophisticated noninvasive sensors, efficient communication systems, and machine learning, have a rapidly increasing range of different applications. The present paper is devoted to pattern recognition and the analysis of physiological data acquired by heart rate and thermal camera sensors during rehabilitation. A total number of 56 experimental data sets, each 40 min long, of the heart rate and breathing temperature recorded on an exercise bike have been processed to determine the fitness level and possible medical disorders. The proposed general methodology combines machine learning methods for the detection of the changing temperature ranges of the thermal camera and adaptive image processing methods to evaluate the frequency of breathing. To determine the individual temperature values, a neural network model with the sigmoidal and the probabilistic transfer function in the first and the second layers are applied. Appropriate statistical methods are then used to find the correspondence between the exercise activity and selected physiological functions. The evaluated mean delay of 21 s of the heart rate drop related to the change of the activity level corresponds to results obtained in real cycling conditions. Further results include the average value of the change of the breathing temperature (167 s) and breathing frequency (49 s).

[1]  Gwo-Jia Jong,et al.  Infrared Image Processing for a Physiological Information Telemetry System , 2015, Wirel. Pers. Commun..

[2]  Hong Yan,et al.  A Machine Learning Approach to Improve Contactless Heart Rate Monitoring Using a Webcam , 2014, IEEE Journal of Biomedical and Health Informatics.

[3]  Parul Parashar,et al.  Neural Networks in Machine Learning , 2014 .

[4]  Tomasz Kocejko,et al.  Estimation of respiration rate using an accelerometer and thermal camera in eGlasses , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).

[5]  Ales Procházka,et al.  Microsoft Kinect Visual and Depth Sensors for Breathing and Heart Rate Analysis , 2016, Sensors.

[6]  Saeid Sanei,et al.  Detection of Interictal Discharges With Convolutional Neural Networks Using Discrete Ordered Multichannel Intracranial EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Lorenzo Scalise,et al.  Non-contact Measurement of the Heart Rate by a Image Sensor , 2015 .

[8]  Pedro Antonio Gutiérrez,et al.  Sensitivity Versus Accuracy in Multiclass Problems Using Memetic Pareto Evolutionary Neural Networks , 2010, IEEE Transactions on Neural Networks.

[9]  Reza Saatchi,et al.  Thermal image processing for real-time non-contact respiration rate monitoring , 2017, IET Circuits Devices Syst..

[10]  Robert P. W. Duin,et al.  Approximating the multiclass ROC by pairwise analysis , 2007, Pattern Recognit. Lett..

[11]  Kala Venugopal,et al.  Centralized Heart Rate Monitoring and Automated Message Alert System using WBAN , 2013 .

[12]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[13]  Aleš Procházka,et al.  Cycling Segments Multimodal Analysis and Classification Using Neural Networks , 2017 .

[14]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jacek Ruminski,et al.  Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions , 2017 .

[16]  Kimio Oguchi,et al.  Basic study on non-contact measurement of human oral breathing by using far infra-red imaging , 2016, 2016 39th International Conference on Telecommunications and Signal Processing (TSP).

[17]  Tony R. Martinez,et al.  Classification-based objective functions , 2006, Machine Learning.

[18]  Benyamin Kusumoputro,et al.  Infrared Face Recognition System Using Cross Entropy Error Function Based Ensemble Backpropagation Neural Networks , 2016 .

[19]  Ales Procházka,et al.  Discrimination of axonal neuropathy using sensitivity and specificity statistical measures , 2014, Neural Computing and Applications.

[20]  David Castells-Rufas,et al.  Camera-based Digit Recognition System , 2006, 2006 13th IEEE International Conference on Electronics, Circuits and Systems.

[21]  Adrian Dinculescu,et al.  Combined thermal infrared and visual spectrum imaging novel methodology for astronauts' psychophysiological assessment. Verification for respiration rate determination , 2017, 2017 E-Health and Bioengineering Conference (EHB).

[22]  Yi Lu Murphey,et al.  Multi-class pattern classification using neural networks , 2007, Pattern Recognit..

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Martin Schätz,et al.  Extraction of breathing features using MS Kinect for sleep stage detection , 2016, Signal Image Video Process..

[25]  Ales Procházka,et al.  Bayesian classification and analysis of gait disorders using image and depth sensors of Microsoft Kinect , 2015, Digit. Signal Process..

[26]  Ales Procházka,et al.  GPS-based analysis of physical activities using positioning and heart rate cycling data , 2017, Signal Image Video Process..

[27]  K. A. Loparo,et al.  Variability in Cadence During Forced Cycling Predicts Motor Improvement in Individuals With Parkinson's Disease , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Aurobinda Routray,et al.  Infrared imaging based hyperventilation monitoring through respiration rate estimation , 2016 .

[29]  Dharmendra Lal Gupta,et al.  Deep Machine Learning and Neural Networks: An Overview , 2016 .

[30]  Yusuf Sinan Akgul,et al.  A Computerized Recognition System for the Home-Based Physiotherapy Exercises Using an RGBD Camera , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Jonathan E. Fieldsend,et al.  Multi-class ROC analysis from a multi-objective optimisation perspective , 2006, Pattern Recognit. Lett..

[32]  Ales Procházka,et al.  Remote physiological and GPS data processing in evaluation of physical activities , 2013, Medical & Biological Engineering & Computing.

[33]  Jacek Ruminski,et al.  Analysis of the parameters of respiration patterns extracted from thermal image sequences , 2016, Biocybernetics and Biomedical Engineering.

[34]  François Michaud,et al.  Contact-Free Respiration Rate Monitoring Using a Pan–Tilt Thermal Camera for Stationary Bike Telerehabilitation Sessions , 2016, IEEE Systems Journal.

[35]  Lorenzo Scalise,et al.  Non contact measurement of heart and respiration rates based on Kinect™ , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[36]  W. Karlen,et al.  Estimating Respiratory and Heart Rates from the Correntropy Spectral Density of the Photoplethysmogram , 2014, PloS one.

[37]  Steffen Leonhardt,et al.  Estimation of breathing rate in thermal imaging videos: a pilot study on healthy human subjects , 2017, Journal of Clinical Monitoring and Computing.

[38]  Duo Li,et al.  Synergetic use of thermal and visible imaging techniques for contactless and unobtrusive breathing measurement , 2017, Journal of biomedical optics.

[39]  Ales Procházka,et al.  Breathing Analysis Using Thermal and Depth Imaging Camera Video Records , 2017, Sensors.

[40]  Adriana Mexicano,et al.  Feature extraction of electrocardiogram signals by applying adaptive threshold and principal component analysis , 2015 .