Incorporating Artificial Intelligence into Medical Cyber Physical Systems: A Survey

Medical Cyber Physical Systems (MCPSs) prescribe a platform in which patient health information is acquired by the emerging Internet of Things (IoT) sensors, pre-processed locally, and processed via advanced machine intelligence algorithms in the cloud. The emergence of MCPSs holds the promise to revolutionize remote patient healthcare monitoring, accelerate the development of new drugs or treatments, and improve the quality-of-life for patients who are suffering from various medical conditions among other various applications. The amount of raw medical data gathered through the IoT sensors in an MCPS provides a rich platform that artificial intelligence algorithms can use to provide decision support for either medical experts or patients. In this paper, we provide an overview of MCPSs and the data flow through these systems. This includes how raw physiological signals are converted into features and are used by machine intelligence algorithms, the types of algorithms available for the healthcare domain, how the data and the decision support output are presented to the end user, and how all of these steps are completed in a secure fashion to preserve the privacy of the users.

[1]  Urbashi Mitra,et al.  Multimodal Physical Activity Recognition by Fusing Temporal and Cepstral Information , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  C. Rudin,et al.  Clinical Prediction Models for Sleep Apnea: The Importance of Medical History over Symptoms. , 2016, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[3]  Suchi Saria,et al.  A Framework for Individualizing Predictions of Disease Trajectories by Exploiting Multi-Resolution Structure , 2015, NIPS.

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  R. Kalman,et al.  New results in linear prediction and filtering theory Trans. AMSE , 1961 .

[6]  Kim-Kwang Raymond Choo,et al.  Medical Cyber-Physical Systems Development: A Forensics-Driven Approach , 2017, 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[7]  Burak Kantarci,et al.  Visualization of Health Monitoring Data Acquired from Distributed Sensors for Multiple Patients , 2014, GLOBECOM 2014.

[8]  Haim Levkowitz,et al.  The role of visualization in tele-rehabilitation: A case study , 2017, 2017 7th International Conference on Cloud Computing, Data Science & Engineering - Confluence.

[9]  Alexandra Hoffmann,et al.  Effective Visualization of Long Term Health Data to Support Behavior Change , 2017, HCI.

[10]  Frank Bentley,et al.  Mobile Health Mashups: Making sense of multiple streams of wellbeing and contextual data for presentation on a mobile device , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[11]  Yixin Chen,et al.  ECGLens: Interactive Visual Exploration of Large Scale ECG Data for Arrhythmia Detection , 2018, CHI.

[12]  Hlaing Minn,et al.  Apnea MedAssist: Real-time Sleep Apnea Monitor Using Single-Lead ECG , 2011, IEEE Transactions on Information Technology in Biomedicine.

[13]  Sungho Jo,et al.  Hybrid-BCI smart glasses for controlling electrical devices , 2015, 2015 54th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[14]  Qiang Chen,et al.  A Health-IoT Platform Based on the Integration of Intelligent Packaging, Unobtrusive Bio-Sensor, and Intelligent Medicine Box , 2014, IEEE Transactions on Industrial Informatics.

[15]  R. Altman,et al.  Detecting Drug Interactions From Adverse‐Event Reports: Interaction Between Paroxetine and Pravastatin Increases Blood Glucose Levels , 2011, Clinical pharmacology and therapeutics.

[16]  Liang-Bi Chen,et al.  An IoT-based elderly behavioral difference warning system , 2018, 2018 IEEE International Conference on Applied System Invention (ICASI).

[17]  Insu Song,et al.  Content-based classification of breath sound with enhanced features , 2014, Neurocomputing.

[18]  Danyang Yuan,et al.  Genetic algorithm for the optimization of features and neural networks in ECG signals classification , 2017, Scientific Reports.

[19]  Yuri Gordienko,et al.  Deep Learning for Fatigue Estimation on the Basis of Multimodal Human-Machine Interactions , 2017, ArXiv.

[20]  Vishal Monga,et al.  Automated discrimination of lower and higher grade gliomas based on histopathological image analysis , 2015, Journal of pathology informatics.

[21]  Abdennour El Rhalibi,et al.  A study into data analysis and visualisation to increase the cyber-resilience of healthcare infrastructures , 2017, IML.

[22]  Burak Kantarci,et al.  Internet-of-everything oriented implementation of secure Digital Health (D-Health) systems , 2016, 2016 IEEE Symposium on Computers and Communication (ISCC).

[23]  Robert P. Sheridan,et al.  Deep Neural Nets as a Method for Quantitative Structure-Activity Relationships , 2015, J. Chem. Inf. Model..

[24]  Hlaing Minn,et al.  Real-Time Sleep Apnea Detection by Classifier Combination , 2012, IEEE Transactions on Information Technology in Biomedicine.

[25]  Samuel Kaski,et al.  Improving genomics-based predictions for precision medicine through active elicitation of expert knowledge , 2017, Bioinform..

[26]  Zied Lachiri,et al.  Audio sounds classification using scattering features and support vectors machines for medical surveillance , 2018 .

[27]  Shahram Ebadollahi,et al.  Toward personalized care management of patients at risk: the diabetes case study , 2011, KDD.

[28]  Long Cheng,et al.  On Threat Modeling and Mitigation of Medical Cyber-Physical Systems , 2017, 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[29]  Moeness Amin,et al.  Fall Detection Using Deep Learning in Range-Doppler Radars , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[30]  Xinlei Chen,et al.  Large-Scale Mobile Fitness App Usage Analysis for Smart Health , 2018, IEEE Communications Magazine.

[31]  Mehmet K. Aktas,et al.  Emerging Security Mechanisms for Medical Cyber Physical Systems , 2016, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[32]  Mohamed Jmaiel,et al.  IoT-based health monitoring via LoRaWAN , 2017, IEEE EUROCON 2017 -17th International Conference on Smart Technologies.

[33]  Deniz Erdoğmuş,et al.  Computer-Based Image Analysis for Plus Disease Diagnosis in Retinopathy of Prematurity: Performance of the "i-ROP" System and Image Features Associated With Expert Diagnosis. , 2015, Translational vision science & technology.

[34]  David Arney,et al.  OpenICE: An open, interoperable platform for medical cyber-physical systems , 2014, 2014 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

[35]  Nitesh V. Chawla,et al.  Automated epileptic seizure detection using improved correlation-based feature selection with random forest classifier , 2017, Neurocomputing.

[36]  Jodi Forlizzi,et al.  A spark of activity: exploring informative art as visualization for physical activity , 2012, UbiComp.

[37]  Hao Chen,et al.  DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Xin Liu,et al.  Passive-ZigBee: Enabling ZigBee Communication in IoT Networks with 1000X+ Less Power Consumption , 2018, SenSys.

[39]  Denise R. Aberle,et al.  TimeLine: Visualizing Integrated Patient Records , 2007, IEEE Transactions on Information Technology in Biomedicine.

[40]  Yu-Liang Hsu,et al.  Predictive Models for Evaluating Cognitive Ability in Dementia Diagnosis Applications Based on Inertia- and Gait-Related Parameters , 2018, IEEE Sensors Journal.

[41]  Ghassem Mokhtari,et al.  BLUESOUND: A New Resident Identification Sensor—Using Ultrasound Array and BLE Technology for Smart Home Platform , 2017, IEEE Sensors Journal.

[42]  A. Taddei,et al.  Long-term ST database: A reference for the development and evaluation of automated ischaemia detectors and for the study of the dynamics of myocardial ischaemia , 2003, Medical and Biological Engineering and Computing.

[43]  Igor Bisio,et al.  A smartphone‐centric platform for remote health monitoring of heart failure , 2015, Int. J. Commun. Syst..

[44]  Burak Kantarci,et al.  SUPPORT SYSTEMS FOR HEALTH MONITORING USING INTERNET-OF-THINGS DRIVEN DATA ACQUISITION , 2016 .

[45]  Urbashi Mitra,et al.  Energy-Efficient, Heterogeneous Sensor Selection for Physical Activity Detection in Wireless Body Area Networks , 2013, IEEE Transactions on Signal Processing.

[46]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[47]  V. Srinivasan,et al.  Artificial Neural Network Based Epileptic Detection Using Time-Domain and Frequency-Domain Features , 2005, Journal of Medical Systems.

[48]  Miguel Angel Lopez-Gordo,et al.  Novel multiclass classification for home-based diagnosis of sleep apnea hypopnea syndrome , 2014, Expert Syst. Appl..

[49]  Urbashi Mitra,et al.  KNOWME: a case study in wireless body area sensor network design , 2012, IEEE Communications Magazine.

[50]  Honglak Lee,et al.  Deep learning for robust feature generation in audiovisual emotion recognition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[51]  Carolyn McGregor,et al.  PhysioEx: Visual Analysis of Physiological Event Streams , 2016, Comput. Graph. Forum.

[52]  Gonzalo Mateos,et al.  Health Monitoring and Management Using Internet-of-Things (IoT) Sensing with Cloud-Based Processing: Opportunities and Challenges , 2015, 2015 IEEE International Conference on Services Computing.

[53]  Tanzeem Choudhury,et al.  Towards Health Recommendation Systems: An Approach for Providing Automated Personalized Health Feedback from Mobile Data , 2017, Mobile Health - Sensors, Analytic Methods, and Applications.

[54]  Jiebo Luo,et al.  Tackling Mental Health by Integrating Unobtrusive Multimodal Sensing , 2015, AAAI.

[55]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[56]  Vinod Chandran,et al.  Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors , 2018, Expert Syst. Appl..

[57]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[58]  Ronald M. Summers,et al.  Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[60]  Song Han,et al.  Building wireless embedded internet for industrial automation , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[61]  Dae SeokLee,et al.  Stress Events Detection of Driver by Wearable Glove System , 2017, IEEE Sensors Journal.

[62]  R G Mark,et al.  Robust heart rate estimation from multiple asynchronous noisy sources using signal quality indices and a Kalman filter , 2008, Physiological measurement.

[63]  Joseph Kee-Yin Ng,et al.  Bayesian Nominal Matrix Factorization for Mining Daily Activity Patterns , 2016, 2016 IEEE/WIC/ACM International Conference on Web Intelligence (WI).

[64]  Adam Pawlak,et al.  Selected design issues of the medical cyber-physical system for telemonitoring pregnancy at home , 2016, Microprocess. Microsystems.

[65]  Andres Ledesma,et al.  Health figures: an open source JavaScript library for health data visualization , 2016, BMC Medical Informatics and Decision Making.

[66]  Larissa Hjorth,et al.  EdiPulse: Investigating a Playful Approach to Self-monitoring through 3D Printed Chocolate Treats , 2017, CHI.

[67]  Ran Gilad-Bachrach,et al.  PopTherapy: coping with stress through pop-culture , 2014, PervasiveHealth.

[68]  Alex A. T. Bui,et al.  Medical Data Visualization: Toward Integrated Clinical Workstations , 2010 .

[69]  Rosalind W. Picard,et al.  Objective assessment of depressive symptoms with machine learning and wearable sensors data , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[70]  Patrick Olivier,et al.  People, sensors, decisions: Customizable and adaptive technologies for assistance in healthcare , 2012, TIIS.

[71]  Jakob Eg Larsen,et al.  Four Data Visualization Heuristics to Facilitate Reflection in Personal Informatics , 2014, HCI.

[72]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[73]  Charlene R. Weir,et al.  Evaluation of the effect of information integration in displays for ICU nurses on situation awareness and task completion time: A prospective randomized controlled study , 2013, Int. J. Medical Informatics.

[74]  Wojciech Zareba,et al.  "QT clock" to improve detection of QT prolongation in long QT syndrome patients. , 2016, Heart rhythm.

[75]  Kijoon Chae,et al.  Evolving neural network intrusion detection system for MCPS , 2018, 2017 19th International Conference on Advanced Communication Technology (ICACT).

[76]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[77]  Mingzhe Jiang,et al.  Exploiting smart e-Health gateways at the edge of healthcare Internet-of-Things: A fog computing approach , 2018, Future Gener. Comput. Syst..

[78]  Andreas Butz,et al.  Activity Sculptures: Exploring the Impact of Physical Visualizations on Running Activity , 2014, IEEE Trans. Vis. Comput. Graph..

[79]  Ignas G. Niemegeers,et al.  IEEE 802.11ah: Advantages in standards and further challenges for sub 1 GHz Wi-Fi , 2012, 2012 IEEE International Conference on Communications (ICC).

[80]  D. Estrin,et al.  Open mHealth Architecture: An Engine for Health Care Innovation , 2010, Science.

[81]  Alain Biem,et al.  Body sensor data processing using stream computing , 2010, MIR '10.

[82]  Daniel Sanchez-Morillo,et al.  Detecting COPD exacerbations early using daily telemonitoring of symptoms and k-means clustering: a pilot study , 2015, Medical & biological engineering & computing.

[83]  Benjamin M. Marlin,et al.  Unsupervised pattern discovery in electronic health care data using probabilistic clustering models , 2012, IHI '12.

[84]  Varun Chandola,et al.  Knowledge discovery from massive healthcare claims data , 2013, KDD.

[85]  Mehmet Aktas,et al.  An Open Source ECG Clock Generator for Visualization of Long-Term Cardiac Monitoring Data , 2015, IEEE Access.

[86]  Ming Yang,et al.  Sensorineural hearing loss detection via discrete wavelet transform and principal component analysis combined with generalized eigenvalue proximal support vector machine and Tikhonov regularization , 2018, Multimedia Tools and Applications.

[87]  Alexander Mertens,et al.  User-Driven Semantic Classification for the Analysis of Abstract Health and Visualization Tasks , 2017, HCI.

[88]  Burak Kantarci,et al.  Machine Learning in Cardiac Health Monitoring and Decision Support , 2016, Computer.

[89]  D. Chou.  Health IT and Patient Safety: Building Safer Systems for Better Care , 2012 .

[90]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[91]  Lui Sha,et al.  Supporting Emergency Medical Care Teams with an Integrated Status Display Providing Real-Time Access to Medical Best Practices, Workflow Tracking, and Patient Data , 2017, Journal of Medical Systems.