Deep Learning on 1-D Biosignals: a Taxonomy-based Survey

Summary Objectives:  Deep learning models such as convolutional neural networks (CNNs) have been applied successfully to medical imaging, but biomedical signal analysis has yet to fully benefit from this novel approach. Our survey aims at (i) reviewing deep learning techniques for biosignal analysis in computer- aided diagnosis; and (ii) deriving a taxonomy for organizing the growing number of applications in the field. Methods:  A comprehensive literature research was performed using PubMed, Scopus, and ACM. Deep learning models were classified with respect to the (i) origin, (ii) dimension, and (iii) type of the biosignal as input to the deep learning model; (iv) the goal of the application; (v) the size and (vi) type of ground truth data; (vii) the type and (viii) schedule of learning the network; and (ix) the topology of the model. Results:  Between January 2010 and December 2017, a total 71 papers were published on the topic. The majority (n = 36) of papers are on electrocariography (ECG) signals. Most applications (n = 25) aim at detection of patterns, while only a few (n = 6) at predection of events. Out of 36 ECG-based works, many (n = 17) relate to multi-lead ECG. Other biosignals that have been identified in the survey are electromyography, phonocardiography, photoplethysmography, electrooculography, continuous glucose monitoring, acoustic respiratory signal, blood pressure, and electrodermal activity signal, while ballistocardiography or seismocardiography have yet to be analyzed using deep learning techniques. In supervised and unsupervised applications, CNNs and restricted Boltzmann machines are the most and least frequently used, (n = 34) and (n = 15), respectively. Conclusion:  Our key-code classification of relevant papers was used to cluster the approaches that have been published to date and demonstrated a large variability of research with respect to data, application, and network topology. Future research is expected to focus on the standardization of deep learning architectures and on the optimization of the network parameters to increase performance and robustness. Furthermore, application-driven approaches and updated training data from mobile recordings are needed.

[1]  Yoshua Bengio,et al.  Learning deep physiological models of affect , 2013, IEEE Computational Intelligence Magazine.

[2]  Kouhyar Tavakolian,et al.  Ballistocardiography and Seismocardiography: A Review of Recent Advances , 2015, IEEE Journal of Biomedical and Health Informatics.

[3]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[4]  Haibin Shen,et al.  Elimination of power line interference from ECG signals using recurrent neural networks , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  U. Rajendra Acharya,et al.  Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network , 2017, Inf. Sci..

[6]  T. Tamura,et al.  Formal Design Methods for Reliable Computer-Aided Diagnosis: A Review , 2012, IEEE Reviews in Biomedical Engineering.

[7]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[8]  Bin He,et al.  Localization of Origins of Premature Ventricular Contraction by Means of Convolutional Neural Network From 12-Lead ECG , 2018, IEEE Transactions on Biomedical Engineering.

[9]  Adrian D. C. Chan,et al.  Classifying measured electrocardiogram signal quality using deep belief networks , 2017, 2017 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[10]  Qiao Li,et al.  An open access database for the evaluation of heart sound algorithms , 2016, Physiological measurement.

[11]  James L. Coyle,et al.  Deep Belief Networks for Electroencephalography: A Review of Recent Contributions and Future Outlooks , 2017, IEEE Journal of Biomedical and Health Informatics.

[12]  M. Fieschi,et al.  Introduction to Clinical Informatics , 1996, Health Informatics Series.

[13]  Khashayar Khorasani,et al.  Deep Convolutional Neural Networks and Learning ECG Features for Screening Paroxysmal Atrial Fibrillation Patients , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Jianqing Li,et al.  Patient-Specific Deep Architectural Model for ECG Classification , 2017, Journal of healthcare engineering.

[15]  Henggui Zhang,et al.  Detecting atrial fibrillation by deep convolutional neural networks , 2018, Comput. Biol. Medicine.

[16]  C.-C. Jay Kuo,et al.  ECG-based biometrics using recurrent neural networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Xiaoping Chen,et al.  EOG-based drowsiness detection using convolutional neural networks , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[18]  Jun Dong,et al.  Classification of normal and abnormal ECG records using lead convolutional neural network and rule inference , 2016, Science China Information Sciences.

[19]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[20]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[21]  Feng Lin,et al.  A stacked contractive denoising auto-encoder for ECG signal denoising , 2016, Physiological measurement.

[22]  Yi Su,et al.  MEASUREMENT OF UPPER LIMB MUSCLE FATIGUE USING DEEP BELIEF NETWORKS , 2016 .

[23]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[24]  Fuqiang Chen,et al.  Automatic sleep stage classification based on sparse deep belief net and combination of multiple classifiers , 2016 .

[25]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[26]  Yixin Chen,et al.  Atrial fibrillation detection by multi-scale convolutional neural networks , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[27]  Jun Dong,et al.  Premature ventricular contraction detection combining deep neural networks and rules inference , 2017, Artif. Intell. Medicine.

[28]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[29]  Jinsul Kim,et al.  An Automated ECG Beat Classification System Using Convolutional Neural Networks , 2016, 2016 6th International Conference on IT Convergence and Security (ICITCS).

[30]  Ming Liu,et al.  ECG signal enhancement based on improved denoising auto-encoder , 2016, Eng. Appl. Artif. Intell..

[31]  Hung T. Nguyen,et al.  A CHF detection method based on deep learning with RR intervals , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Gabriel Jimenez-Moreno,et al.  Deep Neural Networks for the Recognition and Classification of Heart Murmurs Using Neuromorphic Auditory Sensors , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[33]  Hayong Shin,et al.  Classification of heart sound recordings using convolution neural network , 2016, 2016 Computing in Cardiology Conference (CinC).

[34]  Daeyoung Kim,et al.  Premature Ventricular Contraction Beat Detection with Deep Neural Networks , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[35]  Wang Weilian,et al.  Heart Sound Signals Based on CNN Classification Research , 2017, BIOINFORMATICS 2017.

[36]  Ralf Bousseljot,et al.  Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet , 2009 .

[37]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[38]  Joon-Hyuk Chang,et al.  Deep Belief Networks Ensemble for Blood Pressure Estimation , 2017, IEEE Access.

[39]  Hyeon-Min Shim,et al.  Multi-channel electromyography pattern classification using deep belief networks for enhanced user experience , 2015, Journal of Central South University.

[40]  Mohan S. Kankanhalli,et al.  A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface , 2017, Pattern Recognit. Lett..

[41]  Jin He,et al.  Real-Time Multilead Convolutional Neural Network for Myocardial Infarction Detection , 2018, IEEE Journal of Biomedical and Health Informatics.

[42]  Varun Bajaj,et al.  Classification of amyotrophic lateral sclerosis disease based on convolutional neural network and reinforcement sample learning algorithm , 2017, Health Information Science and Systems.

[43]  Hung T. Nguyen,et al.  Deep learning framework for detection of hypoglycemic episodes in children with type 1 diabetes , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[44]  Xiangqian Ding,et al.  A Novel Method for Classification of ECG Arrhythmias Using Deep Belief Networks , 2016, Int. J. Comput. Intell. Appl..

[45]  Rabab Kreidieh Ward,et al.  Semi-supervised Stacked Label Consistent Autoencoder for Reconstruction and Analysis of Biomedical Signals , 2017, IEEE Transactions on Biomedical Engineering.

[46]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[47]  C. Grimbergen,et al.  Investigation into the origin of the noise of surface electrodes , 2002, Medical and Biological Engineering and Computing.

[48]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[49]  H. Critchley,et al.  The influence of physiological signals on cognition , 2018, Current Opinion in Behavioral Sciences.

[50]  K. P. Soman,et al.  Instantaneous heart rate as a robust feature for sleep apnea severity detection using deep learning , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[51]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[52]  U. Rajendra Acharya,et al.  Automated detection of coronary artery disease using different durations of ECG segments with convolutional neural network , 2017, Knowl. Based Syst..

[53]  Amir-Masoud Eftekhari-Moghadam,et al.  Knowledge discovery in medicine: Current issue and future trend , 2014, Expert Syst. Appl..

[54]  Ram Bilas Pachori,et al.  Automatic classification of sleep stages based on the time-frequency image of EEG signals , 2013, Comput. Methods Programs Biomed..

[55]  Moncef Gabbouj,et al.  Personalized Monitoring and Advance Warning System for Cardiac Arrhythmias , 2017, Scientific Reports.

[56]  Christopher Schoelzel,et al.  Can electrocardiogram classification be applied to phonocardiogram data? — An analysis using recurrent neural networks , 2016, 2016 Computing in Cardiology Conference (CinC).

[57]  Adrian D. C. Chan,et al.  False Alarm Reduction in Atrial Fibrillation Detection Using Deep Belief Networks , 2018, IEEE Transactions on Instrumentation and Measurement.

[58]  Yitao Liu,et al.  Deep belief network based deterministic and probabilistic wind speed forecasting approach , 2016 .

[59]  Ying Sun,et al.  ECG Based Identification by Deep Learning , 2017, CCBR.

[60]  Joon-Hyuk Chang,et al.  Oscillometric Blood Pressure Estimation Based on Deep Learning , 2017, IEEE Transactions on Industrial Informatics.

[61]  Ali Işın,et al.  Cardiac arrhythmia detection using deep learning , 2017 .

[62]  Dingchang Zheng,et al.  Variation of the Korotkoff Stethoscope Sounds During Blood Pressure Measurement: Analysis Using a Convolutional Neural Network , 2017, IEEE Journal of Biomedical and Health Informatics.

[63]  Sangmin Lee,et al.  EMG Pattern Classification by Split and Merge Deep Belief Network , 2016, Symmetry.

[64]  Kumar Sricharan,et al.  Classifying heart sound recordings using deep convolutional neural networks and mel-frequency cepstral coefficients , 2016, 2016 Computing in Cardiology Conference (CinC).

[65]  Anirban Mukherjee,et al.  A deep learning approach to fetal-ECG signal reconstruction , 2016, 2016 Twenty Second National Conference on Communication (NCC).

[66]  Yan Liu,et al.  Normal / abnormal heart sound recordings classification using convolutional neural network , 2016, 2016 Computing in Cardiology Conference (CinC).

[67]  Rosaria Silipo,et al.  Artificial neural networks for automatic ECG analysis , 1998, IEEE Trans. Signal Process..

[68]  Enrique Romero,et al.  ECG assessment based on neural networks with pretraining , 2016, Appl. Soft Comput..

[69]  Morten Mørup,et al.  A deep learning approach to adherence detection for type 2 diabetics , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[70]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[71]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[72]  Yunsik Son,et al.  Hemodynamic Instability and Cardiovascular Events After Traumatic Brain Injury Predict Outcome After Artifact Removal With Deep Belief Network Analysis , 2017, Journal of neurosurgical anesthesiology.

[73]  Hugo Gamboa,et al.  Biosignals learning and synthesis using deep neural networks , 2017, BioMedical Engineering OnLine.

[74]  Geoffrey E. Hinton,et al.  Generating Text with Recurrent Neural Networks , 2011, ICML.

[75]  Li Deng,et al.  A tutorial survey of architectures, algorithms, and applications for deep learning , 2014, APSIPA Transactions on Signal and Information Processing.

[76]  M. Gabbouj,et al.  Personalized ECG Classification , 2014 .

[77]  U. Rajendra Acharya,et al.  A deep convolutional neural network model to classify heartbeats , 2017, Comput. Biol. Medicine.

[78]  Qiao Li,et al.  A deep learning approach to monitoring and detecting atrial fibrillation using wearable technology , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[79]  Jake Luo,et al.  Big Data Application in Biomedical Research and Health Care: A Literature Review , 2016, Biomedical informatics insights.

[80]  Jianhua Zhang,et al.  Physiological Feature Based Emotion Recognition via an Ensemble Deep Autoencoder with Parsimonious Structure , 2017 .

[81]  Clément Gosselin,et al.  Transfer learning for sEMG hand gestures recognition using convolutional neural networks , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[82]  John Allen.  Photoplethysmography and its application in clinical physiological measurement , 2007, Physiological measurement.

[83]  Zhong Yin,et al.  Recognition of emotions using multimodal physiological signals and an ensemble deep learning model , 2017, Comput. Methods Programs Biomed..

[84]  Eiji Oki,et al.  ECG Monitoring System Integrated With IR-UWB Radar Based on CNN , 2016, IEEE Access.

[85]  Joon-Hyuk Chang,et al.  Deep learning ensemble with asymptotic techniques for oscillometric blood pressure estimation , 2017, Comput. Methods Programs Biomed..

[86]  U. Rajendra Acharya,et al.  Application of deep convolutional neural network for automated detection of myocardial infarction using ECG signals , 2017, Inf. Sci..

[87]  Andreas Dominik,et al.  Using deep gated RNN with a convolutional front end for end-to-end classification of heart sound , 2016, 2016 Computing in Cardiology Conference (CinC).

[88]  Steffen Leonhardt,et al.  Unobtrusive Nocturnal Heartbeat Monitoring by a Ballistocardiographic Sensor in Patients with Sleep Disordered Breathing , 2017, Scientific Reports.

[89]  Nikolaus Marx,et al.  Computational Electrocardiography: Revisiting Holter ECG Monitoring , 2016, Methods of Information in Medicine.

[90]  Marko Sarlija,et al.  A convolutional neural network based approach to QRS detection , 2017, Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis.

[91]  Rabab Kreidieh Ward,et al.  Robust greedy deep dictionary learning for ECG arrhythmia classification , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[92]  Xianxiang Chen,et al.  Respiration-based emotion recognition with deep learning , 2017, Comput. Ind..

[93]  Jun Dong,et al.  Ensemble Deep Learning for Biomedical Time Series Classification , 2016, Comput. Intell. Neurosci..

[94]  Christopher Chow.  DeepBUFS: Deep Learned Biometric User Feedback System , 2017, Conference on Designing Interactive Systems.

[95]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[96]  R G Mark,et al.  Improved detection and classification of arrhythmias in noise-corrupted electrocardiograms using contextual information , 1990, [1990] Proceedings Computers in Cardiology.

[97]  Algirdas Maknickas,et al.  Recognition of normal–abnormal phonocardiographic signals using deep convolutional neural networks and mel-frequency spectral coefficients , 2017, Physiological measurement.

[98]  Yu Tsao,et al.  S1 and S2 Heart Sound Recognition Using Deep Neural Networks , 2017, IEEE Trans. Biomed. Eng..

[99]  Thomas M. Deserno,et al.  Deterioration of R-Wave Detection in Pathology and Noise: A Comprehensive Analysis Using Simultaneous Truth and Performance Level Estimation , 2017, IEEE Transactions on Biomedical Engineering.

[100]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[101]  C. Peng,et al.  Age-related alterations in the fractal scaling of cardiac interbeat interval dynamics. , 1996, The American journal of physiology.

[102]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[103]  S. Swiryn,et al.  Predicting the onset of paroxysmal atrial fibrillation: the Computers in Cardiology Challenge 2001 , 2001, Computers in Cardiology 2001. Vol.28 (Cat. No.01CH37287).

[104]  Naif Alajlan,et al.  Deep learning approach for active classification of electrocardiogram signals , 2016, Inf. Sci..

[105]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[106]  P. A. Karthick,et al.  Surface electromyography based muscle fatigue progression analysis using modified B distribution time-frequency features , 2016, Biomed. Signal Process. Control..

[107]  Bryan R. Conroy,et al.  Ensemble of feature-based and deep learning-based classifiers for detection of abnormal heart sounds , 2016, 2016 Computing in Cardiology Conference (CinC).

[108]  Hao Dong,et al.  Mixed Neural Network Approach for Temporal Sleep Stage Classification , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[109]  Roberto Sassi,et al.  Assessing nonlinear properties of heart rate variability from short-term recordings: are these measurements reliable? , 2007, Physiological measurement.

[110]  Mehrdad Nourani,et al.  An adaptive deep learning approach for PPG-based identification , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[111]  Yue Zhang,et al.  Deep learning feature representation for electrocardiogram identification , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[112]  Xuan Zeng,et al.  HeartID: A Multiresolution Convolutional Neural Network for ECG-Based Biometric Human Identification in Smart Health Applications , 2017, IEEE Access.

[113]  P. A. Karthick,et al.  Analysis of Muscle Fatigue Progression using Cyclostationary Property of Surface Electromyography Signals , 2015, Journal of Medical Systems.

[114]  Zeng-Guang Hou,et al.  Combined use of sEMG and accelerometer in hand motion classification considering forearm rotation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[115]  Yinghong Peng,et al.  EMG‐Based Estimation of Limb Movement Using Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[116]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.