Deep learning models for electrocardiograms are susceptible to adversarial attack

Electrocardiogram (ECG) acquisition is increasingly widespread in medical and commercial devices, necessitating the development of automated interpretation strategies. Recently, deep neural networks have been used to automatically analyze ECG tracings and outperform physicians in detecting certain rhythm irregularities 1 . However, deep learning classifiers are susceptible to adversarial examples, which are created from raw data to fool the classifier such that it assigns the example to the wrong class, but which are undetectable to the human eye 2 , 3 . Adversarial examples have also been created for medical-related tasks 4 , 5 . However, traditional attack methods to create adversarial examples do not extend directly to ECG signals, as such methods introduce square-wave artefacts that are not physiologically plausible. Here we develop a method to construct smoothed adversarial examples for ECG tracings that are invisible to human expert evaluation and show that a deep learning model for arrhythmia detection from single-lead ECG 6 is vulnerable to this type of attack. Moreover, we provide a general technique for collating and perturbing known adversarial examples to create multiple new ones. The susceptibility of deep learning ECG algorithms to adversarial misclassification implies that care should be taken when evaluating these models on ECGs that may have been altered, particularly when incentives for causing misclassification exist. The development of an algorithm that can imperceptibly manipulate electrocardiographic data to fool a deep learning model for diagnosing cardiac arrhythmia highlights the potential vulnerability of artificial intelligence-enabled diagnosis to adversarial attacks.

[1]  Patrick E. McSharry,et al.  A dynamical model for generating synthetic electrocardiogram signals , 2003, IEEE Transactions on Biomedical Engineering.

[2]  Samy Bengio,et al.  Adversarial Machine Learning at Scale , 2016, ICLR.

[3]  Qian Zhang,et al.  ECGadv: Generating Adversarial Electrocardiogram to Misguide Arrhythmia Classification System , 2019, AAAI.

[4]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[5]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[6]  Andrew P. Martin,et al.  Trusted Computing and Provenance: Better Together , 2010, TaPP.

[7]  Andrew L. Beam,et al.  Adversarial attacks on medical machine learning , 2019, Science.

[8]  Suchi Saria,et al.  Tutorial: Safe and Reliable Machine Learning , 2019, ArXiv.

[9]  Matthew Mirman,et al.  Fast and Effective Robustness Certification , 2018, NeurIPS.

[10]  Qiao Li,et al.  AF classification from a short single lead ECG recording: The PhysioNet/computing in cardiology challenge 2017 , 2017, 2017 Computing in Cardiology (CinC).

[11]  Pushmeet Kohli,et al.  Adversarial Risk and the Dangers of Evaluating Against Weak Attacks , 2018, ICML.

[12]  Kiseon Kim,et al.  Deep Feature Learning for Sudden Cardiac Arrest Detection in Automated External Defibrillators , 2018, Scientific Reports.

[13]  Mykel J. Kochenderfer,et al.  Deep Neural Network Compression for Aircraft Collision Avoidance Systems , 2018, Journal of Guidance, Control, and Dynamics.

[14]  Danny Eytan,et al.  Towards Understanding ECG Rhythm Classification Using Convolutional Neural Networks and Attention Mappings , 2018, MLHC.

[15]  Aleksander Madry,et al.  Adversarially Robust Generalization Requires More Data , 2018, NeurIPS.

[16]  Meng Wu,et al.  ENCASE: An ENsemble ClASsifiEr for ECG classification using expert features and deep neural networks , 2017, 2017 Computing in Cardiology (CinC).

[17]  Aleksander Madry,et al.  Towards Deep Learning Models Resistant to Adversarial Attacks , 2017, ICLR.

[18]  Nassir Navab,et al.  Generalizability vs. Robustness: Adversarial Examples for Medical Imaging , 2018, MICCAI.

[19]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[20]  J. Zico Kolter,et al.  Certified Adversarial Robustness via Randomized Smoothing , 2019, ICML.

[21]  P. Song,et al.  Development and Validation of Deep-Learning Algorithm for Electrocardiography-Based Heart Failure Identification , 2019, Korean circulation journal.

[22]  Bridget B. Kelly,et al.  Promoting Cardiovascular Health in the Developing World: A Critical Challenge to Achieve Global Health , 2010 .

[23]  Michael J Ackerman,et al.  Development and Validation of a Deep-Learning Model to Screen for Hyperkalemia From the Electrocardiogram. , 2019, JAMA cardiology.

[24]  Bridget B. Kelly,et al.  Promoting Cardiovascular Health in the Developing World , 2010 .

[25]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  Fabio Roli,et al.  Evasion Attacks against Machine Learning at Test Time , 2013, ECML/PKDD.

[28]  H. Kennedy,et al.  The evolution of ambulatory ECG monitoring. , 2013, Progress in cardiovascular diseases.