Principles for evaluating the clinical implementation of novel digital healthcare devices

Seong Ho Park, MD · Kyung-Hyun Do, MD · Joon-Il Choi, MD · Jung Suk Sim, MD · Dal Mo Yang, MD · Hong Eo, MD · Hyunsik Woo, MD · Jeong Min Lee, MD · Seung Eun Jung, MD · Joo Hyeong Oh, MD Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul; Department of Radiology, Seoul St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul; Withsim Clinic, Seongnam; Department of Radiology, Kyung Hee University Hospital at Gangdong, Seoul; Department of Radiology and Center for Imaging Science, Samsung Medical Center, Seoul; Department of Radiology, SMG-SNU Boramae Medical Center, Seoul National University College of Medicine, Seoul; Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul; Department of Radiology, Kyung Hee University Hospital, Kyung Hee University College of Medicine, Seoul, Korea

[1]  David A Bluemke,et al.  Radiology in 2018: Are You Working with AI or Being Replaced by AI? , 2018, Radiology.

[2]  Chenxi Liu,et al.  Deep Nets: What have They Ever Done for Vision? , 2018, International Journal of Computer Vision.

[3]  Oleg S. Pianykh,et al.  Current Applications and Future Impact of Machine Learning in Radiology. , 2018, Radiology.

[4]  C. Pal,et al.  Deep Learning: A Primer for Radiologists. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[5]  Young-Jae Kim,et al.  The process by which new health technology is listed for insurance coverage , 2014 .

[6]  Is It Time to Stop Paying for Computer-Aided Mammography? , 2015, JAMA internal medicine.

[7]  S. Jha,et al.  Why CAD Failed in Mammography. , 2018, Journal of the American College of Radiology : JACR.

[8]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[9]  S. Park,et al.  Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction. , 2018, Radiology.

[10]  Gregory T Sica,et al.  Bias in research studies. , 2006, Radiology.

[11]  June-Goo Lee,et al.  Deep Learning in Medical Imaging: General Overview , 2017, Korean journal of radiology.

[12]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[13]  Seong Ho Park,et al.  Regulatory Approval versus Clinical Validation of Artificial Intelligence Diagnostic Tools. , 2018, Radiology.

[14]  Ashirbani Saha,et al.  Deep learning for segmentation of brain tumors: Impact of cross‐institutional training and testing , 2018, Medical physics.

[15]  E. Peterson,et al.  Evaluating Health Technology Through Pragmatic Trials: Novel Approaches to Generate High-Quality Evidence. , 2018, JAMA.

[16]  Christopher Mabey,et al.  Computerised interpretation of fetal heart rate during labour (INFANT): a randomised controlled trial , 2017, The Lancet.

[17]  Marcus A. Badgeley,et al.  Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study , 2018, PLoS medicine.

[18]  Is digital medicine different? , 2018, The Lancet.

[19]  Seong Ho Park,et al.  Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do , 2018, Journal of Korean medical science.

[20]  C. Lehman,et al.  Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection. , 2015, JAMA internal medicine.

[21]  S. Steinhubl,et al.  Effect of a Home-Based Wearable Continuous ECG Monitoring Patch on Detection of Undiagnosed Atrial Fibrillation: The mSToPS Randomized Clinical Trial , 2018, JAMA.

[22]  Jeonghoon Ahn,et al.  The current status and future direction of Korean health technology assessment system , 2014 .

[23]  M. Phipps,et al.  Screening for Colorectal Cancer: US Preventive Services Task Force Recommendation Statement. , 2016, JAMA.

[24]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[25]  Ewout W. Steyerberg,et al.  Big Data and Predictive Analytics: Recalibrating Expectations , 2018, JAMA.

[26]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[27]  Wei Luo,et al.  Guidelines for Developing and Reporting Machine Learning Predictive Models in Biomedical Research: A Multidisciplinary View , 2016, Journal of medical Internet research.

[28]  S. Park.  Artificial Intelligence in Medicine: Beginner's Guide , 2018 .