State-of-the-Art Review Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology

Artificial intelligence (AI) uses data and algorithms to aim to draw conclusions that are as good as, or even better than, those drawn by humans. AI is already part of our daily life; it is behind face recognition technology, speech recognition in virtual assistants (such as Amazon Alexa, Apple’s Siri, Google Assistant and Microsoft Cortana) and self-driving cars. AI software has been able to beat world champions in chess, Go and recently even Poker. Relevant to our community, it is a prominent source of innovation in healthcare, already helping to develop new drugs, support clinical decisions and provide quality assurance in radiology. The list of medical image-analysis AI applications with USA Food and Drug Administration or European Union (soon to fall under European Union Medical Device Regulation) approval is and covers such arrhythmia using a or automatic triage of critical to the top of the worklist. performs impact on this field so far. Nevertheless, there is huge potential for AI to assist in repetitive ultrasound tasks, such as automatically identifying good-quality acquisitions and providing instant quality assurance. For this potential to thrive, interdisciplinary communication between AI developers and ultrasound professionals is necessary. In this article, we explore the fundamentals of medical imaging AI, from theory to applicability, and introduce some key terms to medical professionals in the field of ultrasound. We believe that wider knowledge of AI will help accelerate its integration into healthcare.

[1]  M. Sirota,et al.  Development and validation of a machine‐learning model for prediction of shoulder dystocia , 2020, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[2]  Peter Henderson,et al.  Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims , 2020, ArXiv.

[3]  Curtis P. Langlotz,et al.  Video-based AI for beat-to-beat assessment of cardiac function , 2020, Nature.

[4]  J. Ioannidis,et al.  Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies , 2020, BMJ.

[5]  J. Noble,et al.  Expected‐value bias in routine third‐trimester growth scans , 2020, Ultrasound in Obstetrics and Gynecology.

[6]  FDA Authorizes Marketing of First Cardiac Ultrasound Software That Uses Artificial Intelligence to Guide User , 2020, Case Medical Research.

[7]  Hongmin Cai,et al.  Using deep‐learning algorithms to classify fetal brain ultrasound images as normal or abnormal , 2020, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[8]  E. Segal,et al.  Prediction of gestational diabetes based on nationwide electronic health records , 2020, Nature Medicine.

[9]  Michael W. Sjoding,et al.  Diagnosing bias in data-driven algorithms for healthcare , 2020, Nature Medicine.

[10]  B. Rost,et al.  Validity of machine learning in biology and medicine increased through collaborations across fields of expertise , 2020, Nature Machine Intelligence.

[11]  S. Strother,et al.  Use of Machine Learning for Predicting Escitalopram Treatment Outcome From Electroencephalography Recordings in Adult Patients With Depression , 2020, JAMA network open.

[12]  G. Marcus The Apple Watch can detect atrial fibrillation: so what now? , 2019, Nature Reviews Cardiology.

[13]  T. Bourne,et al.  Ultrasound‐based risk model for preoperative prediction of lymph‐node metastases in women with endometrial cancer: model‐development study , 2019, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[14]  Theodoros Evgeniou,et al.  Algorithms on regulatory lockdown in medicine , 2019, Science.

[15]  J. Noseworthy The Future of Care - Preserving the Patient-Physician Relationship. , 2019, The New England journal of medicine.

[16]  David F. Steiner,et al.  Chest Radiograph Interpretation with Deep Learning Models: Assessment with Radiologist-adjudicated Reference Standards and Population-adjusted Evaluation. , 2019, Radiology.

[17]  P. Chang Moving Artificial Intelligence from Feasible to Real: Time to Drill for Gas and Build Roads. , 2019, Radiology.

[18]  Mark T. Seelen,et al.  Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care , 2019, JAMA network open.

[19]  Krister Wennerberg,et al.  Prediction of drug combination effects with a minimal set of experiments , 2019, Nature Machine Intelligence.

[20]  Bibb Allen,et al.  Integrating Artificial Intelligence Into Radiologic Practice: A Look to the Future. , 2019, Journal of the American College of Radiology : JACR.

[21]  Genki Terashi,et al.  Protein docking model evaluation by 3D deep convolutional neural networks , 2019, Bioinform..

[22]  Po-Hsuan Cameron Chen,et al.  How to Read Articles That Use Machine Learning: Users' Guides to the Medical Literature. , 2019, JAMA.

[23]  W. Price,et al.  Potential Liability for Physicians Using Artificial Intelligence. , 2019, JAMA.

[24]  Nabile M. Safdar,et al.  Ethics of Artificial Intelligence in Radiology: Summary of the Joint European and North American Multisociety Statement , 2019, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[25]  E. Topol,et al.  A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. , 2019, The Lancet. Digital health.

[26]  Elmar Kotter,et al.  Ethics of artificial intelligence in radiology: summary of the joint European and North American multisociety statement , 2019, Insights into Imaging.

[27]  G. Bogani,et al.  OP07.10: Artificial intelligence weights the importance of clinical and sonographic factors predicting nodal metastasis in endometrial cancer , 2019, Ultrasound in Obstetrics & Gynecology.

[28]  David Moher,et al.  Reporting guidelines for clinical trials evaluating artificial intelligence interventions are needed , 2019, Nature Medicine.

[29]  M. Kudo,et al.  Artificial intelligence predicts the progression of diabetic kidney disease using big data machine learning , 2019, Scientific Reports.

[30]  M. Mazurowski Artificial Intelligence May Cause a Significant Disruption to the Radiology Workforce. , 2019, Journal of the American College of Radiology : JACR.

[31]  T. Bjorndahl,et al.  Artificial intelligence and amniotic fluid multiomics: prediction of perinatal outcome in asymptomatic women with short cervix , 2019, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[32]  C. Slump,et al.  Deep learning enables automatic quantitative assessment of puborectalis muscle and urogenital hiatus in plane of minimal hiatal dimensions , 2019, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[33]  Jonathan H. Chen,et al.  Deep learning interpretation of echocardiograms , 2019, bioRxiv.

[34]  E. Walker,et al.  A machine learning approach to predicting psychosis using semantic density and latent content analysis , 2019, npj Schizophrenia.

[35]  Brent Mittelstadt,et al.  Principles alone cannot guarantee ethical AI , 2019, Nature Machine Intelligence.

[36]  C. Langlotz,et al.  A Roadmap for Foundational Research on Artificial Intelligence in Medical Imaging: From the 2018 NIH/RSNA/ACR/The Academy Workshop. , 2019, Radiology.

[37]  Dong Ni,et al.  Deep Learning in Medical Ultrasound Analysis: A Review , 2019, Engineering.

[38]  Harshita Sharma,et al.  Spatio-Temporal Partitioning And Description Of Full-Length Routine Fetal Anomaly Ultrasound Scans , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[39]  Iyad Rahwan,et al.  Toward understanding the impact of artificial intelligence on labor , 2019, Proceedings of the National Academy of Sciences.

[40]  T. Berzin,et al.  Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study , 2019, Gut.

[41]  Paolo Bory Deep new: The shifting narratives of artificial intelligence from Deep Blue to AlphaGo , 2019, Convergence: The International Journal of Research into New Media Technologies.

[42]  Atul J. Butte,et al.  Integrating biomedical research and electronic health records to create knowledge-based biologically meaningful machine-readable embeddings , 2019, Nature Communications.

[43]  Mauro Annarumma,et al.  Automated Triaging of Adult Chest Radiographs with Deep Artificial Neural Networks. , 2019, Radiology.

[44]  J. Henrich,et al.  The Moral Machine experiment , 2018, Nature.

[45]  A. Abuhamad,et al.  Fetal imaging: past, present, and future. A journey of marvel , 2018, BJOG : an international journal of obstetrics and gynaecology.

[46]  M. Abràmoff,et al.  Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices , 2018, npj Digital Medicine.

[47]  Marcus A. Badgeley,et al.  Automated deep-neural-network surveillance of cranial images for acute neurologic events , 2018, Nature Medicine.

[48]  C. Sloane,et al.  Charting the practical dimensions of understaffing from a managerial perspective: The everyday shape of the UK’s sonographer shortage , 2018, Ultrasound.

[49]  C. Schizas,et al.  Two‐stage approach for risk estimation of fetal trisomy 21 and other aneuploidies using computational intelligence systems , 2018, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[50]  N. Shah,et al.  Implementing Machine Learning in Health Care - Addressing Ethical Challenges. , 2018, The New England journal of medicine.

[51]  R Nick Bryan,et al.  Artificial Intelligence: Threat or Boon to Radiologists? , 2017, Journal of the American College of Radiology : JACR.

[52]  Nitin Singhal,et al.  Automated assessment of endometrium from transvaginal ultrasound using Deep Learned Snake , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[53]  Pheng-Ann Heng,et al.  Ultrasound Standard Plane Detection Using a Composite Neural Network Framework , 2017, IEEE Transactions on Cybernetics.

[54]  D. Altman,et al.  Ultrasound‐based gestational‐age estimation in late pregnancy , 2016, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[55]  Konstantinos Kamnitsas,et al.  Real-Time Standard Scan Plane Detection and Localisation in Fetal Ultrasound Using Fully Convolutional Neural Networks , 2016, MICCAI.

[56]  E. Gratacós,et al.  Quantitative ultrasound texture analysis of fetal lungs to predict neonatal respiratory morbidity , 2014, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[57]  W. Moon,et al.  Computer‐aided diagnosis using morphological features for classifying breast lesions on ultrasound , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[58]  Y. Hsiao,et al.  Classification of benign and malignant breast tumors using neural networks and three‐dimensional power Doppler ultrasound , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[59]  Y.‐L. Huang,et al.  Computer‐aided diagnosis of urodynamic stress incontinence with vector‐based perineal ultrasound using neural networks , 2007, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[60]  A. Kurjak,et al.  New Doppler index for prediction of perinatal brain damage in growth‐restricted and hypoxic fetuses , 2007, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[61]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[62]  S. Kuo,et al.  Image retrieval with principal component analysis for breast cancer diagnosis on various ultrasonic systems , 2005, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[63]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[64]  Jean Yeh,et al.  Big Data and the Future of Radiology Informatics. , 2016, Academic radiology.

[65]  J Vandewalle,et al.  Artificial neural network models for the preoperative discrimination between malignant and benign adnexal masses , 1999, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[66]  Jack Kahn,et al.  The Need for a Multidisciplinary Approach , 1981 .