Using DICOM Metadata for Radiological Image Series Categorization: a Feasibility Study on Large Clinical Brain MRI Datasets

The growing interest in machine learning (ML) in healthcare is driven by the promise of improved patient care. However, how many ML algorithms are currently being used in clinical practice? While the technology is present, as demonstrated in a variety of commercial products, clinical integration is hampered by a lack of infrastructure, processes, and tools. In particular, automating the selection of relevant series for a particular algorithm remains challenging. In this work, we propose a methodology to automate the identification of brain MRI sequences so that we can automatically route the relevant inputs for further image-related algorithms. The method relies on metadata required by the Digital Imaging and Communications in Medicine (DICOM) standard, resulting in generalizability and high efficiency (less than 0.4 ms/series). To support our claims, we test our approach on two large brain MRI datasets (40,000 studies in total) from two different institutions on two different continents. We demonstrate high levels of accuracy (ranging from 97.4 to 99.96%) and generalizability across the institutions. Given the complexity and variability of brain MRI protocols, we are confident that similar techniques could be applied to other forms of radiological imaging.

[1]  Perry L. Miller,et al.  Research Paper: PathMaster: Content-based Cell Image Retrieval Using Automated Feature Extraction , 2000, J. Am. Medical Informatics Assoc..

[2]  Euripides G. M. Petrakis,et al.  Similarity Searching in Medical Image Databases , 1997, IEEE Trans. Knowl. Data Eng..

[3]  Christoph M. Friedrich,et al.  FHDO Biomedical Computer Science Group at Medical Classification Task of ImageCLEF 2015 , 2015, CLEF.

[4]  Leland S. Hu,et al.  A Deep Convolutional Neural Network for Annotation of Magnetic Resonance Imaging Sequence Type , 2019, Journal of Digital Imaging.

[5]  David Dagan Feng,et al.  Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data , 2013, Journal of Digital Imaging.

[6]  Patrice Degoulet,et al.  Towards content-based image retrieval in a HIS-integrated PACS , 2000, AMIA.

[7]  Fabio A. González,et al.  A Semantic Content-Based Retrieval Method for Histopathology Images , 2008, AIRS.

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  Horst Bischof,et al.  Evaluation of Fast 2D and 3D Medical Image Retrieval Approaches Based on Image Miniatures , 2011, MCBR-CDS.

[10]  B Japsen,et al.  Rise and fall , 2021, Like Fire.

[11]  S. Mohanapriya,et al.  Automatic retrival of MRI brain image using multiqueries system , 2013, 2013 International Conference on Information Communication and Embedded Systems (ICICES).

[12]  Hayit Greenspan,et al.  A comparative study for chest radiograph image retrieval using binary texture and deep learning classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Pol Cirujeda,et al.  Medical Image Classification via 2D color feature based Covariance Descriptors , 2015, CLEF.

[14]  Hashem Koohy,et al.  The rise and fall of machine learning methods in biomedical research , 2017, F1000Research.

[15]  Oleg S. Pianykh,et al.  Current Applications and Future Impact of Machine Learning in Radiology. , 2018, Radiology.

[16]  Otman A. Basir,et al.  Semantic Image Retrieval in Magnetic Resonance Brain Volumes , 2012, IEEE Transactions on Information Technology in Biomedicine.

[17]  Henning Müller,et al.  Large‐scale retrieval for medical image analytics: A comprehensive review , 2018, Medical Image Anal..

[18]  Antoine Geissbühler,et al.  Integrating Content-Based Visual Access Methods into a Medical Case Database , 2003, MIE.

[19]  Michael Kohnen,et al.  The IRMA code for unique classification of medical images , 2003, SPIE Medical Imaging.

[20]  Jong-Un Won,et al.  Content‐Based Ultrasound Image Retrieval Using a Coarse to Fine Approach , 2002, Annals of the New York Academy of Sciences.

[21]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[22]  Amir Shmuel,et al.  Using Deep Learning Algorithms to Automatically Identify the Brain MRI Contrast: Implications for Managing Large Databases , 2018, Neuroinformatics.

[23]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[24]  Danica Marinac-Dabic,et al.  A Road Map for Translational Research on Artificial Intelligence in Medical Imaging: From the 2018 National Institutes of Health/RSNA/ACR/The Academy Workshop. , 2019, Journal of the American College of Radiology : JACR.

[25]  Frederico Valente,et al.  Dicoogle, a Pacs Featuring Profiled Content Based Image Retrieval , 2013, PloS one.

[26]  Sven Koitka,et al.  Traditional Feature Engineering and Deep Learning Approaches at Medical Classification Task of ImageCLEF 2016 , 2016, CLEF.

[27]  Haipeng Shen,et al.  Artificial intelligence in healthcare: past, present and future , 2017, Stroke and Vascular Neurology.

[28]  Gwénolé Quellec,et al.  Case Retrieval in Medical Databases by Fusing Heterogeneous Information , 2015, IEEE Transactions on Medical Imaging.

[29]  Henning Müller,et al.  Bag-of-Colors for Biomedical Document Image Classification , 2012, MCBR-CDS.

[30]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[31]  Hayit Greenspan,et al.  Visualizing and enhancing a deep learning framework using patients age and gender for chest x-ray image retrieval , 2016, SPIE Medical Imaging.

[32]  Stefano Bromuri,et al.  Overview of the medical tasks in ImageCLEF 2016 , 2016 .

[33]  Henning Müller,et al.  Overview of the ImageCLEF 2016 Medical Task , 2016, CLEF.

[34]  Rolf W. Günther,et al.  Integration of a research CBIR system with RIS and PACS for radiological routine , 2008, SPIE Medical Imaging.

[35]  R. Joe Stanley,et al.  An image feature-based approach to automatically find images for application to clinical decision support , 2011, Comput. Medical Imaging Graph..

[36]  Fátima de Lourdes dos Santos Nunes,et al.  Intelligent retrieval and classification in three-dimensional biomedical images - A systematic mapping , 2019, Comput. Sci. Rev..

[37]  Josef Kittler Medical Content-Based Retrieval for Clinical Decision Support , 2012, Lecture Notes in Computer Science.

[38]  Michael Kohnen,et al.  Quality of DICOM header information for image categorization , 2002, SPIE Medical Imaging.