Identifying gross post‐mortem organ images using a pre‐trained convolutional neural network

Identifying organs/tissue and pathology on radiological and microscopic images can be performed using convolutional neural networks (CNN). However, there are scant studies on applying CNN to post-mortem gross images of visceral organs. This proof-of-concept study used 537 gross post-mortem images of dissected brain, heart, lung, liver, spleen, and kidney, which were randomly divided into a training and teaching datasets for the pre-trained CNN Xception. The CNN was trained using the training dataset and subsequently tested on the testing dataset. The overall accuracies were >95% percent for both training and testing datasets and have an F1 score of >0.95 for all dissected organs. This study showed that small datasets of post-mortem images can be classified with a very high accuracy using a pre-trained CNN. This novel area has the potential for future application in data mining, education and teaching, case review, research, quality assurance, auditing purposes, and identifying pathology.

[1]  R. Khonsari,et al.  Deep learning in medical image analysis: a third eye for doctors. , 2019, Journal of stomatology, oral and maxillofacial surgery.

[2]  Alexander Borowsky,et al.  Impact of pre‐analytical variables on deep learning accuracy in histopathology , 2019, Histopathology.

[3]  Chuan Zhou,et al.  Deep Learning in Medical Image Analysis. , 2017, Advances in experimental medicine and biology.

[4]  Shidan Wang,et al.  Pathology Image Analysis Using Segmentation Deep Learning Algorithms. , 2019, The American journal of pathology.

[5]  Bob D. de Vos,et al.  State-of-the-Art Deep Learning in Cardiovascular Image Analysis. , 2019, JACC. Cardiovascular imaging.

[6]  Maryellen L Giger,et al.  Machine Learning in Medical Imaging. , 2018, Journal of the American College of Radiology : JACR.

[7]  Jitendra Malik,et al.  Expert-level detection of acute intracranial hemorrhage on head computed tomography using deep learning , 2019, Proceedings of the National Academy of Sciences.

[8]  Jakob Nikolas Kather,et al.  Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer , 2019, Nature Medicine.

[9]  C. Langlotz,et al.  Deep Learning in Neuroradiology , 2018, American Journal of Neuroradiology.

[10]  David Beymer,et al.  An End-to-End Deep Learning Pipeline for Emphysema Quantification Using Multi-label Learning , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Horacio Pérez-Sánchez,et al.  Virtual Screening Meets Deep Learning. , 2018, Current computer-aided drug design.

[12]  Geoffrey M Currie,et al.  Intelligent Imaging: Anatomy of Machine Learning and Deep Learning , 2019, The Journal of Nuclear Medicine Technology.

[13]  Casey S Greene,et al.  Bayesian deep learning for single-cell analysis , 2018, Nature Methods.

[14]  William Graf,et al.  Deep learning for cellular image analysis , 2019, Nature Methods.

[15]  Constantino Carlos Reyes-Aldasoro,et al.  Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study , 2019, PLoS medicine.

[16]  Mahmoud Mostapha,et al.  Role of deep learning in infant brain MRI analysis. , 2019, Magnetic resonance imaging.

[17]  G. Ampanozi,et al.  Automatic detection of hemorrhagic pericardial effusion on PMCT using deep learning - a feasibility study , 2017, Forensic Science, Medicine and Pathology.

[18]  Roger Brent,et al.  Deep learning to predict microscope images , 2018, Nature Methods.

[19]  C. Pal,et al.  Deep Learning: A Primer for Radiologists. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[20]  S. Stables,et al.  Identifying Fatal Head Injuries on Postmortem Computed Tomography Using Convolutional Neural Network/Deep Learning: A Feasibility Study , 2020, Journal of forensic sciences.

[21]  Rita Strack,et al.  Deep learning in imaging , 2018, Nature Methods.

[22]  Deep Learning for Triage of Chest Radiographs: Should Every Institution Train Its Own System? , 2019, Radiology.