A large annotated medical image dataset for the development and evaluation of segmentation algorithms

Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is contingent on the availability of high-quality imaging data with corresponding labels provided by experts. We sought to create a large collection of annotated medical image datasets of various clinically relevant anatomies available under open source license to facilitate the development of semantic segmentation algorithms. Such a resource would allow: 1) objective assessment of general-purpose segmentation methods through comprehensive benchmarking and 2) open and free access to medical image data for any researcher interested in the problem domain. Through a multi-institutional effort, we generated a large, curated dataset representative of several highly variable segmentation tasks that was used in a crowd-sourced challenge - the Medical Segmentation Decathlon held during the 2018 Medical Image Computing and Computer Aided Interventions Conference in Granada, Spain. Here, we describe these ten labeled image datasets so that these data may be effectively reused by the research community.

[1]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[2]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[3]  Yu Liu,et al.  A review of semantic segmentation using deep neural networks , 2017, International Journal of Multimedia Information Retrieval.

[4]  William C Chapman,et al.  Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma Using Quantitative Image Analysis. , 2017, Journal of the American College of Surgeons.

[5]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[6]  William C Chapman,et al.  Quantitative Imaging Features and Postoperative Hepatic Insufficiency: A Multi-Institutional Expanded Cohort. , 2018, Journal of the American College of Surgeons.

[7]  Nico Karssemeijer,et al.  A Pattern Recognition Approach to Zonal Segmentation of the Prostate on MRI , 2012, MICCAI.

[8]  Mithat Gönen,et al.  Computed Tomography Image Texture: A Noninvasive Prognostic Marker of Hepatic Recurrence After Hepatectomy for Metastatic Colorectal Cancer , 2017, Annals of Surgical Oncology.

[9]  Yuichiro Hayashi,et al.  Deep learning and its application to medical image segmentation , 2018, ArXiv.

[10]  Stephan Heckers,et al.  Anatomical and functional correlates of human hippocampal volume asymmetry , 2012, Psychiatry Research: Neuroimaging.

[11]  Ashish Sharma,et al.  The public cancer radiology imaging collections of The Cancer Imaging Archive , 2017, Scientific Data.

[12]  Jayasree Chakraborty,et al.  Preoperative risk prediction for intraductal papillary mucinous neoplasms by quantitative CT image analysis. , 2019, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[13]  Aaron Carass,et al.  Why rankings of biomedical image analysis competitions should be interpreted with care , 2018, Nature Communications.

[14]  Jürgen Weese,et al.  Benchmark for Algorithms Segmenting the Left Atrium From 3D CT and MRI Datasets , 2015, IEEE Transactions on Medical Imaging.

[15]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[16]  Amber L. Simpson,et al.  CT radiomics to predict high‐risk intraductal papillary mucinous neoplasms of the pancreas , 2018, Medical physics.

[17]  Alan C. Evans,et al.  Volumetry of hippocampus and amygdala with high-resolution MRI and three-dimensional analysis software: minimizing the discrepancies between laboratories. , 2000, Cerebral cortex.

[18]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[19]  Olivier Ecabert,et al.  Segmentation of the heart and great vessels in CT images using a model-based adaptation framework , 2011, Medical Image Anal..

[20]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[21]  Mithat Gönen,et al.  Chemotherapy-induced splenic volume increase is independently associated with major complications after hepatic resection for metastatic colorectal cancer. , 2014, Journal of the American College of Surgeons.

[22]  Olivier Gevaert,et al.  A radiogenomic dataset of non-small cell lung cancer , 2018, Scientific Data.

[23]  Amber L. Simpson,et al.  Survival Prediction in Pancreatic Ductal Adenocarcinoma by Quantitative Computed Tomography Image Analysis , 2018, Annals of Surgical Oncology.

[24]  Yueh Z Lee,et al.  Image Sharing in Radiology-A Primer. , 2017, Academic radiology.

[25]  D. Amaral,et al.  The three-dimensional organization of the hippocampal formation: A review of anatomical data , 1989, Neuroscience.

[26]  Yuman Fong,et al.  Texture analysis of preoperative CT images for prediction of postoperative hepatic insufficiency: a preliminary study. , 2015, Journal of the American College of Surgeons.

[27]  Hao Chen,et al.  The Liver Tumor Segmentation Benchmark (LiTS) , 2019, Medical Image Anal..

[28]  Benoit M. Dawant,et al.  Semi-automatic Segmentation of the Liver and its Evaluation on the MICCAI 2007 Grand Challenge Data Set , 2007 .