InstantDL: an easy-to-use deep learning pipeline for image segmentation and classification

Background Deep learning contributes to uncovering molecular and cellular processes with highly performant algorithms. Convolutional neural networks have become the state-of-the-art tool to provide accurate and fast image data processing. However, published algorithms mostly solve only one specific problem and they typically require a considerable coding effort and machine learning background for their application. Results We have thus developed InstantDL, a deep learning pipeline for four common image processing tasks: semantic segmentation, instance segmentation, pixel-wise regression and classification. InstantDL enables researchers with a basic computational background to apply debugged and benchmarked state-of-the-art deep learning algorithms to their own data with minimal effort. To make the pipeline robust, we have automated and standardized workflows and extensively tested it in different scenarios. Moreover, it allows assessing the uncertainty of predictions. We have benchmarked InstantDL on seven publicly available datasets achieving competitive performance without any parameter tuning. For customization of the pipeline to specific tasks, all code is easily accessible and well documented. Conclusions With InstantDL, we hope to empower biomedical researchers to conduct reproducible image processing with a convenient and easy-to-use pipeline.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[3]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[4]  Lassi Paavolainen,et al.  nucleAIzer: A Parameter-free Deep Learning Framework for Nucleus Segmentation Using Image Style Transfer , 2020, Cell systems.

[5]  Alan M. Moses,et al.  YeastSpotter: accurate and parameter-free web segmentation for microscopy images of yeast cells , 2019, Bioinform..

[6]  Anne E Carpenter,et al.  Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl , 2019, Nature Methods.

[7]  Thomas Brox,et al.  U-Net: deep learning for cell counting, detection, and morphometry , 2018, Nature Methods.

[8]  R. Hofmann-Wellenhof,et al.  Comparison of the accuracy of human readers versus machine-learning algorithms for pigmented skin lesion classification: an open, web-based, international, diagnostic study. , 2019, The Lancet. Oncology.

[9]  Valery Naranjo,et al.  Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study , 2014, Medical Image Anal..

[10]  Samuel J. Yang,et al.  In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images , 2018, Cell.

[11]  Luís Torgo,et al.  OpenML: networked science in machine learning , 2014, SKDD.

[12]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[13]  Christian Riess,et al.  A Gentle Introduction to Deep Learning in Medical Image Processing , 2018, Zeitschrift fur medizinische Physik.

[14]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[15]  Lassi Paavolainen,et al.  Data-analysis strategies for image-based cell profiling , 2017, Nature Methods.

[16]  Martin Hjelmare,et al.  ImJoy: an open-source computational platform for the deep learning era , 2019, Nature Methods.

[17]  Fabian J. Theis,et al.  Evaluation of Deep Learning Strategies for Nucleus Segmentation in Fluorescence Images , 2019, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[18]  E. Topol,et al.  A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. , 2019, The Lancet. Digital health.

[19]  K. Spiekermann,et al.  Human-level recognition of blast cells in acute myeloid leukaemia with convolutional neural networks , 2019, Nat. Mach. Intell..

[20]  Achim Hekler,et al.  Skin Cancer Classification Using Convolutional Neural Networks: Systematic Review , 2018, Journal of medical Internet research.

[21]  Fabian J Theis,et al.  Prospective identification of hematopoietic lineage choice by deep learning , 2017, Nature Methods.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[24]  Hao Chen,et al.  A Multi-Organ Nucleus Segmentation Challenge , 2020, IEEE Transactions on Medical Imaging.

[25]  Li Shen,et al.  Deep Learning to Improve Breast Cancer Detection on Screening Mammography , 2017, Scientific Reports.