SpheroidJ: An Open-Source Set of Tools for Spheroid Segmentation

BACKGROUND AND OBJECTIVES Spheroids are the most widely used 3D models for studying the effects of different micro-environmental characteristics on tumour behaviour, and for testing different preclinical and clinical treatments. In order to speed up the study of spheroids, imaging methods that automatically segment and measure spheroids are instrumental; and, several approaches for automatic segmentation of spheroid images exist in the literature. However, those methods fail to generalise to a diversity of experimental conditions. The aim of this work is the development of a set of tools for spheroid segmentation that works in a diversity of settings. METHODS In this work, we have tackled the spheroid segmentation task by first developing a generic segmentation algorithm that can be easily adapted to different scenarios. This generic algorithm has been employed to reduce the burden of annotating a dataset of images that, in turn, has been employed to train several deep learning architectures for semantic segmentation. Both our generic algorithm and the constructed deep learning models have been tested with several datasets of spheroid images where the spheroids were grown under several experimental conditions, and the images acquired using different equipment. RESULTS The developed generic algorithm can be particularised to different scenarios; however, those particular algorithms fail to generalise to different conditions. By contrast, the best deep learning model, constructed using the HRNet-Seg architecture, generalises properly to a diversity of scenarios. In order to facilitate the dissemination and use of our algorithms and models, we present SpheroidJ, a set of open-source tools for spheroid segmentation. CONCLUSIONS In this work, we have developed an algorithm and trained several models for spheroid segmentation that can be employed with images acquired under different conditions. Thanks to this work, the analysis of spheroids acquired under different conditions will be more reliable and comparable; and, the developed tools will help to advance our understanding of tumour behaviour.

[1]  G. Devi,et al.  Three-dimensional culture systems in cancer research: Focus on tumor spheroid model. , 2016, Pharmacology & therapeutics.

[2]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[3]  Kevin W. Eliceiri,et al.  ImageJ2: ImageJ for the next generation of scientific image data , 2017, BMC Bioinformatics.

[4]  Filippo Piccinini,et al.  AnaSP: A software suite for automatic image analysis of multicellular spheroids , 2015, Comput. Methods Programs Biomed..

[5]  Yang Zhao,et al.  Deep High-Resolution Representation Learning for Visual Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Evgin Goceri,et al.  Challenges and Recent Solutions for Image Segmentation in the Era of Deep Learning , 2019, 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Evgin Goceri,et al.  CapsNet topology to classify tumours from brain images and comparative evaluation , 2020, IET Image Process..

[9]  Arash Rafii,et al.  Halfway between 2D and Animal Models: Are 3D Cultures the Ideal Tool to Study Cancer-Microenvironment Interactions? , 2018, International journal of molecular sciences.

[10]  Maria Vinci,et al.  Advances in establishment and analysis of three-dimensional tumor spheroid-based functional assays for target validation and drug evaluation , 2012, BMC Biology.

[11]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[12]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[15]  Jessica Konen,et al.  TASI: A software tool for spatial-temporal quantification of tumor spheroid dynamics , 2017, bioRxiv.

[16]  Chiara Moriconi,et al.  INSIDIA: A FIJI Macro Delivering High‐Throughput and High‐Content Spheroid Invasion Analysis , 2017, Biotechnology journal.

[17]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[18]  Emmanuel Gustin,et al.  Phaedra, a Protocol-Driven System for Analysis and Validation of High-Content Imaging and Flow Cytometry , 2012, Journal of biomolecular screening.

[19]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[20]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .

[21]  Alessandro Bevilacqua,et al.  ReViMS: Software tool for estimating the volumes of 3-D multicellular spheroids imaged using a light sheet fluorescence microscope. , 2017, BioTechniques.

[22]  J. Calixto,et al.  Non-clinical studies required for new drug development - Part I: early in silico and in vitro studies, new target discovery and validation, proof of principles and robustness of animal studies , 2016, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[23]  Subrahmanyam Murala,et al.  RescueNet: An unpaired GAN for brain tumor segmentation , 2020, Biomed. Signal Process. Control..

[24]  Johan Karlsson,et al.  Spheroid Segmentation Using Multiscale Deep Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[25]  Alison P McGuigan,et al.  The Current Landscape of 3D In Vitro Tumor Models: What Cancer Hallmarks Are Accessible for Drug Discovery? , 2018, Advanced healthcare materials.

[26]  N. Kanopoulos,et al.  Design of an image edge detection filter using the Sobel operator , 1988, IEEE J. Solid State Circuits.

[27]  Evgin Goceri,et al.  Diagnosis of Alzheimer's disease with Sobolev gradient‐based optimization and 3D convolutional neural network , 2019, International journal for numerical methods in biomedical engineering.

[28]  Brian W. Pogue,et al.  An imaging-based platform for high-content, quantitative evaluation of therapeutic response in 3D tumour models , 2014, Scientific Reports.

[29]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[30]  Hao Chen,et al.  Brain tumor segmentation with deep convolutional symmetric neural network , 2020, Neurocomputing.

[31]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[32]  David J. Foran,et al.  High-throughput Image Analysis of Tumor Spheroids: A User-friendly Software Application to Measure the Size of Spheroids Automatically and Accurately , 2014, Journal of visualized experiments : JoVE.

[33]  Delyan P. Ivanov,et al.  Multiplexing Spheroid Volume, Resazurin and Acid Phosphatase Viability Assays for High-Throughput Screening of Tumour Spheroids and Stem Cell Neurospheres , 2014, PloS one.

[34]  Christian Stüllein,et al.  A Novel Computer-Assisted Approach to evaluate Multicellular Tumor Spheroid Invasion Assay , 2016, Scientific Reports.

[35]  X. Xiuli,et al.  Three ‐ dimensional cell culture : A powerful tool in tumor research and drug discovery ( Review ) , 2022 .

[36]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[37]  Alexandr A. Kalinin,et al.  Albumentations: fast and flexible image augmentations , 2018, Inf..

[38]  Zichen Zhang,et al.  U2-Net: Going Deeper with Nested U-Structure for Salient Object Detection , 2020, Pattern Recognit..