Introducing Biomedisa as an open-source online platform for biomedical image segmentation

We present Biomedisa, a free and easy-to-use open-source online platform developed for semi-automatic segmentation of large volumetric images. The segmentation is based on a smart interpolation of sparsely pre-segmented slices taking into account the complete underlying image data. Biomedisa is particularly valuable when little a priori knowledge is available, e.g. for the dense annotation of the training data for a deep neural network. The platform is accessible through a web browser and requires no complex and tedious configuration of software and model parameters, thus addressing the needs of scientists without substantial computational expertise. We demonstrate that Biomedisa can drastically reduce both the time and human effort required to segment large images. It achieves a significant improvement over the conventional approach of densely pre-segmented slices with subsequent morphological interpolation as well as compared to segmentation tools that also consider the underlying image data. Biomedisa can be used for different 3D imaging modalities and various biomedical applications.

[1]  H. Sebastian Seung,et al.  Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification , 2017, Bioinform..

[2]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[3]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Georg Mayer,et al.  X-ray imaging of a water bear offers a new look at tardigrade internal anatomy , 2019, Zoological Letters.

[5]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[6]  Kornelius Kupczik,et al.  Three-dimensional assessment of enamel and dentine in mouse molar teeth during masseter muscle hypofunction , 2019, Revista Estomatología.

[7]  Vincent Heuveline,et al.  A GPU Based Diffusion Method for Whole-Heart and Great Vessel Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[8]  Serge Beucher,et al.  THE WATERSHED TRANSFORMATION APPLIED TO IMAGE SEGMENTATION , 2009 .

[9]  Bruce M. Rothschild,et al.  A dinosaurian facial deformity and the first occurrence of ameloblastoma in the fossil record , 2016, Scientific Reports.

[10]  Matthew Jon Yoder,et al.  Revision of Trassedia (Hymenoptera: Ceraphronidae), an Evolutionary Relict With an Unusual Distribution , 2018, Insect Systematics and Diversity.

[11]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[12]  Tomy dos Santos Rolo,et al.  In vivo X-ray cine-tomography for tracking morphological dynamics , 2014, Proceedings of the National Academy of Sciences.

[13]  Konstantinos Kamnitsas,et al.  DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[14]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[15]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[16]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  Sébastien Ourselin,et al.  Slic-Seg: A minimally interactive segmentation of the placenta from sparse and motion-corrupted fetal MRI in multiple views , 2016, Medical Image Anal..

[18]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[19]  J. Balanta-Melo,et al.  Masseter muscle atrophy impairs bone quality of the mandibular condyle but not the alveolar process early after induction. , 2018, Journal of oral rehabilitation.

[20]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[21]  P. Sung,et al.  Tel1 and Rif2 Regulate MRX Functions in End-Tethering and Repair of DNA Double-Strand Breaks , 2016, PLoS biology.

[22]  Philipp J. Keller,et al.  Real-Time Three-Dimensional Cell Segmentation in Large-Scale Microscopy Data of Developing Embryos. , 2016, Developmental cell.

[23]  Polina Golland,et al.  Interactive Whole-Heart Segmentation in Congenital Heart Disease , 2015, MICCAI.

[24]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Guillermo Sapiro,et al.  Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting , 2009, International Journal of Computer Vision.

[27]  Nicolas Pinto,et al.  PyCUDA and PyOpenCL: A scripting-based approach to GPU run-time code generation , 2009, Parallel Comput..

[28]  Gregory S.X.E. Jefferis,et al.  Automatic Segmentation of Drosophila Neural Compartments Using GAL4 Expression Data Reveals Novel Visual Pathways , 2015, Current Biology.

[29]  Pierre L'Ecuyer,et al.  Good Parameters and Implementations for Combined Multiple Recursive Random Number Generators , 1999, Oper. Res..

[30]  T. Baumbach,et al.  Three-Dimensional Reconstructions Come to Life – Interactive 3D PDF Animations in Functional Morphology , 2014, PloS one.

[31]  Dieter Schmalstieg,et al.  Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: Practical feasibility and assessment of a new course of action , 2018, PloS one.

[32]  Michael Zapf,et al.  WAVE: A 3D Online Previewing Framework for Big Data Archives , 2017, VISIGRAPP.

[33]  Andrew Blake,et al.  GeoS: Geodesic Image Segmentation , 2008, ECCV.

[34]  P. Ahlberg,et al.  Hidden morphological diversity among early tetrapods , 2017, Nature.

[35]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[36]  Gabriel Tobon,et al.  High-Level Story: Data Analysis in Multimodal Preclinical Imaging—Methods and Tools , 2018, Image Fusion in Preclinical Applications.

[37]  Anne E Carpenter,et al.  Visualization of image data from cells to organisms , 2010, Nature Methods.

[38]  Jan Egger,et al.  Computed tomography data collection of the complete human mandible and valid clinical ground truth models , 2019, Scientific Data.

[39]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[40]  S. Dwivedi,et al.  Obesity May Be Bad: Compressed Convolutional Networks for Biomedical Image Segmentation , 2020 .

[41]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[42]  A. Cecilia,et al.  Comparative thorax morphology of death-feigning flightless cryptorhynchine weevils (Coleoptera: Curculionidae) based on 3D reconstructions. , 2015, Arthropod structure & development.

[43]  Matthias Vogelgesang,et al.  Real-time image-content-based beamline control for smart 4D X-ray imaging. , 2016, Journal of synchrotron radiation.

[44]  Laura B. Porro,et al.  Digital dissection of the head of the rock dove (Columba livia) using contrast-enhanced computed tomography , 2019, Zoological Letters.

[45]  Joachim Wittbrodt,et al.  Quantitative morphometric analysis of adult teleost fish by X-ray computed tomography , 2018, Scientific Reports.

[46]  Sébastien Ourselin,et al.  DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2005, Medical Image Anal..

[48]  Aaron Carass,et al.  Why rankings of biomedical image analysis competitions should be interpreted with care , 2018, Nature Communications.

[49]  Andrew R. Deans,et al.  A new megaspilid wasp from Eocene Baltic amber (Hymenoptera: Ceraphronoidea), with notes on two non-ceraphronoid families: Radiophronidae and Stigmaphronidae , 2018, PeerJ.

[50]  Luis Álvarez,et al.  A Morphological Approach to Curvature-Based Evolution of Curves and Surfaces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Vincent Heuveline,et al.  Enhancing a diffusion algorithm for 4D image segmentation using local information , 2016, SPIE Medical Imaging.

[52]  Andreas Kopmann,et al.  Parasitoid biology preserved in mineralized fossils , 2018, Nature Communications.

[53]  Fred A. Hamprecht,et al.  ilastik: interactive machine learning for (bio)image analysis , 2019, Nature Methods.

[54]  I. Belevich,et al.  Microscopy Image Browser: A Platform for Segmentation and Analysis of Multidimensional Datasets , 2016, PLoS biology.

[55]  P. Withers,et al.  Quantitative X-ray tomography , 2014 .