Interactive segmentation and tracking in optical microscopic images

RECENT advances in optical microscopy have caused a data explosion as scientists can observe biological processes at a wide range of spatial and temporal resolutions. Hence, computer-aided microscopic image analysis is essential in utilizing the complete information embedded in such large volumes of data as manual analysis is extremely time consuming. Segmentation and tracking of objects of interest are some of the fundamental steps in a wide range of microscopic image analysis tasks and have been active areas of research for the past several decades. Though critical, these problems are extremely challenging not only due to ambiguities introduced by the imaging system but also due to wide variations in target objects of interest. Being the smallest units of life, cells and also nuclei have been popular choices as objects of interest. In this context, segmentation and tracking of cells and nuclei in tissue sample images is of particular importance in developmental biology and tumorigenesis since we can observe cells in their natural surroundings, which give us much more realistic experimental conditions compared to a cell culture model. However, development of such algorithms for tissue images is usually far more challenging compared to a cell culture model due to poor signal-to-noise ratio and the inherent contact between cells, making it extremely difficult to segment and/or track structures accurately. Hence, several automatic (1) and semi-automatic (2) methods have been developed to perform tissue segmentation and tracking. The ultimate goal of developing a segmentation and tracking algorithm is to automate it, so that the processing can be done without any manual intervention. This not only increases the throughput of the method enabling it to be used in a wide variety of applications where large datasets have to be analyzed in reasonable amount of time but also reduces the bias and subjectivity introduced by a manual analysis. This is also important in a clinical setup (computer-assisted diagnosis) where on one hand accuracy and reliability of the result is of utmost importance, and on the other hand timely analysis of the data is also required. However, due to aforementioned difficulties and regulatory policies, complete automation is not always possible. Hence, several interactive semi-automatic segmentation and tracking algorithms have been developed which although require some manual intervention, minimizes it as far as possible. The manual interaction is often incorporated in two ways, (I) a continuous corrective interaction with the data and intermediate segmentation and/or tracking results or (II) as a corrective post processing step after the data is segmented and tracked using a fully automatic method. There are several advantages of using a semi-automatic method. In almost all datasets, including the challenging ones where automatic methods have very little hope of producing a satisfactory result, the user can get the help of a semi-automatic method to segment and track objects. All interactive methods allow users to adjust and improve the segmentation or tracking results until they satisfy their own quality control standards. Also, similar to the automatic methods, the semiautomatic methods help in reducing the subjectivity, bias and inter-user variability introduced by a completely manual method to an extent by allowing the user to take the optimal

[1]  Christophe Zimmer,et al.  Segmenting and tracking fluorescent cells in dynamic 3-D microscopy with coupled active surfaces , 2005, IEEE Transactions on Image Processing.

[2]  Eugene W. Myers,et al.  VANO: a volume-object image annotation system , 2009, Bioinform..

[3]  A. Cardona,et al.  An Integrated Micro- and Macroarchitectural Analysis of the Drosophila Brain by Computer-Assisted Serial Section Electron Microscopy , 2010, PLoS biology.

[4]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[5]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[6]  Prabhakar R. Gudla,et al.  Segmentation of Whole Cells and Cell Nuclei From 3-D Optical Microscope Images Using Dynamic Programming , 2008, IEEE Transactions on Medical Imaging.

[7]  Anchi Cheng,et al.  An integrated micro- and macroarchitectural analysis of the drosophila brain by computer-assisted serial section electron microscopy , 2010 .

[8]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[9]  Matthew McAuliffe,et al.  Whole cell segmentation in solid tissue sections , 2005, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[10]  Marco Marcello,et al.  Interactive segmentation of clustered cells via geodesic commute distance and constrained density weighted Nyström method , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[11]  Frank Jülicher,et al.  Cell Flow Reorients the Axis of Planar Polarity in the Wing Epithelium of Drosophila , 2010, Cell.

[12]  Anne E Carpenter,et al.  CellProfiler: free, versatile software for automated biological image analysis. , 2007, BioTechniques.