Active Subdivision Surfaces for the Semiautomatic Segmentation of Biomedical Volumes

We present a new family of active surfaces for the semiautomatic segmentation of volumetric objects in 3D biomedical images. We represent our deformable model by a subdivision surface encoded by a small set of control points and generated through a geometric refinement process. The subdivision operator confers important properties to the surface such as smoothness, reproduction of desirable shapes and interpolation of the control points. We deform the subdivision surface through the minimization of suitable gradient-based and region-based energy terms that we have designed for that purpose. In addition, we provide an easy way to combine these energies with convolutional neural networks. Our active subdivision surface satisfies the property of multiresolution, which allows us to adopt a coarse-to-fine optimization strategy. This speeds up the computations and decreases its dependence on initialization compared to singleresolution active surfaces. Performance evaluations on both synthetic and real biomedical data show that our active subdivision surface is robust in the presence of noise and outperforms current state-of-the-art methods. In addition, we provide a software that gives full control over the active subdivision surface via an intuitive manipulation of the control points.

[1]  G. Umlauf Analyzing the Characteristic Map of Triangular Subdivision Schemes , 2000 .

[2]  Jörg Peters,et al.  Extending Catmull-Clark Subdivision and PCCM with Polar Structures , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[3]  Jean-Christophe Olivo-Marin,et al.  3-D Active Meshes: Fast Discrete Deformable Models for Cell Tracking in 3-D Time-Lapse Microscopy , 2011, IEEE Transactions on Image Processing.

[4]  Hugues Hoppe,et al.  Displaced subdivision surfaces , 2000, SIGGRAPH.

[5]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[6]  Julien Cohen-Adad,et al.  Robust, accurate and fast automatic segmentation of the spinal cord , 2014, NeuroImage.

[7]  N. Dyn,et al.  A butterfly subdivision scheme for surface interpolation with tension control , 1990, TOGS.

[8]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[9]  Michael Unser,et al.  Multiresolution Subdivision Snakes , 2017, IEEE Transactions on Image Processing.

[10]  Weiyin Ma,et al.  A generalized surface subdivision scheme of arbitrary order with a tension parameter , 2014, Comput. Aided Des..

[11]  Nicolas Chenouard,et al.  Icy: an open bioimage informatics platform for extended reproducible research , 2012, Nature Methods.

[12]  E. Sahai,et al.  Membrane blebbing during apoptosis results from caspase-mediated activation of ROCK I , 2001, Nature Cell Biology.

[13]  Jennifer L. Whitwell,et al.  Accurate automatic estimation of total intracranial volume: A nuisance variable with less nuisance , 2015, NeuroImage.

[14]  Yao-Tien Chen,et al.  A novel approach to segmentation and measurement of medical image using level set methods. , 2017, Magnetic resonance imaging.

[15]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[16]  Michael Unser,et al.  Spline-Based Deforming Ellipsoids for Interactive 3D Bioimage Segmentation , 2013, IEEE Transactions on Image Processing.

[17]  Johan Montagnat,et al.  A review of deformable surfaces: topology, geometry and deformation , 2001, Image Vis. Comput..

[18]  Lucia Romani,et al.  Reproduction of exponential polynomials by multivariate non-stationary subdivision schemes with a general dilation matrix , 2013, Numerische Mathematik.

[19]  Leif Kobbelt,et al.  Interpolatory Subdivision on Open Quadrilateral Nets with Arbitrary Topology , 1996, Comput. Graph. Forum.

[20]  Weiyin Ma,et al.  A unified interpolatory subdivision scheme for quadrilateral meshes , 2013, TOGS.

[21]  Peter Schröder,et al.  Interpolating Subdivision for meshes with arbitrary topology , 1996, SIGGRAPH.

[22]  Lucia Romani,et al.  Exact evaluation of a class of nonstationary approximating subdivision algorithms and related applications , 2015 .

[23]  Michael Unser,et al.  A non-stationary subdivision scheme for the construction of deformable models with sphere-like topology , 2017, Graph. Model..

[24]  Boudewijn P. F. Lelieveldt,et al.  Segmentation of branching vascular structures using adaptive subdivision surface fitting , 2015, Medical Imaging.

[25]  Naixue Xiong,et al.  Coronary Arteries Segmentation Based on 3D FCN With Attention Gate and Level Set Function , 2019, IEEE Access.

[26]  Shu Zhang,et al.  Automatic pancreas segmentation based on lightweight DCNN modules and spatial prior propagation , 2020, Pattern Recognit..

[27]  Thierry Blu,et al.  Efficient energies and algorithms for parametric snakes , 2004, IEEE Transactions on Image Processing.

[28]  Gábor Székely,et al.  Tamed Snake: A Particle System for Robust Semi-automatic Segmentation , 1999, MICCAI.

[29]  Nicola Guglielmi,et al.  Regularity of non-stationary subdivision: a matrix approach , 2017, Numerische Mathematik.

[30]  Lucia Romani,et al.  Algebraic conditions on non-stationary subdivision symbols for exponential polynomial reproduction , 2011, J. Comput. Appl. Math..

[31]  Lucia Romani,et al.  On extraordinary rules of quad-based interpolatory subdivision schemes , 2015, Comput. Aided Geom. Des..

[32]  Hong Qin,et al.  Intelligent balloon: a subdivision-based deformable model for surface reconstruction of arbitrary topology , 2001, SMA '01.

[33]  Michael Unser,et al.  Efficient Shape Priors for Spline-Based Snakes , 2015, IEEE Transactions on Image Processing.

[34]  M. Donatelli,et al.  Convergence and Normal Continuity Analysis of Nonstationary Subdivision Schemes Near Extraordinary Vertices and Faces , 2017, Constructive Approximation.

[35]  Stefano Serra Capizzano,et al.  A merged tuning of binary and ternary Loop's subdivision , 2019, Comput. Aided Geom. Des..

[36]  Vladimir G. Kim,et al.  Neural subdivision , 2020, ACM Trans. Graph..

[37]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[38]  E. Catmull,et al.  Recursively generated B-spline surfaces on arbitrary topological meshes , 1978 .

[39]  Michal Kozubek,et al.  Generation of digital phantoms of cell nuclei and simulation of image formation in 3D image cytometry , 2009, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[40]  Anders P. Eriksson,et al.  Implicit Surface Representations As Layers in Neural Networks , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[41]  Michael Unser,et al.  Snakes on a Plane: A perfect snap for bioimage analysis , 2015, IEEE Signal Processing Magazine.

[42]  Tony DeRose,et al.  Subdivision surfaces in character animation , 1998, SIGGRAPH.

[43]  Malcolm A. Sabin,et al.  Behaviour of recursive division surfaces near extraordinary points , 1998 .

[44]  Nira Dyn,et al.  A 4-point interpolatory subdivision scheme for curve design , 1987, Comput. Aided Geom. Des..

[45]  Lucia Romani,et al.  Exponential Hermite splines for the analysis of biomedical images , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Michael Unser,et al.  The Ovuscule , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Jörg Peters,et al.  Bicubic polar subdivision , 2007, TOGS.

[48]  Ronald M. Summers,et al.  A large annotated medical image dataset for the development and evaluation of segmentation algorithms , 2019, ArXiv.

[49]  Daniel Sage,et al.  Phosphorylation does not prompt, nor prevent, the formation of alpha-synuclein toxic species in a rat model of Parkinson's disease. , 2008, Human molecular genetics.

[50]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[51]  Fredrik Orderud,et al.  Real-time 3D segmentation of the left ventricle using deformable subdivision surfaces , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.