Automatic optimal filament segmentation with sub-pixel accuracy using generalized linear models and B-spline level-sets

Biological filaments, such as actin filaments, microtubules, and cilia, are often imaged using different light-microscopy techniques. Reconstructing the filament curve from the acquired images constitutes the filament segmentation problem. Since filaments have lower dimensionality than the image itself, there is an inherent trade-off between tracing the filament with sub-pixel accuracy and avoiding noise artifacts. Here, we present a globally optimal filament segmentation method based on B-spline vector level-sets and a generalized linear model for the pixel intensity statistics. We show that the resulting optimization problem is convex and can hence be solved with global optimality. We introduce a simple and efficient algorithm to compute such optimal filament segmentations, and provide an open-source implementation as an ImageJ/Fiji plugin. We further derive an information-theoretic lower bound on the filament segmentation error, quantifying how well an algorithm could possibly do given the information in the image. We show that our algorithm asymptotically reaches this bound in the spline coefficients. We validate our method in comprehensive benchmarks, compare with other methods, and show applications from fluorescence, phase-contrast, and dark-field microscopy.

[1]  Ivo F. Sbalzarini,et al.  Discrete Region Competition for Unknown Numbers of Connected Regions , 2012, IEEE Transactions on Image Processing.

[2]  J. Howard,et al.  Flexural rigidity of microtubules and actin filaments measured from thermal fluctuations in shape , 1993, The Journal of cell biology.

[3]  William J. Byrne,et al.  Convergence Theorems for Generalized Alternating Minimization Procedures , 2005, J. Mach. Learn. Res..

[4]  Ivo F. Sbalzarini,et al.  Coupling Image Restoration and Segmentation: A Generalized Linear Model/Bregman Perspective , 2013, International Journal of Computer Vision.

[5]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[6]  Christian Heipke,et al.  Network snakes: graph-based object delineation with active contour models , 2010, Machine Vision and Applications.

[7]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[8]  Jonathon Howard,et al.  Microtubule dynamics reconstituted in vitro and imaged by single-molecule fluorescence microscopy. , 2010, Methods in cell biology.

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Stanley Osher,et al.  REVIEW ARTICLE: Level Set Methods and Their Applications in Image Science , 2003 .

[11]  Xavier Bresson,et al.  Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction , 2010, J. Sci. Comput..

[12]  Rudolf Oldenbourg,et al.  Image simulation for biological microscopy: microlith. , 2013, Biomedical optics express.

[13]  David Zwicker,et al.  Tracking single particles and elongated filaments with nanometer precision. , 2011, Biophysical journal.

[14]  Gerald Farin,et al.  Curves and surfaces for computer aided geometric design , 1990 .

[15]  Thomas L. Marzetta,et al.  Detection, Estimation, and Modulation Theory , 1976 .

[16]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[17]  Pamela C. Cosman,et al.  Automatic tracking, feature extraction and classification of C. elegans phenotypes , 2004, IEEE Transactions on Biomedical Engineering.

[18]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[19]  Tian Shen,et al.  Segmentation and tracking of cytoskeletal filaments using open active contours , 2010, Cytoskeleton.

[20]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[21]  森 健策 国際会議MICCAI : Medical Image Computing and Computer Assisted Intervention(特別講演セッション,医療における多次元大規模データ解析) , 2012 .

[22]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[23]  Inderjit S. Dhillon,et al.  Clustering with Bregman Divergences , 2005, J. Mach. Learn. Res..

[24]  Zhiping Lin,et al.  Quantitative Aspects of Single-Molecule Microscopy: Information-theoretic analysis of single-molecule data , 2015, IEEE Signal Processing Magazine.

[25]  Laurent Sarry,et al.  Three-dimensional tracking of coronary arteries from biplane angiographic sequences using parametrically deformable models , 2001, IEEE Transactions on Medical Imaging.

[26]  Daniel Baum,et al.  Automated segmentation of electron tomograms for a quantitative description of actin filament networks. , 2012, Journal of structural biology.

[27]  V. Mukundan,et al.  Reconstitution of flagellar sliding. , 2013, Methods in enzymology.

[28]  P. Réfrégier,et al.  Bhattacharyya distance as a contrast parameter for statistical processing of noisy optical images. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  R. Rikmenspoel,et al.  Digitized precision measurements of the movements of sea urchin sperm flagella. , 1985, Biophysical journal.

[30]  Pong C. Yuen,et al.  Segmented snake for contour detection , 1998, Pattern Recognit..

[31]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[32]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[33]  W. Austin Elam,et al.  Multi-Platform Compatible Software for Analysis of Polymer Bending Mechanics , 2014, PloS one.

[34]  Xavier Bresson,et al.  Completely Convex Formulation of the Chan-Vese Image Segmentation Model , 2012, International Journal of Computer Vision.

[35]  Daniel Ramot,et al.  The Parallel Worm Tracker: A Platform for Measuring Average Speed and Drug-Induced Paralysis in Nematodes , 2008, PloS one.

[36]  B. S. Manjunath,et al.  Automated tracking and modeling of microtubule dynamics , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[37]  Gábor Székely,et al.  Bayesian image analysis with on-line confidence estimates and its application to microtubule tracking , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[38]  Ting Xu,et al.  3D actin network centerline extraction with multiple active contours , 2014, Medical Image Anal..

[39]  S. Ram,et al.  Localization accuracy in single-molecule microscopy. , 2004, Biophysical journal.

[40]  Michael Unser,et al.  Variational B-Spline Level-Set: A Linear Filtering Approach for Fast Deformable Model Evolution , 2009, IEEE Transactions on Image Processing.

[41]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[42]  Eugene W. Myers,et al.  Automated Tracking of Whiskers in Videos of Head Fixed Rodents , 2012, PLoS Comput. Biol..

[43]  Fan Zhang,et al.  Contour extraction of gait recognition based on improved GVF Snake model , 2012, Comput. Electr. Eng..

[44]  J. Aboudarham,et al.  Filament Recognition and Image Cleaning on Meudon Hα Spectroheliograms , 2005 .

[45]  Takeo Kanade,et al.  Understanding the Optics to Aid Microscopy Image Segmentation , 2010, MICCAI.

[46]  P. Atzberger,et al.  Spectral analysis methods for the robust measurement of the flexural rigidity of biopolymers. , 2012, Biophysical journal.

[47]  G Danuser,et al.  Tracking differential interference contrast diffraction line images with nanometre sensitivity , 2000, Journal of microscopy.

[48]  Max W. K. Law,et al.  A Deformable Surface Model for Vascular Segmentation , 2009, MICCAI.

[49]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[50]  Qi Zhang,et al.  Adaptive Vector Flow for Active Contour Model , 2012, CCPR.

[51]  Nikos Paragios,et al.  Particle Filters, a Quasi-Monte Carlo Solution for Segmentation of Coronaries , 2005, MICCAI.

[52]  V. Joshi On the Attainment of the Cramer-Rao Lower Bound , 1976 .

[53]  R. Wijsman On the Attainment of the Cramer-Rao Lower Bound , 1973 .

[54]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  S. Ram,et al.  Ultrahigh accuracy imaging modality for super-localization microscopy , 2013, Nature Methods.

[56]  Denis Friboulet,et al.  Compactly Supported Radial Basis Functions Based Collocation Method for Level-Set Evolution in Image Segmentation , 2007, IEEE Transactions on Image Processing.

[57]  W. Eric L. Grimson,et al.  A shape-based approach to the segmentation of medical imagery using level sets , 2003, IEEE Transactions on Medical Imaging.

[58]  Veikko F. Geyer,et al.  Motor regulation results in distal forces that bend partially disintegrated Chlamydomonas axonemes into circular arcs. , 2014, Biophysical journal.

[59]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  E. Maeland On the comparison of interpolation methods. , 1988, IEEE transactions on medical imaging.