Thin Structure Estimation with Curvature Regularization

Many applications in vision require estimation of thin structures such as boundary edges, surfaces, roads, blood vessels, neurons, etc. Unlike most previous approaches, we simultaneously detect and delineate thin structures with sub-pixel localization and real-valued orientation estimation. This is an ill-posed problem that requires regularization. We propose an objective function combining detection likelihoods with a prior minimizing curvature of the center-lines or surfaces. Unlike simple block-coordinate descent, we develop a novel algorithm that is able to perform joint optimization of location and detection variables more effectively. Our lower bound optimization algorithm applies to quadratic or absolute curvature. The proposed early vision framework is sufficiently general and it can be used in many higher-level applications. We illustrate the advantage of our approach on a range of 2D and 3D examples.

[1]  Benjamin B. Kimia,et al.  A Multi-stage Approach to Curve Extraction , 2014, ECCV.

[2]  Vladimir Kolmogorov,et al.  Partial Enumeration and Curvature Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Kaleem Siddiqi,et al.  Medial Representations: Mathematics, Algorithms and Applications , 2008 .

[4]  Lance R. Williams,et al.  Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience , 1997, Neural Computation.

[5]  Carl Olsson,et al.  Curvature-based regularization for surface approximation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Benjamin B. Kimia,et al.  On evaluating methods for recovering image curve fragments , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[8]  Stephen J. Wright,et al.  An inexact Levenberg-Marquardt method for large sparse nonlinear least squres , 1985, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[9]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[10]  Kenneth Levenberg.  A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[11]  KolmogorovVladimir.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006 .

[12]  Thomas Pock,et al.  Convex Relaxation of a Class of Vertex Penalizing Functionals , 2013, Journal of Mathematical Imaging and Vision.

[13]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[14]  Daniel Cremers,et al.  Curvature regularity for region-based image segmentation and inpainting: A linear programming relaxation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Ronen Basri,et al.  Extracting Salient Curves from Images: An Analysis of the Saliency Network , 2004, International Journal of Computer Vision.

[16]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  M. Drangova,et al.  Implementation of dual- and triple-energy cone-beam micro-CT for postreconstruction material decomposition. , 2008, Medical physics.

[18]  R. Horgan,et al.  Statistical Field Theory , 2014 .

[19]  Fredrik Kahl,et al.  Curvature Regularization for Curves and Surfaces in a Global Optimization Framework , 2011, EMMCVPR.

[20]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Daniel Cremers,et al.  A Linear Framework for Region-Based Image Segmentation and Inpainting Involving Curvature Penalization , 2011, International Journal of Computer Vision.

[22]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Kaleem Siddiqi,et al.  Hamilton-Jacobi Skeletons , 2002, International Journal of Computer Vision.

[24]  Lena Gorelick,et al.  Efficient Squared Curvature , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Benjamin B. Kimia,et al.  Shapes, shocks, and deformations I: The components of two-dimensional shape and the reaction-diffusion space , 1995, International Journal of Computer Vision.

[26]  Gérard G. Medioni,et al.  Inferring global perceptual contours from local features , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[29]  Benjamin B. Kimia,et al.  No Grouping Left Behind: From Edges to Curve Fragments , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Thomas Pock,et al.  Approximate Envelope Minimization for Curvature Regularity , 2012, ECCV Workshops.

[31]  Andrew W. Fitzgibbon,et al.  Global stereo reconstruction under second order smoothness priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  MalikJitendra,et al.  Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues , 2004 .

[33]  D. Holdsworth,et al.  Micro-CT in small animal and specimen imaging , 2002 .

[34]  Kaleem Siddiqi,et al.  3D Stochastic Completion Fields for Mapping Connectivity in Diffusion MRI , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Steven W. Zucker,et al.  Differential Geometric Inference in Surface Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Carl Olsson,et al.  In Defense of 3D-Label Stereo , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[39]  Gerda Kamberova,et al.  Ill-posed problems in surface and surface shape recovery , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[40]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[41]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.