Automatic Detection and Uncertainty Quantification of Landmarks on Elastic Curves

Abstract A population quantity of interest in statistical shape analysis is the location of landmarks, which are points that aid in reconstructing and representing shapes of objects. We provide an automated, model-based approach to inferring landmarks given a sample of shape data. The model is formulated based on a linear reconstruction of the shape, passing through the specified points, and a Bayesian inferential approach is described for estimating unknown landmark locations. The question of how many landmarks to select is addressed in two different ways: (1) by defining a criterion-based approach and (2) joint estimation of the number of landmarks along with their locations. Efficient methods for posterior sampling are also discussed. We motivate our approach using several simulated examples, as well as data obtained from applications in computer vision, biology, and medical imaging. Supplementary materials for this article, including a standardized description of the materials available for reproducing the work, are available as an online supplement.

[1]  Sebastian Kurtek,et al.  Bayesian Model-Based Automatic Landmark Detection for Planar Curves , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[3]  Li Bai,et al.  A new method of automatic landmark tagging for shape model construction via local curvature scale , 2008, SPIE Medical Imaging.

[4]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[5]  Katarina Domijan A Bayesian Method for Automatic Landmark Detection in Segmented Images , 2005 .

[6]  Michael I. Miller,et al.  REPRESENTATIONS OF KNOWLEDGE IN COMPLEX SYSTEMS , 1994 .

[7]  D. Mumford,et al.  A Metric on Shape Space with Explicit Geodesics , 2007, 0706.4299.

[8]  Guoyan Zheng,et al.  Automatic X-ray landmark detection and shape segmentation via data-driven joint estimation of image displacements , 2014, Medical Image Anal..

[9]  Leif Ellingson,et al.  Evaluation and prediction of polygon approximations of planar contours for shape analysis , 2017 .

[10]  Wen Cheng,et al.  Bayesian Registration of Functions and Curves , 2013, 1311.2105.

[11]  Maurício Pamplona Segundo,et al.  Automatic Face Segmentation and Facial Landmark Detection in Range Images , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Laurent Younes,et al.  Computable Elastic Distances Between Shapes , 1998, SIAM J. Appl. Math..

[13]  Malcolm Sabin Functions and Curves , 2010 .

[14]  K. Mardia,et al.  Size and shape analysis of landmark data , 1992 .

[15]  Anuj Srivastava,et al.  A Novel Representation for Riemannian Analysis of Elastic Curves in Rn , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  S. Kurtek A Geometric Approach to Pairwise Bayesian Alignment of Functional Data Using Importance Sampling , 2015, 1505.06954.

[17]  Anuj Srivastava,et al.  A joint model for boundaries of multiple anatomical parts , 2011, Medical Imaging.

[18]  Martin Bauer,et al.  Landmark-Guided Elastic Shape Analysis of Human Character Motions , 2015, ArXiv.

[19]  Sebastian Kurtek,et al.  Landmark-Constrained Elastic Shape Analysis of Planar Curves , 2017 .

[20]  James E. Mosimann Size and Shape Analysis , 2006 .

[21]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .

[23]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[24]  Ajmal S. Mian,et al.  Shape-based automatic detection of a large number of 3D facial landmarks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Anuj Srivastava,et al.  Statistical Modeling of Curves Using Shapes and Related Features , 2012 .

[26]  Anuj Srivastava,et al.  Functional and Shape Data Analysis , 2016 .

[27]  Ling Guan,et al.  Automatic landmark point detection and tracking for human facial expressions , 2013, EURASIP J. Image Video Process..

[28]  Anuj Srivastava,et al.  Analysis of planar shapes using geodesic paths on shape spaces , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Daniel T. Robinson,et al.  Functional data analysis and partial shape matching in the square root velocity framework , 2012 .

[30]  Rikard Berthilsson,et al.  A Statistical Theory of Shape , 1998, SSPR/SPR.

[31]  Wei Liu,et al.  Protein structure alignment using elastic shape analysis , 2010, BCB '10.

[32]  T. Gasser,et al.  Searching for Structure in Curve Samples , 1995 .

[33]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[34]  Li Bai,et al.  Landmark selection for shape model construction via equalization of variance , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[35]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[36]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[37]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.