Pre-organizing Shape Instances for Landmark-Based Shape Correspondence

The major challenge in constructing a statistical shape model for a structure is shape correspondence, which identifies a set of corresponded landmarks across a population of shape instances to accurately estimate the underlying shape variation. Both global or pairwise shape-correspondence methods have been developed to automatically identify the corresponded landmarks. For global methods, landmarks are found by optimizing a comprehensive objective function that considers the entire population of shape instances. While global methods can produce very accurate shape correspondence, they tend to be very inefficient when the population size is large. For pairwise methods, all shape instances are corresponded to a given template independently. Therefore, pairwise methods are usually very efficient. However, if the population exhibits a large amount of shape variation, pairwise methods may produce very poor shape correspondence. In this paper, we develop a new method that attempts to address the limitations of global and pairwise methods. In particular, we first construct a shape tree to globally organize the population of shape instances by identifying similar shape instance pairs. We then perform pairwise shape correspondence between such similar shape instances with high accuracy. Finally, we combine these pairwise correspondences to achieve a unified correspondence for the entire population of shape instances. We evaluate the proposed method by comparing its performance to five available shape correspondence methods, and show that the proposed method achieves the accuracy of a global method with the efficiency of a pairwise method.

[1]  Alejandro F. Frangi,et al.  Automatic 3D ASM Construction via Atlas-Based Landmarking and Volumetric Elastic Registration , 2001, IPMI.

[2]  Daniel González-Jiménez,et al.  Toward Pose-Invariant 2-D Face Recognition Through Point Distribution Models and Facial Symmetry , 2007, IEEE Transactions on Information Forensics and Security.

[3]  Stephen J. Wright,et al.  Object-oriented software for quadratic programming , 2003, TOMS.

[4]  Marios Savvides,et al.  Robust modified Active Shape Model for automatic facial landmark annotation of frontal faces , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[5]  Jeff G. Schneider,et al.  Automatic construction of active appearance models as an image coding problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[7]  Alfred M. Bruckstein,et al.  Similarity-invariant signatures for partially occluded planar shapes , 1992, International Journal of Computer Vision.

[8]  Martin Styner,et al.  Evaluation of 3D Correspondence Methods for Model Building , 2003, IPMI.

[9]  Fred L. Bookstein,et al.  Morphometric Tools for Landmark Data. , 1998 .

[10]  Rogério Schmidt Feris,et al.  Efficient partial shape matching using Smith-Waterman algorithm , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Luiz A. Costa,et al.  Determining the similarity of deformable shapes , 1995, Vision Research.

[12]  Song Wang,et al.  Nonrigid Shape Correspondence Using Landmark Sliding, Insertion and Deletion , 2005, MICCAI.

[13]  Guang-Zhong Yang,et al.  Outlier Detection and Handling for Robust 3-D Active Shape Models Search , 2007, IEEE Transactions on Medical Imaging.

[14]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[15]  Stephen R. Marsland,et al.  A minimum description length objective function for groupwise non-rigid image registration , 2008, Image Vis. Comput..

[16]  Kanti V. Mardia,et al.  The Statistical Analysis of Shape , 1998 .

[17]  Hans-Peter Meinzer,et al.  3D Active Shape Models Using Gradient Descent Optimization of Description Length , 2005, IPMI.

[18]  Song Wang,et al.  Fast multiple shape correspondence by pre-organizing shape instances , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Song Wang,et al.  Evaluating Shape Correspondence for Statistical Shape Analysis: A Benchmark Study , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Christopher J. Taylor,et al.  Evaluation of Statistical Models , 2008 .

[22]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  Ender Özcan,et al.  Partial shape matching using genetic algorithms , 1997, Pattern Recognit. Lett..

[24]  A. Murat Tekalp,et al.  Partial shape recognition by sub-matrix matching for partial matching guided image labeling , 2005, Pattern Recognit..

[25]  Timothy F. Cootes,et al.  Facial Motion Analysis using Clustered Shortest Path Tree Registration , 2008 .

[26]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[27]  Johan Karlsson,et al.  A Ground Truth Correspondence Measure for Benchmarking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[28]  Fred L. Bookstein,et al.  Landmark methods for forms without landmarks: morphometrics of group differences in outline shape , 1997, Medical Image Anal..

[29]  Hans Henrik Thodberg,et al.  Minimum Description Length Shape and Appearance Models , 2003, IPMI.

[30]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  E. Catmull,et al.  A CLASS OF LOCAL INTERPOLATING SPLINES , 1974 .

[32]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[33]  Christopher J. Taylor,et al.  Automatic Landmark Generation for Point Distribution Models , 1994, BMVC.

[34]  Pheng-Ann Heng,et al.  Shape Modeling Using Automatic Landmarking , 2005, MICCAI.

[35]  Rhodri H. Davies,et al.  Learning Shape: Optimal Models for Analysing Natural Variability , 2004 .

[36]  Timothy F. Cootes,et al.  Automatic face identification system using flexible appearance models , 1995, Image Vis. Comput..

[37]  Song Wang,et al.  Shape correspondence through landmark sliding , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[38]  ten Josephus Berge,et al.  Review of: J.C. Gower & G.B. Dijksterhuis: Procrustes Problems, Oxford University Press. , 2004 .

[39]  Milan Sonka,et al.  Segmentation and interpretation of MR brain images. An improved active shape model , 1998, IEEE Transactions on Medical Imaging.

[40]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[41]  Alejandro F. Frangi,et al.  Automatic Construction of 3D Statistical Deformation Models Using Non-rigid Registration , 2001, MICCAI.

[42]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[43]  Remco C. Veltkamp,et al.  State of the Art in Shape Matching , 2001, Principles of Visual Information Retrieval.

[44]  Dinggang Shen,et al.  Multiple Cortical Surface Correspondence Using Pairwise Shape Similarity , 2010, MICCAI.

[45]  Qiang Wang,et al.  An elastic partial shape matching technique , 2007, Pattern Recognit..

[46]  R. Kikinis,et al.  Amygdala–hippocampal shape differences in schizophrenia: the application of 3D shape models to volumetric MR data , 2002, Psychiatry Research: Neuroimaging.

[47]  Thomas B. Moeslund,et al.  Long-Term Occupancy Analysis Using Graph-Based Optimisation in Thermal Imagery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[49]  Snigdhansu Chatterjee,et al.  Procrustes Problems , 2005, Technometrics.

[50]  Remco C. Veltkamp,et al.  Part-based shape retrieval , 2005, MULTIMEDIA '05.

[51]  Dominik S. Meier,et al.  Parameter space warping: shape-based correspondence between morphologically different objects , 2002, IEEE Transactions on Medical Imaging.

[52]  Daniel Cremers,et al.  Fast Matching of Planar Shapes in Sub-cubic Runtime , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[53]  Yali Amit,et al.  Shape Quantization and Recognition with Randomized Trees , 1997, Neural Computation.