Image Segmentation Using Graph Representations and Local Appearance and Shape Models

A generic model-based segmentation algorithm is presented. Based on a set of training data, consisting of images with corresponding object segmentations, a local appearance and local shape model is build. The object is described by a set of landmarks. For each landmark a local appearance model is build. This model describes the local intensity values in the image around each landmark. The local shape model is constructed by considering the landmarks to be vertices in an undirected graph. The edges represent the relations between neighboring landmarks. By implying the markovianity property on the graph, every landmark is only directly dependent upon its neighboring landmarks, leading to a local shape model. The objective function to be minimized is obtained from a maximum a-posteriori approach. To minimize this objective function, the problem is discretized by considering a finite set of possible candidates for each landmark. In this way the segmentation problem is turned into a labeling problem. Mean field annealing is used to optimize this labeling problem. The algorithm is validated for the segmentation of teeth from cone beam computed tomography images and for automated cephalometric analysis.

[1]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[2]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[3]  R. Courant,et al.  Methods of Mathematical Physics , 1962 .

[4]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[5]  Filip Schutyser,et al.  Three-dimensional cephalometry : a color atlas and manual , 2006 .

[6]  Nikos Komodakis,et al.  MRF Optimization via Dual Decomposition: Message-Passing Revisited , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[9]  Filip Schutyser,et al.  Three-Dimensional Cephalometry , 2006 .

[10]  Andrea J. van Doorn,et al.  The Structure of Locally Orderless Images , 1999, International Journal of Computer Vision.

[11]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[13]  Daniel Cremers,et al.  Statistical shape knowledge in variational motion segmentation , 2003, Image Vis. Comput..

[14]  A. J. Barret,et al.  Methods of Mathematical Physics, Volume I . R. Courant and D. Hilbert. Interscience Publishers Inc., New York. 550 pp. Index. 75s. net. , 1954, The Journal of the Royal Aeronautical Society.

[15]  Daniel Cremers,et al.  Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation , 2006, International Journal of Computer Vision.

[16]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[17]  Joni-Kristian Kämäräinen.  Feature extraction using Gabor filters , 2003 .

[18]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[19]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[22]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[23]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[24]  Jouko Lampinen,et al.  Distortion tolerant pattern recognition based on self-organizing feature extraction , 1995, IEEE Trans. Neural Networks.

[25]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[26]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[27]  Martin J. Wainwright,et al.  MAP estimation via agreement on trees: message-passing and linear programming , 2005, IEEE Transactions on Information Theory.

[28]  Paul Suetens,et al.  Model-Based Segmentation Using Graph Representations , 2008, MICCAI.

[29]  Dieter Seghers.  Local Graph-Based Probabilistic Representation of Object Shape and Appearance for Model-Based Medical Image Segmentation (Lokale graafgebaseerde probabilistische representatie van beeldobjecten voor modelgebaseerde segmentatie van medische beelden) , 2008 .

[30]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .