Revisiting the medial axis for planar shape decomposition

Abstract We present a simple computational model for planar shape decomposition that naturally captures most of the rules and salience measures suggested by psychophysical studies, including the minima and short-cut rules, convexity, and symmetry. It is based on a medial axis representation in ways that have not been explored before and sheds more light into the connection between existing rules like minima and convexity. In particular, vertices of the exterior medial axis directly provide the position and extent of negative minima of curvature, while a traversal of the interior medial axis directly provides a small set of candidate endpoints for part-cuts. The final selection follows a prioritized processing of candidate part-cuts according to a local convexity rule that can incorporate arbitrary salience measures. Neither global optimization nor differentiation is involved. We provide qualitative and quantitative evaluation and comparisons on ground-truth data from psychophysical experiments. With our single computational model, we outperform even an ensemble method on several other competing models.

[1]  Kaleem Siddiqi,et al.  Parts of Visual Form: Computational Aspects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Wenyu Liu,et al.  Skeleton Pruning by Contour Partitioning with Discrete Curve Evolution , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  J. Koenderink,et al.  The Shape of Smooth Objects and the Way Contours End , 1982, Perception.

[4]  A. Pentland Recognition by Parts , 1987 .

[5]  Xiaoyi Jiang,et al.  A Clustering-Based Ensemble Technique for Shape Decomposition , 2012, SSPR/SPR.

[6]  Longin Jan Latecki,et al.  Convexity Rule for Shape Decomposition Based on Discrete Contour Evolution , 1999, Comput. Vis. Image Underst..

[7]  Xiaofeng Mi,et al.  Separating Parts from 2D Shapes using Relatability , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Fernando C. Monteiro,et al.  Distance measures for image segmentation evaluation , 2012 .

[9]  HARRY BLUM,et al.  Shape description using weighted symmetric axis features , 1978, Pattern Recognit..

[10]  Alex Pentland,et al.  Part Segmentation for Object Recognition , 1989, Neural Computation.

[11]  Xin Li,et al.  2D Shape Decomposition Based on Combined Skeleton-Boundary Features , 2008, ISVC.

[12]  Michael Leyton,et al.  Inferring Causal History from Shape , 1989, Cogn. Sci..

[13]  Anders Linnér Steepest Descent as a Tool to Find Critical Points of ∫ k2 Defined on Curves in the Plane with Arbitrary Types of Boundary Conditions , 1991 .

[14]  Xiaoyi Jiang,et al.  Framework for quantitative performance evaluation of shape decomposition algorithms , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[15]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[16]  David Mumford,et al.  Filtering, Segmentation and Depth , 1993, Lecture Notes in Computer Science.

[17]  Wen Gao,et al.  A Method of Perceptual-Based Shape Decomposition , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Iasonas Kokkinos,et al.  Semantic Part Segmentation with Deep Learning , 2015, ArXiv.

[19]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  H. Blum Biological shape and visual science. I. , 1973, Journal of theoretical biology.

[21]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[22]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[23]  Horst Bunke,et al.  Distance Measures for Image Segmentation Evaluation , 2006, EURASIP J. Adv. Signal Process..

[24]  Yannis Avrithis,et al.  The medial feature detector: Stable regions from image boundaries , 2011, 2011 International Conference on Computer Vision.

[25]  Kaleem Siddiqi,et al.  Ligature Instabilities in the Perceptual Organization of Shape , 1999, Comput. Vis. Image Underst..

[26]  Donald D. Hoffman,et al.  Codon constraints on closed 2D shapes , 1985, Comput. Vis. Graph. Image Process..

[27]  Herbert Freeman,et al.  Shape description via the use of critical points , 1978, Pattern Recognit..

[28]  Berthold K. P. Horn The Curve of Least Energy , 1983, TOMS.

[29]  Urs Ramer,et al.  An iterative procedure for the polygonal approximation of plane curves , 1972, Comput. Graph. Image Process..

[30]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[31]  Zhonghua Xi,et al.  Dual-Space Decomposition of 2D Complex Shapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Donald D. Hoffman,et al.  Parts of Visual Objects: An Experimental Test of the Minima Rule , 1989, Perception.

[33]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Yannis Avrithis,et al.  Planar shape decomposition made simple , 2015, BMVC.

[35]  Nancy M. Amato,et al.  Approximate convex decomposition of polygons , 2004, SCG '04.

[36]  Azriel Rosenfeld,et al.  From volumes to views: An approach to 3-D object recognition , 1992, CVGIP Image Underst..

[37]  J. Wagemans,et al.  Segmentation of object outlines into parts: A large-scale integrative study , 2006, Cognition.

[38]  Tamal K. Dey,et al.  Shape Segmentation and Matching with Flow Discretization , 2003, WADS.

[39]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[40]  Robert M. Haralick,et al.  Decomposition of Two-Dimensional Shapes by Graph-Theoretic Clustering , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Michael Leyton,et al.  Symmetry-curvature duality , 1987, Comput. Vis. Graph. Image Process..

[42]  Donald D. Hoffman,et al.  Part-Based Representations of Visual Shape and Implications for Visual Cognition , 2001 .

[43]  Stepán Obdrzálek,et al.  Stable Affine Frames on Isophotes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[44]  Hwan Pyo Moon,et al.  MATHEMATICAL THEORY OF MEDIAL AXIS TRANSFORM , 1997 .

[45]  Lei Luo,et al.  A Computational Model of the Short-Cut Rule for 2D Shape Decomposition , 2015, IEEE Transactions on Image Processing.

[46]  Donald D. Hoffman,et al.  Parsing silhouettes: The short-cut rule , 1999, Perception & psychophysics.

[47]  P. Danielsson Euclidean distance mapping , 1980 .

[48]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Kim L. Boyer,et al.  Robust Contour Decomposition Using a Constant Curvature Criterion , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[51]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Leonidas J. Guibas,et al.  SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Kaleem Siddiqi,et al.  Ligature instabilities in the perceptual organization of shape , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[54]  Daniel P. Huttenlocher,et al.  Distance Transforms of Sampled Functions , 2012, Theory Comput..

[55]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[56]  Tao Xiang,et al.  Sketch-a-Net: A Deep Neural Network that Beats Humans , 2017, International Journal of Computer Vision.

[57]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[58]  Donald D. Hoffman,et al.  Salience of visual parts , 1997, Cognition.

[59]  Adolfo Guzmán-Arenas,et al.  Decomposition of a visual scene into three-dimensional bodies , 1968, AFIPS Fall Joint Computing Conference.

[60]  José García Rodríguez,et al.  PointNet: A 3D Convolutional Neural Network for real-time object class recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[61]  S. Ullman,et al.  Filling-in the gaps: The shape of subjective contours and a model for their generation , 1976, Biological Cybernetics.

[62]  Yvan G. Leclerc,et al.  Constructing simple stable descriptions for image partitioning , 1989, International Journal of Computer Vision.

[63]  R. Bajcsy,et al.  Three dimensional object representation revisited , 1987 .

[64]  Junsong Yuan,et al.  Minimum near-convex decomposition for robust shape representation , 2011, 2011 International Conference on Computer Vision.

[65]  R. Hetherington The Perception of the Visual World , 1952 .

[66]  Markus Ilg,et al.  Voronoi skeletons: theory and applications , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[67]  W. Eric L. Grimson,et al.  Shape Encoding and Subjective Contours , 1980, AAAI.

[68]  Paul L. Rosin Shape Partitioning by Convexity , 1999, BMVC.

[69]  Wenyu Liu,et al.  Convex shape decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[70]  Michael Leyton,et al.  A Process-Grammar for Shape , 1988, Artif. Intell..

[71]  Sang Uk Lee,et al.  A new shape decomposition scheme for graph-based representation , 2005, Pattern Recognit..