Geometric segmentation of perspective images based on symmetry groups

Symmetry is an effective geometric cue to facilitate conventional segmentation techniques on images of man-made environment. Based on three fundamental principles that summarize the relations between symmetry and perspective imaging, namely, structure from symmetry, symmetry hypothesis testing, and global symmetry testing, we develop a prototype system which is able to automatically segment symmetric objects in space from single 2D perspective images. The result of such a segmentation is a hierarchy of geometric primitives, called symmetry cells and complexes, whose 3D structure and pose are fully recovered. Such a geometrically meaningful segmentation may greatly facilitate applications such as feature matching and robot navigation.

[1]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[2]  Allen Y. Yang,et al.  Structure and pose from single images of symmetric objects with applications to robot navigation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[4]  Yutaka Fukui,et al.  3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Kim L. Boyer,et al.  Robust Contour Decomposition Using a Constant Curvature Criterion , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Gérard G. Medioni,et al.  Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry , 2002, Object recognition supported by user interaction for service robots.

[7]  Kenichi Kanatani,et al.  Comments on "Symmetry as a Continuous Feature" , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Changming Sun,et al.  3D Symmetry Detection Using The Extended Gaussian Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Allen Y. Yang,et al.  Symmetry-based 3-D reconstruction from perspective images , 2005, Comput. Vis. Image Underst..

[14]  Andrew Zisserman,et al.  Shape from symmetry: detecting and exploiting symmetry in affine images , 1995, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[15]  Y. C. Hecker,et al.  On Geometric Hashing and the Generalized Hough Transform , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[16]  Nahum Kiryati,et al.  Detecting Symmetry in Grey Level Images: The Global Optimization Approach , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[17]  Nikolaus F. Troje,et al.  How is bilateral symmetry of human faces used for recognition of novel views? , 1998, Vision Research.

[18]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  David A. Forsyth,et al.  Extracting projective structure from single perspective views of 3D point sets , 1993, 1993 (4th) International Conference on Computer Vision.

[21]  T. Poggio,et al.  The importance of symmetry and virtual views in three-dimensional object recognition , 1994, Current Biology.

[22]  Allen Y. Yang,et al.  On Symmetry and Multiple-View Geometry: Structure, Pose, and Calibration from a Single Image , 2004, International Journal of Computer Vision.

[23]  Daphna Weinshall,et al.  Using Bilateral Symmetry to Improve 3D Reconstruction from Image Sequences , 1997, Comput. Vis. Image Underst..

[24]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Zhengyou Zhang,et al.  Parameter estimation techniques: a tutorial with application to conic fitting , 1997, Image Vis. Comput..

[26]  T. Poggio,et al.  Symmetric 3D objects are an easy case for 2D object recognition. , 1994, Spatial vision.

[27]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[28]  Giovanni Marola,et al.  On the Detection of the Axes of Symmetry of Symmetric and Almost Symmetric Planar Images , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[30]  S. Shankar Sastry,et al.  Geometry and Reconstruction from Symmetry , 2004 .

[31]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[32]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[33]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[34]  Jitendra Malik,et al.  Computing Local Surface Orientation and Shape from Texture for Curved Surfaces , 1997, International Journal of Computer Vision.