Finding Mirror Symmetry via Registration and Optimal Symmetric Pairwise Assignment of Curves: Algorithm and Results

We demonstrate that the problem of fitting a plane of mirror symmetry to data in any Euclidian space can be reduced to the problem of registering two datasets, and that the exactness of the solution depends entirely on the registration accuracy. This new Mirror Symmetry via Registration (MSR) framework involves (1) data reflection with respect to an arbitrary plane, (2) registration of original and reflected datasets, and (3) calculation of the eigenvector of eigenvalue -1 for the transformation matrix representing the reflection and registration mappings. To support MSR, we also introduce a novel 2D registration method based on random sample consensus of an ensemble of normalized cross-correlation matches. We further demonstrate the generality of MSR by testing it on a database of 3D shapes with an iterative closest point registration back-end.

[1]  Michael Arens,et al.  Recognition of Symmetry Structure by Use of Gestalt Algebra , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Evangelos Kalogerakis,et al.  Folding meshes: hierarchical mesh segmentation based on planar symmetry , 2006, SGP '06.

[3]  Fei Su,et al.  An adaptive symmetry detection algorithm based on local features , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[4]  David Grant Colburn Hildebrand,et al.  Finding Mirror Symmetry via Registration , 2016 .

[5]  Bo Li,et al.  Efficient 3D reflection symmetry detection: A view-based approach , 2016, Graph. Model..

[6]  Yanxi Liu,et al.  Symmetry reCAPTCHA , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Prabhu Kaliamoorthi,et al.  Three-Dimensional Bilateral Symmetry Plane Estimation in the Phase Domain , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Zesheng Tang,et al.  Reflection Symmetry Detection Using Locally Affine Invariant Edge Correspondence , 2015, IEEE Transactions on Image Processing.

[9]  Alfredo Petrosino,et al.  Multi-scale Kernel Operators for Reflection and Rotation Symmetry: Further Achievements , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Linda G. Shapiro,et al.  Learning to compute the plane of symmetry for human faces , 2011, BCB '11.

[11]  Maks Ovsjanikov,et al.  Detection of Mirror-Symmetric Image Patches , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Zhaohui Wu,et al.  Finding Symmetry Plane of 3D Face Shape , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Nick Pears,et al.  A Review and Characterization of ICP-based Symmetry Plane Localisation in 3 D Face Data , 2011 .

[14]  Ali Shokoufandeh,et al.  Retrieving articulated 3-D models using medial surfaces , 2008, Machine Vision and Applications.

[15]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[16]  Yanxi Liu,et al.  Symmetry Detection from RealWorld Images Competition 2013: Summary and Results , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[17]  Michael Werman,et al.  A convolutional approach to reflection symmetry , 2016, Pattern Recognit. Lett..

[18]  Emeka Nkenke,et al.  The Symmetry of Faces , 2002, VMV.

[19]  Kiyoshi Kato,et al.  Three-Dimensional Symmetry Identification Part I : Theory , 1992 .

[20]  Daniel Cohen-Or,et al.  Skeleton‐Intrinsic Symmetrization of Shapes , 2015, Comput. Graph. Forum.

[21]  Won-Ki Jeong,et al.  Whole-brain serial-section electron microscopy in larval zebrafish , 2017, Nature.

[22]  Yanxi Liu,et al.  Curved glide-reflection symmetry detection , 2009, CVPR.

[23]  Tobias Schreck,et al.  Approximate Symmetry Detection in Partial 3D Meshes , 2014, Comput. Graph. Forum.

[24]  Michael Werman,et al.  Mirror Symmetry Histograms for Capturing Geometric Properties in Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.