Using Bilateral Symmetry to Improve 3D Reconstruction from Image Sequences

Abstract In previous applications, bilateral symmetry of objects was used either as a descriptive feature in domains such as recognition and grasping or as a way to reduce the complexity of structure from motion. In this paper we demonstrate how bilateral symmetry can be used to improve the accuracy in 3D reconstruction. The symmetry property is used to “symmetrize” data before and after reconstruction. We first show how to compute the closest symmetric 2D and 3D configurations given noisy data. This gives us a symmetrization procedure, which we apply to images before reconstruction, and which we apply to the 3D configuration after reconstruction. We demonstrate a significant improvement obtained with real images. We demonstrate the relative merits of symmetrization before and after reconstruction using simulated and real data.

[1]  J. Bigun Recognition of local symmetries in gray value images by harmonic functions , 1988 .

[2]  Daphna Weinshall,et al.  Linear and incremental acquisition of invariant shape models from image sequences , 1993, 1993 (4th) International Conference on Computer Vision.

[3]  Yutaka Fukui,et al.  3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  David A. Forsyth,et al.  Extracting projective structure from single perspective views of 3D point sets , 1993, 1993 (4th) International Conference on Computer Vision.

[5]  Josef Bigün Recognition of local symmetries in gray value images by harmonic functions , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[6]  Ramakant Nevatia,et al.  Using Symmetries For Analysis Of Shape From Contour , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[7]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[8]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrew Blake,et al.  Grasping visual symmetry , 1993, 1993 (4th) International Conference on Computer Vision.

[10]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[11]  Jean Ponce,et al.  On characterizing ribbons and finding skewed symmetries , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[12]  Daphna Weinshall Model-based invariants for 3D vision , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  H. Hel-Or Computational aspects of pattern characterization: continuous symmetry (הבטים חשוביים באפיון תבניות : סימטריה רציפה.) , 1993 .

[14]  Yehezkel Yeshurun,et al.  Robust detection of facial features by generalized symmetry , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[15]  Jean Ponce,et al.  On characterizing ribbons and finding skewed symmetries , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[16]  M. Asada,et al.  Model-based matching using skewed symmetry information , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[17]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[18]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Stuart A. Friedberg,et al.  Finding axes of skewed symmetry , 1986, Comput. Vis. Graph. Image Process..