Rigidity Checking of 3D Point Correspondences Under Perspective Projection

An algorithm is described which rapidly verifies the potential rigidity of three-dimensional point correspondences from a pair of two-dimensional views under perspective projection. The output of the algorithm is a simple yes or no answer to the question "Could these corresponding points from two views be the projection of a rigid configuration?" Potential applications include 3D object recognition from a single previous view and correspondence matching for stereo or motion over widely separated views. The rigidity checking problem is different from the structure-from-motion problem because it is often the case that two views cannot provide an accurate structure-from-motion estimate due to ambiguity and ill conditioning, whereas it is still possible to give an accurate yes/no answer to the rigidity question. Rigidity checking verifies point correspondences using 3D recovery equations as a matching condition. The proposed algorithm improves upon other methods that fall under this approach because it works with as few as six corresponding points under full perspective projection, handles correspondences from widely separated views, makes full use of the disparity of the correspondences, and is integrated with a linear algorithm for 3D recovery due to Kontsevich (1993). Results are given for experiments with synthetic and real image data. A complete implementation of this algorithm is being made publicly available.

[1]  Narendra Ahuja,et al.  Optimal motion and structure estimation , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Richard Szeliski,et al.  Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares , 1994, J. Vis. Commun. Image Represent..

[3]  Thomas S. Huang,et al.  Motion and structure from orthographic projections , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[4]  Ramesh C. Jain,et al.  A nonlinear optimization algorithm for the estimation of structure and motion parameters , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Songde Ma,et al.  Fusing the matching and motion estimation of rigid point patterns , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[6]  Berthold K. P. Horn Relative orientation revisited , 1991 .

[7]  Thomas S. Huang,et al.  Finding point correspondences and determining motion of a rigid object from two weak perspective views , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  D D Hoffman,et al.  Structure from two orthographic views of rigid motion. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[9]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[10]  R. Basri On the Uniqueness of Correspondence under Orthographic and Perspective Projections , 1991 .

[11]  Elizabeth R. Stuck,et al.  Detecting Moving Objects Using the Rigidity Constraint , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Christopher G. Harris,et al.  3D positional integration from image sequences , 1988, Image Vis. Comput..

[14]  D. Sinclair Motion segmentation and local structure , 1993, 1993 (4th) International Conference on Computer Vision.

[15]  S. B. Kang,et al.  Recovering 3 D Shape and Motion from Image Streams using Non-Linear Least Squares , 1993 .

[16]  Jon M. Kleinberg,et al.  Comparing point sets under projection , 1994, SODA '94.

[17]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[18]  N M Grzywacz,et al.  Massively parallel implementations of theories for apparent motion. , 1988, Spatial vision.

[19]  L L Kontsevich,et al.  Pairwise comparison technique: a simple solution for depth reconstruction. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[20]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[21]  O J Braddick,et al.  Low-level and high-level processes in apparent motion. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[23]  Narendra Ahuja,et al.  Motion estimation under orthographic projection , 1991, IEEE Trans. Robotics Autom..

[24]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[25]  Michael S. Landy,et al.  Computational Issues in Solving the Stereo Correspondence ProblemComputational Issues in Solving the Stereo Correspondence Problem , 1991 .

[26]  S. Anstis The perception of apparent movement. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  D. McReynolds,et al.  Determining the motion of a remotely piloted vehicle from a sequence of images , 1989, Proceedings of the IEEE National Aerospace and Electronics Conference.

[28]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[29]  R. Basri On the Uniqueness of Correspondence from Orthographic and Perspective Projection , 1992 .

[30]  Thomas S. Huang,et al.  Motion and Structure from Image Sequences , 1992 .

[31]  Donald D. Hoffman,et al.  Discriminating rigid from nonrigid motion: Minimum points and views , 1990, Perception & psychophysics.

[32]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  J Wagemans,et al.  Perceptual use of nonaccidental properties. , 1992, Canadian journal of psychology.

[34]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[35]  Richard Szeliski,et al.  Recovering 3D shape and motion from image streams using nonlinear least squares , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Daniel Peter McReynolds Solving for relative orientation and depth , 1988 .

[37]  William T. Freeman,et al.  Exploiting the generic view assumption to estimate scene parameters , 1993, 1993 (4th) International Conference on Computer Vision.

[38]  Christopher G. Harris Structure-from-motion under orthographic projection , 1991, Image Vis. Comput..

[39]  Subhashis Banerjee,et al.  Finding Point Correspondences in Motion Sequences Preserving Affine Structure , 1993, BMVC.

[40]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..