Model-Based Joint Motion and Structure Estimation from Stereo Images

In this paper we integrate motion and structure estimation in order to exploit their coherence. We propose an algorithm that uses models for object surfaces and their motion and estimates the model parameters using the image intensity matching criterion. The visible scene surface is represented with a parametrically deformable, spatially adaptive, wireframe model. Object motion is first modeled using the well-known rigid motion assumption along with the quaternion rotation representation. Nonrigid motion modeling using the finite element technique is also investigated as an alternative to rigid motion modeling or as a refinement of it. A functional containing image matching and surface smoothness constraints is minimized with respect to the unknown model parameters. A discontinuity detection scheme allowing deactivation of smoothness constraints across object boundaries, is investigated. A regularization scheme using a coarse to fine strategy is employed.

[1]  Hans P. Morevec.  Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[2]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  C. T. F. Ross.  Finite Element Methods in Engineering Science , 1984 .

[4]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[9]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[10]  Steven D. Blostein,et al.  QUANTIZATION ERRORS IN STEREO TRIANGULATION. , 1987 .

[11]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[12]  G.-S. Young,et al.  3-D motion estimation using a sequence of noisy stereo images , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  P. Besl.  Geometric modeling and computer vision , 1988, Proc. IEEE.

[14]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[15]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Kiyoharu Aizawa,et al.  Model-based analysis synthesis image coding (MBASIC) system for a person's face , 1989, Signal Process. Image Commun..

[17]  Jörn Ostermann,et al.  Object-oriented analysis-synthesis coding of moving images , 1989, Signal Process. Image Commun..

[18]  G. Medioni,et al.  Accurate surface description from binocular stereo , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[19]  David B. Cooper,et al.  Toward a Model-Based Bayesian Theory for Estimating and Recognizing Parameterized 3-D Objects Using Two or More Images Taken from Different Positions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[21]  Rama Chellappa,et al.  3-D Motion Estimation Using a Sequence of Noisy Stereo Images: Models, Estimation, and Uniqueness Results , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Y. Kay,et al.  A Kalman filter approach for accurate 3D motion estimation from a sequence of stereo images , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[23]  Alex Pentland,et al.  Closed-Form Solutions for Physically Based Shape Modeling and Recognition , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Sukhan Lee,et al.  A Kalman filter approach for accurate 3-D motion estimation from a sequence of stereo images , 1991, CVGIP Image Underst..

[25]  Ahmed Tamtaoui,et al.  Constrained disparity and motion estimators for 3DTV image sequence coding , 1991, Signal Process. Image Commun..

[26]  Dimitris N. Metaxas,et al.  Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Brian G. Schunck,et al.  A Two-Stage Algorithm for Discontinuity-Preserving Surface Reconstruction , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  A. Tamtaoui,et al.  Constrained Motion Estimators for 3DTV Sequence Coding , 1992 .

[30]  Gérard G. Medioni,et al.  3-D Surface Description from Binocular Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Michael A. Penna,et al.  Non-rigid motion analysis: Isometric motion , 1992, CVGIP Image Underst..

[32]  Gary Whitten,et al.  Scale Space Tracking and Deformable Sheet Models for Computational Vision , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Narendra Ahuja,et al.  Optimal Motion and Structure Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Reinhard Koch,et al.  Dynamic 3-D Scene Analysis Through Synthesis Feedback Control , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Michael G. Strintzis,et al.  Evaluation of multiresolution block matching techniques for motion and disparity estimation , 1994, Signal Process. Image Commun..

[38]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[39]  Sotiris Malassiotis,et al.  Joint motion/disparity estimation for stereo image sequences , 1994, Other Conferences.

[40]  Nikolaos Grammalidis,et al.  Stereo image sequence coding based on three-dimensional motion estimation and compensation , 1995, Signal Process. Image Commun..