Cooperative integration of stereopsis and optic flow computation

A cooperative integration of stereopsis and optic flow computation is presented. Central to our approach is the modeling of the visual processes as a sequence of coupled Markov random fields by definition of suitable interprocess interactions based on some natural constraints. The integration makes each of the individual processes better constrained and more reliable. Further, as a result of the integration, it becomes possible to obtain accurately the discontinuities in both the flow and the disparity fields along with the regions of stereo occlusion. Results on both noisy synthetic image data and real images are presented.

[1]  D. Vleeschauwer.  An intensity-based, coarse-to-fine approach to reliably measure binocular disparity , 1993 .

[2]  Sang Uk Lee,et al.  A hierarchical optical flow estimation algorithm based on the interlevel motion smoothness constraint , 1993, Pattern Recognit..

[3]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[4]  Anil K. Jain,et al.  Random field models in image analysis , 1989 .

[5]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[6]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[7]  Christoph Schnörr.  On Functionals with Greyvalue-Controlled Smoothness Terms for Determining Optical Flow , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  W Richards,et al.  Structure from stereo and motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[10]  Patrick Bouthemy,et al.  Multimodal Estimation of Discontinuous Optical Flow using Markov Random Fields , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[12]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Yi Liu,et al.  Integration of stereo vision and optical flow by using an energy-minimization approach , 1989 .

[14]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[16]  Paolo Nesi,et al.  Variational approach to optical flow estimation managing discontinuities , 1993, Image Vis. Comput..

[17]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[18]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ramakant Nevatia,et al.  Depth measurement by motion stereo , 1976 .

[20]  D. Devleeschauwer.  Regular ArticleAn Intensity-Based, Coarse-to-Fine Approach to Reliably Measure Binocular Disparity , 1993 .

[21]  Berthold K. P. Horn,et al.  "Determining optical flow": A Retrospective , 1993, Artif. Intell..

[22]  Alberto Del Bimbo,et al.  Optical flow from constraint lines parametrization , 1993, Pattern Recognit..