Extracting depth-information from dynamic image by spatio-temporal correlation analysis

Optical flow-field obtained by the analysis of a sequential scene derived by a relative motion between object and camera includes three-dimensional information (depth and/or shape). This paper develops a spatio-temporal correlation method for determining optical flow and attempts to extract the depth information on the basis of the analyzed optical flow field and the principle of the “motion stereo.” The method herein is improved in two critical points: (1) analysis of the plane wave propagation; and (2) algorithms for rapid calculation. It is demonstrated that the improved method and the theory of “motion stereo” are available for extracting depth information from actual scenes.

[1]  Michael A. Arbib,et al.  Computing the optic flow: The MATCH algorithm and prediction , 1983, Comput. Vis. Graph. Image Process..

[2]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  H. Nieman,et al.  Computing depth from stereo images by using optical flow , 1986 .

[6]  Hidetoshi Miike,et al.  Determining optical flow from sequential images , 1988, Systems and Computers in Japan.

[7]  Hidetoshi Miike,et al.  Exact determination of optical flow by pixel-based temporal mutual-correlation analysis , 1987 .

[8]  Hidetoshi Miike,et al.  Optical Flow Analysis Based on Spatio-Temporal Correlation of Dynamic Image , 1990, Systems and Computers in Japan.

[9]  HANS-HELLMUT NAGEL,et al.  On a Constraint Equation for the Estimation of Displacement Rates in Image Sequences , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Hidetoshi Miike,et al.  Velocity-Field Measurement by Pixel-Based Temporal Mutual-Correlation Analysis of Dynamic Image , 1986 .

[11]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Masahiko Yachida.  Determining velocity maps by spatio-temporal neighborhoods from image sequences , 1983, Comput. Vis. Graph. Image Process..

[13]  Kenichi Kanatani.  Tracing planar surface motion from a projection without knowing the correspondence , 1985, Comput. Vis. Graph. Image Process..

[14]  Hidetoshi Miike,et al.  Velocity-Field Measurement of a Vortex by Dynamic Image Processing , 1986 .

[15]  Allen M. Waxman,et al.  Dynamic Stereo: Passive Ranging to Moving Objects from Relative Image Flows , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ramakant Nevatia,et al.  Depth measurement by motion stereo , 1976 .

[17]  Katsuaki Onogi,et al.  Detectability of Optical Flow by Temporal Spatial Gradient Method and an Algorithm for 3-D Motion Estimation , 1988 .

[18]  T. D. Williams,et al.  Depth from camera motion in a real world scene , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.