Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications

In this paper we define a complete framework for processing large image sequences for a global monitoring of short range oceanographic and atmospheric processes. This framework is based on the use of a non quadratic regularization technique for optical flow computation that preserves flow discontinuities. We also show that using an appropriate tessellation of the image according to an estimate of the motion field can improve optical flow accuracy and yields more reliable flows. This method defines a non uniform multiresolution approach for coarse to fine grid generation. It allows to locally increase the resolution of the grid according to the studied problem. Each added node refines the grid in a region of interest and increases the numerical accuracy of the solution in this region. We make use of such a method for solving the optical flow equation with a non quadratic regularization scheme allowing the computation of optical flow field while preserving its discontinuities. The second part of the paper deals with the interpretation of the obtained displacement field. For this purpose a phase portrait model used along with a new formulation of the approximation of an oriented flow field allowing to consider arbitrary polynomial phase portrait models for characterizing salient flow features. This new framework is used for processing oceanographic and atmospheric image sequences and presents an alternative to complex physical modeling techniques.

[1]  Richard Szeliski,et al.  Motion Estimation with Quadtree Splines , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Max A. Viergever,et al.  Nonlinear diffusion of scalar images using well-posed differential operators , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ramesh C. Jain,et al.  Vector field analysis for oriented patterns , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  J. B. Rosen The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints , 1960 .

[6]  J. W. Eastwood,et al.  Springer series in computational physics Editors: H. Cabannes, M. Holt, H.B. Keller, J. Killeen and S.A. Orszag , 1984 .

[7]  M. Chipot Finite Element Methods for Elliptic Problems , 2000 .

[8]  Isabelle Herlin,et al.  Temporal Tracking With Implicit Templates , 1995 .

[9]  Isabelle Herlin,et al.  Tracking highly deformable structures: a surface model applied to vortex evolution within satellite oceanographic images , 1995, Remote Sensing.

[10]  Hans-Hellmut Nagel,et al.  Optical Flow Estimation: Advances and Comparisons , 1994, ECCV.

[11]  Ramesh C. Jain,et al.  Computerized Flow Field Analysis: Oriented Texture Fields , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[13]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Isabelle Herlin,et al.  Non uniform multiresolution method for optical flow computation , 1996 .

[15]  Demetri Terzopoulos,et al.  Adaptive meshes and shells: irregular triangulation, discontinuities, and hierarchical subdivision , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  J. B. Rosen The gradient projection method for nonlinear programming: Part II , 1961 .

[17]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[18]  Isabelle Herlin,et al.  Optical Flow and Phase Portrait Methods for Environmental Satellite Image Sequences , 1996, ECCV.

[19]  Christoph Schnörr,et al.  Computation of discontinuous optical flow by domain decomposition and shape optimization , 1992, International Journal of Computer Vision.

[20]  David J. Fleet,et al.  Performance of optical flow techniques , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Ramesh C. Jain,et al.  Vector Field Analysis for Oriented Patterns , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Viktor Vladimirovich Nemytskii Qualitative theory of differential equations , 1960 .

[23]  Robin N. Strickland,et al.  Nonlinear phase portrait models for oriented textures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Isabelle Herlin,et al.  Image Processing for Sequences of Oceanographic Images , 1996 .

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  Isabelle Herlin,et al.  Curves matching using geodesic paths , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[27]  P. Anandan,et al.  Adaptive-complexity registration of images , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Michal Irani,et al.  Detecting and Tracking Multiple Moving Objects Using Temporal Integration , 1992, ECCV.

[29]  Patrick Pérez,et al.  A multigrid approach for hierarchical motion estimation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[30]  Gene H. Golub,et al.  Matrix computations , 1983 .

[31]  Solomon Lefschetz,et al.  Differential Equations: Geometric Theory , 1958 .

[32]  Thomas S. Huang,et al.  Salient structure analysis of fluid flow , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Kaleem Siddiqi,et al.  Geometric heat equation and nonlinear diffusion of shapes and images , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[34]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[35]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[36]  R. Glowinski,et al.  Numerical Methods for Nonlinear Variational Problems , 1985 .

[37]  Michael J. Black,et al.  Robust dynamic motion estimation over time , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Bruce A. Thomas,et al.  Image Models for 2-D Flow Visualization and Compression , 1994, CVGIP Graph. Model. Image Process..

[39]  RaoA. Ravishankar,et al.  Computerized Flow Field Analysis , 1992 .

[40]  Isabelle Herlin,et al.  Tracking meteorological structures through curves matching using geodesic paths , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[41]  Michael J. Black Recursive Non-Linear Estimation of Discontinuous Flow Fields , 1994, ECCV.

[42]  Tomaso A. Poggio,et al.  Motion Field and Optical Flow: Qualitative Properties , 1989, IEEE Trans. Pattern Anal. Mach. Intell..