Adaptive Structure Tensors and their Applications

The structure tensor, also known as second moment matrix or Forstner interest operator, is a very popular tool in image processing. Its purpose is the estimation of orientation and the local analysis of structure in general. It is based on the integration of data from a local neighborhood. Normally, this neighborhood is defined by a Gaussian window function and the structure tensor is computed by the weighted sum within this window. Some recently proposed methods, however, adapt the computation of the structure tensor to the image data. There are several ways how to do that. This chapter wants to give an overview of the different approaches, whereas the focus lies on the methods based on robust statistics and nonlinear diffusion. Furthermore, the data-adaptive structure tensors are evaluated in some applications. Here the main focus lies on optic flow estimation, but also texture analysis and corner detection are considered.

[1]  Hagen Spies,et al.  Motion , 2000, Computer Vision and Applications.

[2]  Rachid Deriche,et al.  Unsupervised Segmentation Incorporating Colour, Texture, and Motion , 2003, CAIP.

[3]  Bernd Neumann,et al.  Computer Vision — ECCV’98 , 1998, Lecture Notes in Computer Science.

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  Bernd Jähne,et al.  Spatio-Temporal Image Processing , 1993, Lecture Notes in Computer Science.

[6]  Ullrich Köthe,et al.  Edge and Junction Detection with an Improved Structure Tensor , 2003, DAGM-Symposium.

[7]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[8]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[9]  Tony Lindeberg,et al.  Shape from texture from a multi-scale perspective , 1993, 1993 (4th) International Conference on Computer Vision.

[10]  P. Mrázek,et al.  ON ROBUST ESTIMATION AND SMOOTHING WITH SPATIAL AND TONAL KERNELS , 2006 .

[11]  S. Eiho,et al.  Processing of RI-Angiocardiographic Images , 1976 .

[12]  Hans-Hellmut Nagel,et al.  Spatiotemporally Adaptive Estimation and Segmenation of OF-Fields , 1998, ECCV.

[13]  Hans-Hellmut Nagel,et al.  Empirically Convergent Adaptive Estimation of Grayvalue Structure Tensors , 2002, DAGM-Symposium.

[14]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[15]  Lucas J. van Vliet,et al.  Edge preserving orientation adaptive filtering , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Rachid Deriche,et al.  Active unsupervised texture segmentation on a diffusion based feature space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  A. R. Rao,et al.  Computing oriented texture fields , 1989, CVPR 1989.

[18]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[19]  Ingo P. Thomas.  Anisotropic Adaption and Structure Detection , 1999 .

[20]  Hans-Hellmut Nagel,et al.  Estimation and Interpretation of Discontinuities in Optical Flow Fields , 2001, ICCV.

[21]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[22]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[23]  Joachim Weickert,et al.  Coherence-enhancing diffusion of colour images , 1999, Image Vis. Comput..

[24]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[25]  Thomas Brox,et al.  Nonlinear structure tensors , 2006, Image Vis. Comput..

[26]  Joost van de Weijer,et al.  Robust Estimation of Orientation for Texture Analysis , 2002 .

[27]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[28]  R. Boomgaard,et al.  Decomposition of the Kuwahara-Nagao Operator in terms of Linear Smoothing and Morphological Sharpening , 2002 .

[29]  M. Nagao,et al.  Edge preserving smoothing , 1979 .

[30]  Rachid Deriche,et al.  Diffusion tensor regularization with constraints preservation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[31]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[32]  Karl Rohr,et al.  Localization properties of direct corner detectors , 1994, Journal of Mathematical Imaging and Vision.

[33]  V. Caselles,et al.  Minimizing total variation flow , 2000, Differential and Integral Equations.

[34]  T. Brox,et al.  Diffusion and regularization of vector- and matrix-valued images , 2002 .

[35]  Bernd Jähne,et al.  Signal processing and pattern recognition , 1999 .

[36]  Johan Wiklund,et al.  Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[38]  Karl Rohr,et al.  Modelling and identification of characteristic intensity variations , 1992, Image Vis. Comput..

[39]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[41]  Otmar Scherzer,et al.  Inverse Problems, Image Analysis, and Medical Imaging , 2002 .