Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow

The problem of detection of orientation in finite dimensional Euclidean spaces is solved in the least squares sense. The theory is developed for the case when such orientation computations are necessary at all local neighborhoods of the n-dimensional Euclidean space. Detection of orientation is shown to correspond to fitting an axis or a plane to the Fourier transform of an n-dimensional structure. The solution of this problem is related to the solution of a well-known matrix eigenvalue problem. The computations can be performed in the spatial domain without actually doing a Fourier transformation. Along with the orientation estimate, a certainty measure, based on the error of the fit, is proposed. Two applications in image analysis are considered: texture segmentation and optical flow. The theory is verified by experiments which confirm accurate orientation estimates and reliable certainty measures in the presence of noise. The comparative results indicate that the theory produces algorithms computing robust texture features as well as optical flow. >

[1]  E. Wigner On the quantum correction for thermodynamic equilibrium , 1932 .

[2]  Dennis Gabor,et al.  Theory of communication , 1946 .

[3]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[4]  W Reichardt,et al.  Autocorrelation, a principle for evaluation of sensory information by the central nervous system , 1961 .

[5]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[6]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[7]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[8]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[9]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[10]  Theodosios Pavlidis,et al.  A hierarchical data structure for picture processing , 1975 .

[11]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of striate cortical neurones , 1975, Nature.

[12]  Ruzena Bajcsy,et al.  Texture gradient as a depth cue , 1976 .

[13]  A. Papoulis Signal Analysis , 1977 .

[14]  G. Granlund In search of a general picture processing operator , 1978 .

[15]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[16]  Arthur Wouk,et al.  A course of applied functional analysis , 1979 .

[17]  D H Hubel,et al.  Brain mechanisms of vision. , 1979, Scientific American.

[18]  Robert A. Hummel,et al.  Feature detection using basis functions , 1979 .

[19]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[20]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[21]  Edward H. Adelson,et al.  Phenomenal coherence of moving gratings (A) , 1980 .

[22]  K. Laws Textured Image Segmentation , 1980 .

[23]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[24]  P. Burt Fast filter transform for image processing , 1981 .

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[27]  Andrew B. Watson,et al.  Detection and Recognition of Simple Spatial Forms , 1983 .

[28]  Dan E. Dudgeon,et al.  Multidimensional Digital Signal Processing , 1983 .

[29]  John Daugman,et al.  Six formal properties of two-dimensional anisotropie visual filters: Structural principles and frequency/orientation selectivity , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Richard M. Stern,et al.  Fast Computation of the Difference of Low-Pass Transform , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[33]  Hans Knutsson,et al.  Filtering and reconstruction in image processing , 1984 .

[34]  Michael Spann,et al.  A quad-tree approach to image segmentation which combines statistical and spatial information , 1985, Pattern Recognit..

[35]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[36]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[37]  P. Anandan,et al.  Computing Dense Displacement Fields With Confidence Measures In Scenes Containing Occlusion , 1985, Other Conferences.

[38]  M. Unser Local linear transforms for texture measurements , 1986 .

[39]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[40]  Ishwar K. Sethi,et al.  Finding Trajectories of Feature Points in a Monocular Image Sequence , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Narendra Ahuja,et al.  3-D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  J. Bigun,et al.  Optimal Orientation Detection of Linear Symmetry , 1987, ICCV 1987.

[43]  David J. Heeger,et al.  Optical flow from spatialtemporal filters , 1987 .

[44]  Peter J. Burt,et al.  Smart sensing within a pyramid vision machine , 1988, Proc. IEEE.

[45]  O. Faugeras,et al.  A preliminary investigation of the problem of determining ego- and object motions from stereo , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[46]  J. Bigun Recognition of local symmetries in gray value images by harmonic functions , 1988 .

[47]  Michael Unser,et al.  Multiresolution Feature Extraction and Selection for Texture Segmentation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  David J. Fleet,et al.  Hierarchical Construction of Orientation and Velocity Selective Filters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  M. Porat,et al.  Localized texture processing in vision: analysis and synthesis in the Gaborian space , 1989, IEEE Transactions on Biomedical Engineering.

[50]  Bernd Jähne Motion Determination in Space-Time Images , 1990, ECCV.

[51]  J. Bigun A structure feature for some image processing applications based on spiral functions , 1990 .

[52]  Richard Szeliski,et al.  Fast Surface Interpolation Using Hierarchical Basis Functions , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  O. Axelsson,et al.  Finite element solution of boundary value problemes - theory and computation , 2001, Classics in applied mathematics.