Motion Estimation Using a General Purpose Neural Network Simulator for Visual Attention

Motion detection and estimation is a first step in the much larger framework of attending to visual motion based on Selective Tuning Model of Visual Attention (Tsotsos, et al., 2002). In order to be able to detect and estimate complex motion in a hierarchical system it is necessary to use robust and efficient methods which encapsulate as much information as possible about the motion together with a measure of reliability of that information. One such method is the orientation tensor formalism which incorporates a confidence measure that propagates into subsequent processing steps. The tensor method is implemented in a neural network simulator which allows distributed processing and visualization of results. As output we obtain information about the moving objects from the scene

[1]  Hans Knutsson,et al.  Signal processing for computer vision , 1994 .

[2]  H. Spies,et al.  Accurate optical flow in noisy image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Hanno Scharr,et al.  Study of Dynamical Processes with Tensor-Based Spatiotemporal Image Processing Techniques , 1998, ECCV.

[4]  G. Granlund,et al.  Estimation of velocity, acceleration and disparity in time sequences , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[5]  Gösta H. Granlund,et al.  The complexity of vision , 1999, Signal Process..

[6]  John K. Tsotsos,et al.  TarzaNN: A General Purpose Neural Network Simulator for Visual Attention Modeling , 2004, WAPCV.

[7]  H. Knutsson,et al.  Advanced Filter Design , 1999 .

[8]  S. Lippman,et al.  The Scripps Institution of Oceanography , 1959, Nature.

[9]  John K. Tsotsos,et al.  Attending to visual motion , 2005, Comput. Vis. Image Underst..

[10]  Carl-Fredrik Westin,et al.  Estimation of motion vector fields using tensor field filtering , 1994, Proceedings of 1st International Conference on Image Processing.

[11]  John K. Tsotsos,et al.  Attending to Motion: Localizing and Classifying Motion Patterns in Image Sequences , 2002, Biologically Motivated Computer Vision.

[12]  G. Granlund In search of a general picture processing operator , 1978 .

[13]  H. Knutsson Representing Local Structure Using Tensors , 1989 .

[14]  John K. Tsotsos,et al.  Attention and Performance in Computational Vision , 2008 .

[15]  Hans Knutsson,et al.  Uncertainty and inference in the visual system , 1988, IEEE Trans. Syst. Man Cybern..

[16]  David J. Fleet,et al.  Performance of optical flow techniques , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  H. Knutsson,et al.  Sequential Filter Trees for Efficient 2D 3D and 4D Orientation Estimation , 1998 .