Optical flow object detection, motion estimation, and tracking on moving vehicles using wavelet decompositions

Optical flow-based tracking methods offer the promise of precise, accurate, and reliable analysis of motion, but they suffer from several challenges such as elimination of background movement, estimation of flow velocity, and optimal feature selection. Wavelet approximations can offer similar benefits and retain spatial information at coarser scales, while optical flow estimation increases with the reduction of finer details of moving objects. Optical flow methods often suffer from significant computational overload. In this study, we have investigated the necessary processing steps to increase detection and estimation accuracy, while effectively reducing computation time through the reduction of the image frame size. We have implemented an object tracking algorithm using the optical flow calculated from a phase change between representative coarse wavelet coefficients in subsequent image frames. We have also compared phasebased optical flow with two versions of intensity-based optical flow to determine which method produces superior results under specific operational conditions. The investigation demonstrates the feasibility of using phase-based optical flow with wavelet approximations for object detection and tracking of low resolution aerial vehicles. We also demonstrate that this method can work in tandem with feature-based tracking methods to increase tracking accuracy.

[1]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  S. Mallat A wavelet tour of signal processing , 1998 .

[4]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[6]  Jae S. Lim,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[7]  Marc M. Van Hulle,et al.  A phase-based approach to the estimation of the optical flow field using spatial filtering , 2002, IEEE Trans. Neural Networks.

[8]  Marc M. Van Hulle A goal programming network for linear programming , 2004, Biological Cybernetics.

[9]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[10]  Ja-Chen Lin,et al.  Wavelet-based optical flow estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[11]  SchmidCordelia,et al.  A Performance Evaluation of Local Descriptors , 2005 .

[12]  Mohan Malkani,et al.  A novel method for real-time multiple moving targets detection from moving IR camera , 2008, 2008 19th International Conference on Pattern Recognition.

[13]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[15]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[16]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[17]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[18]  Alan S. Willsky,et al.  Multiscale appoaches to moving target detection in image sequences , 1994 .

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[20]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..