High-speed target tracking by fuzzy hostility-induced segmentation of optical flow field

A time efficient technique for real-time tracking of high-speed objects in a video sequence is presented in this article. The technique is primarily based on the segmentation of the optical flow field computed between the successive image frames of a video sequence, followed by the tracking of a detected point of interest (POI) within the segmented flow field. In the initial phase of the technique, the optical flow field between the first two successive image frames acquired from a video sequence, is computed. A fuzzy hostility index indicative of the degree of coherence of the moving objects in the image frames, is used to segment the optical flow field. This yields different coherent regions of interest (ROIs) in the segmented flow field. A POI is then detected in the different ROIs obtained. Tracking of the moving object is then carried out by computing the flow fields between predefined ROIs in the neighborhood of the detected POI in the subsequent image frames. Since the selected ROIs are smaller than the image frames, a fair amount of reduction in the time required for the computation of the optical flow field is achieved, thereby facilitating real-time operation. An application of the proposed technique is demonstrated on three video sequences of high-speed flying fighter aircrafts.

[1]  Tomaso A. Poggio,et al.  Motion Field and Optical Flow: Qualitative Properties , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Harry Wechsler,et al.  Derivation of optical flow using a spatiotemporal-Frequency approach , 1987, Comput. Vis. Graph. Image Process..

[3]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[5]  Ellen C Hildreth,et al.  Computing the velocity field along contours , 1986, Workshop on Motion.

[6]  J. Hadamard,et al.  Lectures on Cauchy's Problem in Linear Partial Differential Equations , 1924 .

[7]  Kathryn A. Kelly,et al.  An Inverse Model for Near-Surface Velocity from Infrared Images , 1989 .

[8]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[9]  Alessandro Verri,et al.  Computing optical flow from an overconstrained system of linear algebraic equations , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[10]  T. M. Chin,et al.  Sequential filtering for multi-frame visual reconstruction , 1992, Signal Process..

[11]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  P. Pérez,et al.  Parallel visual motion analysis using multiscale Markov random fields , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[13]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[14]  Richard Szeliski,et al.  Bayesian modeling of uncertainty in low-level vision , 2011, International Journal of Computer Vision.

[15]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[16]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[17]  Laurent D. Cohen,et al.  A finite element method applied to new active contour models and 3D reconstruction from cross sections , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[18]  A. Verri,et al.  A computational approach to motion perception , 1988, Biological Cybernetics.

[19]  Ujjwal Maulik,et al.  Binary object extraction using bi-directional self-organizing neural network (BDSONN) architecture with fuzzy context sensitive thresholding , 2007, Pattern Analysis and Applications.

[20]  Yuan-Fang Wang,et al.  Experiments in computing optical flow with the gradient-based, multiconstraint method , 1987, Pattern Recognit..

[21]  John K. Tsotsos,et al.  Motion: Representation and perception , 1986 .

[22]  Jerry L. Prince,et al.  Motion estimation from tagged MR image sequences , 1992, IEEE Trans. Medical Imaging.

[23]  Jesús Chamorro-Martínez,et al.  A New Approach to Motion Pattern Recognition and Its Application to Optical Flow Estimation , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Javier Díaz,et al.  FPGA-based real-time optical-flow system , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Gérard G. Medioni,et al.  Robust Estimation of Three-Dimensional Motion Parameters from a Sequence of Image Frames Using Regularization , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  F. Heitz,et al.  Parallel Relaxation Algorithms For The Statistical Analysis Of Visual Motion , 1991, Proceedings of the Seventh Workshop on Multidimensional Signal Processing.

[27]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[28]  Ajit Singh,et al.  An estimation-theoretic framework for image-flow computation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[29]  J. H. Duncan,et al.  On the Detection of Motion and the Computation of Optical Flow , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Alberto Del Bimbo,et al.  Analysis of optical flow constraints , 1995, IEEE Trans. Image Process..

[31]  HANS-HELLMUT NAGEL,et al.  On a Constraint Equation for the Estimation of Displacement Rates in Image Sequences , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Paolo Nesi,et al.  Variational approach to optical flow estimation managing discontinuities , 1993, Image Vis. Comput..

[33]  Andrea Giachetti,et al.  The use of optical flow for road navigation , 1998, IEEE Trans. Robotics Autom..

[34]  A. Verri,et al.  Differential techniques for optical flow , 1990 .

[35]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[36]  Guozhi Tao,et al.  Quantifying motion in video recordings of neonatal seizures by regularized optical flow methods , 2005, IEEE Transactions on Image Processing.

[37]  Vilém Novák,et al.  Fuzzy Set , 2009, Encyclopedia of Database Systems.

[38]  Robert J. Woodham Multiple light source optical flow , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[39]  Tzi-Dar Chiueh,et al.  An analog motion field detection chip for image segmentation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[40]  Yoshiaki Shirai,et al.  Segmentation and 2D motion estimation by region fragments , 1993, 1993 (4th) International Conference on Computer Vision.

[41]  M. Thoniiat SEGMENTATION OF OPTICAL FLOW AND 3D DATA FOR THE INTERPRETATION OF MOBILE OBJECTS , 1990 .

[42]  J. D. Robbins,et al.  Motion-compensated coding: Some new results , 1980, The Bell System Technical Journal.

[43]  Yoshiaki Shirai,et al.  Realtime multiple object tracking based on optical flows , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[44]  James H. Duncan,et al.  Temporal Edges: The Detection Of Motion And The Computation Of Optical Flow , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[45]  Amar Mitiche,et al.  Optical Flow 3D Segmentation and Interpretation: A Variational Method with Active Curve Evolution and Level Sets , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Alberto Del Bimbo,et al.  A Robust Algorithm for Optical Flow Estimation , 1995, Comput. Vis. Image Underst..