Coupled multi-object tracking and labeling for vehicle trajectory estimation and matching

Efficient detection and tracking of moving objects in real life conditions is a very challenging research issue, mainly due to occlusions, illumination variations, appearance (disappearance) of new (existing) objects and overlapping issues. In this paper, we address these difficulties by incorporating non-linear and recursive identification mechanisms in motion-based detection and tracking algorithms. Non-linearity allows correct identification of object of complex visual properties while the adaptability makes the proposed scheme able to update its behaviour to the dynamic environmental changes. In addition, in this paper, we introduce the concept of polar spectrum which is a measure for determining the deviation of a vehicle trajectory from an ideal trace. The proposed methods (object tracking and trajectory matching) are applied in survey engineering problems dealing with safe design road turns. In particular, the automatically detected trajectory of a moving vehicle is compared with the ideal trace, through the polar spectrum measure, to determine the safety of a road turn. This trace is also compared with the one manually derived using photogrammetric algorithms and a small error is obtained verifying the efficiency of the method.

[1]  Zhisheng You,et al.  A Real-time Vision-based Vehicle Tracking and Traffic Surveillance , 2007, Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007).

[2]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[3]  Stefanos D. Kollias,et al.  An adaptable neural-network model for recursive nonlinear traffic prediction and modeling of MPEG video sources , 2003, IEEE Trans. Neural Networks.

[4]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[5]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[6]  C. Patrikakis,et al.  Real-time context-aware and personalized media streaming environments for large scale broadcasting applications My-e-Director 2012 , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[7]  John R. Smith,et al.  Real-time video surveillance for traffic monitoring using virtual line analysis , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[8]  You Zhi-sheng,et al.  A Real-time Vision-based Vehicle Tracking and Traffic Surveillance , 2007 .

[9]  Manuele Bicego,et al.  Audio-Visual Event Recognition in Surveillance Video Sequences , 2007, IEEE Transactions on Multimedia.

[10]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[11]  Dong Xu,et al.  An Introduction to the Special Issue on Event Analysis in Videos , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[13]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[14]  Luc Van Gool,et al.  Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yu-Feng Lin,et al.  Intelligent Vehicle Counting Method Based on Blob Analysis in Traffic Surveillance , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[16]  Petros Maragos,et al.  Generalized multiscale connected operators with applications to granulometric image analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[17]  Geoffrey D. Sullivan,et al.  Model-based vehicle detection and classification using orthographic approximations , 1997, Image Vis. Comput..

[18]  Andreas Georgopoulos,et al.  Angle spectrum for estimation of trajectory deviation using combined tracking and neural network labeling , 2008, AREA '08.

[19]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[20]  Noel E. O'Connor,et al.  Event detection in field sports video using audio-visual features and a support vector Machine , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[22]  Kuo-Chin Fan,et al.  Real-time traffic parameter extraction using entropy , 2004 .

[23]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..