A novel evidence based model for detecting dangerous situations in level crossing environments

Considered as a weak point in road and railway infrastructure, level crossings (LC) improvement safety became an important field of academic research and took increasingly railways undertakings concerns. Improving safety of people and road-rail facilities is an essential key element to ensure a good operating of the road and railway transport. For this purpose, road and railway safety professionals from several countries have been focused on providing level crossings as safer as possible. Many actions are planned in order to exchange information and provide experiments for improving the management of level crossing safety and performance. This paper aims to develop a video surveillance system to detect, recognize and evaluate potentially dangerous situations in level crossing environments. First, a set of moving objects are detected and separated using an automatic clustering process coupled to an energy vector comparison strategy. Then, a multi-object tracking algorithm, based on optical flow propagation and Kalman filtering correction with adaptive parameters, is implemented. The next step consists on using a Hidden Markov Model to predict trajectories of the detected objects. Finally, the trajectories are analysed with a particular credibility model to evaluate dangerous situations at level crossings. Real data sets are used to test the effectiveness and robustness of the method. This work is developed within the framework of PANsafer project, supported by the French work program ANR.

[1]  Alain Rakotomamonjy,et al.  A Pedestrian Detector Using Histograms of Oriented Gradients and a Support Vector Machine Classifier , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[2]  Daniel Gatica-Perez,et al.  Order Matters: A Distributed Sampling Method for Multi-Object Tracking , 2004, BMVC.

[3]  J. Kacprzyk,et al.  Advances in the Dempster-Shafer theory of evidence , 1994 .

[4]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[5]  Yassine Ruichek,et al.  Object tracking using Harris corner points based optical flow propagation and Kalman filter , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[6]  Dan Schonfeld,et al.  Automatic Object Trajectory-Based Motion Recognition Using Gaussian Mixture Models , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[7]  Dan Schonfeld,et al.  Object Trajectory-Based Activity Classification and Recognition Using Hidden Markov Models , 2007, IEEE Transactions on Image Processing.

[8]  Michael Isard,et al.  Object localization by Bayesian correlation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[10]  Ramakant Nevatia,et al.  Coupled Hidden Semi Markov Models for Activity Recognition , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[11]  L. Baum,et al.  Growth transformations for functions on manifolds. , 1968 .

[12]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  David J. Fleet,et al.  Hybrid Monte Carlo filtering: edge-based people tracking , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[14]  Svetha Venkatesh,et al.  Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Yassine Ruichek,et al.  Gaussian Propagation Model Based Dense Optical Flow for Objects Tracking , 2012, ICIAR.

[16]  Jean-Luc Bruyelle,et al.  Background subtraction and 3D localization of moving and stationary obstacles at level crossings , 2010, 2010 2nd International Conference on Image Processing Theory, Tools and Applications.

[17]  Kenji Suzuki,et al.  Linear-time connected-component labeling based on sequential local operations , 2003, Comput. Vis. Image Underst..

[18]  Alexandre R. J. François.  Real-Time Multi-Resolution Blob Tracking , 2004 .

[19]  A. Enis Çetin,et al.  Moving object detection in wavelet compressed video , 2005, Signal Process. Image Commun..

[20]  Thiagalingam Kirubarajan,et al.  Data association combined with the probability hypothesis density filter for multitarget tracking , 2004, SPIE Defense + Commercial Sensing.

[21]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[23]  Taiyi Zhang,et al.  Object tracking using an adaptive Kalman filter combined with mean shift , 2010 .

[24]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2000, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  Larry S. Davis,et al.  Fast multiple object tracking via a hierarchical particle filter , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[26]  Niloofar Gheissari,et al.  Evaluation of Background Subtraction Methods , 2008, 2008 Digital Image Computing: Techniques and Applications.

[27]  Andrew Blake,et al.  Articulated body motion capture by annealed particle filtering , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[28]  Sukeshni N. Tamgade,et al.  Motion Vector Estimation of Video Image by Pyramidal Implementation of Lucas Kanade Optical Flow , 2009, 2009 Second International Conference on Emerging Trends in Engineering & Technology.

[29]  Chandra Shekhar,et al.  Moving Object Tracking Using Object Segmentation , 2010, ICT.

[30]  Didier Dubois,et al.  Possibility theory and statistical reasoning , 2006, Comput. Stat. Data Anal..