On feature selection in network flow based traffic sign tracking models

Abstract We use the network flow based tracking model to process videos recorded by taxicabs to collect information, such as the locations and types, of traffic signs. One of the key questions in this type of tracking models is the feature selection problem, which determines the features and their associated weights to construct the costs on the edges of the underlying network. However, in existing studies, the features and their weights are set mostly by intuition and there are no studies that systematically investigate this problem. We investigate the feature selection problem by considering a wide range of features related to traffic sign candidates, including its position, size, frame index, color histogram, speed up robust feature (SURF) descriptors, and template matching similarities. We propose to use the multinomial logit model to identify features that have significant influence on the edge costs and to estimate their corresponding weights. We test the performance of our selected features using real videos recorded by taxicabs in the city of Beijing. We find that the position and frame index of the traffic sign candidates are the top two features that influence the tracking results. We also find that image similarity measures are helpful features, but their contribution is not as large as the previous two features.

[1]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[2]  Charless C. Fowlkes,et al.  Globally-optimal greedy algorithms for tracking a variable number of objects , 2011, CVPR 2011.

[3]  Andrew V. Goldberg,et al.  An efficient implementation of a scaling minimum-cost flow algorithm , 1993, IPCO.

[4]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Volker Eiselein,et al.  High-Speed tracking-by-detection without using image information , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[7]  K. Train Discrete Choice Methods with Simulation , 2003 .

[8]  Xiaolin Hu,et al.  Traffic sign detection based on convolutional neural networks , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[9]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[10]  Anton Kummert,et al.  3D Traffic Sign Tracking Using a Particle Filter , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[11]  Alan Fern,et al.  Discriminatively trained particle filters for complex multi-object tracking , 2009, CVPR.

[12]  Henry Y. K. Lau,et al.  An integrated flight scheduling and fleet assignment method based on a discrete choice model , 2016, Comput. Ind. Eng..

[13]  Konrad Schindler,et al.  Continuous Energy Minimization for Multitarget Tracking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Christophe Cudel,et al.  Multi-ROI Association and Tracking With Belief Functions: Application to Traffic Sign Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[15]  Qi Wang,et al.  An Incremental Framework for Video-Based Traffic Sign Detection, Tracking, and Recognition , 2017, IEEE Transactions on Intelligent Transportation Systems.

[16]  Robert T. Collins,et al.  Multi-target Tracking by Lagrangian Relaxation to Min-cost Network Flow , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Ramakant Nevatia,et al.  Tracking of Multiple, Partially Occluded Humans based on Static Body Part Detection , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Suliman A. Gargoum,et al.  Automated Highway Sign Extraction Using Lidar Data , 2017 .

[19]  Kai Xu,et al.  Multiple object tracking by multi-feature combination based on min-cost network flow , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[20]  Jiang Jun,et al.  Real-Time Detection and Tracking of Traffic Sign in Video Sequences for Autonomous Mobile Robot , 2012, 2012 Second International Conference on Intelligent System Design and Engineering Application.

[21]  Yang Xu,et al.  Dynamic decision making in mass customization , 2018, Comput. Ind. Eng..

[22]  Luc Van Gool,et al.  Multi-view traffic sign detection, recognition, and 3D localisation , 2014, Machine Vision and Applications.

[23]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[24]  Zhenyu He,et al.  One global optimization method in network flow model for multiple object tracking , 2015, Knowl. Based Syst..

[25]  Lesley Strawderman,et al.  An analysis of activity scheduling behavior of airport travelers , 2014, Comput. Ind. Eng..