Traffic Sensory Data Classification by Quantifying Scenario Complexity

For unmanned ground vehicle (UGV) off-line testing and performance evaluation, massive amount of traffic scenario data is often required. The annotations in current off-line traffic sensory dataset typically include I) types of roadways II) scene types III) specific characteristics that are generally considered challenging for cognitive algorithms. While such annotations are helpful in manual selection of data, they are insufficient for comprehensive and quantitate measurement of per-roadway-segment scenario complexity. To resolve such limitations, we propose a traffic sensory data classification paradigm based on quantifying the scenario complexity for each roadway segment, where such quantification is jointly based on road semantic complexity and traffic element complexity. The road semantic complexity is a proposed measurement of the complexity incurred by the static elements such as curvy roads, intersections, merges and splits, which is predicted with a Support Vector Regression (SVR). The traffic element complexity is a measurement of complexity due to dynamic traffic elements, such as nearby vehicles and pedestrians. Experimental results and a case study verify the efficacy of the proposed method.

[1]  Paul Newman,et al.  1 year, 1000 km: The Oxford RobotCar dataset , 2017, Int. J. Robotics Res..

[2]  Jian Li,et al.  Fast implementation of sparse iterative covariance-based estimation for array processing , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[3]  Shadi Banitaan,et al.  Support Vector Regression for Predicting the Enhancement Duration of Software Projects , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[4]  Nanning Zheng,et al.  The “floor-wall” traffic scenes construction for unmanned vehicle simulation evaluation , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Gang Hua,et al.  Attention-based Temporal Weighted Convolutional Neural Network for Action Recognition , 2018, AIAI.

[6]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[7]  Gang Hua,et al.  Multi-View Visual Recognition of Imperfect Testing Data , 2015, ACM Multimedia.

[8]  Chi Zhang,et al.  Autonomous Driving Simulation for Unmanned Vehicles , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[9]  Ashish Kapoor,et al.  AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles , 2017, FSR.

[10]  Sinisa Segvic,et al.  Experimental Evaluation of Autonomous Driving Based on Visual Memory and Image-Based Visual Servoing , 2011, IEEE Transactions on Intelligent Transportation Systems.

[11]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles. , 2016 .

[12]  Gang Hua,et al.  Auxiliary Training Information Assisted Visual Recognition , 2015, IPSJ Trans. Comput. Vis. Appl..

[13]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Silvio Savarese,et al.  Beyond PASCAL: A benchmark for 3D object detection in the wild , 2014, IEEE Winter Conference on Applications of Computer Vision.

[15]  Jie Huang,et al.  Video-based Sign Language Recognition without Temporal Segmentation , 2018, AAAI.

[16]  Jian Li,et al.  Iterative Sparse Asymptotic Minimum Variance Based Approaches for Array Processing , 2013, IEEE Transactions on Signal Processing.

[17]  Ming-Ting Sun,et al.  Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Li Li,et al.  Intelligence Testing for Autonomous Vehicles: A New Approach , 2016, IEEE Transactions on Intelligent Vehicles.

[19]  Yanning Zhang,et al.  Convolutional Neural Network-Based Robot Navigation Using Uncalibrated Spherical Images , 2017, Sensors.

[20]  Gang Hua,et al.  Can Visual Recognition Benefit from Auxiliary Information in Training? , 2014, ACCV.

[21]  Jian Li,et al.  Fast implementation of sparse iterative covariance-based estimation for source localization. , 2012, The Journal of the Acoustical Society of America.

[22]  Wei Wei,et al.  A Hyperspectral Image Classification Framework with Spatial Pixel Pair Features , 2017, Sensors.

[23]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Ding Zhao,et al.  Accelerated Evaluation of Automated Vehicles in Car-Following Maneuvers , 2016, IEEE Transactions on Intelligent Transportation Systems.

[25]  Chi Zhang,et al.  RoadView: A traffic scene simulator for autonomous vehicle simulation testing , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).