Deep Intersection Classification Using First and Third Person Views

We explore the problem of intersection classification using monocular on-board passive vision, with the goal of classifying traffic scenes with respect to road topology. We divide the existing approaches into two broad categories according to the type of input data: (a) first person vision (FPV) approaches, which use an egocentric view sequence as the intersection is passed; and (b) third person vision (TPV) approaches, which use a single view immediately before entering the intersection. The FPV and TPV approaches each have advantages and disadvantages. Therefore, we aim to combine them into a unified deep learning framework. Experimental results show that the proposed FPV-TPV scheme outperforms previous methods and only requires minimal FPV/TPV measurements.

[1]  Sara McMains,et al.  Convolution neural network-based lane change intention prediction of surrounding vehicles for ACC , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Friedrich Kruber,et al.  An Unsupervised Random Forest Clustering Technique for Automatic Traffic Scenario Categorization , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[4]  Peter Ondruska,et al.  Predicting trajectories of vehicles using large-scale motion priors , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Ignacio Parra,et al.  Vehicle trajectory and lane change prediction using ANN and SVM classifiers , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[7]  Sen Wang,et al.  DeepVO: Towards end-to-end visual odometry with deep Recurrent Convolutional Neural Networks , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Charles Richter,et al.  Bayesian Learning for Safe High-Speed Navigation in Unknown Environments , 2015, ISRR.

[9]  Barbara Caputo,et al.  Learning Deep NBNN Representations for Robust Place Categorization , 2017, IEEE Robotics and Automation Letters.

[10]  Christoph Stiller,et al.  A Deep Analysis of the Existing Datasets for Traffic Light State Recognition , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[11]  Markus Maurer,et al.  Assessment of Deep Convolutional Neural Networks for Road Surface Classification , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[12]  Paul Newman,et al.  Inferring Road Boundaries Through and Despite Traffic , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[13]  Wei Zhan,et al.  A Framework for Probabilistic Generic Traffic Scene Prediction , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[14]  Barbara Caputo,et al.  Frustratingly Easy NBNN Domain Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Matthias Huber,et al.  HDTLR: A CNN based Hierarchical Detector for Traffic Lights , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[16]  Huijing Zhao,et al.  Multimodal information fusion for urban scene understanding , 2016, Machine Vision and Applications.

[17]  Chen Zhang,et al.  Multi-Scale Spatial Context Features Using 3-D Recurrent Neural Networks for Pedestrian Detection , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[18]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  K. Madhava Krishna,et al.  Towards View-Invariant Intersection Recognition from Videos using Deep Network Ensembles , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Klaus C. J. Dietmayer,et al.  Detecting Traffic Lights by Single Shot Detection , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[21]  Paul Newman,et al.  Semantic Classification of Road Markings from Geometric Primitives , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[22]  Klaus C. J. Dietmayer,et al.  Deep Convolutional Traffic Light Recognition for Automated Driving , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[23]  Paul Newman,et al.  Reading between the Lanes: Road Layout Reconstruction from Partially Segmented Scenes , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[24]  Ashish Bhaskar,et al.  Real-Time Joint Estimation of Traffic States and Parameters Using Cell Transmission Model and Considering Capacity Drop , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Kaige Zhang,et al.  Efficient Dense-Dilation Network for Pavement Cracks Detection with Large Input Image Size , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[27]  Tanaka Kanji.  Self-localization from Images with Small Overlap , 2016, IROS 2016.

[28]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[29]  Luc Van Gool,et al.  Segmentation-Based Urban Traffic Scene Understanding , 2009, BMVC.

[30]  Tanaka Kanji,et al.  Leveraging Object Proposals for Object-Level Change Detection , 2018 .

[31]  Martin Lauer,et al.  Momo: Monocular motion estimation on manifolds , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[32]  Torsten Bertram,et al.  A combined recognition and segmentation model for urban traffic scene understanding , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[33]  Luis Miguel Bergasa,et al.  Intersection Perception Through Real-Time Semantic Segmentation to Assist Navigation of Visually Impaired Pedestrians , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[34]  Baher Abdulhai,et al.  Travel Time Collection and Traffic Monitoring Via GPS Technologies , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[35]  Luc Van Gool,et al.  Dark Model Adaptation: Semantic Image Segmentation from Daytime to Nighttime , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[36]  Any Gupta,et al.  A Framework for Real-time Traffic Sign Detection and Recognition using Grassmann Manifolds , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[37]  K. Madhava Krishna,et al.  Have i reached the intersection: A deep learning-based approach for intersection detection from monocular cameras , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[38]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[39]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[40]  Hironobu Fujiyoshi,et al.  Pedestrian-Detection Method based on 1D-CNN during LiDAR Rotation , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[41]  Daisuke Deguchi,et al.  Attribute-aware Semantic Segmentation of Road Scenes for Understanding Pedestrian Orientations , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[42]  Martin Lauer,et al.  A Literature Review on the Prediction of Pedestrian Behavior in Urban Scenarios , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[43]  Martin Lauer,et al.  3D Traffic Scene Understanding From Movable Platforms , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Wolfgang Hübner,et al.  Particle-based Pedestrian Path Prediction using LSTM-MDL Models , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[46]  Gerd Wanielik,et al.  Neural network for lane change prediction assessing driving situation, driver behavior and vehicle movement , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[47]  Matthias Althoff,et al.  Set-Based Prediction of Pedestrians in Urban Environments Considering Formalized Traffic Rules , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[48]  Clemens Linnhoff,et al.  Multi-Session Visual Roadway Mapping , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[49]  Julian Eggert,et al.  Lane Detection Based Camera to Map Alignment Using Open-Source Map Data , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[50]  Johannes Fürnkranz,et al.  Time-to-lane-change prediction with deep learning , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).