Evaluation of Synthetic Video Data in Machine Learning Approaches for Parking Space Classification

Most modern computer vision techniques rely on large amounts of meticulously annotated data for training and evaluation. In close-to-market development, this demand is even higher since numerous common and—more important—less common situations have to be tested and must hence be covered datawise. However, gathering the necessary amount of data ready-labeled for the task at hand is a challenge of its own. Depending on the complexity of the objective and the chosen approach, the required amount of data can be vast. At the same time, the effort to capture all possible cases of a given problem grows with their variability. This makes recording new video data unfeasible, even impossible at times. In this work, we regard parking space classification as an exemplary application to target the imbalance of cost and benefit w.r.t. image data creation for machine learning approaches. We rely on a fully-fledged park deck simulation created with Unreal Engine 4 for data creation and replace all conventionally recorded and hand-labeled training data by automatically-annotated synthetic video data. We train several of-the-shelf classifiers with a common choice of feature inputs on synthetic images only and evaluate them on two realworld sequences of different outdoor car parks. We reach a classification performance that matches our previous work on this task in which all classifiers were developed solely with real-life video data.

[1]  Marc Schlipsing,et al.  Comparing Image Features and Machine Learning Algorithms for Real-Time Parking Space Classification , 2013 .

[2]  Marc Tschentscher,et al.  A simulated car-park environment for the evaluation of video-based on-site parking guidance systems , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[3]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[4]  Jiri Matas,et al.  A system for real-time detection and tracking of vehicles from a single car-mounted camera , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[5]  Montasir Abbas,et al.  Using Game Engines for Designing Traffic Control Educational Games , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[6]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Kai Liu,et al.  The 3D-simulation implementation of parking guidance system , 2014, 2014 International Conference on Audio, Language and Image Processing.

[8]  Johannes Stallkamp,et al.  Detection of traffic signs in real-world images: The German traffic sign detection benchmark , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[9]  Cheng Chen,et al.  A Game-Engine-Based Platform for Modeling and Computing Artificial Transportation Systems , 2011, IEEE Transactions on Intelligent Transportation Systems.

[10]  Markus König,et al.  Scalable real-time parking lot classification: An evaluation of image features and supervised learning algorithms , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[11]  Marcelo L. Moreyra,et al.  The use of game engines and virtual models to build a simulator for Intelligent Transportation Systems , 2015, 2015 XVI Workshop on Information Processing and Control (RPIC).

[12]  Video-based Parking Space Detection : Localisation of Vehicles and Development of an Infrastructure for a Routeing System , 2015 .