Multi-modal identification and tracking of vehicles in partially observed environments

High-quality positioning is of fundamental importance for an increasing variety of advanced driver assistance systems. GNSS-based systems are predominant outdoors but usually fail in enclosed areas where a direct line-of-sight to satellites is unavailable. For those scenarios, external infrastructure-based positioning systems are a promising alternative. However, external position detections have no identity information as they may belong to any object, i.e. they are anonymous. Moreover, the area covered by external sensors may contain gaps where objects cannot be observed leading to a correspondence problem between multiple detections and actual objects. We present a global tracking-by-identification approach as extension to existing local trackers that uses odometry sensor data of vehicles to find the corresponding subset of external detections. Thus, our approach enables the assignment of anonymous external detections to a specific vehicular endpoint and the estimation of its current position without requiring an initial location. The problem is decomposed resulting in a two step approach. The first algorithm determines possible track segment combinations which are used as track hypotheses. The track hypothesis generation algorithm considers spatio-temporal relationships between track segments, thus avoiding exponentially growing complexity inherent to data association problems. The second algorithm compares track hypotheses to the relative vehicle trajectory using pseudo-distance correlation metrics. In a detailed evaluation, we demonstrate that the proposed approach is able to reliably perform global tracking and identification of camera-observed vehicles in real-time, despite relatively large coverage gaps of the external sensors.

[1]  Andrea F. Cattoni,et al.  Video-radio fusion approach for target tracking in smart spaces , 2007, 2007 10th International Conference on Information Fusion.

[2]  M. DeCecco Sensor fusion of inertial-odometric navigation as a function of the actual manoeuvres of autonomous guided vehicles , 2003 .

[3]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[4]  Magnus Egerstedt,et al.  Autonomous driving in urban environments: approaches, lessons and challenges , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[5]  Janne Haverinen,et al.  Global indoor self-localization based on the ambient magnetic field , 2009, Robotics Auton. Syst..

[6]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[7]  Alois Knoll,et al.  Towards autonomous driving in a parking garage: Vehicle localization and tracking using environment-embedded LIDAR sensors , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[8]  Andreas Savvides,et al.  Towards Cooperative Localization of Wearable Sensors using Accelerometers and Cameras , 2010, 2010 Proceedings IEEE INFOCOM.

[9]  Cheng Chen,et al.  Low cost IMU based indoor mobile robot navigation with the assist of odometry and Wi-Fi using dynamic constraints , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[10]  Sebastian Tilch,et al.  Survey of optical indoor positioning systems , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[11]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[12]  Berthe Y. Choueiry,et al.  An Algorithm for Generating All Connected Subgraphs with k Vertices of a Graph , 2013 .

[13]  Ilja Radusch,et al.  Identification of vehicle tracks and association to wireless endpoints by multiple sensor modalities , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[14]  Ilja Radusch,et al.  External visual positioning system for enclosed carparks , 2014, 2014 11th Workshop on Positioning, Navigation and Communication (WPNC).

[15]  Liqiang Feng,et al.  Gyrodometry: a new method for combining data from gyros and odometry in mobile robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[16]  Ruzena Bajcsy,et al.  Linking Computer Vision with Off-the-Shelf Accelerometry through Kinetic Energy for Precise Localization , 2011, 2011 IEEE Fifth International Conference on Semantic Computing.

[17]  M. Wing,et al.  Consumer-Grade Global Positioning System (GPS) Accuracy and Reliability , 2005 .

[18]  R. Mautz Indoor Positioning Technologies , 2012 .

[19]  Marc Schlipsing,et al.  Towards highly automated driving in a parking garage: General object localization and tracking using an environment-embedded camera system , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[20]  Matej Kristan,et al.  Fusion of non-visual modalities into the Probabilistic Occupancy Map framework for person localization , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[21]  Gi-Wan Yoon,et al.  Building a Practical Wi-Fi-Based Indoor Navigation System , 2014, IEEE Pervasive Computing.