A Distributed Approach of Accompany Vehicle Discovery

Accompany vehicle discovery is a hot topic in criminal investigation department with regard to massive vehicle data retrieval. In this paper, we study accompany vehicle discovery from traffic monitor plate recognition data. Existing methods are inefficient to query accompany vehicle. To address the problem, we propose a distributed algorithm to find accompany vehicle pair using sliding window algorithm with new prune strategies. We first load traffic monitor plate recognition data into memory by Spark, get candidate vehicle’s upper bound of statistical data to prune invalidate candidates of vehicle and perform verification on these candidates to get final results. We devise some new prune strategies to find high quality candidates. Experiments with real Traffic Monitor Plate Recognition (TMPR) data in a distributed environment verify that our distributed approach can discover accompany vehicles efficiency. We also analyze the performance affecting factors from the experiments.

[1]  Michael D. Ernst,et al.  HaLoop , 2010, Proc. VLDB Endow..

[2]  Christian S. Jensen,et al.  Discovery of convoys in trajectory databases , 2008, Proc. VLDB Endow..

[3]  Jin Soung Yoo,et al.  A Parallel Spatial Co-location Mining Algorithm Based on MapReduce , 2014, 2014 IEEE International Congress on Big Data.

[4]  Jiawei Han,et al.  Swarm: Mining Relaxed Temporal Moving Object Clusters , 2010, Proc. VLDB Endow..

[5]  Yanbo Han,et al.  Instant Discovery of Moment Companion Vehicles from Big Streaming Traffic Data , 2015, 2015 International Conference on Cloud Computing and Big Data (CCBD).

[6]  Yuan Yu,et al.  Dryad: distributed data-parallel programs from sequential building blocks , 2007, EuroSys '07.

[7]  Howard Gobioff,et al.  The Google file system , 2003, SOSP '03.

[8]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[9]  Ion Stoica,et al.  G-OLA: Generalized On-Line Aggregation for Interactive Analysis on Big Data , 2015, SIGMOD Conference.

[10]  Nicholas Jing Yuan,et al.  On discovery of gathering patterns from trajectories , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[11]  Panos Kalnis,et al.  On Discovering Moving Clusters in Spatio-temporal Data , 2005, SSTD.

[12]  Joachim Gudmundsson,et al.  Computing longest duration flocks in trajectory data , 2006, GIS '06.

[13]  Jing Yuan,et al.  A framework of traveling companion discovery on trajectory data streams , 2013, ACM Trans. Intell. Syst. Technol..

[14]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[15]  Joseph K. Bradley,et al.  Spark SQL: Relational Data Processing in Spark , 2015, SIGMOD Conference.

[16]  Hui Xiong,et al.  Introduction to special section on intelligent mobile knowledge discovery and management systems , 2013, ACM Trans. Intell. Syst. Technol..

[17]  Shashi Shekhar,et al.  A partial join approach for mining co-location patterns , 2004, GIS '04.

[18]  Junming Zhang,et al.  On Retrieving Moving Objects Gathering Patterns from Trajectory Data via Spatio-temporal Graph , 2014, 2014 IEEE International Congress on Big Data.

[19]  Joachim Gudmundsson,et al.  Reporting flock patterns , 2008, Comput. Geom..