The MapReduce-based approach to improve vehicle controls on big traffic events

Recently, with the integration of Hadoop framework in the resolution of many related transportation problems, it has been show that the concept of parallel and distributed computing plays an important role in the management of large-scale traffic data. The advantages of Hadoop components allow intensive computing with huge volume of streaming data which cannot be processed by traditional Intelligent Transportation System (ITS). In this paper, we present a MapReduce-based approach to analyze big stream data in order to detect abnormal traffic events. Our approach consists in partitioning the big log file of traffic events into a set of sub-events then analyzing traffic events on each event block in parallel way. Experimental tests reveal that the proposed approach is very inspiring and achieves significant gain in term of calculation time.

[1]  Alain Biem,et al.  Real-Time Traffic Information Management using Stream Computing , 2010, IEEE Data Eng. Bull..

[2]  Lu Xiong,et al.  The Research of Dynamic Shortest Path Based on Cloud Computing , 2016, 2016 12th International Conference on Computational Intelligence and Security (CIS).

[3]  R. Kitchin The real-time city? Big data and smart urbanism , 2013 .

[4]  Xuesong Zhou,et al.  Traffic zone division based on big data from mobile phone base stations , 2015 .

[5]  GhemawatSanjay,et al.  The Google file system , 2003 .

[6]  Marta C. González,et al.  The path most traveled: Travel demand estimation using big data resources , 2015, Transportation Research Part C: Emerging Technologies.

[7]  Li Li,et al.  Robust causal dependence mining in big data network and its application to traffic flow predictions , 2015 .

[8]  Rob Kitchin,et al.  The automatic management of drivers and driving spaces , 2007 .

[9]  Alain Biem,et al.  IBM infosphere streams for scalable, real-time, intelligent transportation services , 2010, SIGMOD Conference.

[10]  Eric Bouillet,et al.  Scalable, Real-Time Map-Matching Using IBM's System S , 2010, 2010 Eleventh International Conference on Mobile Data Management.

[11]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[12]  Qi Shi,et al.  Big Data applications in real-time traffic operation and safety monitoring and improvement on urban expressways , 2015 .

[13]  Jinwei Hao,et al.  The rise of big data on urban studies and planning practices in China: Review and open research issues , 2015 .

[14]  Freddy Lécué,et al.  Smart traffic analytics in the semantic web with STAR-CITY: Scenarios, system and lessons learned in Dublin City , 2014, J. Web Semant..