The impact of intelligent transportation points system based on Elo rating on emergence of cooperation at Y intersection

The construction of intelligent transportation system is of great benefit to the efficiency, safety and fairness of urban residents’ travel. This paper focuses on a passing dilemma at Y intersection. An intelligent transportation points system (ITPS) based on Elo rating system is proposed to attempt to solve this dilemma. The drivers in the simulation system are given reinforcement learning ability based on Q-learning algorithm, by evaluating the benefits of each behavior. The conclusions are summarized as follows. For pure selfish drivers group, the application of ITPS has little impact on cooperation. For heterogeneous drivers group, the cooperation probability and passing efficiency of drivers can be improved by the regulation of the ITPS. Meantime, the fairness between drivers could be also maintained. It means that the application of ITPS can achieve the unity of fairness and efficiency. From a long-term perspective, the establishment of the ITPS will be a strong guarantee for the reciprocity of the travelers’ efficiency and fairness. Therefore, this study is conducive to the future construction of more perfect urban traffic intelligent system.

[1]  Inbal Nahum-Shani,et al.  Q-learning: a data analysis method for constructing adaptive interventions. , 2012, Psychological methods.

[2]  Jun Tanimoto,et al.  Fundamentals of Evolutionary Game Theory and its Applications , 2015 .

[3]  S. Haykin,et al.  A Q-learning-based dynamic channel assignment technique for mobile communication systems , 1999 .

[4]  Ye Ye,et al.  Evolution of emotions on networks leads to the evolution of cooperation in social dilemmas , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  P. Schmidt,et al.  Incentives, Morality, Or Habit? Predicting Students’ Car Use for University Routes With the Models of Ajzen, Schwartz, and Triandis , 2003 .

[6]  Antje Engelhardt,et al.  Assessing dominance hierarchies: validation and advantages of progressive evaluation with Elo-rating , 2011, Animal Behaviour.

[7]  C. Hauert,et al.  Volunteering as Red Queen Mechanism for Cooperation in Public Goods Games , 2002, Science.

[8]  Tao Wang,et al.  Behavioral evolution in evacuation crowd based on heterogeneous rationality of small groups , 2015, Appl. Math. Comput..

[9]  Jun Tanimoto,et al.  Evolutionary Games with Sociophysics: Analysis of Traffic Flow and Epidemics , 2018 .

[10]  S. Kokubo,et al.  Universal scaling for the dilemma strength in evolutionary games. , 2015, Physics of life reviews.

[11]  G. Williams,et al.  NATURAL SELECTION OF INDIVIDUALLY HARMFUL SOCIAL ADAPTATIONS AMONG SIBS WITH SPECIAL REFERENCE TO SOCIAL INSECTS , 1957 .

[12]  Jun Tanimoto,et al.  A study on emergence of alternating reciprocity in a 2 × 2 game with 2-length memory strategy , 2007, Biosyst..

[13]  Zengqiang Chen,et al.  Risk Analysis and Enhancement of Cooperation Yielded by the Individual Reputation in the Spatial Public Goods Game , 2017, IEEE Systems Journal.

[14]  D. Aldous.  Elo Ratings and the Sports Model: A Neglected Topic in Applied Probability? , 2017 .

[15]  Angela Di Febbraro,et al.  An agent-based framework for cooperative planning of intermodal freight transport chains , 2016 .

[16]  Yongjie Wang,et al.  Heuristics guide cooperative behaviors in public goods game , 2015 .

[17]  Jun Tanimoto,et al.  Relationship between dilemma occurrence and the existence of a weakly dominant strategy in a two-player symmetric game , 2007, Biosyst..

[18]  Linda Steg,et al.  Car use: lust and must. Instrumental, symbolic and affective motives for car use , 2005 .

[19]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[20]  Jun Tanimoto,et al.  What initially brought about communications? , 2008, Biosyst..

[21]  Georg Schreyögg,et al.  Organizational Path Dependence: Opening the Black Box , 2009 .

[22]  Juan Wang,et al.  Impact of individual difference and investment heterogeneity on the collective cooperation in the spatial public goods game , 2017, Knowl. Based Syst..

[23]  Susan L Handy,et al.  Driving by choice or necessity , 2005 .

[24]  Huijia Li,et al.  Punishment diminishes the benefits of network reciprocity in social dilemma experiments , 2017, Proceedings of the National Academy of Sciences.

[25]  M. Milinski,et al.  Volunteering leads to rock–paper–scissors dynamics in a public goods game , 2003, Nature.

[26]  Alvin E. Roth,et al.  A Choice Prediction Competition for Market Entry Games: An Introduction , 2010, Games.

[27]  Marie-Therese Wolfram,et al.  Boltzmann and Fokker–Planck Equations Modelling the Elo Rating System with Learning Effects , 2018, Journal of Nonlinear Science.

[28]  Omer Tatari,et al.  Modeling the effect of electric vehicle adoption on pedestrian traffic safety: An agent-based approach , 2018, Transportation Research Part C: Emerging Technologies.

[29]  Xiaoping Zheng,et al.  Effect of heterogeneous sub-populations on the evolution of cooperation , 2015, Appl. Math. Comput..

[30]  Pierre-Emmanuel Jabin,et al.  A Continuous Model For Ratings , 2015, SIAM J. Appl. Math..

[31]  Eran Ben-Elia,et al.  An agent-based model of the emergence of cooperation and a fair and stable system optimum using ATIS on a simple road network , 2018 .

[32]  M. Nowak,et al.  Evolution of indirect reciprocity , 2005, Nature.

[33]  Yongjie Wang,et al.  Publishing the donation list incompletely promotes the emergence of cooperation in public goods game , 2017, Appl. Math. Comput..

[34]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[35]  Han de Vries,et al.  Elo-rating as a tool in the sequential estimation of dominance strengths , 2001, Animal Behaviour.

[36]  Jun Tanimoto,et al.  Scaling the phase-planes of social dilemma strengths shows game-class changes in the five rules governing the evolution of cooperation , 2018, Royal Society Open Science.

[37]  E. Verhoef,et al.  Basic Economic Principles of Road Pricing: From Theory to Applications , 2006 .

[38]  Jun Tanimoto,et al.  Social dilemma structure hidden behind traffic flow with route selection , 2016 .

[39]  Yongjie Wang,et al.  Cleverly handling the donation information can promote cooperation in public goods game , 2019, Appl. Math. Comput..

[40]  R. Martin,et al.  Path dependence and regional economic evolution , 2006 .

[41]  Attila Szolnoki,et al.  Rewarding evolutionary fitness with links between populations promotes cooperation , 2014, Journal of theoretical biology.

[42]  R. Trivers.  The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[43]  Fengyin Li,et al.  A game-theoretic method based on Q-learning to invalidate criminal smart contracts , 2019, Inf. Sci..

[44]  W. Hamilton.  The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[45]  M. Perc,et al.  Self-organization of punishment in structured populations , 2012, 1203.6900.

[46]  Mei-huan Chen,et al.  Impact of individual response strategy on the spatial public goods game within mobile agents , 2015, Appl. Math. Comput..

[47]  A. Colman,et al.  Evolution of coordinated alternating reciprocity in repeated dyadic games. , 2004, Journal of theoretical biology.

[48]  Tong Chen,et al.  Emotional decisions in structured populations for the evolution of public cooperation , 2017 .

[49]  H. Ohtsuki,et al.  A simple rule for the evolution of cooperation on graphs and social networks , 2006, Nature.

[50]  Eran Ben-Elia,et al.  Emergence of cooperation in congested road networks using ICT and future and emerging technologies: A game-based review , 2016 .

[51]  Jun Tanimoto,et al.  Reciprocity phase in various 2 × 2 games by agents equipped with two-memory length strategy encouraged by grouping for interaction and adaptation , 2011, Biosyst..

[52]  Young-Jun Son,et al.  Two-level modeling framework for pedestrian route choice and walking behaviors , 2012, Simul. Model. Pract. Theory.

[53]  Eran Ben-Elia,et al.  Emergence of cooperation and a fair system optimum in road networks: A game-theoretic and agent-based modelling approach , 2017, Research in Transportation Economics.