Cooperative decentralized decision making for conflict resolution among autonomous agents

Autonomous agents plan their paths through known and unknown environments to reach their goals. When multiple autonomous agents share the same area, conflict situations may occur that need to be solved. We present a decentralized decision making algorithm to solve conflicts among autonomous agents. It is based on two main ideas: First, we introduce an innovative operationalization of cooperative behavior which allows to determine whether a behavior is cooperative by computing the total utility and comparing it to a reference utility. Second, we use motion primitives as a representation of available maneuvers obeying individual and environmental restrictions. The decentralized decision making algorithm is based on communication among the autonomous agents to find an optimal maneuver combination. Simulations show that our algorithm is applicable to different highway traffic scenarios of two automated vehicles. We use a mean-square acceleration as an individual cost function and show that our intelligent controller leads to cooperative solutions.

[1]  Kyounghwan An,et al.  Cooperative vehicle control system based on fusion map , 2012, 2012 7th International Conference on Computing and Convergence Technology (ICCCT).

[2]  Eric Feron,et al.  Decentralized Cooperative Trajectory Planning of Multiple Aircraft with Hard Safety Guarantees , 2004 .

[3]  H. A. Talebi,et al.  Robust cooperative control in the presence of obstacles , 2013, 2013 21st Iranian Conference on Electrical Engineering (ICEE).

[4]  I. Kaminer,et al.  Time-Critical Cooperative Control of Multiple Autonomous Vehicles: Robust Distributed Strategies for Path-Following Control and Time-Coordination over Dynamic Communications Networks , 2012, IEEE Control Systems.

[5]  Ryotaro Kamimura,et al.  Cooperation control and enhanced class structure in self-organizing maps , 2011, The 2011 International Joint Conference on Neural Networks.

[6]  Shi-Yuan Han,et al.  Decentralized Longitudinal Tracking Control for Cooperative Adaptive Cruise Control Systems in a Platoon , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[7]  E.J. Barth.  A Cooperative Control Structure for UAV~s Executing a Cooperative Ground Moving Target Engagement (CGMTE) Scenario , 2006, 2006 American Control Conference.

[8]  Philippe Fraisse,et al.  Remote decentralized control strategy for cooperative mobile robots , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[9]  Zheping Yan,et al.  Formation coordinated control for multi-AUV based on spatial curve path tracking , 2011, OCEANS'11 MTS/IEEE KONA.

[10]  Marco Bibuli,et al.  Cooperative robotic maneuvers for emergency ship towing operations , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[11]  Mohsen Guizani,et al.  Opportunistic Channel Selection Strategy for Better QoS in Cooperative Networks with Cognitive Radio Capabilities , 2008, IEEE Journal on Selected Areas in Communications.

[12]  Anil V. Rao,et al.  Optimal Control of an Underwater Sensor Network for Cooperative Target Tracking , 2009, IEEE Journal of Oceanic Engineering.

[13]  Matthias Althoff,et al.  Safety verification of autonomous vehicles for coordinated evasive maneuvers , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[14]  A. Aguiary,et al.  Cooperative Autonomous Marine Vehicle motion control in the scope of the EU GREX Project: Theory and Practice , 2009, OCEANS 2009-EUROPE.

[15]  C. Laurgeau,et al.  An analysis of the lane changing manoeuvre on roads : the contribution of inter-vehicle cooperation via communication , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[16]  M. Aicardi.  Coordination and control of a team of mobile robots , 1995, Proceedings 1995 INRIA/IEEE Symposium on Emerging Technologies and Factory Automation. ETFA'95.

[17]  B. M. Albaker,et al.  Straight projection conflict detection and cooperative avoidance for autonomous unmanned aircraft systems , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.

[18]  Marcelo H. Ang,et al.  Cooperative perception for autonomous vehicle control on the road: Motivation and experimental results , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Antonio Bicchi,et al.  On optimal cooperative conflict resolution for air traffic management systems , 2000, IEEE Trans. Intell. Transp. Syst..

[20]  Chun-gui Li,et al.  Multi-intersections traffic signal intelligent control using collaborative q-learning algorithm , 2011, 2011 Seventh International Conference on Natural Computation.

[21]  Nobuaki Kobayashi,et al.  Cooperative transportation control by using internal model control design and LQ control , 2003, Proceedings of 2003 IEEE Conference on Control Applications, 2003. CCA 2003..