Game theory control solution for sensor coverage problem in unknown environment

This paper studies the coverage problem in an unknown environment by a Mobile Sensor Network (MSN). Each agent in the MSN has sensing, communication, computation and moving capabilities to complete sensing tasks. Here the agents need to relocate themselves, from their initial random locations, to their optimal configuration. The proposed algorithm is based on game theory control where a collection of distributed agents use their local information to make decisions. A state-based potential game is defined in which each agent's utility function is designed to consider the trade off between the worth of the covered area and the energy consumption. The agents employ binary log-linear learning to update their actions in each iteration in order to converge to the Nash equilibrium. As the agents do not have the knowledge of the sensing area, a Maximum Likelihood estimation scheme is used to estimate the unknown parameters of a Gaussian Mixture Model (GMM). Then in order to feed the estimation algorithm with more informative data, a mutual information term is added to the agents' utility functions. The mutual information is utilized to determine which observation can improve the agent's knowledge of the unobserved area more. Simulation results are provided to verify the performance of the proposed algorithm.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  Henry P. Wynn,et al.  Maximum entropy sampling , 1987 .

[3]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[4]  Krishnendu Chakrabarty,et al.  Sensor deployment and target localization based on virtual forces , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[5]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[6]  Andreas Krause,et al.  Near-optimal sensor placements in Gaussian processes , 2005, ICML.

[7]  Wei Li,et al.  Distributed Cooperative coverage Control of Sensor Networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[8]  Pravin K. Trivedi,et al.  Copula Modeling: An Introduction for Practitioners , 2007 .

[9]  Mac Schwager,et al.  Decentralized, Adaptive Control for Coverage with Networked Robots , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  Adam Wierman,et al.  Distributed welfare games with applications to sensor coverage , 2008, 2008 47th IEEE Conference on Decision and Control.

[11]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  V. Lakshmanan,et al.  A Gaussian Mixture Model Approach to Forecast Verification , 2010 .

[13]  Masayuki Fujita,et al.  Payoff-based Inhomogeneous Partially Irrational Play for potential game theoretic cooperative control: Convergence analysis , 2012, 2012 American Control Conference (ACC).

[14]  Jason R. Marden State based potential games , 2012, Autom..

[15]  Adam Wierman,et al.  Distributed Welfare Games , 2013, Oper. Res..

[16]  Jeff S. Shamma,et al.  Robustness of stochastic stability in game theoretic learning , 2013, 2013 American Control Conference.

[17]  Sonia Martínez,et al.  Distributed Coverage Games for Energy-Aware Mobile Sensor Networks , 2013, SIAM J. Control. Optim..