Distributed coverage games for mobile visual sensors (II) : Reaching the set of global optima

We formulate a coverage optimization problem for mobile visual sensor networks as a repeated multi-player game. Each visual sensor tries to optimize its own coverage while minimizing the processing cost. The rewards for the sensing are not prior information to the agents. We present an asynchronous distributed learning algorithm where each sensor only remembers the utility values obtained by its neighbors and itself, and the actions it played during the last two time steps when it was active. We show that this algorithm is convergent in probability to the set of global optima of certain coverage performance metric.

[1]  D. Vere-Jones Markov Chains , 1972, Nature.

[2]  Jorge Urrutia,et al.  Art Gallery and Illumination Problems , 2000, Handbook of Computational Geometry.

[3]  Sonia Martinez,et al.  Deployment algorithms for a power‐constrained mobile sensor network , 2010 .

[4]  T. C. Shermer,et al.  Recent results in art galleries (geometry) , 1992, Proc. IEEE.

[5]  Ian F. Akyildiz,et al.  Wireless multimedia sensor networks: A survey , 2007, IEEE Wireless Communications.

[6]  Tansu Alpcan,et al.  A power control game based on outage probabilities for multicell wireless data networks , 2004 .

[7]  Roberto Manduchi,et al.  Characterizing energy consumption in a visual sensor network testbed , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[8]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[9]  W.B. Heinzelman,et al.  On the coverage problem in video-based wireless sensor networks , 2005, 2nd International Conference on Broadband Networks, 2005..

[10]  Drew Fudenberg,et al.  Game theory (3. pr.) , 1991 .

[11]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[12]  Jason R. Marden,et al.  Payoff-Based Dynamics for Multiplayer Weakly Acyclic Games , 2009, SIAM J. Control. Optim..

[13]  Jorge Cortés,et al.  Coverage control by multi-robot networks with limited-range anisotropic sensory , 2009, Int. J. Control.

[14]  Tim Roughgarden,et al.  Selfish routing and the price of anarchy , 2005 .

[15]  Francesco Bullo,et al.  Multirobot Rendezvous With Visibility Sensors in Nonconvex Environments , 2006, IEEE Transactions on Robotics.

[16]  Sonia Martínez,et al.  Distributed coverage games for mobile visual sensors (I): Reaching the set of Nash equilibria , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[17]  Lachlan L. H. Andrew,et al.  Game theory for heterogeneous flow control , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[18]  Jason R. Marden,et al.  Payoff based dynamics for multi-player weakly acyclic games , 2007, 2007 46th IEEE Conference on Decision and Control.

[19]  Tansu Alpcan,et al.  A power control game based on outage probabilities for multicell wireless data networks , 2004, IEEE Transactions on Wireless Communications.

[20]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[21]  R. Lienhart,et al.  On the optimal placement of multiple visual sensors , 2006, VSSN '06.

[22]  Francesco Bullo,et al.  Esaim: Control, Optimisation and Calculus of Variations Spatially-distributed Coverage Optimization and Control with Limited-range Interactions , 2022 .

[23]  Connections between cooperative control and potential games illustrated on the consensus problem , 2007, 2007 European Control Conference (ECC).

[24]  T. Shermer Recent Results in Art Galleries , 1992 .

[25]  R. Cucchiara Multimedia surveillance systems , 2005, VSSN@MM.

[26]  H. Young,et al.  The Evolution of Conventions , 1993 .

[27]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[28]  Edmund Y. Lam,et al.  Maximizing Angle Coverage in Visual Sensor Networks , 2007, 2007 IEEE International Conference on Communications.

[29]  J. O'Rourke Art gallery theorems and algorithms , 1987 .

[30]  F. Bullo,et al.  Visibility-based multi-agent deployment in orthogonal environments , 2007, 2007 American Control Conference.

[32]  Robert Murphey,et al.  Target-Based Weapon Target Assignment Problems , 2000 .