Cooperative multi-agent inference over grid structured Markov random fields

In this work we investigate cooperative inference in multi-agent systems where uncertainty is modeled by the grid structured pairwise Markov random field. A framework is proposed, which we term the multi-agent Markov random field, that decomposes the global inference problem into inter-agent belief exchanges over a hypertree topology and local intra-agent inference problems. Due to the exponential complexity of exact inference, we propose a loopy belief propagation algorithm for approximate inference over appropriately formed local generalized cluster graphs. Both synchronous and intelligent message passing are considered and a grid scale-invariant scheme based on the notion of regions of influence in a cluster graph is presented. The algorithms are simulated over a grid workspace with a team of virtual Autonomous Surface Vehicles (ASVs), with the goal of spatial plume detection in oceanographic data captured from the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument. We show that while the exact method produces predictably accurate and smooth grid maps, the approximate method competes well in terms of plume detection rate with the region of influence message passing scheme excelling over large tasks due to a lack of dependence on grid size.

[1]  Victor R. Lesser,et al.  On the role of multiply sectioned Bayesian networks to cooperative multiagent systems , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Yang Xiang,et al.  PROBABILISTIC REASONING IN MULTIAGENT SYSTEMS: A GRAPHICAL MODELS APPROACH, by Yang Xiang, Cambridge University Press, Cambridge, 2002, xii + 294 pp., ISBN 0-521-81308-5 (Hardback, £45.00). , 2002, Robotica.

[3]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[4]  Suxuan Bian,et al.  Multiscale Image Segmentation Using Markov Random Field and Spatial Fuzzy Clustering in Wavelet Domain , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[5]  Pradeep K. Khosla,et al.  Efficient mapping through exploitation of spatial dependencies , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Victor R. Lesser,et al.  Justifying multiply sectioned Bayesian networks , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[7]  Éva Tardos,et al.  Approximation algorithms for classification problems with pairwise relationships: metric labeling and Markov random fields , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[8]  Venu Govindaraju,et al.  Preprocessing of Low-Quality Handwritten Documents Using Markov Random Fields , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Masao Nagasaki,et al.  Estimating Genome-Wide Gene Networks Using Nonparametric Bayesian Network Models on Massively Parallel Computers , 2011, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[10]  Gaurav S. Sukhatme,et al.  Planning and Implementing Trajectories for Autonomous Underwater Vehicles to Track Evolving Ocean Processes Based on Predictions from a Regional Ocean Model , 2010, Int. J. Robotics Res..

[11]  Odest Chadwicke Jenkins,et al.  Multi-robot Markov random fields , 2008, AAMAS.

[12]  Naomi Ehrich Leonard,et al.  Exploring scalar fields using multiple sensor platforms: Tracking level curves , 2007, 2007 46th IEEE Conference on Decision and Control.

[13]  I. Cetinić,et al.  Harmful algal blooms in the urbanized coastal ocean an application of remote sensing for understanding, characterization and prediction , 2009 .

[14]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[15]  Andrea L. Bertozzi,et al.  Determining Environmental Boundaries: Asynchronous Communication and Physical Scales , 2005 .

[16]  Plácido Rogério Pinheiro,et al.  A Multicriteria Model Applied in the Diagnosis of Alzheimer's Disease: A Bayesian Network , 2008, CSE.