An Optimization-Based Distributed Planning Algorithm: A Blackboard-Based Collaborative Framework

Motivated by the need for multiple agents to collaborate in order to solve a distributed resource allocation planning problem, this paper develops a distributed framework that combines each agent's information, expertise, responsibility, and asset ownership with the goal of optimizing a given mission objective. A mission is a collection of interdependent tasks to be executed in a directed/sequential sequence. Each task is modeled by a vector of resource requirements, a processing time, and a start time (release time). Each agent has a subset of tasks for which it is responsible, and owns a set of heterogeneous assets, where each asset is modeled by a vector of resource capabilities that it provides. Multiple agents must collaboratively allocate assets to tasks to maximize an expected mission performance, defined by how well all of the tasks' requirements are satisfied by the allocated asset capabilities. Our agent-based distributed planning framework uses a blackboard communication paradigm to exchange information among agents. The framework contains an intra-agent and an interagent module that support individual and cooperative planning, respectively. The intra-agent module employs an optimization-based m-best asset allocation algorithm to match an agent's own tasks with its locally owned assets. The interagent module coordinates the exchange of information and asset allocations among agents to improve the local plans using an asset pricing mechanism, and includes a means for characterizing an agent's cooperative behavior.

[1]  H. Penny Nii,et al.  Blackboard systems: the blackboard model of problem solving and the evolution of blackboard architectures , 1995 .

[2]  Victor R. Lesser,et al.  Cooperative Multiagent Systems: A Personal View of the State of the Art , 1999, IEEE Trans. Knowl. Data Eng..

[3]  Victor R. Lesser,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.

[4]  José M. Vidal,et al.  Multiagent Coordination Using a Distributed Combinatorial Auction , 2006 .

[5]  Krishna R. Pattipati,et al.  Normative design of organizations. I. Mission planning , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Edmund H. Durfee,et al.  Distributed Continual Planning for Unmanned Ground Vehicle Teams , 1999, AI Mag..

[7]  Yuri N. Levchuk,et al.  Normative Design of Organizations — Part II : Organizational Structure , 2001 .

[8]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[9]  Geoffrey J. Gordon,et al.  Distributed Planning in Hierarchical Factored MDPs , 2002, UAI.

[10]  Suvasri Mandal,et al.  Agent-based distributed framework for collaborative planning , 2010, 2010 IEEE Aerospace Conference.

[11]  A. Roadmapof A Roadmap of Agent Research and Development , 1995 .

[12]  Barbara Hayes-Roth,et al.  A Blackboard Architecture for Control , 1985, Artif. Intell..

[13]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[14]  Krishna R. Pattipati,et al.  Quantifying the Impact of Information and Organizational Structures via Distributed Auction Algorithm: Point-to-Point Communication Structure , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Xu Han,et al.  Optimization-Based Decision Support Software for a Team-In-The-Loop Experiment: Asset Package Selection and Planning , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  José L. Poza,et al.  Agent-based distributed architecture for mobile robot control , 2008, Eng. Appl. Artif. Intell..

[17]  David W. Hildum,et al.  MASCOT: An Agent-based Architecture for Coordinated Mixed-Initiative Supply Chain Planning and Scheduling , 1999 .

[18]  Colin F. Mackenzie,et al.  SPECIAL SECTION: Comparison of Self-Reporting of Deficiencies in Airway Management with Video Analyses of Actual Performance , 1996, Hum. Factors.

[19]  Thomas Dean,et al.  Decomposition Techniques for Planning in Stochastic Domains , 1995, IJCAI.

[20]  Victor R. Lesser,et al.  Multistage negotiation for distributed constraint satisfaction , 1991, IEEE Trans. Syst. Man Cybern..

[21]  Katta G. Murty,et al.  Letter to the Editor - An Algorithm for Ranking all the Assignments in Order of Increasing Cost , 1968, Oper. Res..

[22]  Xu Han,et al.  Hidden Markov Model and Auction-Based Formulations of Sensor Coordination Mechanisms in Dynamic Task Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[24]  H. Leonard Elicitation of Honest Preferences for the Assignment of Individuals to Positions , 1983, Journal of Political Economy.

[25]  Krishna R. Pattipati,et al.  Multi-level operational C2 architecture modeling via hierarchically structured semi-Markov decision processes , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  D. Corkill Blackboard Systems , 1991 .

[27]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[28]  Edmund H. Durfee,et al.  Distributed Problem Solving and Planning , 2001, EASSS.

[29]  Krishna R. Pattipati,et al.  Normative design of project-based organizations-Part III: modeling congruent, robust, and adaptive organizations , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[30]  Janet Bruten,et al.  Ant-like agents for load balancing in telecommunications networks , 1997, AGENTS '97.

[31]  Nicholas R. Jennings,et al.  Cooperating agents for 3-D scientific data interpretation , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[32]  Yuri N. Levchuk,et al.  Normative Design of Organizations — Part I : Mission Planning , 2001 .

[33]  Krishna R. Pattipati,et al.  Normative design of organizations. II. Organizational structure , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[34]  K. G. Murty An Algorithm for Ranking All the Assignment in Order of Increasing Cost , 1968 .

[35]  D.A. Castanon,et al.  Rollout Algorithms for Stochastic Scheduling Problems , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[36]  H. P Nii,et al.  Blackboard Systems , 1986 .

[37]  Carlos José Pereira de Lucena,et al.  The Reflective Blackboard Pattern: Architecting Large Multi-agent Systems , 2002, SELMAS.

[38]  Xu Han,et al.  Optimization-based decision support algorithms for a team-in-the-loop planning experiment , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[39]  David L. Kleinman,et al.  Maritime Headquarters with Maritime Operations Center: A Research Agenda for Experimentation , 2009 .

[40]  Michael Weiss,et al.  Reusable Patterns for Agent Coordination , 2001, Coordination of Internet Agents: Models, Technologies, and Applications.