Beyond Reinforcement Learning and Local View in Multiagent Systems

Learning is an important component of an agent’s decision making process. Despite many messages in contrary, the fact is that, currently, in the multiagent community it is mostly likely that learning means reinforcement learning. Given this background, this paper has two aims: to revisit the “old days” motivations for multiagent learning, and to describe some of the work addressing the frontiers of multiagent systems and machine learning. The intention of the latter task is to try to motivate people to address the issues that are involved in the application of techniques from multiagent systems in machine learning and vice-versa.

[1]  Frans Coenen,et al.  Clustering in a Multi-Agent Data Mining Environment , 2010, ADMI.

[2]  Daryl E. Hershberger,et al.  Collective Data Mining: a New Perspective toward Distributed Data Mining Advances in Distributed Data Mining Book , 1999 .

[3]  Peter Edwards,et al.  Distributed Learning: An Agent-Based Approach to Data-Mining , 1995 .

[4]  Foster J. Provost,et al.  Scaling Up: Distributed Machine Learning with Cooperation , 1996, AAAI/IAAI, Vol. 1.

[5]  Gerhard Weiss,et al.  Multiagent Learning: Basics, Challenges, and Prospects , 2012, AI Mag..

[6]  B. Kulkarni,et al.  An ant colony approach for clustering , 2004 .

[7]  Frans Coenen,et al.  A framework for Multi-Agent Based Clustering , 2011, Autonomous Agents and Multi-Agent Systems.

[8]  I. Hamzaoglu H. Kargupta,et al.  Distributed Data Mining Using An Agent Based Architecture , 1997, KDD 1997.

[9]  Michal Pechoucek,et al.  Probabilistic Modeling of Mobile Agents' Trajectories , 2010, ADMI.

[10]  Peter Stone,et al.  Multiagent learning is not the answer. It is the question , 2007, Artif. Intell..

[11]  Marek Kisiel-Dorohinicki,et al.  The Application of Evolution Process in Multi-Agent World to the Prediction System , 1996 .

[12]  Kevin Cheng,et al.  An ACO-Based Clustering Algorithm , 2006, ANTS Workshop.

[13]  Jörg P. Müller,et al.  Change Point Analysis for Intelligent Agents in City Traffic , 2011, ADMI.

[14]  Simon Parsons,et al.  Learning strategies for task delegation in norm-governed environments , 2012, Autonomous Agents and Multi-Agent Systems.

[15]  Luís Torgo,et al.  Panel: Learning in Distributed Systems and Multi-Agent Environments , 1991, EWSL.

[16]  Wei Zhang,et al.  Agent-Based Cluster Analysis of Tropical Cyclone Tracks in the Western North Pacific , 2011, ADMI.

[17]  Tamio Arai,et al.  Distributed Autonomous Robotic Systems 3 , 1998 .

[18]  Mohamed S. Kamel,et al.  An aggregated clustering approach using multi-ant colonies algorithms , 2006, Pattern Recognit..

[19]  Matthias Klusch,et al.  Issues of agent-based distributed data mining , 2003, AAMAS '03.

[20]  Matthias Klusch,et al.  Distributed data mining and agents , 2005, Eng. Appl. Artif. Intell..

[21]  Bertha Guijarro-Berdiñas,et al.  A survey of methods for distributed machine learning , 2012, Progress in Artificial Intelligence.

[22]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[23]  Frances M. T. Brazier,et al.  A method for decentralized clustering in large multi-agent systems , 2003, AAMAS '03.

[24]  T. Ravindra Babu,et al.  Multiagent Systems for Large Data Clustering , 2009, Data Mining and Multi-agent Integration.

[25]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[26]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[27]  Vasant Honavar,et al.  Analysis and Synthesis of Agents That Learn from Distributed Dynamic Data Sources , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[28]  Anne M. P. Canuto,et al.  Analyzing the Performance of an Agent-based Neural System for Classification Tasks Using Data Distribution among the Agents , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[29]  Yoav Shoham,et al.  If multi-agent learning is the answer, what is the question? , 2007, Artif. Intell..

[30]  Murat Sensoy,et al.  Discovering Frequent Patterns to Bootstrap Trust , 2012, ADMI.

[31]  Kagan Tumer,et al.  Efficient agent-based cluster ensembles , 2006, AAMAS '06.

[32]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[33]  Jason Miller,et al.  Forecasting market prices in a supply chain game , 2007, AAMAS '07.

[34]  Manuela M. Veloso,et al.  On Behavior Classification in Adversarial Environments , 2000, DARS.

[35]  Ana L. C. Bazzan.  Agents and Data Mining in Bioinformatics: Joining Data Gathering and Automatic Annotation with Classification and Distributed Clustering , 2009, ADMI.

[36]  Sadok Ben Yahia,et al.  Towards a Multiagent-Based Distributed Intrusion Detection System Using Data Mining Approaches , 2011, ADMI.

[37]  Longbing Cao.  Data Mining and Multi-agent Integration , 2009 .

[38]  Manuela Veloso,et al.  An Empirical Study of Coaching , 2002, DARS.

[39]  Trevor J. M. Bench-Capon,et al.  Multi-agent based classification using argumentation from experience , 2011, Autonomous Agents and Multi-Agent Systems.

[40]  Michal Pechoucek,et al.  A framework for agent-based distributed machine learning and data mining , 2007, AAMAS '07.

[41]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  Ana L. C. Bazzan,et al.  A Multiagent, Multiobjective Clustering Algorithm , 2009, Data Mining and Multi-agent Integration.

[43]  James Allan,et al.  Web Page Clustering Using Heuristic Search in the Web Graph , 2007, IJCAI.

[44]  Michael Rovatsos,et al.  Collaborative agent-based learning with limited data exchange , 2009, AAMAS.

[45]  Stefan Wermter,et al.  Emergent Neural Computational Architectures Based on Neuroscience , 2001, Lecture Notes in Computer Science.

[46]  Stephen Muggleton,et al.  Learning to Relate Terms in a Multiple Agent Environment , 1991, EWSL.

[47]  Chengqi Zhang,et al.  Agent-Mining Interaction: An Emerging Area , 2007, AIS-ADM.

[48]  Baldo Faieta,et al.  Diversity and adaptation in populations of clustering ants , 1994 .

[49]  Guandong Xu,et al.  KNN-Based Clustering for Improving Social Recommender Systems , 2012, ADMI.

[50]  Ana L. C. Bazzan,et al.  Distributed clustering for group formation and task allocation in multiagent systems: A swarm intelligence approach , 2012, Appl. Soft Comput..

[51]  Karl Tuyls,et al.  Stigmergic landmark foraging , 2009, AAMAS.

[52]  Domenico Rosaci,et al.  Agent clustering based on semantic negotiation , 2008, TAAS.

[53]  Mikhail Prokopenko,et al.  Decentralized Multi-Agent Clustering in Scale-free Sensor Networks , 2008, Computational Intelligence: A Compendium.

[54]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[55]  Gillian Dobbie,et al.  Exploiting Swarm Behaviour of Simple Agents for Clustering Web Users' Session Data , 2009, Data Mining and Multi-agent Integration.

[56]  Peter Stone,et al.  Learning and Multiagent Reasoning for Autonomous Agents , 2007, IJCAI.

[57]  Philip S. Yu,et al.  A brief introduction to agent mining , 2012, Autonomous Agents and Multi-Agent Systems.

[58]  Foster J. Provost,et al.  A Survey of Methods for Scaling Up Inductive Algorithms , 1999, Data Mining and Knowledge Discovery.

[59]  Wei-Min Shen,et al.  Collaborative multiagent learning for classification tasks , 2001, AGENTS '01.

[60]  Philippe Fournier-Viger,et al.  Data Mining and Multi-agent Integration , 2009 .

[61]  Ana L. C. Bazzan.  Cooperative induction of decision trees , 2013, 2013 IEEE Symposium on Intelligent Agents (IA).

[62]  Ana L. C. Bazzan,et al.  Social choice in distributed classification tasks: Dealing with vertically partitioned data , 2016, Inf. Sci..

[63]  Salvatore J. Stolfo,et al.  JAM: Java Agents for Meta-Learning over Distributed Databases , 1997, KDD.

[64]  Koby Crammer,et al.  Learning from Multiple Sources , 2006, NIPS.

[65]  André M. C. Campos,et al.  A Comparative Analysis of Data Distribution Methods in an Agent-Based Neural System for Classification Tasks , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[66]  Manuela M. Veloso,et al.  Confidence-based policy learning from demonstration using Gaussian mixture models , 2007, AAMAS '07.