Expertness measuring in cooperative learning

Cooperative learning in a multi-agent system can improve the learning quality and learning speed. The improvement can be gained if each agent detects the expert agents and uses their knowledge properly. In the paper, a cooperative learning method, called weighted strategy sharing (WSS) is introduced. Also some criteria are introduced to measure the expertness of agents. In WSS, based on the amount of its team-mate expertness, each agent assigns a weight to their knowledge. These weights are used in sharing knowledge among agents in our system. WSS and the expertness criteria are tested on two simulated hunter-prey problems and on object pushing systems.

[1]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[2]  Arthur L. Samuel,et al.  Some studies in machine learning using the game of checkers" in computers and thought eds , 1995 .

[3]  Gillian M. Hayes,et al.  A Robot Controller Using Learning by Imitation , 1994 .

[4]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[5]  Arthur L. Samuel,et al.  Some studies in machine learning using the game of checkers , 2000, IBM J. Res. Dev..

[6]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[7]  C. Kaynak,et al.  Techniques for Combining Multiple Learners , 1998 .

[8]  D. L. Corgan,et al.  King's College , 1867, British medical journal.

[9]  Jude W. Shavlik,et al.  Creating advice-taking reinforcement learners , 1998 .

[10]  Craig Boutilier,et al.  The Dynamics of Reinforcement Learning in Cooperative Multiagent Systems , 1998, AAAI/IAAI.

[11]  Yasuhiro Tanaka,et al.  Speed up reinforcement learning between two agents with adaptive mimetism , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[12]  Peter Bakker,et al.  Robot see, robot do: An overview of robot imitation , 1996 .

[13]  Rüdiger Dillmann,et al.  Learning and Communication in Multi-Agent Systems , 1996, ECAI Workshop LDAIS / ICMAS Workshop LIOME.

[14]  Xin Yao,et al.  A cooperative ensemble learning system , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[15]  Richard Alterman,et al.  Multiagent Learning through Collective Memory , 1996 .

[16]  Foster J. Provost,et al.  Scaling Up: Distributed Machine Learning with Cooperation , 1996, AAAI/IAAI, Vol. 1.

[17]  Ming Tan,et al.  Multi-Agent Reinforcement Learning: Independent versus Cooperative Agents , 1997, ICML.