Collaborative Case Retention Strategies for CBR Agents

Empirical experiments have shown that storing every case does not automatically improve the accuracy of a CBR system. Therefore, several retain policies have been proposed in order to select which cases to retain. However, all the research done in case retention strategies is done in centralized CBR systems. We focus on multiagent CBR systems, where each agent has a local case base, and where each agent can interact with other agents in the system to solve problems in a collaborative way. We propose several case retention strategies that directly deal with the issue of being in a multiagent CBR system. Those case retention strategies combine ideas from the CBR case retain strategies and from the active learning techniques. Empirical results show that strategies that use collaboration with other agents outperform those strategies where the agents work in isolation. We present experiments in two different scenarios, the first one allowing multiple copies of one case and the second one only allowing one copy of each case. Although it may seem counterintuitive, we show and explain why not allowing multiple copies of each case achieves better results.

[1]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[2]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[3]  Padraig Cunningham,et al.  The Utility Problem Analysed: A Case-Based Reasoning Perspective , 1996, EWCBR.

[4]  Barry Smyth,et al.  Remembering To Forget: A Competence-Preserving Case Deletion Policy for Case-Based Reasoning Systems , 1995, IJCAI.

[5]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[6]  David A. Cohn,et al.  Improving generalization with active learning , 1994, Machine Learning.

[7]  Qiang Yang,et al.  Remembering to Add: Competence-preserving Case-Addition Policies for Case Base Maintenance , 1999, IJCAI.

[8]  David C. Wilson,et al.  Remembering Why to Remember: Performance-Guided Case-Base Maintenance , 2000, EWCBR.

[9]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[10]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Santiago Ontañón,et al.  Ensemble Case-Based Reasoning: Collaboration Policies for Multiagent Cooperative CBR , 2001, ICCBR.

[12]  Santiago Ontañón,et al.  Learning When to Collaborate among Learning Agents , 2001, ECML.

[13]  Shaul Markovitch,et al.  The Role of Forgetting in Learning , 1988, ML.

[14]  Santiago Ontañón,et al.  Learning to form dynamic committees , 2003, AAMAS '03.