CILIOS: Connectionist inductive learning and inter-ontology similarities for recommending information agents

For a software information agent, operating on behalf of a human owner and belonging to a community of agents, the choice of communicating or not with another agent becomes a decision to take, since communication generally implies a cost. Since these agents often operate as recommender systems, on the basis of dynamic recognition of their human owners' behaviour and by generally using hybrid machine learning techniques, three main necessities arise in their design, namely (i) providing the agent with an internal representation of both interests and behaviour of its owner, usually called ontology; (ii) detecting inter-ontology properties that can help an agent to choose the most promising agents to be contacted for knowledge-sharing purposes; (iii) semi-automatically constructing the agent ontology, by simply observing the behaviour of the user supported by the agent, leaving to the user only the task of defining concepts and categories of interest. We present a complete MAS architecture, called connectionist learning and inter-ontology similarities (CILIOS), for supporting agent mutual monitoring, trying to cover all the issues above. CILIOS exploits an ontology model able to represent concepts, concept collections, functions and causal implications among events in a multi-agent environment; moreover, it uses a mechanism capable of inducing logical rules representing agent behaviour in the ontology by means of a connectionist ontology representation, based on neural-symbolic networks, i.e., networks whose input and output nodes are associated with logic variables.

[1]  George Karypis,et al.  Selective Markov models for predicting Web page accesses , 2004, TOIT.

[2]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.

[3]  Michael Luck,et al.  Cooperative Plan Selection Through Trust , 1999, MAAMAW.

[4]  Dell Zhang,et al.  An object oriented data model for Web and its algebra , 1999, Proceedings Technology of Object-Oriented Languages and Systems (Cat. No.PR00393).

[5]  D. Rosaci,et al.  A multi-agent model for handling e-commerce activities , 2002, Proceedings International Database Engineering and Applications Symposium.

[6]  Wiebe van der Hoek,et al.  Logical Foundations of Agent-Based Computing , 2001, EASSS.

[7]  Yih-Fang Huang,et al.  Bounds on the number of hidden neurons in multilayer perceptrons , 1991, IEEE Trans. Neural Networks.

[8]  Frank van Harmelen,et al.  Introduction to Semantic Web Ontology Languages , 2005, Reasoning Web.

[9]  Artur S. d'Avila Garcez,et al.  The Connectionist Inductive Learning and Logic Programming System , 1999, Applied Intelligence.

[10]  Yun Peng,et al.  Semantic resolution for e-commerce , 2002, AAMAS '02.

[11]  Michael Luck,et al.  Multi-Agent Systems and Applications , 2001, Lecture Notes in Computer Science.

[12]  Michael Gelfond,et al.  Classical negation in logic programs and disjunctive databases , 1991, New Generation Computing.

[13]  José Júlio Alferes,et al.  Logics in Artificial Intelligence: European Workshop, JELIA '96, Evora, Portugal, September 30 - October 3, 1996, Proceedings , 1996 .

[14]  Domenico Rosaci A Model of Agent Ontologies for B2C E-Commerce , 2004, ICEIS.

[15]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[16]  Tao Luo,et al.  Effective personalization based on association rule discovery from web usage data , 2001, WIDM '01.

[17]  MSc DIC PhD Artur S. d’Avila Garcez MEng,et al.  Neural-Symbolic Learning Systems , 2002, Perspectives in Neural Computing.

[18]  T. Ash,et al.  Dynamic node creation in backpropagation networks , 1989, International 1989 Joint Conference on Neural Networks.

[19]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[20]  Domenico Rosaci Exploiting Agent Ontologies in B2C Virtual Marketplaces , 2005, J. Univers. Comput. Sci..

[21]  Michael Bieber,et al.  A clickstream-based collaborative filtering personalization model: towards a better performance , 2004, WIDM '04.

[22]  Thomas Eiter,et al.  Preferred Answer Sets for Extended Logic Programs , 1999, Artif. Intell..

[23]  Vasant G Honavar,et al.  MTiling A Constructive Neural Network Learning Algorithm for Multi Category Pattern Classi cation , 1996 .

[24]  Borys Omelayenko,et al.  Syntactic-Level Ontology Integration Rules for E-Commerce , 2001, FLAIRS.

[25]  Frank Dignum,et al.  Issues in Agent Communication , 2000, Lecture Notes in Computer Science.

[26]  Michael Wooldridge,et al.  Reasoning about rational agents , 2000, Intelligent robots and autonomous agents.

[27]  N. Guarino,et al.  Formal Ontology in Information Systems : Proceedings of the First International Conference(FOIS'98), June 6-8, Trento, Italy , 1998 .

[28]  Stephen I. Gallant,et al.  Neural network learning and expert systems , 1993 .

[29]  Miroslaw Truszczynski,et al.  Computing Minimal Models, Stable Models, and Answer Sets , 2003, ICLP.

[30]  Krysia Broda,et al.  Neural-Symbolic Learning Systems , 2002 .

[31]  Rajesh Parekh,et al.  Constructive theory refinement in knowledge based neural networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[32]  Jaideep Srivastava,et al.  Automatic personalization based on Web usage mining , 2000, CACM.

[33]  Victor R. Lesser,et al.  Communication decisions in multi-agent cooperation: model and experiments , 2001, AGENTS '01.

[34]  Giuseppe M. L. Sarnè,et al.  An Agent-Based Hierarchical Clustering Approach for E-commerce Environments , 2002, EC-Web.

[35]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[36]  Tony R. Martinez,et al.  Improved Backpropagation Learning in Neural Networks with Windowed Momentum , 2002, Int. J. Neural Syst..

[37]  Munindar P. Singh,et al.  Service-Oriented Computing: Semantics, Processes, Agents , 2010 .

[38]  Yun Peng,et al.  Semantic Resolution for E-commerce , 2002, WRAC.

[39]  Yu He,et al.  Asymptotic Convergence of Backpropagation: Numerical Experiments , 1989, NIPS.

[40]  Frank Guerin,et al.  Denotational semantics for agent communication language , 2001, AGENTS '01.

[41]  Avi Pfeffer,et al.  Probabilistic Frame-Based Systems , 1998, AAAI/IAAI.

[42]  Krysia Broda,et al.  Neural-symbolic learning systems - foundations and applications , 2012, Perspectives in neural computing.

[43]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[44]  Robert A. Kowalski,et al.  The Semantics of Predicate Logic as a Programming Language , 1976, JACM.

[45]  J. Ross Quinlan,et al.  Learning logical definitions from relations , 1990, Machine Learning.

[46]  Melvin Fitting,et al.  Metric Methods Three Examples and a Theorem , 1994, J. Log. Program..

[47]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[48]  Munindar P. Singh A Social Semantics for Agent Communication Languages , 2000, Issues in Agent Communication.

[49]  Bertram Ludäscher,et al.  On integrating scientific resources through semantic registration , 2004, Proceedings. 16th International Conference on Scientific and Statistical Database Management, 2004..

[50]  Stefano Modafferi,et al.  X-Compass: An XML Agent for Supporting User Navigation on the Web , 2002, FQAS.

[51]  Rajesh Parekh,et al.  Constructive Neural Network Learning Algorithms for Multi-Category Pattern Classification , 1995 .

[52]  Thomas R. Gruber,et al.  A Translation Approach to Portable Ontologies , 1993 .

[53]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[54]  Krysia Broda,et al.  Symbolic knowledge extraction from trained neural networks: A sound approach , 2001, Artif. Intell..

[55]  José Júlio Alferes,et al.  Updates plus Preferences , 2000, JELIA.

[56]  Jude W. Shavlik,et al.  Knowledge-Based Artificial Neural Networks , 1994, Artif. Intell..

[57]  Anand S. Rao,et al.  Decision Procedures for BDI Logics , 1998, J. Log. Comput..

[58]  Giuseppe M. L. Sarnè,et al.  Modeling cooperation in multi-agent communities , 2004, Cognitive Systems Research.