Learning Systems of Concepts with an Infinite Relational Model

Relationships between concepts account for a large proportion of semantic knowledge. We present a nonparametric Bayesian model that discovers systems of related concepts. Given data involving several sets of entities, our model discovers the kinds of entities in each set and the relations between kinds that are possible or likely. We apply our approach to four problems: clustering objects and features, learning ontologies, discovering kinship systems, and discovering structure in political data.

[1]  C. Antoniak.  Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[2]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[3]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[4]  L. Hubert,et al.  Comparing partitions , 1985 .

[5]  Ernest Davis,et al.  Representations of commonsense knowledge , 2014, notThenot Morgan Kaufmann series in representation and reasoning.

[6]  Daniel N. Osherson,et al.  Joshua Stern, Ormond Wilkie, Michael Stob, Edward E. Smith: Default Probability , 1991, Cognitive Sciences.

[7]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[8]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[9]  R. Rummel.  Dimensionality of Nations project: attributes of nations and behavior of nation dyads , 1999 .

[10]  Thomas Hofmann,et al.  Latent Class Models for Collaborative Filtering , 1999, IJCAI.

[11]  Ben Taskar,et al.  Probabilistic Classification and Clustering in Relational Data , 2001, IJCAI.

[12]  Olivier Bodenreider,et al.  Aggregating UMLS Semantic Types for Reducing Conceptual Complexity , 2001, MedInfo.

[13]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[14]  Yiming Yang,et al.  Stochastic link and group detection , 2002, AAAI/IAAI.

[15]  Ben Taskar,et al.  Learning Probabilistic Models of Link Structure , 2003, J. Mach. Learn. Res..

[16]  Alexa T. McCray,et al.  An Upper-Level Ontology for the Biomedical Domain , 2003, Comparative and functional genomics.

[17]  Radford M. Neal,et al.  A Split-Merge Markov chain Monte Carlo Procedure for the Dirichlet Process Mixture Model , 2004 .

[18]  Daniel,et al.  Default Probability , 2004 .

[19]  Pedro M. Domingos,et al.  Learning the structure of Markov logic networks , 2005, ICML.

[20]  Andrew McCallum,et al.  Group and topic discovery from relations and text , 2005, LinkKDD '05.

[21]  J. Pitman.  Combinatorial Stochastic Processes , 2006 .