From entropy to ontology

The theoretical foundations for a definition of distance on ontologies are laid out in this paper. The distance measure is defined using the well known concepts of entropy and mutual information from information theory. These formal methods are adapted for practical use in ontologies through the definition of useful discrete random variables. These include centrality measures like degree, closeness or betweeness.

[1]  Alfréd Rényi.  Tagebuch über die Informationstheorie , 1983 .

[2]  Editors , 1986, Brain Research Bulletin.

[3]  Philip Resnik,et al.  Using Information Content to Evaluate Semantic Similarity in a Taxonomy , 1995, IJCAI.

[4]  J. Pierce.  An introduction to information theory: symbols, signals & noise , 1980 .

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[7]  J. Maxwell,et al.  Theory of Heat , 1892 .

[8]  Fazlollah M. Reza,et al.  Introduction to Information Theory , 2004, Lecture Notes in Electrical Engineering.

[9]  M. Zelen,et al.  Rethinking centrality: Methods and examples☆ , 1989 .

[10]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[11]  K. Menger.  Statistical Metrics. , 1942, Proceedings of the National Academy of Sciences of the United States of America.

[12]  R. Tolman,et al.  The Principles of Statistical Mechanics. By R. C. Tolman. Pp. xix, 661. 40s. 1938. International series of monographs on physics. (Oxford) , 1939, The Mathematical Gazette.

[13]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[14]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[15]  Peter Willett,et al.  Readings in information retrieval , 1997 .

[16]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[17]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[18]  Steffen Staab,et al.  Ontology-based Text Document Clustering , 2002, Künstliche Intell..