Effective Classification and Categorization for Categorical Sets: Distance Similarity Measures

Measuring the similarity between objects is considered one of the main hot topics nowadays and the main core requirement for several data mining and knowledge discovery task. For better performance most organizations are in need on semantic similarity and similarity measures. This article presents different distance metrics used for measuring the similarity between qualitative data within a text. The case study represents a qualitative data of Faculty of medicine Cairo University for theses. The dataset is about 5,000 thesis document with 35 departments and about 16,000 keyword. As a result, we are able to better discover the commonalities between theses data and hence, improve the accuracy of the similarity estimation which in return improves the scientific research sector. The experimental results show that Kulczynksi distance yields better with a 92.51 % without normalization that correlate more closely with human assessments compared to other distance measures.

[1]  Aboul Ella Hassanien,et al.  Evaluation of Semantic Similarity across MeSH Ontology: A Cairo University Thesis Mining Case Study , 2013, 2013 12th Mexican International Conference on Artificial Intelligence.

[2]  Peter C. R. Lane,et al.  Copy detection in Chinese documents using Ferret , 2007, Lang. Resour. Evaluation.

[3]  Anna-Lan Huang,et al.  Similarity Measures for Text Document Clustering , 2008 .

[4]  Susan T. Dumais,et al.  Similarity Measures for Short Segments of Text , 2007, ECIR.

[5]  Loet Leydesdorff,et al.  Similarity Measures, Author Cocitation Analysis, and Information Theory , 2005, J. Assoc. Inf. Sci. Technol..

[6]  Phillip W. Lord,et al.  Semantic Similarity in Biomedical Ontologies , 2009, PLoS Comput. Biol..

[7]  Manesh Kokare,et al.  Performance Evaluation of Distance Metrics: Application to Fingerprint Recognition , 2011, Int. J. Pattern Recognit. Artif. Intell..

[8]  Aidong Zhang,et al.  Cluster analysis for gene expression data: a survey , 2004, IEEE Transactions on Knowledge and Data Engineering.

[9]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[10]  Xiao-Dong Liu,et al.  Finding Plagiarism Based on Common Semantic Sequence Model , 2004, WAIM.

[11]  David Sánchez,et al.  Semantic similarity estimation in the biomedical domain: An ontology-based information-theoretic perspective , 2011, J. Biomed. Informatics.

[12]  Tao Liu,et al.  Text Similarity Computing Based on Standard Deviation , 2005, ICIC.

[13]  Sanghamitra Bandyopadhyay,et al.  Unsupervised Classification: Similarity Measures, Classical and Metaheuristic Approaches, and Applications , 2012 .

[14]  Teruaki Kitasuka,et al.  Test collection recycling for semantic text similarity , 2012, IIWAS '12.

[15]  Bernard De Baets,et al.  On the transitivity of a parametric family of cardinality-based similarity measures , 2009, Int. J. Approx. Reason..

[16]  Peter C. R. Lane,et al.  Copy detection in Chinese documents using the Ferret: a report on experiments , 2006 .

[17]  C. Tappert,et al.  A Survey of Binary Similarity and Distance Measures , 2010 .

[18]  Loet Leydesdorff,et al.  Co-words and citations relations between document sets and environments , 1988 .