MODC: Multi-Objective Distance based Optimal Document Clustering by GA

Background/Objective: Unsupervised learning of text documents is an essential and significant process of knowledge discovery and data mining. The concept, context and semantic relevancy are the important and exclusive factors in text mining, where as in the case of unsupervised learning of record structured data, these factors are not in scope. Methods/Statistical Analysis: The current majority of benchmarking document clustering models is keen and relies on term frequency, and all these models are not considering the concept, context and semantic relations during document clustering. In regard to this, our earlier works introduced a novel document clustering approaches and one of that named as Document Clustering by Conceptual, Contextual and Semantic Relevance (DC3SR). The lessons learned from the empirical study of this contribution motivated us to propose aMulti-Objective Distance based optimal document Clustering (MODC) approach that optimizes resultant clusters using the well-known evolutionary computation technique called Genetic Algorithm.Findings: The significant contribution of this proposal is feature formation by concept, context and semantic relevance and optimizing resultant clusters by genetic algorithm. An unsupervised learning approach to form the initial clusters that estimates similarity between any two documents by concept, context and semantic relevance score and further optimizes by genetic algorithm is proposed. This novel method represents the concept as correlation between arguments and activities in given documents, context as correlation between meta-text of the documents and the semantic relevance is assessed by estimating the similarity between documents through the hyponyms of the arguments. The meta-text of the documents considered for context assessment contains the authors list, keywords list and list of document versioning time schedules. Application/Improvements:The experiments were conducted to assess the significance of the proposed model.The results obtained from experiments concluding that the MODC is performing exceptionally well under divergent document count and evincing the cluster formation accuracy as 97%. The dimensionality reduction by concept, context and semantic relevance is left for future enhancement of the proposed model.

[1]  Thomas E. Potok,et al.  A flocking based algorithm for document clustering analysis , 2006, J. Syst. Archit..

[2]  S. Siamala Devi,et al.  An Integrated Harmony Search Method for Text Clustering using a Constraint based Approach , 2015 .

[3]  Annaluri Sreenivasa Rao,et al.  DCCR: Document Clustering by Conceptual Relevance as a Factor of Unsupervised Learning , 2014 .

[4]  Wei Song,et al.  Genetic algorithm for text clustering based on latent semantic indexing , 2009, Comput. Math. Appl..

[5]  K. Premalatha,et al.  Hybrid PSO and GA models for Document Clustering , 2010 .

[6]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[7]  Bijaya K. Panigrahi,et al.  Multi-objective optimization with artificial weed colonies , 2011, Inf. Sci..

[8]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[9]  Anna-Lan Huang,et al.  Similarity Measures for Text Document Clustering , 2008 .

[10]  Veenu Mangat,et al.  Evaluation of text document clustering approach based on particle swarm optimization , 2013, Central European Journal of Computer Science.

[11]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[12]  Fevrier Valdez,et al.  Comparative study of bio-inspired algorithms applied to the optimization of type-1 and type-2 fuzzy controllers for an autonomous mobile robot , 2012, Inf. Sci..

[13]  Soon Myoung Chung,et al.  Text document clustering based on frequent word sequences , 2005, CIKM '05.

[14]  C. M. Sheela Rani,et al.  A Survey on Clustering Techniques for Big Data Mining , 2016 .

[15]  D. Layzer,et al.  Genetic Variation and Progressive Evolution , 1980, The American Naturalist.

[16]  Enrique Herrera-Viedma,et al.  Clustering of web search results based on the cuckoo search algorithm and Balanced Bayesian Information Criterion , 2014, Inf. Sci..

[17]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[18]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[19]  Randy L. Haupt,et al.  Practical Genetic Algorithms , 1998 .

[20]  Ross Ihaka,et al.  Gentleman R: R: A language for data analysis and graphics , 1996 .

[21]  Pavel Berkhin,et al.  A Survey of Clustering Data Mining Techniques , 2006, Grouping Multidimensional Data.

[22]  Hamid Alinejad Rokny,et al.  Text clustering on latent semantic indexing with particle swarm optimization (PSO) algorithm , 2012 .

[23]  Dawid Weiss,et al.  A survey of Web clustering engines , 2009, CSUR.

[24]  Babak Fakhar,et al.  A Novel Document Clustering Algorithm Based on Ant Colony Optimization Algorithm , 2013 .

[25]  Hong-Gee Kim,et al.  Exploiting noun phrases and semantic relationships for text document clustering , 2009, Inf. Sci..

[26]  H. B. Barlow,et al.  Unsupervised Learning , 1989, Neural Computation.

[27]  Dimitar Kazakov,et al.  WordNet-based text document clustering , 2004 .

[28]  Junjie Li,et al.  Rosenbrock artificial bee colony algorithm for accurate global optimization of numerical functions , 2011, Inf. Sci..

[29]  R. Nagaraj,et al.  Correlation Similarity Measure based Document Clustering with Directed Ridge Regression , 2014 .

[30]  Francisco Azuaje,et al.  Cluster validation techniques for genome expression data , 2003, Signal Process..

[31]  Nihal M. AbdelHamid,et al.  BEES ALGORITHM-BASED DOCUMENT CLUSTERING , 2013 .

[32]  J. E. Judith,et al.  Enhanced distributed document clustering algorithm using different similarity measures , 2013, 2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES.