Unsupervised Linkage Learner Based on Local Optimums

Genetic Algorithms (GAs) are categorized as search heuristics and have been broadly applied to optimization problems. These algorithms have been used for solving problems in many applications, but it has been shown that simple GA is not able to effectively solve complex real world problems. For proper solving of such problems, knowing the relationships between decision variables which is referred to as linkage learning is necessary. In this paper a linkage learning approach is proposed that utilizes the special features of the decomposable problems to solve them. The proposed approach is called Linkage Learner based on Local Optimums and Clustering (LLLC). The LLLC algorithm is capable of identifying the groups of variables which are related to each other (known as linkage groups), no matter if these groups are overlapped or different in size. The proposed algorithm, unlike other linkage learning techniques, is not done along with optimization algorithm; but it is done in a whole separated phase from optimization search. After finding linkage group information by LLLC, an optimization search can use this information to solve the problem. LLLC is tested on some benchmarked decomposable functions. The results show that the algorithm is an efficient alternative to other linkage learning techniques.

[1]  D. Goldberg,et al.  Escaping hierarchical traps with competent genetic algorithms , 2001 .

[2]  Hamid Parvin,et al.  A Metric to Evaluate a Cluster by Eliminating Effect of Complement Cluster , 2011, KI.

[3]  Stefan Edelkamp,et al.  KI 2011: Advances in Artificial Intelligence , 2011, Lecture Notes in Computer Science.

[4]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[5]  David E. Goldberg,et al.  A hierarchy machine: Learning to optimize from nature and humans , 2003, Complex..

[6]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[7]  Hamid Parvin,et al.  An Innovative Linkage Learning Based on Differences in Local Optimums , 2011, CISIS.

[8]  Behrouz Minaei-Bidgoli,et al.  Multi objective association rule mining with genetic algorithm without specifying minimum support and minimum confidence , 2011, Expert Syst. Appl..

[9]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[10]  Jan Wessnitzer,et al.  A Model of Non-elemental Associative Learning in the Mushroom Body Neuropil of the Insect Brain , 2007, ICANNGA.

[11]  Haibo He,et al.  Advances in Neural Networks - ISNN 2011 - 8th International Symposium on Neural Networks, ISNN 2011, Guilin, China, May 29-June 1, 2011, Proceedings, Part I , 2011, International Symposium on Neural Networks.

[12]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[13]  Hamid Parvin,et al.  An innovative combination of particle swarm optimization, learning automaton and great deluge algorithms for dynamic environments , 2011 .

[14]  Hamid Parvin,et al.  Linkage Learning Based on Local Optima , 2011, ICCCI.

[15]  Hamid Parvin,et al.  A Novel Classifier Ensemble Method Based on Class Weightening in Huge Dataset , 2011, ISNN.

[16]  Hamid Parvin,et al.  Detection of Cancer Patients Using an Innovative Method for Learning at Imbalanced Datasets , 2011, RSKT.

[17]  Hamid Parvin,et al.  A New N-gram Feature Extraction-Selection Method for Malicious Code , 2011, ICANNGA.

[18]  P. Audebert,et al.  Preparation and electrochemistry of several substituted 9-(4-R-phenyl)-N-methylacridinium salts.: Kinetic analysis of the O2 catalytic reduction in acidic dimethylsulfoxide and in hydrophobic Nafion® gels , 1993 .

[19]  Hamid Parvin,et al.  A New Clustering Algorithm with the Convergence Proof , 2011, KES.

[20]  William F. Punch,et al.  Effects of resampling method and adaptation on clustering ensemble efficacy , 2011, Artificial Intelligence Review.

[21]  Hamid Parvin,et al.  Linkage learning based on differences in local optimums of building blocks with one optima , 2011 .

[22]  P. Paronen,et al.  Effect of powder inhaler design on drug deposition in the respiratory tract , 1988 .

[23]  B. Miller.  Charge transfer and corrosion processes at III-V semiconductor/electrolyte interfaces , 1984 .

[24]  Hamid Parvin,et al.  An Innovative Feature Selection Using Fuzzy Entropy , 2011, ISNN.

[25]  R. Linford.  Electrochemical science and technology of polymers , 1987 .