Review on Feature Selection and Classification using Neuro-Fuzzy Approaches

This research article attempts to provide a recent survey on neuro-fuzzy approaches for feature selection and classification. Feature selection acts as a catalyst in reducing computation time and dimensionality, enhancing prediction performance or accuracy and curtailing irrelevant or redundant data. The neuro-fuzzy approach is used for feature selection and for providing some insight to the user about the symbolic knowledge embedded within the network. The neuro-fuzzy approach combines the merits of neural network and fuzzy logic to solve many complex machine learning problems. The objective of this article is to provide a generic introduction and a recent survey to neuro-fuzzy approaches for feature selection and classification in a wide area of machine learning problems. Some of the existing neuro-fuzzy models are also applied on standard datasets to demonstrate the applicability of neuro-fuzzy approaches.

[1]  James C. Bezdek,et al.  Prototype classification and feature selection with fuzzy sets , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Nikola K. Kasabov,et al.  Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems , 1996, Fuzzy Sets Syst..

[3]  Yonghong Peng,et al.  A novel feature selection approach for biomedical data classification , 2010, J. Biomed. Informatics.

[4]  Masao Mukaidono,et al.  A fuzzy neural network for pattern classification and feature selection , 2002, Fuzzy Sets Syst..

[5]  Saroj K. Meher,et al.  A novel approach to neuro-fuzzy classification , 2009, Neural Networks.

[6]  Walmir M. Caminhas,et al.  Evolving Neural Fuzzy Network with Adaptive Feature Selection , 2012, 2012 11th International Conference on Machine Learning and Applications.

[7]  Huan Liu,et al.  Neural-network feature selector , 1997, IEEE Trans. Neural Networks.

[8]  Partha Pratim Sarkar,et al.  A novel Neuro-fuzzy classification technique for data mining , 2014 .

[9]  M. Ganesh,et al.  Introduction to Fuzzy Sets and Fuzzy Logic , 2006 .

[10]  Aboul Ella Hassanien,et al.  Dimensionality reduction of medical big data using neural-fuzzy classifier , 2014, Soft Computing.

[11]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[12]  Kazuyuki Murase,et al.  A new wrapper feature selection approach using neural network , 2010, Neurocomputing.

[13]  Antanas Verikas,et al.  Feature selection with neural networks , 2002, Pattern Recognit. Lett..

[14]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[15]  Ferat Sahin,et al.  A survey on feature selection methods , 2014, Comput. Electr. Eng..

[16]  Giovanna Castellano,et al.  Discovering Prediction Rules by a Neuro-fuzzy Modeling Framework , 2003, KES.

[17]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[18]  Mohammad Mehdi Ebadzadeh,et al.  A novel hybrid algorithm for creating self-organizing fuzzy neural networks , 2009, Neurocomputing.

[19]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[20]  Sankar K. Pal,et al.  Feature analysis: Neural network and fuzzy set theoretic approaches , 1997, Pattern Recognit..

[21]  Nikhil R. Pal,et al.  A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification , 2004, IEEE Transactions on Neural Networks.

[22]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[23]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[24]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[25]  Samarjit Kar,et al.  Applications of neuro fuzzy systems: A brief review and future outline , 2014, Appl. Soft Comput..

[26]  Baoding Liu.  Uncertainty Theory: An Introduction to its Axiomatic Foundations , 2004 .

[27]  Francesco Marcelloni,et al.  Feature selection based on a modified fuzzy C-means algorithm with supervision , 2003, Inf. Sci..

[28]  Craig Valli,et al.  A Wrapper-Based Feature Selection for Analysis of Large Data Sets , 2010 .

[29]  Narissara Eiamkanitchat,et al.  Enhance Neuro-fuzzy system for classification using dynamic clustering , 2014, The 4th Joint International Conference on Information and Communication Technology, Electronic and Electrical Engineering (JICTEE).

[30]  Nikhil R. Pal,et al.  An Integrated Mechanism for Feature Selection and Fuzzy Rule Extraction for Classification , 2012, IEEE Transactions on Fuzzy Systems.

[31]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  James J. Buckley,et al.  Fuzzy neural network with fuzzy signals and weights , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[33]  Nikhil R. Pal,et al.  Integrated feature analysis and fuzzy rule-based system identification in a neuro-fuzzy paradigm , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[34]  Dunja Mladenic,et al.  Feature Selection for Dimensionality Reduction , 2005, SLSFS.

[35]  Sankar K. Pal,et al.  Neuro-fuzzy feature evaluation with theoretical analysis , 1999, Neural Networks.

[36]  José Ramón Villar,et al.  A Feature Selection Method Using a Fuzzy Mutual Information Measure , 2008, Innovations in Hybrid Intelligent Systems.

[37]  Sansanee Auephanwiriyakul,et al.  A novel neuro-fuzzy method for linguistic feature selection and rule-based classification , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[38]  Zvonko G. Vranesic,et al.  Multiple-Valued Logic: An Introduction and Overview , 1977, IEEE Transactions on Computers.

[39]  Chih-Ming Chen,et al.  An efficient fuzzy classifier with feature selection based on fuzzy entropy , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[40]  J.L. Castro,et al.  A neuro-fuzzy approach for feature selection , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[41]  Narissara Eiamkanitchat,et al.  The Adaptive Dynamic Clustering Neuro-Fuzzy System for Classification , 2015 .

[42]  U. V. Kulkarni,et al.  Hybrid fuzzy classifier based on feature-wise membership given by artificial neural network , 2013, 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[43]  Pablo A. Estévez,et al.  A review of feature selection methods based on mutual information , 2013, Neural Computing and Applications.

[44]  Tandra Pal,et al.  A Neuro-Fuzzy Scheme for Integrated Input Fuzzy Set Selection and Optimal Fuzzy Rule Generation for Classification , 2007, PReMI.