Evolving Linear Discriminant in a Continuously Growing Dimensional Space for Incremental Attribute Learning

Feature Ordering is a unique preprocessing step in Incremental Attribute Learning (IAL), where features are gradually trained one after another. In previous studies, feature ordering derived based upon each individual feature’s contribution is time-consuming. This study attempts to develop an efficient feature ordering algorithm by some evolutionary approaches. The feature ordering algorithm presented in this paper is based on a criterion of maximum mean of feature discriminability. Experimental results derived by ITID, a neural IAL algorithm, show that such a feature ordering algorithm has a higher probability to obtain the lowest classification error rate with datasets from UCI Machine Learning Repository.

[1]  Troels Andreasen,et al.  Foundations of Intelligent Systems , 2014, Lecture Notes in Computer Science.

[2]  Fai Wong,et al.  An incremental decision tree learning methodology regarding attributes in medical data mining , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[3]  Jun Liu,et al.  Incremental Neural Network Training with an Increasing Input Dimension , 2004 .

[4]  Jose Miguel Puerta,et al.  Fast wrapper feature subset selection in high-dimensional datasets by means of filter re-ranking , 2012, Knowl. Based Syst..

[5]  Jun Liu,et al.  Incremental Ordered Neural Network Training , 2002 .

[6]  Steven Guan,et al.  An incremental approach to genetic-algorithms-based classification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Fei Liu,et al.  Feature Discriminability for Pattern Classification Based on Neural Incremental Attribute Learning , 2011 .

[8]  Shi Ying,et al.  Frontiers in Algorithmics , 2010, Lecture Notes in Computer Science.

[9]  Steven Guan,et al.  Incremental Learning with Respect to New Incoming Input Attributes , 2004, Neural Processing Letters.

[10]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  En Zhu,et al.  An Incremental Feature Learning Algorithm Based on Least Square Support Vector Machine , 2008, FAW.