Modeling Spectral Data Based on Mutual Information and Kernel Extreme Learning Machines

Effective modeling based on the high dimensional data needs feature selection and fast learning speed. Aim at this problem, a novel modeling approach based on mutual information and extreme learning machines is proposed in this paper. Simple mutual information based feature selection method is integrated with the fast learning kernel based extreme learning machines to obtain better modeling performance. In the method, optimal number of the features and learning parameters of models are selected simultaneously. The simulation results based on the near-infrared spectrum show that the proposed approach has better prediction performance and fast leaning speed.

[1]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[4]  R. Leardi,et al.  Variable selection for multivariate calibration using a genetic algorithm: prediction of additive concentrations in polymer films from Fourier transform-infrared spectral data , 2002 .

[5]  Menglong Li,et al.  Mutual information-induced interval selection combined with kernel partial least squares for near-infrared spectral calibration. , 2008, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[6]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[7]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[8]  Lei Wang,et al.  Feature Selection with Kernel Class Separability , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Lei Liu,et al.  Feature selection with dynamic mutual information , 2009, Pattern Recognit..

[10]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[11]  Luis O. Jimenez-Rodriguez,et al.  Unsupervised Linear Feature-Extraction Methods and Their Effects in the Classification of High-Dimensional Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.