Extreme Learning Machines for VISualization+R: Mastering Visualization with Target Variables

The current paper presents an improvement of the Extreme Learning Machines for VISualization (ELMVIS+) nonlinear dimensionality reduction method. In this improved method, called ELMVIS+R, it is proposed to apply the originally unsupervised ELMVIS+ method for the regression problems, using target values to improve visualization results. It has been shown in previous work that the approach of adding supervised component for classification problems indeed allows to obtain better visualization results. To verify this assumption for regression problems, a set of experiments on several different datasets was performed. The newly proposed method was compared to the ELMVIS+ method and, in most cases, outperformed the original algorithm. Results, presented in this article, prove the general idea that using supervised components (target values) with nonlinear dimensionality reduction method like ELMVIS+ can improve both visual properties and overall accuracy.

[1]  Yu Xue,et al.  A Review on Feature Binding Theory and Its Functions Observed in Perceptual Process , 2017, Cognitive Computation.

[2]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[3]  I. Jolliffe.  Principal Component Analysis , 2002 .

[4]  Amir Hussain,et al.  From Spin to Swindle: Identifying Falsification in Financial Text , 2016, Cognitive Computation.

[5]  Samuel Kaski,et al.  Dimensionality Reduction for Data Visualization , 2010 .

[6]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[7]  Amaury Lendasse,et al.  X-SOM and L-SOM: A double classification approach for missing value imputation , 2010, Neurocomputing.

[8]  Mauro Dell'Amico,et al.  Assignment Problems , 1998, IFIP Congress: Fundamentals - Foundations of Computer Science.

[9]  Fadi Dornaika,et al.  Linear Dimensionality Reduction through Eigenvector Selection for Object Recognition , 2010, ISVC.

[10]  J. Gerritsma,et al.  Geometry, resistance and stability of the Delft Systematic Yacht hull series , 1981 .

[11]  Jieping Ye,et al.  Dimension reduction algorithms in data mining, with applications , 2005 .

[12]  Paulo Cortez,et al.  Modeling wine preferences by data mining from physicochemical properties , 2009, Decis. Support Syst..

[13]  Michel Verleysen,et al.  Time series forecasting with SOM and local non-linear models-Application to the DAX 30 index prediction , 2003 .

[14]  D. Lakshmi Padmaja,et al.  Comparative Study of Feature Subset Selection Methods for Dimensionality Reduction on Scientific Data , 2016, 2016 IEEE 6th International Conference on Advanced Computing (IACC).

[15]  Amaury Lendasse,et al.  High-Performance Extreme Learning Machines: A Complete Toolbox for Big Data Applications , 2015, IEEE Access.

[16]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[17]  Amaury Lendasse,et al.  ELMVIS+: Fast nonlinear visualization technique based on cosine distance and extreme learning machines , 2016, Neurocomputing.

[18]  Wu Wei,et al.  Convergence Analysis of a New Self Organizing Map Based Optimization (SOMO) Algorithm , 2015, Cognitive Computation.

[19]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[20]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[21]  Bing Liu,et al.  A Kernel Clustering-Based Possibilistic Fuzzy Extreme Learning Machine for Class Imbalance Learning , 2015, Cognitive Computation.

[22]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.

[23]  Mohammad Reza Daliri,et al.  Semantic Category-Based Classification Using Nonlinear Features and Wavelet Coefficients of Brain Signals , 2017, Cognitive Computation.

[24]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[25]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[26]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[27]  Amaury Lendasse,et al.  Extreme learning machine towards dynamic model hypothesis in fish ethology research , 2014, Neurocomputing.

[28]  Samuel Kaski,et al.  Dimensionality Reduction for Data Visualization [Applications Corner] , 2011, IEEE Signal Processing Magazine.

[29]  Guang-Bin Huang,et al.  What are Extreme Learning Machines? Filling the Gap Between Frank Rosenblatt’s Dream and John von Neumann’s Puzzle , 2015, Cognitive Computation.

[30]  Hui Wei,et al.  V4 Neural Network Model for Shape-Based Feature Extraction and Object Discrimination , 2015, Cognitive Computation.

[31]  Robert Jenssen,et al.  Training Echo State Networks with Regularization Through Dimensionality Reduction , 2016, Cognitive Computation.

[32]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[33]  Jarkko Venna,et al.  Information Retrieval Perspective to Nonlinear Dimensionality Reduction for Data Visualization , 2010, J. Mach. Learn. Res..

[34]  K. Hemachandran,et al.  Significance of Dimensionality Reduction in Image Processing , 2015 .

[35]  Alexander Vergara,et al.  On the calibration of sensor arrays for pattern recognition using the minimal number of experiments , 2014 .

[36]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[37]  Qinyu. Zhu.  Extreme Learning Machine , 2013 .

[38]  I-Cheng Yeh,et al.  Modeling of strength of high-performance concrete using artificial neural networks , 1998 .

[39]  Barbara Hammer,et al.  Data visualization by nonlinear dimensionality reduction , 2015, WIREs Data Mining Knowl. Discov..

[40]  Shankar Vembu,et al.  Chemical gas sensor drift compensation using classifier ensembles , 2012 .

[41]  Amaury Lendasse,et al.  Combined nonlinear visualization and classification: ELMVIS++C , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[42]  Amaury Lendasse,et al.  Linear Projection based on Noise Variance Estimation - Application to Spectral Data , 2008, ESANN.

[43]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[44]  Saman A. Zonouz,et al.  CloudID: Trustworthy cloud-based and cross-enterprise biometric identification , 2015, Expert Syst. Appl..

[45]  Amaury Lendasse,et al.  ELMVIS+: Improved Nonlinear Visualization Technique Using Cosine Distance and Extreme Learning Machines , 2016 .

[46]  Hongming Zhou,et al.  Extreme Learning Machines [Trends & Controversies] , 2013 .