Calibrated Simplex Mapping Classification

We propose a novel supervised multi-class/single-label classifier that maps training data onto a linearly separable latent space with a simplex-like geometry. This approach allows us to transform the classification problem into a well-defined regression problem. For its solution we can choose suitable distance metrics in feature space and regression models predicting latent space coordinates. A benchmark on various artificial and real-world data sets is used to demonstrate the calibration qualities and prediction performance of our classifier.

[1]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[2]  Thorsteinn S. Rögnvaldsson,et al.  State of the art prediction of HIV-1 protease cleavage sites , 2015, Bioinform..

[3]  Bianca Zadrozny,et al.  Transforming classifier scores into accurate multiclass probability estimates , 2002, KDD.

[4]  Rajen B. Bhatt,et al.  User Localization in an Indoor Environment Using Fuzzy Hybrid of Particle Swarm Optimization & Gravitational Search Algorithm with Neural Networks , 2016, SocProS.

[5]  Harold Parks,et al.  An Elementary Calculation of the Dihedral Angle of the Regular n-Simplex , 2002, Am. Math. Mon..

[6]  Zoubin Ghahramani,et al.  Adversarial Examples, Uncertainty, and Transfer Testing Robustness in Gaussian Process Hybrid Deep Networks , 2017, 1707.02476.

[7]  Elena Deza,et al.  Encyclopedia of Distances , 2014 .

[8]  Rich Caruana,et al.  Predicting good probabilities with supervised learning , 2005, ICML.

[9]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[10]  R. Srinivasan.  Importance Sampling: Applications in Communications and Detection , 2010 .

[11]  James Hensman,et al.  MCMC for Variationally Sparse Gaussian Processes , 2015, NIPS.

[12]  Marc Sebban,et al.  A Survey on Metric Learning for Feature Vectors and Structured Data , 2013, ArXiv.

[13]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[14]  Andrew Gordon Wilson,et al.  Learning Scalable Deep Kernels with Recurrent Structure , 2016, J. Mach. Learn. Res..

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Edward Challis,et al.  Gaussian process classification of Alzheimer's disease and mild cognitive impairment from resting-state fMRI , 2015, NeuroImage.

[17]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[18]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[19]  M. F. Baumgardner,et al.  220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3 , 2015 .

[20]  Birgit Kirsch,et al.  Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systems , 2019 .

[21]  Donald D. Lucas,et al.  Failure analysis of parameter-induced simulation crashes in climate models , 2013 .

[22]  Constantinos Daskalakis,et al.  Scalable Gaussian Processes, with Guarantees: Kernel Approximations and Deep Feature Extraction , 2020 .

[23]  Andrew Gordon Wilson,et al.  Stochastic Variational Deep Kernel Learning , 2016, NIPS.

[24]  Carl E. Rasmussen,et al.  Manifold Gaussian Processes for regression , 2014, 2016 International Joint Conference on Neural Networks (IJCNN).

[25]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[26]  Peter A. Lieberzeit,et al.  Classification of alcohols obtained by QCM sensors with different characteristics using ABC based neural network , 2020, Engineering Science and Technology, an International Journal.

[27]  Tomoharu Iwata,et al.  Improving Output Uncertainty Estimation and Generalization in Deep Learning via Neural Network Gaussian Processes , 2017, 1707.05922.

[28]  S. Chandramathi,et al.  A Review of various k-Nearest Neighbor Query Processing Techniques , 2011 .

[29]  Stephen E. Fienberg,et al.  The Comparison and Evaluation of Forecasters. , 1983 .

[30]  Haitao Liu,et al.  When Gaussian Process Meets Big Data: A Review of Scalable GPs , 2018, IEEE Transactions on Neural Networks and Learning Systems.