Discriminative directional classifiers

In different areas of knowledge, phenomena are represented by directional-angular or periodic-data; from wind direction and geographical coordinates to time references like days of the week or months of the calendar. These values are usually represented in a linear scale, and restricted to a given range (e.g. 0 , 2 π ) ), hiding the real nature of this information. Therefore, dealing with directional data requires special methods. So far, the design of classifiers for periodic variables adopts a generative approach based on the usage of the von Mises distribution or variants. Since for non-periodic variables state of the art approaches are based on non-generative methods, it is pertinent to investigate the suitability of other approaches for periodic variables. We propose a discriminative Directional Logistic Regression model able to deal with angular data, which does not make any assumption on the data distribution. Also, we study the expressiveness of this model for any number of features. Finally, we validate our model against the previously proposed directional naive Bayes approach and against a Support Vector Machine with a directional Radial Basis Function kernel with synthetic and real data obtaining competitive results.

[1]  Adelaide Figueiredo,et al.  Discriminant analysis based on the Watson distribution defined on the hypersphere , 2006 .

[2]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[3]  Jaime S. Cardoso,et al.  Context-based trajectory descriptor for human activity profiling , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[4]  Concha Bielza,et al.  Directional naive Bayes classifiers , 2015, Pattern Analysis and Applications.

[5]  Alan J. Lee,et al.  Regression Models for an Angular Response , 1992 .

[6]  Kanti V. Mardia,et al.  Mixtures of concentrated multivariate sine distributions with applications to bioinformatics , 2012 .

[7]  Jaime S. Cardoso,et al.  Social Signaling Descriptor for Group Behaviour Analysis , 2015, IbPRIA.

[8]  Pat Langley,et al.  Induction of Selective Bayesian Classifiers , 1994, UAI.

[9]  Grace S. Shieh,et al.  A CIRCULAR-CIRCULAR REGRESSION MODEL , 2008 .

[10]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[11]  Guilherme A. Barreto,et al.  Short-term memory mechanisms in neural network learning of robot navigation tasks: A case study , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[12]  Richard S. Zemel,et al.  Lending direction to neural networks , 1995, Neural Networks.

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  Cordelia Schmid,et al.  Applying Color Names to Image Description , 2007, 2007 IEEE International Conference on Image Processing.

[15]  Ian T. Jolliffe,et al.  Fitting mixtures of von Mises distributions: a case study involving sudden infant death syndrome , 2003, Comput. Stat. Data Anal..

[16]  Paulo Cortez,et al.  A Proactive Intelligent Decision Support System for Predicting the Popularity of Online News , 2015, EPIA.

[17]  H. A. Guvenir,et al.  A supervised machine learning algorithm for arrhythmia analysis , 1997, Computers in Cardiology 1997.

[18]  Bernhard Schölkopf,et al.  Comparing support vector machines with Gaussian kernels to radial basis function classifiers , 1997, IEEE Trans. Signal Process..

[19]  W. L. Kovach,et al.  Quantitative methods for the study of lycopod megaspore ultrastructure , 1989 .

[20]  R. Miranda,et al.  Circular Nodes in Neural Networks , 1996, Neural Computation.

[21]  A. SenGupta,et al.  A Classification Method for Directional Data with Application to the Human Skull , 2011 .

[22]  Rocco A. Servedio,et al.  Discriminative learning can succeed where generative learning fails , 2006, Inf. Process. Lett..

[23]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[24]  Suvrit Sra,et al.  A short note on parameter approximation for von Mises-Fisher distributions: and a fast implementation of Is(x) , 2012, Comput. Stat..

[25]  Concha Bielza,et al.  The von Mises Naive Bayes Classifier for Angular Data , 2011, CAEPIA.

[26]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[27]  Jaime S. Cardoso,et al.  Temporal Segmentation of Digital Colposcopies , 2015, IbPRIA.

[28]  Frederic Paik Schoenberg,et al.  Kernel Regression of Directional Data with Application to Wind and Wildfire Data in Los Angeles County, California , 2007, Forest Science.

[29]  Inderjit S. Dhillon,et al.  Clustering on the Unit Hypersphere using von Mises-Fisher Distributions , 2005, J. Mach. Learn. Res..

[30]  A. SenGupta,et al.  A Simple Classification Rule for Directional Data , 2005 .

[31]  Petr Savický,et al.  Methods for multidimensional event classification: A case study using images from a Cherenkov gamma-ray telescope , 2004 .

[32]  Bruno Bauwens,et al.  From circular ordinal regression to multilabel classification , 2010 .

[33]  Adelaide Figueiredo,et al.  Discriminant Analysis for the von Mises-Fisher Distribution , 2009, Commun. Stat. Simul. Comput..