Kullback-Leibler Divergence Measure for Multivariate Skew-Normal Distributions

The aim of this work is to provide the tools to compute the well-known Kullback–Leibler divergence measure for the flexible family of multivariate skew-normal distributions. In particular, we use the Jeffreys divergence measure to compare the multivariate normal distribution with the skew-multivariate normal distribution, showing that this is equivalent to comparing univariate versions of these distributions. Finally, we applied our results on a seismological catalogue data set related to the 2010 Maule earthquake. Specifically, we compare the distributions of the local magnitudes of the regions formed by the aftershocks.

[1]  Don H. Johnson,et al.  the Kullback-Leibler distance , 2001 .

[2]  Michel Barlaud,et al.  High-Dimensional Statistical Measure for Region-of-Interest Tracking , 2009, IEEE Transactions on Image Processing.

[3]  R. Arellano-Valle,et al.  On the Unification of Families of Skew‐normal Distributions , 2006 .

[4]  A. Azzalini,et al.  Statistical applications of the multivariate skew normal distribution , 2009, 0911.2093.

[5]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[6]  Jing-Huai Gao,et al.  Estimation of Seismic Wavelets Based on the Multivariate Scale Mixture of Gaussians Model , 2010, Entropy.

[7]  Nicola Torelli,et al.  Clustering via nonparametric density estimation , 2007, Stat. Comput..

[8]  R. Arellano-Valle,et al.  Bayesian sensitivity analysis in elliptical linear regression models , 2000 .

[9]  Arjun K. Gupta,et al.  A multivariate skew normal distribution , 2004 .

[10]  A. C. Frery,et al.  Information Theory and Image Understanding: An Application to Polarimetric SAR Imagery , 2014 .

[11]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[12]  Maya R. Gupta,et al.  Parametric Bayesian Estimation of Differential Entropy and Relative Entropy , 2010, Entropy.

[13]  Barnabás Póczos,et al.  Nonparametric divergence estimators for independent subspace analysis , 2011, 2011 19th European Signal Processing Conference.

[14]  Tariq S. Durrani,et al.  Copula based divergence measures and their use in image registration , 2009, 2009 17th European Signal Processing Conference.

[15]  On the spatial correlation between areas of high coseismic slip and aftershock clusters of the Maule earthquake Mw=8.8 , 2012, 1208.1517.

[16]  M. Genton,et al.  Moments of skew-normal random vectors and their quadratic forms , 2001 .

[17]  A. Ullah.  Entropy, divergence and distance measures with econometric applications , 1996 .

[18]  Peter Harremoës,et al.  Rényi divergence and majorization , 2010, 2010 IEEE International Symposium on Information Theory.

[19]  David R. Anderson,et al.  Model Selection and Inference: A Practical Information-Theoretic Approach , 2001 .

[20]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[21]  Abd-Krim Seghouane,et al.  Multivariate regression model selection from small samples using Kullback's symmetric divergence , 2006, Signal Process..

[22]  M. Genton,et al.  On fundamental skew distributions , 2005 .

[23]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[24]  Abd-Krim Seghouane,et al.  New AIC Corrected Variants for Multivariate Linear Regression Model Selection , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[25]  Robert E. Weiss,et al.  A Graphical Case Statistic for Assessing Posterior Influence , 1992 .

[26]  Leandro Pardo,et al.  On the applications of divergence type measures in testing statistical hypotheses , 1994 .

[27]  Ananda Sen,et al.  Skew-Elliptical Distributions and Their Applications: A Journey Beyond Normality , 2005, Technometrics.

[28]  Javier E. Contreras-Reyes,et al.  Shannon Entropy and Mutual Information for Multivariate Skew‐Elliptical Distributions , 2013 .