Mining local and tail dependence structures based on pointwise mutual information

The behavior of events that occur infrequently but have a large impact tends to differ from that of the central tendency, and identifying the tail dependence structure among key factors is critical for controlling risks. However, due to technical difficulties, conventional analyses of dependence have focused on the global average dependence. This article proposes a novel approach for analyzing the entire structure of nonlinear dependence between two data sets on the basis of accurate pointwise mutual information estimation. The emphasis is on fat-tailed distributions that tend to appear in events involving sudden large changes. The proposed pointwise mutual information estimator is sufficiently robust and efficient for exploring tail dependence, and its good performance was confirmed in an experimental study. The significance of the identified dependence structure was assessed using the proposed bootstrap procedure. New facts were discovered from its application to daily returns and volume on the New York stock Exchange (NYSE) Composite Index.

[1]  Paul Embrechts,et al.  Quantitative Risk Management , 2011, International Encyclopedia of Statistical Science.

[2]  R. Nelsen An Introduction to Copulas , 1998 .

[3]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[4]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[5]  Jonathan M. Karpoff The Relation between Price Changes and Trading Volume: A Survey , 1987, Journal of Financial and Quantitative Analysis.

[6]  Marcia L. Branstetter,et al.  Geospatial temporal dependence among weekly precipitation extremes with applications to observations and climate model simulations in South America , 2007 .

[7]  Chu-hsiung Lin,et al.  Multiple structural changes in the tail behavior: Evidence from stock index futures returns , 2008 .

[8]  E. Luciano,et al.  Copula Methods in Finance: Cherubini/Copula , 2004 .

[9]  Takafumi Kanamori,et al.  Mutual information estimation reveals global associations between stimuli and biological processes , 2009, BMC Bioinformatics.

[10]  B. Lindsay,et al.  Minimum disparity estimation for continuous models: Efficiency, distributions and robustness , 1994 .

[11]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[12]  Aristidis K. Nikoloulopoulos,et al.  Tail dependence functions and vine copulas , 2010, J. Multivar. Anal..

[13]  Andrew J. Patton Copula-Based Models for Financial Time Series , 2009 .

[14]  R. Nelsen An Introduction to Copulas (Springer Series in Statistics) , 2006 .

[15]  Richard A. Davis,et al.  Handbook of Financial Time Series , 2009 .

[16]  Johan Segers,et al.  Extreme-value copulas , 2009, 0911.1015.

[17]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[18]  Gholam-Ali Hossein-Zadeh,et al.  A mutual information‐based metric for evaluation of fMRI data‐processing approaches , 2011, Human brain mapping.

[19]  S. Saigal,et al.  Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  C. Klüppelberg,et al.  Estimating the tail dependence function of an elliptical distribution , 2007 .

[21]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[22]  Peter E. Rossi,et al.  Stock Prices and Volume , 1992 .

[23]  Chong-Ho Choi,et al.  Input Feature Selection by Mutual Information Based on Parzen Window , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  D. Kugiumtzis,et al.  Evaluation of mutual information estimators on nonlinear dynamic systems , 2008, 0809.2149.

[25]  A. McNeil Multivariate t Distributions and Their Applications , 2006 .

[26]  R. Huisman,et al.  Tail-Index Estimates in Small Samples , 2001 .

[27]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[28]  J. Gore,et al.  Mutual information analysis of the EEG in patients with Alzheimer's disease , 2001, Clinical Neurophysiology.

[29]  R T Wicks,et al.  Mutual information as a tool for identifying phase transitions in dynamical complex systems with limited data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[31]  Teruko Takada,et al.  Asymptotic and Qualitative Performance of Non-Parametric Density Estimators: A Comparative Study , 2008 .

[32]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[33]  Ian Abramson On Bandwidth Variation in Kernel Estimates-A Square Root Law , 1982 .

[34]  Fabrizio Durante,et al.  Copula Theory and Its Applications , 2010 .

[35]  M Palus,et al.  Synchronization as adjustment of information rates: detection from bivariate time series. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Teruko Takada,et al.  Simulated minimum Hellinger distance estimation of stochastic volatility models , 2009, Comput. Stat. Data Anal..

[37]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[38]  P. Rousseeuw,et al.  Unmasking Multivariate Outliers and Leverage Points , 1990 .

[39]  Arthur Charpentier,et al.  Tails of multivariate Archimedean copulas , 2009, J. Multivar. Anal..

[40]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[42]  R. O. Dendy,et al.  Mutual information between geomagnetic indices and the solar wind as seen by WIND: Implications for propagation time estimates , 2005 .

[43]  Moon,et al.  Estimation of mutual information using kernel density estimators. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[44]  L. Breiman,et al.  Variable Kernel Estimates of Multivariate Densities , 1977 .

[45]  S. Kotz,et al.  Correlation and dependence , 2001 .

[46]  Mauricio Barahona,et al.  Detection of nonlinear dynamics in short, noisy time series , 1996, Nature.

[47]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[48]  Jenq-Neng Hwang,et al.  Nonparametric multivariate density estimation: a comparative study , 1994, IEEE Trans. Signal Process..

[49]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[50]  J. Marron,et al.  SCALE SPACE VIEW OF CURVE ESTIMATION , 2000 .

[51]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.