Evaluating measures of adverse financial conditions

Timely identification and anticipation of adverse conditions in the financial system are critical for macroprudential policy. However, there is no consensus on how to evaluate the quality of systemic measures. This paper provides a framework to compare measures of systemic conditions. We illustrate the proposed tests with a case study of US measures from 1976 to 2013. We find that measures which include information from multiple markets improve identification of critical system states. However, tested measures show limited capacity to anticipate critical episodes.

[1]  Ying Liu,et al.  Measuring financial stress in a developed country: An application to Canada , 2006 .

[2]  Lucia Alessi,et al.  On policymakers’ loss functions and the evaluation of early warning systems: Comment , 2014 .

[3]  Michael T. Owyang,et al.  Disentangling diverse measures: a survey of financial stress indexes , 2012 .

[4]  R. Shiller.  Causes of changing financial market volatility , 1988 .

[5]  Mohamed Limam,et al.  On monitoring financial stress index with extreme value theory , 2012 .

[6]  Marcel Fratzscher,et al.  Low probability, high impact: Policy making and extreme events , 2008 .

[7]  J. Hollingsworth,et al.  Advancing socio-economics : an institutionalist perspective , 2002 .

[8]  John Metcalfe,et al.  Evolutionary Theories of Economic and Technological Change: Present Status and Future Prospects , 1991 .

[9]  William A. Brock,et al.  A rational route to randomness , 1997 .

[10]  H. Simon,et al.  Rational Decision Making in Business Organizations , 1978 .

[11]  G. H. Moore.  What Is a Recession , 1967 .

[12]  E. Fama,et al.  BUSINESS CONDITIONS AND EXPECTED RETURNS ON STOCKS AND BONDS , 1989 .

[13]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[14]  Markus Holopainen,et al.  Toward robust early-warning models: a horse race, ensembles and model uncertainty , 2015, SSRN Electronic Journal.

[15]  Carmen M. Reinhart,et al.  Leading Indicators of Currency Crises , 1997, SSRN Electronic Journal.

[16]  Andrew Berg,et al.  Predicting currency crises:: The indicators approach and an alternative , 1999 .

[17]  Peter Sarlin,et al.  Predicting Distress in European Banks , 2013, SSRN Electronic Journal.

[18]  Hans-Eggert Reimers,et al.  Asset Price Misalignments and the Role of Money and Credit , 2009, SSRN Electronic Journal.

[19]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[20]  Mikhail V. Oet,et al.  Early Warning Systems for Systemic Banking Risk: Critical Review and Modeling Implications , 2010 .

[21]  L. Laeven,et al.  Systemic Banking Crises Database II , 2013 .

[22]  Kathryn Judge.  Fragmentation Nodes: A Study in Financial Innovation, Complexity and Systemic Risk , 2012 .

[23]  Dieter Gramlich,et al.  SAFE: An Early Warning System for Systemic Banking Risk , 2011 .

[24]  G. Dufrénot,et al.  A Forewarning Indicator System for Financial Crises: The Case of Six Central and Eastern European Countries , 2007 .

[25]  W. Scott,et al.  Organizations and Organizing: Rational, Natural and Open Systems Perspectives , 2006 .

[26]  Matthew J. Streeter,et al.  Two Broad Classes of Functions for Which a No Free Lunch Result Does Not Hold , 2003, GECCO.

[27]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[28]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[29]  William A Brock,et al.  Policy Evaluation in Uncertain Economic Environments , 2003 .

[30]  Asli Demirgüç-Kunt,et al.  Monitoring Banking Sector Fragility: A Multivariate Logit Approach with an Application to the 1996-97 Banking Crises , 1999 .

[31]  C. Borio,et al.  Assessing the risk of banking crises , 2002 .

[32]  Marc Toussaint,et al.  A No-Free-Lunch Theorem for Non-Uniform Distributions of Target Functions , 2004 .

[33]  Rosario N. Mantegna,et al.  Book Review: An Introduction to Econophysics, Correlations, and Complexity in Finance, N. Rosario, H. Mantegna, and H. E. Stanley, Cambridge University Press, Cambridge, 2000. , 2000 .

[34]  Lucia Alessi,et al.  'Real Time' Early Warning Indicators for Costly Asset Price Boom/Bust Cycles: A Role for Global Liquidity , 2009 .

[35]  Craig S. Hakkio,et al.  Financial stress: what is it, how can it be measured, and why does it matter? , 2009 .

[36]  Lawrence B. Mohr,et al.  Explaining organizational behavior , 1982 .

[37]  Jason Potts,et al.  The General Theory of Economic Evolution , 2007 .

[38]  R. Levins.  Evolution in Changing Environments: Some Theoretical Explorations. (MPB-2) , 1968 .

[39]  The Three Ps: Simple Tools for Monitoring Economic Cycles , 1999 .

[40]  James D. Thompson.  Organizations in Action: Social Science Bases of Administrative Theory , 1967 .

[41]  G. Schwert.  Why Does Stock Market Volatility Change Over Time? , 1988 .

[42]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[43]  Carmen M. Reinhart,et al.  The Twin Crises: The Causes of Banking and Balance-of-Payments Problems , 1996 .

[44]  W. Arthur,et al.  Complexity in Economic and Financial Markets , 1995 .

[45]  Hali J. Edison,et al.  Do Indicators of Financial Crises Work? An Evaluation of an Early Warning System , 2000 .

[46]  T. Havránek,et al.  Leading Indicators of Crisis Incidence: Evidence from Developed Countries , 2012, SSRN Electronic Journal.

[47]  Peter Sarlin,et al.  On policymakers’ loss functions and the evaluation of early warning systems , 2013 .

[48]  J. Stock,et al.  Macroeconomic Forecasting Using Diffusion Indexes , 2002 .

[49]  Mikhail V. Oet,et al.  Supervising System Stress in Multiple Markets , 2015 .

[50]  Naeem Siddiqi,et al.  Credit Risk Scorecards: Developing and Implementing Intelligent Credit Scoring , 2005 .

[51]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[52]  J. Gibbons,et al.  A Correlation Measure for Nominal Data , 1967 .

[53]  W. Brian Arthur,et al.  Complexity in economic and financial markets: Behind the physical institutions and technologies of the marketplace lie the beliefs and expectations of real human beings , 1995, Complex..

[54]  Cars H. Hommes,et al.  Financial markets as nonlinear adaptive evolutionary systems , 2001 .

[55]  W. Brock,et al.  Heterogeneous beliefs and routes to chaos in a simple asset pricing model , 1998 .

[56]  Pierre Monnin,et al.  Measuring and forecasting stress in the banking sector: evidence from Switzerland , 2005 .

[57]  Scott A. Brave,et al.  Diagnosing the Financial System: Financial Conditions and Financial Stress , 2012 .

[58]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[59]  J. Barkley Rosser,et al.  From Catastrophe to Chaos: A General Theory of Economic Discontinuities , 1991 .

[60]  H. Simon,et al.  Models of Man, Social and Rational: Mathematical Essays on Rational Human Behavior in a Social Setting , 1957 .

[61]  V. Zarnowitz.  Recent Work on Business Cycles in Historical Perspective: Review of Theories and Evidence , 1984 .

[62]  Ogden Bancshares.  UNITED STATES OF AMERICA BEFORE THE BOARD OF GOVERNORS OF THE FEDERAL RESERVE SYSTEM WASHINGTON, D.C. , 2009 .

[63]  H. Young,et al.  Individual Strategy and Social Structure: An Evolutionary Theory of Institutions , 1999 .

[64]  Mathias Drehmann,et al.  Evaluating Early Warning Indicators of Banking Crises: Satisfying Policy Requirements , 2013 .

[65]  S. Johansen.  Likelihood-Based Inference in Cointegrated Vector Autoregressive Models , 1996 .

[66]  Marco Gallegati,et al.  Early Warning Signals of Financial Stress: A “Wavelet-Based” Composite Indicators Approach , 2014 .

[67]  W. A. Wallis,et al.  A Significance Test for Time Series Analysis , 1941 .

[68]  C. Borio.  Towards a Macroprudential Framework for Financial Supervision and Regulation? , 2003 .

[69]  Mathias Drehmann,et al.  Assessing the Risk of Banking Crises – Revisited , 2009 .

[70]  Dieter Gramlich,et al.  The Financial Stress Index: Identification of Systemic Risk Conditions , 2011 .

[71]  Wolfram Elsner,et al.  The Microeconomics of Complex Economies: Evolutionary, Institutional, Neoclassical, and Complexity Perspectives , 2014 .

[72]  E. Davis,et al.  Comparing early warning systems for banking crises , 2008 .

[73]  A. Lo,et al.  Frontiers of finance: evolution and efficient markets. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[74]  Tuomas A. Peltonen,et al.  Assessing systemic risks and predicting systemic events , 2013 .

[75]  HERBERT A. SIMON,et al.  The Architecture of Complexity , 1991 .

[76]  M. Bordo,et al.  Strained Relations: US Foreign-Exchange Operations and Monetary Policy in the Twentieth Century , 2015 .

[77]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[78]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .