Using Fisher Information In Big Data

In this era of Big Data, proficient use of data mining is the key to capture useful information from any dataset. As numerous data mining techniques make use of information theory concepts, in this paper, we discuss how Fisher information (FI) can be applied to analyze patterns in Big Data. The main advantage of FI is its ability to combine multiple variables together to inform us on the overall trends and stability of a system. It can therefore detect whether a system is losing dynamic order and stability, which may serve as a signal of an impending regime shift. In this work, we first provide a brief overview of Fisher information theory, followed by a simple step-by-step numerical example on how to compute FI. Finally, as a numerical demonstration, we calculate the evolution of FI for GDP per capita (current US Dollar) and total population of the USA from 1960 to 2013.

[1]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[2]  Brian D. Fath,et al.  Applications of Fisher Information to the Management of Sustainable Environmental Systems , 2007 .

[3]  C. Allen,et al.  Prolonged Instability Prior to a Regime Shift , 2014, PloS one.

[4]  Brian D. Fath,et al.  Exergy and Fisher Information as ecological indices , 2004 .

[5]  M. Maslin,et al.  Defining the Anthropocene , 2015, Nature.

[6]  Jane C. Bare,et al.  Integrated Metrics for Improving the Life Cycle Approach to Assessing Product System Sustainability , 2014 .

[7]  S. Derrible,et al.  Macroscopic Model of Greenhouse Gas Emissions for Municipalities , 2010 .

[8]  Alejandra M. González-Mejía,et al.  Recent developments in the application of Fisher information to sustainable environmental management , 2015 .

[9]  Caitlin D Cottrill,et al.  Leveraging Big Data for the Development of Transport Sustainability Indicators , 2015 .

[10]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[11]  Sybil Derrible,et al.  Network-Based and Binless Frequency Analyses , 2015, PloS one.

[12]  A. Garmestani,et al.  CROSS-SCALE DYNAMICS OF A REGIONAL URBAN SYSTEM THROUGH TIME , 2012 .

[13]  Heriberto Cabezas,et al.  Regime changes in ecological systems: an information theory approach. , 2003, Journal of theoretical biology.

[14]  Heriberto Cabezas,et al.  Detection and Assessment of Ecosystem Regime Shifts from Fisher Information , 2008 .

[15]  Heriberto Cabezas,et al.  Assessing sustainability in real urban systems: the Greater Cincinnati Metropolitan Area in Ohio, Kentucky, and Indiana. , 2012, Environmental science & technology.

[16]  Sybil Derrible,et al.  Development and application of the Pedestrian Environment Index (PEI) , 2014 .

[17]  Brian D. Fath,et al.  Towards a sustainability index using information theory , 2005 .

[18]  K. Taylor.  Rapid Climate Change , 1999 .

[19]  M. Maslin,et al.  Sudden climate transitions during the Quaternary , 1999 .

[20]  Heriberto Cabezas,et al.  Computing and interpreting Fisher Information as a metric of sustainability: regime changes in the United States air quality , 2012, Clean Technologies and Environmental Policy.

[21]  Alejandra M. González-Mejía,et al.  Social and economic sustainability of urban systems: comparative analysis of metropolitan statistical areas in Ohio, USA , 2014, Sustainability Science.

[22]  Brian D. Fath,et al.  Towards a theory of sustainable systems , 2002 .

[23]  Craig A. Stow,et al.  Managing for resilience: an information theory‐based approach to assessing ecosystems , 2016 .

[24]  Audrey L. Mayer,et al.  Fisher Information and dynamic regime changes in ecological systems , 2006 .

[25]  P. Crutzen,et al.  The Anthropocene: Are Humans Now Overwhelming the Great Forces of Nature , 2007, Ambio.

[26]  Robert A. Gatenby,et al.  Exploratory Data Analysis Using Fisher Information , 2006 .

[27]  Lawrence L. Lapin.  Statistics: Meaning and Method , 1975 .

[28]  B. Frieden,et al.  Physics from Fisher Information by B. Roy Frieden , 1998 .

[29]  B. Frieden,et al.  Physics from Fisher Information: A Unification , 1998 .

[30]  Matthew T Heberling,et al.  Introduction to the special collection of papers on the San Luis Basin Sustainability Metrics Project: a methodology for evaluating regional sustainability. , 2012, Journal of environmental management.

[31]  Heriberto Cabezas,et al.  Managing for resilience: early detection of regime shifts in complex systems , 2014, Clean Technologies and Environmental Policy.

[32]  H. Cabezas,et al.  Evaluating the sustainability of a regional system using Fisher information in the San Luis Basin, Colorado. , 2012, Journal of environmental management.