Big Data: Unleashing information

At present, it is projected that about 4 zettabytes (or 10**21 bytes) of digital data are being generated per year by everything from underground physics experiments to retail transactions to security cameras to global positioning systems. In the U. S., major research programs are being funded to deal with big data in all five sectors (i.e., services, manufacturing, construction, agriculture and mining) of the economy. Big Data is a term applied to data sets whose size is beyond the ability of available tools to undertake their acquisition, access, analytics and/or application in a reasonable amount of time. Whereas Tien (2003) forewarned about the data rich, information poor (DRIP) problems that have been pervasive since the advent of large-scale data collections or warehouses, the DRIP conundrum has been somewhat mitigated by the Big Data approach which has unleashed information in a manner that can support informed — yet, not necessarily defensible or valid — decisions or choices. Thus, by somewhat overcoming data quality issues with data quantity, data access restrictions with on-demand cloud computing, causative analysis with correlative data analytics, and model-driven with evidence-driven applications, appropriate actions can be undertaken with the obtained information. New acquisition, access, analytics and application technologies are being developed to further Big Data as it is being employed to help resolve the 14 grand challenges (identified by the National Academy of Engineering in 2008), underpin the 10 breakthrough technologies (compiled by the Massachusetts Institute of Technology in 2013) and support the Third Industrial Revolution of mass customization.

[1]  James M. Tien,et al.  Systems engineering in the growing service economy , 1995 .

[2]  G. Nolan,et al.  Computational solutions to large-scale data management and analysis , 2010, Nature Reviews Genetics.

[3]  Hans Peter Luhn,et al.  A Business Intelligence System , 1958, IBM J. Res. Dev..

[4]  James M. Tien,et al.  Enhancing the effectiveness of computers in public organizations through appropriate use of technology , 1986 .

[5]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[6]  Pedro Furtado A Survey of Parallel and Distributed Data Warehouses , 2009, Int. J. Data Warehous. Min..

[7]  H. Hoijtink,et al.  The proof of the pudding is in the eating Data fusion: An application in marketing , 2008 .

[8]  J. Tien Manufacturing and services: From mass production to mass customization , 2011 .

[9]  Ian T. Foster,et al.  Software as a service for data scientists , 2012, Commun. ACM.

[10]  Samir Khuller,et al.  Four colors suffice! , 2005, SIGA.

[11]  R. Bert Third Industrial Revolution: How Lateral Power Is Transforming Energy, the Economy, and the World By Jeremy Rifkin. New York City: Palgrave Macmillan, 2011 , 2012 .

[12]  Anwar M. Ghuloum,et al.  ViewpointFace the inevitable, embrace parallelism , 2009, CACM.

[13]  Eric Siegel,et al.  Predictive analytics: The power to predict who will click, buy, lie, or die , 2013, Journal of Marketing Analytics.

[14]  E. R. Swart The Philosophical Implications of the Four-Color Problem , 1980 .

[15]  K. Hipel,et al.  Interrelationships among noncooperative and coalition stability concepts , 2008 .

[16]  Viktor Mayer-Schnberger,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2013 .

[17]  F. Black,et al.  The Pricing of Options and Corporate Liabilities , 1973, Journal of Political Economy.

[18]  James M. Tien,et al.  Towards an operations-oriented approach to information systems design in public organizations , 1990 .

[19]  K. Appel,et al.  The Solution of the Four-Color-Map Problem , 1977 .

[20]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[21]  James M. Tien,et al.  On integration and adaptation in complex service systems , 2008, Journal of systems science and systems engineering.

[22]  Jeremy Rifkin,et al.  The third industrial revolution : how lateral power is transforming energy, the economy, and the world , 2011 .

[23]  N. Lindner,et al.  Topological Quantum Computation—From Basic Concepts to First Experiments , 2013, Science.

[24]  D. McFadden,et al.  The New Science of Pleasure , 2013 .

[25]  Adam Jacobs,et al.  The pathologies of big data , 2009, Commun. ACM.

[26]  Hiromitsu Hattori,et al.  Learning From Humans: Agent Modeling With Individual Human Behaviors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Nicholas G. Carr,et al.  Recent Future-Related Writing , 2010 .

[28]  Tilmann Rabl,et al.  Benchmarking Big Data Systems and the BigData Top100 List , 2013, Big Data.

[29]  James M. Tien,et al.  Toward a decision informatics paradigm: a real-time, information-based approach to decision making , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[30]  Michael L. Brodie,et al.  The meaningful use of big data: four perspectives -- four challenges , 2012, SGMD.

[31]  Ananth Krishnamurthy,et al.  Towards real-time customized management of supply and demand chains , 2004 .

[32]  Leonard Mlodinow,et al.  Subliminal: How Your Unconscious Mind Rules Your Behavior , 2012 .

[33]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[34]  Paul Zikopoulos,et al.  Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data , 2011 .

[35]  Nate Silver,et al.  The signal and the noise : why so many predictions fail but some don't , 2012 .

[36]  J. Tien The next industrial revolution: Integrated services and goods , 2012, Journal of Systems Science and Systems Engineering.

[37]  Jeanne G. Harris,et al.  Competing on Analytics: The New Science of Winning , 2007 .

[38]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[39]  J. Avouac,et al.  Under the Hood of the Earthquake Machine: Toward Predictive Modeling of the Seismic Cycle , 2012, Science.

[40]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[41]  Paul Segall,et al.  Understanding Earthquakes , 2012, Science.

[42]  James M. Tien,et al.  A case for service systems engineering , 2003 .