Big Data: A Survey Research Perspective

Big data is a term that means different things to different people. To some, it means datasets so large that our traditional processing and analytic systems can no longer accommodate them. To others, it simply means taking advantage of existing datasets of all sizes and finding ways to merge them with the goal of generating new insights. The former view poses a number of important challenges to traditional market, opinion, and social research. In either case, there are implications for the future of surveys that are only beginning to be explored.

[1]  Adam Barker,et al.  Undefined By Data: A Survey of Big Data Definitions , 2013, ArXiv.

[2]  Piet Daas,et al.  Big Data as a Source for Official Statistics , 2015 .

[3]  Robert M. Groves,et al.  Survey Errors and Survey Costs: Groves/Survey Errors , 2005 .

[4]  Helmut Krcmar,et al.  Big Data , 2014, Wirtschaftsinf..

[5]  Piet Daas,et al.  Official statistics and Big Data , 2014 .

[6]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[7]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[8]  R. Viertl.  On the Future of Data Analysis , 2002 .

[9]  Han Liu,et al.  Challenges of Big Data Analysis. , 2013, National science review.

[10]  Vasant Dhar,et al.  Data science and prediction , 2012, CACM.

[11]  John Forsyth,et al.  Why Big Data Is Not Enough , 2015 .

[12]  Philip B. Stark.  Privacy, Big Data, and the Public Good: Frameworks for Engagement , 2016 .

[13]  Brendan T. O'Connor,et al.  From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series , 2010, ICWSM.

[14]  Y. de Montjoye,et al.  Unique in the shopping mall: On the reidentifiability of credit card metadata , 2015, Science.

[15]  R. Groves.  Three Eras of Survey Research , 2011 .

[16]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001, Statistical Science.

[17]  Vasant Dhar,et al.  A comparison of nonlinear methods for predicting earnings surprises and returns , 2001, IEEE Trans. Neural Networks.

[18]  M. Couper.  Is the sky falling? new technology, changing media, and the future of surveys , 2013 .

[19]  Charles Anderson,et al.  The end of theory: The data deluge makes the scientific method obsolete , 2008 .

[20]  Eric R. Ziegel,et al.  Survey Errors and Survey Costs , 1990 .

[21]  Latanya Sweeney,et al.  Matching Known Patients to Health Records in Washington State Data , 2013, ArXiv.

[22]  Shawn T. Brown,et al.  Contagious diseases in the United States from 1888 to the present. , 2013, The New England journal of medicine.

[23]  M. Orshansky.  Commentary: the poverty measure. , 1988, Social security bulletin.

[24]  Declan Butler,et al.  When Google got flu wrong , 2013, Nature.

[25]  Cliff Lampe,et al.  Big Data in Survey Research AAPOR Task Force Report , 2015 .

[26]  Andrew O'Connell.  Reading the public mind. , 2010, Harvard business review.

[27]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[28]  Cr Sridhar.  The signal and the noise , 2016 .

[29]  Tim Macer.  Big Data Plus Research Means More Accurate Results , 2015 .

[30]  N. McGlynn.  Thinking fast and slow. , 2014, Australian veterinary journal.