Integrating the Split/Analyze/Meta-Analyze (SAM) Approach and a Multilevel Framework to Advance Big Data Research in Psychology: Guidelines and an Empirical Illustration via the Human Resource Management Investment–Firm Performance Relationship

Though big data research has undergone dramatic developments in recent decades, it has mainly been applied in disciplines such as computer science and business. Psychology research that applies big data to examine research issues in psychology is largely lacking. One of the major challenges regarding the use of big data in psychology is that many researchers in the field may not have sufficient knowledge of big data analytical techniques that are rooted in computer science. This paper integrates the split/analyze/meta-analyze (SAM) approach and a multilevel framework to illustrate how to use the SAM approach to address multilevel research questions with big data. Specifically, we first introduce the SAM approach and then illustrate how to implement this to integrate two big datasets at the firm level and country level. Finally, we discuss theoretical and practical implications, proposing future research directions for psychology scholars.

[1]  D. Bowen,et al.  Understanding HRM–Firm Performance Linkages: The Role of the “Strength” of the HRM System , 2004 .

[2]  Aoju Chen,et al.  Acquiring Complex Focus-Marking: Finnish 4- to 5-Year-Olds Use Prosody and Word Order in Interaction , 2016, Front. Psychol..

[3]  Ramon Wenzel,et al.  The Double-Edged Sword of Big Data in Organizational and Management Research , 2018 .

[4]  Galit Shmueli,et al.  A Tree-Based Approach for Addressing Self-Selection in Impact Studies with Big Data , 2015, MIS Q..

[5]  Kristopher J Preacher,et al.  Advantages of Monte Carlo Confidence Intervals for Indirect Effects , 2012 .

[6]  C. Crainiceanu,et al.  A practical guide to big data. , 2018, Statistics & probability letters.

[7]  John Storey,et al.  HRM and company performance: the use of measurement and the influence of economic cycles , 1998 .

[8]  Rob Thomas,et al.  Big Data Revolution , 2015 .

[9]  Mike W.-L. Cheung,et al.  Analyzing Big Data in Psychology: A Split/Analyze/Meta-Analyze Approach , 2016, Front. Psychol..

[10]  Roger Calantone,et al.  The Promise and Perils of Wearable Sensors in Organizational Research , 2017 .

[11]  L. Collins.  Analysis of longitudinal data: the integration of theoretical model, temporal design, and statistical model. , 2006, Annual review of psychology.

[12]  Scott Tonidandel,et al.  Big Data Methods , 2018 .

[13]  Kristopher J Preacher,et al.  A general multilevel SEM framework for assessing multilevel mediation. , 2010, Psychological methods.

[14]  A. Carmeli.  Strategic human capital and the performance of public sector organizations. , 2004 .

[15]  Mike W-L Cheung,et al.  Modeling dependent effect sizes with three-level meta-analyses: a structural equation modeling approach. , 2014, Psychological methods.

[16]  M. Subramony.  A meta‐analytic investigation of the relationship between HRM bundles and firm performance , 2009 .

[17]  Jason D. Shaw,et al.  A resource‐based perspective on human capital losses, HRM investments, and organizational performance , 2013 .

[18]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[19]  James G. Combs,et al.  Does human capital matter? A meta-analysis of the relationship between human capital and firm performance. , 2011, The Journal of applied psychology.

[20]  Trudy W. Banta.  Promise and perils , 1988 .

[21]  Ernst C. Osinga,et al.  Big Data and Data Science Methods for Management Research , 2016 .

[22]  J. Dunlop,et al.  Partial least squares correspondence analysis: A framework to simultaneously analyze behavioral and genetic data. , 2016, Psychological methods.

[23]  Yaping Gong,et al.  A Multilevel Model of Team Goal Orientation, Information Exchange, and Creativity , 2013 .

[24]  Alex Pentland,et al.  Big Data and Management , 2014 .

[25]  Joseph T. Mahoney,et al.  HOW DYNAMICS , MANAGEMENT , AND GOVERNANCE OF RESOURCE DEPLOYMENTS INFLUENCE FIRM-LEVEL PERFORMANCE , 2005 .

[26]  L. Harlow,et al.  Big data in psychology: Introduction to the special issue. , 2016, Psychological methods.

[27]  J. Colquitt,et al.  TRENDS IN THEORY BUILDING AND THEORY TESTING: A FIVE-DECADE STUDY OF THE ACADEMY OF MANAGEMENT JOURNAL , 2007 .

[28]  Mark A. Huselid,et al.  Technical and Strategic Human Resource Management Effectiveness as Determinants of Firm Performance , 1997 .

[29]  Ioanna D. Constantiou,et al.  New games, new rules: big data and the changing context of strategy , 2015, J. Inf. Technol..

[30]  S. Wojcik,et al.  A practical guide to big data research in psychology. , 2016, Psychological methods.

[31]  Mike W.-L. Cheung,et al.  metaSEM: an R package for meta-analysis using structural equation modeling , 2015, Front. Psychol..

[32]  Adam M. Grant,et al.  Mission possible? The performance of prosocially motivated employees depends on manager trustworthiness. , 2009, The Journal of applied psychology.

[33]  Ulrich Trautwein,et al.  Doubly-Latent Models of School Contextual Effects: Integrating Multilevel and Structural Equation Approaches to Control Measurement and Sampling Error , 2009, Multivariate behavioral research.

[34]  Semin Park,et al.  A Fitting Approach to Construct and Measurement Alignment , 2018 .

[35]  Y. Gong.  Subsidiary Staffing in Multinational Enterprises: Agency, Resources, and Performance , 2003 .