Theory Pruning: Strategies to Reduce Our Dense Theoretical Landscape

The current article presents a systematic approach to theory pruning (defined here as hypothesis specification and study design intended to bound and reduce theory). First, we argue that research that limits theory is underrepresented in the organizational sciences, erring overwhelmingly on the side of confirmatory null hypothesis testing. Second, we propose criteria for determining comparability, deciding when it is appropriate to test theories or parts of theories against one another. Third, we suggest hypotheses or questions for testing competing theories. Finally, we revisit the spirit of ‘‘strong inference.’’ We present reductionist strategies appropriate for the organizational sciences, which extend beyond traditional approaches of ‘‘critical’’ comparisons between whole theories. We conclude with a discussion of strong inference in organizational science and how theory pruning can help in that pursuit.

[1]  V. Vroom Work and motivation , 1964 .

[2]  Amy B. Henley,et al.  The Presence of Equivalent Models in Strategic Management Research Using Structural Equation Modeling , 2006 .

[3]  D. Bakan,et al.  The test of significance in psychological research. , 1966, Psychological bulletin.

[4]  M. Seligman,et al.  Alleviation of learned helplessness in the dog. , 1968, Journal of abnormal psychology.

[5]  Alicia A. Grandey,et al.  Service with a smile and encounter satisfaction: emotional contagion and appraisal mechanisms , 2006 .

[6]  I. Lakatos Falsification and the Methodology of Scientific Research Programmes , 1976 .

[7]  B. Becker,et al.  How meta-analysis increases statistical power. , 2003, Psychological methods.

[8]  A. Brief,et al.  Organizational behavior: affect in the workplace. , 2002, Annual review of psychology.

[9]  Scott W. Geiger,et al.  Statistical Power and the Testing of Null Hypotheses: A Review of Contemporary Management Research and Recommendations for Future Studies , 2004 .

[10]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[11]  E. Higgins,et al.  Expectancy × Value Effects: Regulatory Focus as Determinant of Magnitude and Direction , 1997 .

[12]  James L. Price,et al.  The Study of Turnover. , 1978 .

[13]  A. Ehrenberg,et al.  The Design of Replicated Studies , 1993 .

[14]  Rowland H. Davis,et al.  Strong Inference: rationale or inspiration? , 2006, Perspectives in biology and medicine.

[15]  Murray R. Barrick,et al.  The Moderating Role of Top Management Team Interdependence: Implications for Real Teams and Working Groups , 2007 .

[16]  Herman Aguinis,et al.  Social-Role versus Structural Models of Gender and Influence Use in Organizations , 1998 .

[17]  Robert Rosenthal,et al.  Replication in behavioral research. , 1990 .

[18]  Robert J. Vandenberg,et al.  Alternative model specifications in structural equation modeling: Facts, fictions, and truth. , 2009 .

[19]  S. Milgram BEHAVIORAL STUDY OF OBEDIENCE. , 1963, Journal of abnormal psychology.

[20]  Kenneth S. Law,et al.  Multidimensional Constructs M Structural Equation Analysis: An Illustration Using the Job Perception and Job Satisfaction Constructs , 1999 .

[21]  Joel A. C. Baum,et al.  Time to Break Up: Social and Instrumental Antecedents of Firm Exits from Exchange Cliques , 2005 .

[22]  J. Platt Strong Inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others. , 1964, Science.

[23]  Herman Aguinis,et al.  Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables , 2008 .

[24]  Jason Millman,et al.  Research on human behavior;: A systematic guide to method , 1972 .

[25]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[26]  Barry M. Staw,et al.  What Theory is Not , 1995 .

[27]  E. Higgins,et al.  Beyond pleasure and pain. , 1997, The American psychologist.

[28]  Terence R. Mitchell,et al.  Instrumentality theories: Current uses in psychology. , 1971 .

[29]  Jeffrey B Vancouver,et al.  Self-efficacy and resource allocation: support for a nonmonotonic, discontinuous model. , 2008, The Journal of applied psychology.

[30]  T. Mitchell,et al.  Building Better Theory: Time and The Specification of When Things Happen , 2001 .

[31]  Noam Wasserman,et al.  Stewards, Agents, and the Founder Discount: Executive Compensation in New Ventures , 2006 .

[32]  M. Hallahan,et al.  Explaining Real-Life Events: How Culture and Domain Shape Attributions , 1996 .

[33]  H. Eysenck Personality and experimental psychology: The unification of psychology and the possibility of a paradigm. , 1997 .

[34]  Murray R. Barrick,et al.  Reducing voluntary, avoidable turnover through selection. , 2005, The Journal of applied psychology.

[35]  Christina E. Shalley,et al.  Effects of Productivity Goals, Creativity Goals, and Personal Discretion on Individual Creativity , 1991 .

[36]  E. Higgins,et al.  Expectancy x value effects: regulatory focus as determinant of magnitude and direction. , 1997, Journal of personality and social psychology.

[37]  P. Meehl Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. , 1978 .

[38]  S. Maxwell The persistence of underpowered studies in psychological research: causes, consequences, and remedies. , 2004, Psychological methods.

[39]  M. Wood Bootstrapped Confidence Intervals as an Approach to Statistical Inference , 2005 .

[40]  M. Fishbein A Behavior Theory Approach to the Relations between Beliefs about an Object and the Attitude Toward the Object , 1976 .

[41]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[42]  J. Mackie,et al.  The Conduct of Inquiry: Methodology for Behavioural Science , 1965 .

[43]  A. V. D. Ven,et al.  Knowledge for Theory and Practice , 2006 .

[44]  F. Schmidt Meta-Analysis , 2008 .

[45]  J. Armstrong,et al.  Replications and Extensions in Marketing - Rarely Published But Quite Contrary , 1994 .

[46]  D. Eden Replication, Meta-Analysis, Scientific Progress, and AMJ's Publication Policy , 2002 .

[47]  L. J. Chase,et al.  REPLICATION IN EXPERIMENTAL COMMUNICATION RESEARCH: AN ANALYSIS , 1979 .

[48]  Edwin A. Locke,et al.  Resolving scientific disputes by the joint design of crucial experiments by the antagonists: Application to the Erez–Latham dispute regarding participation in goal setting. , 1988 .

[49]  Ralph R. Roberts,et al.  Signifying significant significance. , 1972 .

[50]  J. Bargh,et al.  Nonconscious Behavioral Confirmation Processes: The Self-Fulfilling Consequences of Automatic Stereotype Activation , 1997 .

[51]  W. W. Rozeboom The fallacy of the null-hypothesis significance test. , 1960, Psychological bulletin.

[52]  E. Higgins Beyond pleasure and pain. , 1997, The American psychologist.

[53]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[54]  Reginald Shareff,et al.  Want Better Business Theories? Maybe Karl Popper Has the Answer , 2007 .

[55]  T. Scandura,et al.  Research Methodology In Management: Current Practices, Trends, And Implications For Future Research , 2000 .

[56]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[57]  K. Weick What Theory Is Not, Theorizing Is , 1995 .

[58]  Geoff Cumming,et al.  Confidence intervals and replication: where will the next mean fall? , 2006, Psychological methods.

[59]  E. Furchtgott,et al.  Replicate, again and again. , 1984 .

[60]  Donald E. Conlon,et al.  Justice at the millennium: a meta-analytic review of 25 years of organizational justice research. , 2001, The Journal of applied psychology.

[61]  Anthony G. Greenwald,et al.  On the Conceptual Disconfirmation of Theories , 1981 .

[62]  D. Lykken Statistical significance in psychological research. , 1968, Psychological bulletin.

[63]  Ronald F. Piccolo,et al.  Transformational and transactional leadership: a meta-analytic test of their relative validity. , 2004, The Journal of applied psychology.

[64]  P. Meehl Theory-Testing in Psychology and Physics: A Methodological Paradox , 1967, Philosophy of Science.

[65]  Kenneth D. Mackenzie,et al.  Paradigm Development in the Social Sciences: A Proposed Research Strategy , 1978 .

[66]  D. Hambrick THE FIELD OF MANAGEMENT'S DEVOTION TO THEORY: TOO MUCH OF A GOOD THING? , 2007 .

[67]  Jacob Cohen The earth is round (p < .05) , 1994 .

[68]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[69]  A. Stinchcombe Constructing Social Theories , 1970 .

[70]  John E. Delery,et al.  Alternative Conceptualizations of the Relationship Between Voluntary Turnover and Organizational Performance , 2005 .

[71]  O. Behling The Case for the Natural Science Model For Research in Organizational Behavior And Organization Theory , 1980 .

[72]  Martine,et al.  A Study of turnover , 2007 .

[73]  A. Kluger,et al.  The error of accepting the "theoretical" null hypothesis: the rise, fall, and resurrection of commonsense hypotheses in psychology. , 2001, Psychological bulletin.

[74]  Anton J. Villado,et al.  The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. , 2008, The Journal of applied psychology.

[75]  Herman Aguinis,et al.  First Decade of Organizational Research Methods , 2009 .

[76]  L. Porter Forty Years of Organization Studies: Reflections from a Micro Perspective , 1996 .

[77]  Frank L. Schmidt,et al.  What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. , 1992 .