The error of accepting the "theoretical" null hypothesis: the rise, fall, and resurrection of commonsense hypotheses in psychology.

When psychologists test a commonsense (CS) hypothesis and obtain no support, they tend to erroneously conclude that the CS belief is wrong. In many such cases it appears, after many years, that the CS hypothesis was valid after all. It is argued that this error of accepting the "theoretical" null hypothesis reflects confusion between the operationalized hypothesis and the theory or generalization that it is designed to test. That is, on the basis of reliable null data one can accept the operationalized null hypothesis (e.g., "A measure of attitude x is not correlated with a measure of behavior y"). In contrast, one cannot generalize from the findings and accept the abstract or theoretical null (e.g., "We know that attitudes do not predict behavior"). The practice of accepting the theoretical null hypothesis hampers research and reduces the trust of the public in psychological research.

[1]  D. Simonton Creativity. Cognitive, personal, developmental, and social aspects. , 2000, The American psychologist.

[2]  T. A. Wright,et al.  Psychological well-being and job satisfaction as predictors of job performance. , 2000, Journal of occupational health psychology.

[3]  Matthew D. Lieberman,et al.  Intuition: a social cognitive neuroscience approach. , 2000, Psychological bulletin.

[4]  Dean Keith Simonton,et al.  Talent and its development: An emergenic and epigenetic model. , 1999 .

[5]  E. Guadagnoli,et al.  Use of alternative medicine by women with early-stage breast cancer. , 1999, The New England journal of medicine.

[6]  Barry M. Staw,et al.  Affect and favorable work outcomes: two longitudinal tests of the happy–productive worker thesis , 1999 .

[7]  Russell Cropanzano,et al.  A 5-year study of change in the relationship between well-being and job performance. , 1999 .

[8]  H. Kerl,et al.  A double-blind, controlled clinical trial of homeopathy and an analysis of lunar phases and postoperative outcome. , 1998, Archives of dermatology.

[9]  A. Kluger,et al.  Feedback Interventions , 1998 .

[10]  E. Higgins Promotion and Prevention: Regulatory Focus as A Motivational Principle , 1998 .

[11]  H. Eysenck Personality and experimental psychology: The unification of psychology and the possibility of a paradigm. , 1997 .

[12]  E. Higgins,et al.  Beyond pleasure and pain. , 1997, The American psychologist.

[13]  K. Loewenthal,et al.  Inferring gender from handwriting in Urdu and English. , 1996, The Journal of social psychology.

[14]  R. Frick,et al.  The appropriate use of null hypothesis testing. , 1996 .

[15]  S. Adler Personality and Work Behaviour: Exploring the Linkages , 1996 .

[16]  N. Nicholson Towards a New Agenda for Work and Personality: Traits, Self-identity, "Strong" Interactionism, and Change , 1996 .

[17]  B. Schneider Whither Goest Personality at Work?: Overview of the special issue on “Work and Personality” , 1996 .

[18]  Dwight D. Frink,et al.  Should We Write Off Graphology , 1996 .

[19]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[20]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[21]  R. Falk,et al.  Significance Tests Die Hard , 1995 .

[22]  R. Frick Accepting the null hypothesis , 1995, Memory & cognition.

[23]  Jacob Cohen The earth is round (p < .05) , 1994 .

[24]  A. Kluger,et al.  The Influence of Feedback on Mood: Linear Effects on Pleasantness and Curvilinear Effects on Arousal , 1994 .

[25]  A. Furnham Explaining health and illness: lay beliefs on the nature of health , 1994 .

[26]  S. Epstein Integration of the cognitive and the psychodynamic unconscious. , 1994, The American psychologist.

[27]  Steven D. Maurer,et al.  The validity of employment interviews: A comprehensive review and meta-analysis. , 1994 .

[28]  Winfred Arthur,et al.  Hunter and Hunter (1984) revisited: Interview validity for entry-level jobs. , 1994 .

[29]  Simcha Ronen,et al.  An underlying structure of motivational need taxonomies: A cross-cultural confirmation. , 1994 .

[30]  Louis Guttman,et al.  Louis Guttman on theory and methodology : selected writings , 1994 .

[31]  A. Damasio Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[32]  S. Blinkhorn The writing is on the wall , 1993, Nature.

[33]  Sigal G. Barsade,et al.  Affect and managerial performance: A test of the sadder-but-wiser vs. happier-and-smarter hypotheses. , 1993 .

[34]  S. Chaiken,et al.  The psychology of attitudes. , 1993 .

[35]  H. Kelley Common-Sense Psychology and Scientific Psychology , 1992 .

[36]  S. Schwartz Universals in the Content and Structure of Values: Theoretical Advances and Empirical Tests in 20 Countries , 1992 .

[37]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[38]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[39]  Gershon Ben-Shakhar,et al.  The predictive validity of graphological inferences: A meta-analytic approach , 1989 .

[40]  Bernhard Wilpert,et al.  Applied psychology : an international review , 1989 .

[41]  Steven D. Jones,et al.  Effects of group feedback, goal setting, and incentives on organizational productivity. , 1988 .

[42]  J. Hollenbeck,et al.  Reclaiming Personality Traits for Personnel Selection: Self-Esteem as an Illustrative Case , 1988 .

[43]  G. Graen,et al.  Toward a psychology of dyadic organizing. , 1987 .

[44]  Robin M. Hogarth,et al.  Generalization in Decision Research: The Role of Formal Models , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[45]  Michelle T. Iaffaldano,et al.  Job satisfaction and job performance: A meta-analysis. , 1985 .

[46]  Michael P. Kirsch,et al.  METAANALYSES OF VALIDITY STUDIES PUBLISHED BETWEEN 1964 AND 1982 AND THE INVESTIGATION OF STUDY CHARACTERISTICS , 1984 .

[47]  R. Klimoski,et al.  Predicting sales success through handwriting analysis: An evaluation of the effects of training and handwriting sample content. , 1983 .

[48]  M. Kohn Work And Personality , 1983 .

[49]  James E. Campion,et al.  The employment interview: A summary and review of recent research. , 1982 .

[50]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[51]  George C. Thornton,et al.  PSYCHOMETRIC PROPERTIES OF SELF-APPRAISALS OF JOB PERFORMANCE , 1980 .

[52]  W. A. Schiemann,et al.  Leader–member agreement: A vertical dyad linkage approach. , 1978 .

[53]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[54]  M. A. Wahba,et al.  Maslow reconsidered: A review of research on the need hierarchy theory , 1976 .

[55]  H. G. Heneman,et al.  Interviewer validity as a function of interview structure, biographical data, and interviewee order. , 1975 .

[56]  Edwin A. Locke,et al.  Job satisfaction and job performance: A theoretical analysis , 1970 .

[57]  J. B. Pearson,et al.  Methodology in Social Research. , 1968 .

[58]  P. Meehl Theory-Testing in Psychology and Physics: A Methodological Paradox , 1967, Philosophy of Science.

[59]  Dalva E. Hedlund A Review of the MMPI in Industry , 1965, Psychological reports.

[60]  R. Guion,et al.  Validity Of Personality Measures In Personnel Selection , 1965 .

[61]  J. Platt Strong Inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others. , 1964, Science.

[62]  V. Vroom Work and motivation , 1964 .

[63]  E. A. Locke,et al.  A REVIEW AND EVALUATION OF THE VALIDITY STUDIES OF ACTIVITY VECTOR ANALYSIS , 1962 .

[64]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[65]  R. Ammons Effects of Knowledge of Performance: A Survey and Tentative Theoretical Formulation , 1956 .

[66]  R. Wagner The Employment Interview: a Critical Summary , 1949 .

[67]  Florence L. Goodenough,et al.  Sex Differences in Judging the Sex of Handwriting , 1945 .

[68]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .