Underlying Agreements Between Quantitative and Qualitative Research

A review of the methodological literature describing mixed-methods and quantitative and qualitative research paradigms suggest that though many have rejected the so-called paradigm wars there remains much focus on what is different about each research tradition. This has borne out in practice where professional organizations often have subgroups dedicated to the study of one tradition or another. Indeed, Human Resources Development Review has issued calls for manuscripts that explore this topic. This article examines the idea that there can be times when it is best to think of research as a monolithic paradigm rather than a distinct set of subparadigms. The reason for this is there are a number of common research scenarios where it is best to apply perspectives that might typically be characterized as qualitative as well as ones that are considered to be qualitative in orientation (e.g., using contextual information to make judgments about practical significance). There are other scenarios where the underlying goal of a procedure from, say the quantitative paradigm is similar to that from the qualitative realm (e.g., exploratory factor analyses and thematic analyses). There are of course real differences among the paradigms, but overemphasis on division might obfuscate how to conduct rigorous research. The article closes by encouraging readers to let their research questions dictate methodological approach, in the context of the purpose, rather than building questions around techniques that tend to align with different subparadigms.

[1]  M. Patton Qualitative research and evaluation methods , 1980 .

[2]  J. Levin,et al.  Single-case research design and analysis : new directions for psychology and education , 1992 .

[3]  B. Thompson What Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect Sizes , 2002 .

[4]  I. Newman Qualitative-Quantitative Research Methodology : Exploring the Interactive Continuum , 1999 .

[5]  D. Rubin,et al.  Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach , 1999 .

[6]  Isadore Newman,et al.  USING Q METHODOLOGY AND Q FACTOR ANALYSIS IN MIXED METHODS RESEARCH , 2010 .

[7]  I. Higginson,et al.  Experimental and quasi-experimental designs , 2011 .

[8]  E. Guba,et al.  The Paradigm dialog , 1990 .

[9]  K. Howe Against the Quantitative-Qualitative Incompatibility Thesis or Dogmas Die Hard , 1988 .

[10]  L. Harlow,et al.  What if there were no significance tests , 1997 .

[11]  T. Christ Teaching Mixed Methods and Action Research: Pedagogical, Practical, and Evaluative Considerations , 2010 .

[12]  C. Teddlie,et al.  SAGE Handbook of Mixed Methods in Social & Behavioral Research , 2010 .

[13]  J. Maxwell Using Qualitative Methods for Causal Explanation , 2004 .

[14]  I. Newman,et al.  Mixed Methods Research , 2008 .

[15]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[16]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[17]  Jacob Cohen The earth is round (p < .05) , 1994 .

[18]  Robert T. Jiménez,et al.  Qualitative Studies in Special Education , 2005 .

[19]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[20]  N. Denzin,et al.  The Discipline and Practice of Qualitative Research , 2005 .

[21]  Paul Kline,et al.  An easy guide to factor analysis , 1993 .

[22]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[23]  Rex B. Kline,et al.  Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research , 2004 .

[24]  B. Thompson Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications , 2004 .

[25]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[26]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[27]  R. B. Johnson,et al.  Educational Research: Quantitative, Qualitative, and Mixed Approaches , 2007 .

[28]  K. Varjas,et al.  Assessing Adolescents' Understanding of and Reactions to Stress in Different Cultures , 2007 .

[29]  Stephen W. Raudenbush,et al.  Effects of Kindergarten Retention Policy on Children’s Cognitive Growth in Reading and Mathematics , 2005 .

[30]  Jamie L. Callahan,et al.  Making Subjective Judgments in Quantitative Studies: The Importance of Using Effect Sizes and Confidence Intervals. , 2006 .

[31]  Jean J. Schensul,et al.  Essential Ethnographic Methods: Observations, Interviews, and Questionnaires , 1999 .

[32]  E. Guba The alternative paradigm dialog. , 1990 .

[33]  Patricia A. Adler,et al.  Ethnography and Human Development: Context and Meaning in Social Inquiry , 1997 .

[34]  Meredith D. Gall,et al.  Educational Research: An Introduction , 1965 .

[35]  J. Smith Quantitative Versus Qualitative Research: An Attempt to Clarify the Issue , 1983 .

[36]  T. Reio The Ongoing Quest for Theory-Building Research Methods Articles , 2010 .

[37]  P. Morgan Null Hypothesis Significance Testing: Philosophical and Practical Considerations of a Statistical Controversy , 2003 .

[38]  Bruce Thompson,et al.  Statistical Significance and Effect Size Reporting: Portrait of a Possible Future. , 1998 .

[39]  B. Nastasi,et al.  Contributions of qualitative research to the validity of intervention research , 2005 .

[40]  J. Smith The Problem of Criteria for Judging Interpretive Inquiry , 1984 .

[41]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[42]  Anthony J. Onwuegbuzie,et al.  Positivists, Post-Positivists, Post-Structuralists, and Post-Modernists: Why Can't We All Get Along? Towards a Framework for Unifying Research Paradigms. , 2000 .

[43]  Bruce Thompson,et al.  "Statistical," "practical", and "clinical": How many kinds of significance do counselors need to consider? , 2002 .

[44]  Laura Johnson,et al.  How Many Interviews Are Enough? , 2006 .

[45]  M. Wolery,et al.  The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education , 2005 .

[46]  Nancy L. Leech,et al.  A Call for Qualitative Power Analyses , 2007 .

[47]  Joan Newman,et al.  Illustrating a Mixed-Method Approach for Validating Culturally Specific Constructs , 2005 .

[48]  R. Stake Qualitative Case Studies. , 2005 .

[49]  John H. Hitchcock,et al.  An Inclusive Framework for Conceptualizing Mixed Methods Design Typologies: Moving Toward Fully Integrated Synergistic Research Models , 2010 .