A Methodological Self-Study of Quantitizing

This inquiry developed during the process of “quantitizing” qualitative data the authors had gathered for a mixed methods curriculum efficacy study. Rather than providing the intended rigor to their data coding process, their use of an intercoder reliability metric prompted their investigation of the multiplicity and messiness that, as they suggest here, are inherent to work that crosses the epistemological boundaries of academic fields and research paradigms. Even as the authors developed a deeper understanding of—and appreciation for—the nature of quantitative rigor, they moved toward a more deeply constructivist view of the research process itself. Ultimately, the authors abandoned the neat study of intercoder reliability that they had envisioned and moved toward the present dialogic report to reveal and examine their process.

[1]  S. Westwood,et al.  Deweyan Multicultural Democracy, Rortian Solidarity, and the Popular Arts: Krumping into Presence , 2010 .

[2]  K. Howe.  THE QUESTION OF EDUCATION SCIENCE: EXPERIMENTISM VERSUS EXPERIMENTALISM , 2005 .

[3]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[4]  Jennifer Caroline Greene,et al.  The generative potential of mixed methods inquiry1 , 2005 .

[5]  D. Weiss,et al.  Interrater reliability and agreement of subjective judgments , 1975 .

[6]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[7]  Martyn Denscombe,et al.  Communities of Practice , 2008 .

[8]  M. T. Reddy,et al.  Race in the College Classroom: Pedagogy and Politics , 2002 .

[9]  J. Brannen.  Mixing Methods: The Entry of Qualitative and Quantitative Approaches into the Research Process , 2005 .

[10]  J. Preston,et al.  Editorial: Speaking in Tongues—Diversity in Mixed Methods Research , 2005 .

[11]  Patricia S. Jones,et al.  Cultural differences in responses to a Likert scale. , 2002, Research in nursing & health.

[12]  Alette Willis,et al.  Separately Together: Working Reflexively as a Team , 2008 .

[13]  S. Pickett,et al.  Interdisciplinary Research: Maintaining the Constructive Impulse in a Culture of Criticism , 1999, Ecosystems.

[14]  Jerome A. Popp.  Evolution's First Philosopher: John Dewey and the Continuity of Nature , 2007 .

[15]  Stacy Holman Jones,et al.  Autoethnography: Making the personal political , 2005 .

[16]  T. Kuhn.  The structure of scientific revolutions, 3rd ed. , 1996 .

[17]  N. Burbules,et al.  Pragmatism and educational research , 2003 .

[18]  D. Morgan.  Paradigms Lost and Pragmatism Regained , 2007 .

[19]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[20]  Gregory Bateson,et al.  Experiments in Thinking about Observed Ethnological Material , 1941, Philosophy of Science.

[21]  S. Laverty.  Hermeneutic Phenomenology and Phenomenology: A Comparison of Historical and Methodological Considerations , 2003 .

[22]  Monica G. Turner,et al.  Tips and Traps in Interdisciplinary Research , 1999, Ecosystems.

[23]  David N. Wear,et al.  Challenges to Interdisciplinary Discourse , 1999, Ecosystems.

[24]  Arthur P. Bochner.  It's About Time: Narrative and the Divided Self , 1997 .

[25]  N. Denzin,et al.  The Sage handbook of qualitative research, 3rd ed. , 2005 .

[26]  Tony Hak,et al.  Coder training: Theoretical training or practical socialization? , 1996 .

[27]  Thomas A. Schwandt.  A Diagnostic Reading of Scientifically Based Research for Education. , 2005 .

[28]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[29]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[30]  Toward a Sociology of Social Scientific Knowledge , 2000 .

[31]  N. Leech,et al.  Toward a Unified Validation Framework in Mixed Methods Research , 2007 .

[32]  D. O. Sears,et al.  The Origins and Persistence of Ethnic Identity Among the "New Immigrant" Groups* , 2003 .

[33]  D. Macbeth,et al.  On “Reflexivity” in Qualitative Research: Two Readings, and a Third , 2001 .

[34]  D. O. Sears,et al.  The Political Color Line in America: Many "Peoples of Color" or Black Exceptionalism? , 2006 .

[35]  Patti Lather.  2007 Kneller Lecture, AESA Getting Lost: Social Science and/as Philosophy , 2009 .

[36]  Nancy L. Leech,et al.  A typology of mixed methods research designs , 2009 .

[37]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[38]  J. Law.  After Method: Mess in Social Science Research , 2004 .

[39]  J. Dewey.  Logic, the theory of inquiry , 1938 .

[40]  J. Dewey,et al.  The Quest for Certainty , 1929 .

[41]  David L. Altheide,et al.  Criteria for assessing interpretive validity in qualitative research. , 1994 .