Toward a General and Unified View of Educational Research and Educational Evaluation

This paper addresses an important problem that may really be a pseudoproblem perpetuated by a current artificial or even political need to isolate researchers, evaluators, and theorists and put them in conceptual-methodological boxes. In this paper, we argue that scholars of all kinds should focus on the nouns (i.e., research, evaluation, theory) versus the adjectives (i.e., quantitative, qualitative, or mixed methods) used to qualify these nouns and core constructs. In a word, researchers, evaluators, measurement professionals, and theorists of all persuasions should strive to be neither qualitative nor quantitative, as that is like striving to be a single leg in a triangle. Following Hacking (1965), our view is that all forms of research methodology and evaluation methodology represent a “patchwork quilt” that is essentially “one fabric” with two connected but often unacknowledged sides to the quilt and that all methodology, analysis, and evaluations are essentially “qual-quantification” and “quant-qualification” and usually both at the same time. This general and unified or “one fabric” view of these debates and issues is discussed from a historical-philosophical perspective, and the need for a more general and inclusive evaluation and research epistemology is elucidated. Having outlined an epistemic framework and argument for a more comprehensive and complete view and model of evaluation and research that transcends a specific research paradigm, the paper concludes by outlining eight general key points that most (if not all) researchers and evaluators

[1]  M. R. Matthews Reappraising Positivism and Education: The Arguments of Philipp Frank and Herbert Feigl , 2004 .

[2]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[3]  I. Lakatos,et al.  Criticism and the Growth of Knowledge: Falsification and the Methodology of Scientific Research Programmes , 1970 .

[4]  Willard Van Orman Quine,et al.  From a Logical Point of View , 1955 .

[5]  Nicholas Rescher,et al.  On the Epistemology of the Inexact Sciences , 1959 .

[6]  T. Kuhn,et al.  Criticism and the Growth of Knowledge: Logic of Discovery or Psychology of Research? , 1970 .

[7]  James Carifio Towards A Standard Integrated Information Processing / Cognitive Model of Learning , 2008 .

[8]  N. Denzin,et al.  The SAGE handbook of qualitative research , 2005 .

[9]  R. Merton,et al.  Genesis and development of a scientific fact , 1979 .

[10]  G. Gigerenzer From Tools to Theories: A Heuristic of Discovery in Cognitive Psychology. , 1991 .

[11]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[12]  William Anderson McCall How to experiment in education , 1923 .

[13]  D. C. Phillips The contested nature of empirical educational research (and why philosophy of education offers little help) , 2005 .

[14]  James Carifio,et al.  Resolving the 50‐year debate around using and misusing Likert scales , 2008, Medical education.

[15]  John Benjafield,et al.  Cognition, 3rd ed. , 2007 .

[16]  D. Rosenhan On being sane in insane places , 1973, Science.

[17]  I. Hacking,et al.  How Experiments End , 1989 .

[18]  S. Gould,et al.  Punctuated equilibria: an alternative to phyletic gradualism , 1972 .

[19]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[20]  H. Reichenbach Experience And Prediction , 1938 .

[21]  A. Bryman Barriers to Integrating Quantitative and Qualitative Research , 2007 .

[22]  S. Pinker How the Mind Works , 1999, Philosophy after Darwin.

[23]  M. R. Matthews Thomas Kuhn's Impact on Science Education: What Lessons Can Be Learned? , 2004 .

[24]  F. Suppe The Structure of Scientific Theories. , 1975 .

[25]  Arthur Pap,et al.  The Vienna Circle : the origin of neo-positivism, a chapter in the history of recent philosophy , 1969 .

[26]  T. Kuhn The structure of scientific revolutions, 3rd ed. , 1996 .

[27]  Corrine Glesne,et al.  Becoming Qualitative Researchers: An Introduction , 1991 .

[28]  Seymour Geisser,et al.  Logic of Statistical Inference. , 1967 .

[29]  A. Flew,et al.  Patterns of Discovery. , 1961 .

[30]  Sally Sieloff Magnan,et al.  Research Design: Qualitative and Quantitative Approaches , 1997 .

[31]  Chris L. S. Coryn The Holy Trinity of Methodological Rigor: A Skeptical View. , 2007 .