Toward a General and Unified View of Educational Research and Evaluation: Bridging Philosophy and Methodology

This paper addresses an important problun that may really be a pseudoproblem perpetuated by a currcnt artificial or even political need to isolate researchers, evaluators, and theorists and put them in conceptual-methodological boxes. In th paper, me argue that scholars of all kinds should focus on the nouns (i.e., research, ~aluauon, theory) versus the adjecaves (l.e., quantitative, qualitative, or ~ni~ed methods) used to qualify these nouns and core constructs. In a word, researchers, evaluators, measurement professionals, and theorists of all persuasions should stri\-e to be neither qualitative nor quantitative, as that is like striving to be a single leg in a triangle. 1;oUowing Hacking (1965), our view is that all forms of research methodology and evaluation methodolog represent a "patchwork quilt" that is essmtially "one fabdc" with two connected but often unacknowledged sides to the quilt and that all methodology, analysis, and evaluations are essentially "qual-quantifxation" and "quant-qualification" and usually both at the same time. This general and unified or "one fabric" view of these debates and issues is discussed from a historical-philosophical perspective, and the need for a more general and inclusir-e wduaxion and research epistemology is elucidated. fIaving outhed an episttrmc framework and argument for a more coinprehrnsive and complete view and model of n-aluation and research that transcends a speak research paradigm, the paper concludes by outlining eight general key points that most (if not a10 researchtrs and evaluators should consider.

[1]  R. Merton,et al.  Genesis and development of a scientific fact , 1979 .

[2]  M. R. Matthews Thomas Kuhn's Impact on Science Education: What Lessons Can Be Learned? , 2004 .

[3]  John W. Creswell,et al.  Research Design: Qualitative and Quantitative Approaches , 1997 .

[4]  F. Suppe The Structure of Scientific Theories. , 1975 .

[5]  D. Rosenhan On Being Sane in Insane Places , 1973, Science.

[6]  I. Hacking,et al.  How Experiments End , 1989 .

[7]  William Anderson McCall How to experiment in education , 1923 .

[8]  Frederick Suppe,et al.  The Structure of Scientific Theories. , 1975 .

[9]  Corrine Glesne,et al.  Becoming Qualitative Researchers: An Introduction , 1991 .

[10]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[11]  I. Lakatos,et al.  Criticism and the Growth of Knowledge: Falsification and the Methodology of Scientific Research Programmes , 1970 .

[12]  John Benjafield,et al.  Cognition, 3rd ed. , 2007 .

[13]  Chris L. S. Coryn The Holy Trinity of Methodological Rigor: A Skeptical View. , 2007 .

[14]  Chris L. S. Coryn,et al.  Evaluation Theory, Models, and Applications , 2007 .

[15]  Willard Van Orman Quine,et al.  From a Logical Point of View , 1955 .

[16]  Nicholas Rescher,et al.  On the Epistemology of the Inexact Sciences , 1959 .

[17]  R. Carnap Logical Syntax of Language , 1937 .

[18]  G. Gigerenzer From Tools to Theories: A Heuristic of Discovery in Cognitive Psychology. , 1991 .

[19]  M. R. Matthews Reappraising Positivism and Education: The Arguments of Philipp Frank and Herbert Feigl , 2004 .

[20]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[21]  James Carifio,et al.  Resolving the 50‐year debate around using and misusing Likert scales , 2008, Medical education.

[22]  D. C. Phillips The contested nature of empirical educational research (and why philosophy of education offers little help) , 2005 .

[23]  A. Flew,et al.  Patterns of Discovery. , 1961 .

[24]  P. Thagard,et al.  Computational Philosophy of Science , 1988 .

[25]  G. Ryle,et al.  心的概念 = The concept of mind , 1962 .

[26]  T. Kuhn The structure of scientific revolutions, 3rd ed. , 1996 .

[27]  R. Shavelson,et al.  Scientific Research in Education , 2002 .

[28]  F. Sloane Comments on Slavin: Through the Looking Glass: Experiments, Quasi-Experiments, and the Medical Model , 2008 .

[29]  H. Reichenbach Experience And Prediction , 1938 .

[30]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[31]  A. Bryman Barriers to Integrating Quantitative and Qualitative Research , 2007 .

[32]  G. A. Barnard,et al.  THE LOGIC OF STATISTICAL INFERENCE1 , 1972, The British Journal for the Philosophy of Science.

[33]  T. Kuhn,et al.  Criticism and the Growth of Knowledge: Logic of Discovery or Psychology of Research? , 1970 .

[34]  J. O. Urmson,et al.  The Development of Logical Empiricism. , 1952 .

[35]  Theodore Schick Readings in the Philosophy of Science: From Positivism to Postmodernism , 1999 .

[36]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[37]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[38]  S. Pinker How the Mind Works , 1999, Philosophy after Darwin.

[39]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[40]  I. Lakatos Falsification and the Methodology of Scientific Research Programmes , 1976 .