Vindicating methodological triangulation

Social scientists use many different methods, and there are often substantial disagreements about which method is appropriate for a given research question. In response to this uncertainty about the relative merits of different methods, W. E. B. Du Bois advocated for and applied “methodological triangulation”. This is to use multiple methods simultaneously in the belief that, where one is uncertain about the reliability of any given method, if multiple methods yield the same answer that answer is confirmed more strongly than it could have been by any single method. Against this, methodological purists believe that one should choose a single appropriate method and stick with it. Using tools from voting theory, we show Du Boisian methodological triangulation to be more likely to yield the correct answer than purism, assuming the scientist is subject to some degree of diffidence about the relative merits of the various methods. This holds even when in fact only one of the methods is appropriate for the given research question.

[1]  Larry Laudan,et al.  William Whewell on the Consilience of Inductions , 1971 .

[2]  W. D. Bois Sociology Hesitant , 2000 .

[3]  C. Hempel Philosophy of Natural Science , 1966 .

[4]  Jon Bannister,et al.  QUESTIONING THE MEASUREMENT OF THE ‘FEAR OF CRIME’: Findings from a Major Methodological Study , 1997 .

[5]  Tewksbury Richard Qualitative versus Quantitative Methods: Understanding Why Qualitative Methods are Superior for Criminology and Criminal Justice , 2013 .

[6]  G. Owen,et al.  Thirteen theorems in search of the truth , 1983 .

[7]  K. Reisman,et al.  The Robust Volterra Principle* , 2008, Philosophy of Science.

[8]  T. Jick Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[9]  U. Kelle Sociological Explanations between Micro and Macro and the Integration of Qualitative and Quantitative Methods , 2001 .

[10]  J. Stegenga Rerum Concordia Discors: Robustness and Discordant Multimodal Evidence , 2012 .

[11]  K Sharp,et al.  A critical appraisal of the role of triangulation in nursing research. , 1998, International journal of nursing studies.

[12]  François Claveau The Independence Condition in the Variety-of-Evidence Thesis , 2013, Philosophy of Science.

[13]  Elijah Anderson,et al.  The Philadelphia Negro: A Social Study , 1900 .

[14]  R. Hudson Seeing Things: The Philosophy of Reliable Observation , 2013 .

[15]  G. Rolfe A critical realist rationale for using a combination of quantitative and qualitative methods , 2006 .

[16]  Amitabh S. Raturi,et al.  Lessons learned from methodological triangulation in management research , 2006 .

[17]  C. List,et al.  Epistemic democracy : generalizing the Condorcet jury theorem , 2001 .

[18]  Mark Risjord,et al.  Methodological Triangulation in Nursing Research , 2001 .

[19]  Wendy S. Parker,et al.  When Climate Models Agree: The Significance of Robust Model Predictions* , 2011, Philosophy of Science.

[20]  Jaakko Kuorikoski,et al.  Evidential Diversity and the Triangulation of Phenomena , 2016, Philosophy of Science.

[21]  V A Thurmond,et al.  The point of triangulation. , 2001, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[22]  L. F. Cunningham,et al.  Methodological triangulation in measuring public transportation service quality , 2000 .

[23]  N. Blaikie A critique of the use of triangulation in social research , 1991 .

[24]  Margaret F Moloney,et al.  A new foundation for methodological triangulation. , 2002, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[25]  A. Bryman,et al.  The debate about quantitative and qualitative research , 2012 .

[26]  Strategies for Strengthening Causal Inferences in Cross Cultural Research , 2008 .

[27]  J. Eyles,et al.  Developing and Implementing a Triangulation Protocol for Qualitative Health Research , 2006, Qualitative health research.

[28]  M. Fisch Whewell's Consilience of Inductions--An Evaluation , 1985, Philosophy of Science.

[29]  R. Wortham Du Bois and the Sociology of Religion: Rediscovering a Founding Figure* , 2005 .

[30]  Branden Fitelson,et al.  A Bayesian Account of Independent Evidence with Applications , 2001, Philosophy of Science.

[31]  Kevin J. S. Zollman,et al.  The Independence Thesis: When Individual and Social Epistemology Diverge* , 2011, Philosophy of Science.

[32]  M. Fredericks,et al.  Some notes on confirming hypotheses in qualitative research: An application , 1988 .

[33]  Jonah N. Schupbach,et al.  Robustness, Diversity of Evidence, and Probabilistic Independence , 2015 .

[34]  C. Lalwani,et al.  Combining quantitative and qualitative methodologies in logistics research , 2004 .