Is Quantitative Research Ethical? Tools for Ethically Practicing, Evaluating, and Using Quantitative Research

This editorial offers new ways to ethically practice, evaluate, and use quantitative research (QR). Our central claim is that ready-made formulas for QR, including ‘best practices’ and common notions of ‘validity’ or ‘objectivity,’ are often divorced from the ethical and practical implications of doing, evaluating, and using QR for specific purposes. To focus on these implications, we critique common theoretical foundations for QR and then recommend approaches to QR that are ‘built for purpose,’ by which we mean designed to ethically address specific problems or situations on terms that are contextually relevant. For this, we propose a new tool for evaluating the quality of QR, which we call ‘relational validity.’ Studies, including their methods and results, are relationally valid when they ethically connect researchers’ purposes with the way that QR is oriented and the ways that it is done—including the concepts and units of analysis invoked, as well as what its ‘methods’ imply more generally. This new way of doing QR can provide the liberty required to address serious worldly problems on terms that are both practical and ethically informed in relation to the problems themselves rather than the confines of existing QR logics and practices.

[1]  James Austin Laboratory life: The social construction of scientific facts: by Bruno Latour and Steve Woolgar. Sage, Beverly Hills, CA, 1979. , 1982 .

[2]  J. Dewey,et al.  The Quest for Certainty , 1929 .

[3]  R. Rorty,et al.  Philosophy and the Mirror of Nature. , 1980 .

[4]  A. Nayak Wisdom and the Tragic Question: Moral Learning and Emotional Perception in Leadership and Organisations , 2016 .

[5]  D. Campbell Factors relevant to the validity of experiments in social settings. , 1957, Psychological bulletin.

[6]  Peer C. Fiss,et al.  Embracing Causal Complexity , 2017 .

[7]  Nikolas Rose,et al.  The Psychological Complex , 1985 .

[8]  Alex C. Michalos,et al.  Editorial: Purpose and policy , 1982 .

[9]  Simon Knox,et al.  The Application of Stakeholder Theory to Relationship Marketing Strategy Development in a Non-profit Organization , 2007 .

[10]  Jean‐Pascal Gond,et al.  Unpacking the Drivers of Corporate Social Performance: A Multilevel, Multistakeholder, and Multimethod Analysis , 2017 .

[11]  Duygu Turker Measuring Corporate Social Responsibility: A Scale Development Study , 2009 .

[12]  Stewart Clegg,et al.  Reflexivity in Organization and Management Theory: A Study of the Production of the Research `Subject' , 2001 .

[13]  A. Cunliffe Reflexive Inquiry in Organizational Research: Questions and Possibilities , 2003 .

[14]  S. Kozlowski,et al.  Multilevel Theory, Research, a n d M e t h o d s i n Organizations Foundations, Extensions, and New Directions , 2022 .

[15]  Stuart Barber,et al.  All of Statistics: a Concise Course in Statistical Inference , 2005 .

[16]  P. Guttorp,et al.  The Taming of Chance. , 1992 .

[17]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[18]  Ian Palmer,et al.  Societal-Level Versus Individual-Level Predictions of Ethical Behavior: A 48-Society Study of Collectivism and Individualism , 2013, Journal of Business Ethics.

[19]  D. Rousseau,et al.  Evidence in Management and Organizational Science: Assembling the Field's Full Weight of Scientific Knowledge through Syntheses , 2008 .

[20]  Dov M. Gabbay,et al.  Handbook of Philosophical Logic , 2011 .

[21]  Emma L. Jeanes,et al.  Are we ethical? Approaches to ethics in management and organisation research , 2017 .

[22]  R. Rorty Philosophy and the Mirror of Nature: Thirtieth-Anniversary Edition , 2008 .

[23]  D. Stone,et al.  Causal Stories and the Formation of Policy Agendas , 1989, Anthologie Kulturpolitik.

[24]  Taru Feldt,et al.  Does the Ethical Culture of Organisations Promote Managers’ Occupational Well-Being? Investigating Indirect Links via Ethical Strain , 2011 .

[25]  Muel Kaptein,et al.  The Effectiveness of Business Codes: A Critical Examination of Existing Studies and the Development of an Integrated Research Model , 2007 .

[26]  Nancy Cartwright In Defence of ‘This Worldly’ Causality: Comments on van Fraassen’s Laws and Symmetry , 1993 .

[27]  William N. Dunn,et al.  Reforms as A rguments , 1982 .

[28]  Nancy Cartwright Hunting Causes and Using Them: Plurality in causality , 2007 .

[29]  Hugh Willmott,et al.  Registering ‘the Ethical’ in Organization Theory Formation: Towards the Disclosure of an ‘Invisible Force’ , 2014 .

[30]  Gerd Gigerenzer,et al.  Surrogate Science , 2015 .

[31]  J. L. Heilbron,et al.  Leviathan and the air-pump. Hobbes, Boyle, and the experimental life , 1989, Medical History.

[32]  Ronald Paul Hill,et al.  Stalking the Poverty Consumer A Retrospective Examination of Modern Ethical Dilemmas , 2002 .

[33]  Murray S. Davis,et al.  That's Interesting! , 1971 .

[34]  Lorraine Daston,et al.  Scientific Error and the Ethos of Belief , 2014 .

[35]  N. Cartwright Causation: One Word, Many Things , 2004, Philosophy of Science.

[36]  T. Morris Justice and the Politics of Difference , 1992 .

[37]  Wanda J. Orlikowski,et al.  Theorizing Practice and Practicing Theory , 2011, Organ. Sci..

[38]  Paul R. Yarnold "A Statistical Guide for the Ethically Perplexed" (Chapter 4, Panter & Sterba, Handbook of Ethics in Quantitative Methodology, Routledge, 2011): Clarifying Disorientation Regarding the Etiology and Meaning of the Term Optimal as Used in the Optimal Data Analysis (ODA) Paradigm , 2014 .

[39]  Oili-Helena Ylijoki,et al.  Research for Whom? Research Orientations in Three Academic Cultures , 2001 .

[40]  Donald A. Schön The Theory of Inquiry: Dewey's Legacy to Education , 1992 .

[41]  Sebastian Rathner,et al.  The Influence of Primary Study Characteristics on the Performance Differential Between Socially Responsible and Conventional Investment Funds: A Meta-Analysis , 2013 .

[42]  John Law,et al.  DEVICES AS RITUALS , 2013 .

[43]  Mollie Painter-Morland,et al.  Rethinking Responsible Agency in Corporations: Perspectives from Deleuze and Guattari , 2011 .

[44]  Zhen Zhang,et al.  Multilevel Latent Polynomial Regression for Modeling (In)Congruence Across Organizational Groups , 2016 .

[45]  Arjen Boin,et al.  PERSPECTIVE - Pragmatism in Organization Studies: Meeting the Challenges of a Dynamic and Complex World , 2015, Organ. Sci..

[46]  Donald T. Campbell,et al.  Methods for the experimenting society , 1991 .

[47]  Ian Hacking,et al.  The Emergence of Probability. A Philosophical Study of Early Ideas about Probability, Induction and Statistical Inference , 1979 .

[48]  H. Pashler,et al.  Editors’ Introduction to the Special Section on Replicability in Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[49]  J. Froud,et al.  (HOW) DO DEVICES MATTER IN FINANCE? , 2013 .

[50]  M. Greenwood Approving or Improving Research Ethics in Management Journals , 2016 .

[51]  I. Hacking An Introduction to Probability and Inductive Logic , 2001 .

[52]  S. Deetz Crossroads---Describing Differences in Approaches to Organization Science: Rethinking Burrell and Morgan and Their Legacy , 1996 .

[53]  T. Zuberi Thicker Than Blood: How Racial Statistics Lie , 2001 .

[54]  R. Edward Freeman Toward a New Vision for Management Research , 2002 .

[55]  Eve Tuck,et al.  Relational Validity and the “Where” of Inquiry , 2015 .

[56]  James M. Joyce Interpreting Probability: Controversies and Developments in the Early Twentieth Century , 2004 .

[57]  Patricia H. Werhane,et al.  Business Ethics: The State of the Art , 1999 .

[58]  Andrew C. Wicks,et al.  Organization Studies and the New Pragmatism: Positivism, Anti-Positivism, and the Search for Ethics , 1998 .

[59]  Fred Beard,et al.  College Student Attitudes Toward Advertising's Ethical, Economic, and Social Consequences , 2003 .

[60]  John Woods,et al.  Handbook of the History of Logic: Inductive Logic , 2011 .

[61]  Lorraine Daston,et al.  The Moral Economy of Science , 1995, Osiris.

[62]  Chad Albrecht,et al.  The Worldwide Academic Field of Business Ethics: Scholars’ Perceptions of the Most Important Issues , 2013 .

[63]  P Fisher Research for whom? , 2001, The British homoeopathic journal.

[64]  E. Schwartz,et al.  The quest for certainty. , 1959, A.M.A. archives of neurology and psychiatry.

[65]  Justin Parkhurst,et al.  What Constitutes “Good” Evidence for Public Health and Social Policy-making? From Hierarchies to Appropriateness , 2016 .

[66]  Conceição Soares,et al.  Corporate Versus Individual Moral Responsibility , 2003 .

[67]  Frank Martela Fallible Inquiry with Ethical Ends-in-View: A Pragmatist Philosophy of Science for Organizational Research , 2015 .

[68]  John Beatty,et al.  The Empire of Chance: How Probability Changed Science and Everyday Life , 1989 .

[69]  Constance E. Helfat,et al.  Creating repeatable cumulative knowledge in strategic management , 2016 .

[70]  Olaf A.M. Fisscher,et al.  Ethical Dilemmas in Performance Measurement , 2003 .

[71]  Michael J. Zyphur,et al.  Measurement and statistics in ‘organization science’ , 2015 .

[72]  Patrik Aspers Book Review: Donald MacKenzie, Fabian Muniesa and Lucia Siu(eds) Do Economists Make Markets? On the Performativity of Economics , 2008 .

[73]  Nancy Cartwright,et al.  Well‐Ordered Science: Evidence for Use , 2006, Philosophy of Science.

[74]  J. Alexander,et al.  Images of Organization , 1988 .

[75]  James C. Scott,et al.  Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed , 1999 .

[76]  N. Léchopier " Experimental and quasi-experimental designs for research on teaching ", de Donald T. Campbell & Julian C. Stanley, (1963). , 2011 .

[77]  A. Gelman The Connection Between Varying Treatment Effects and the Crisis of Unreplicable Research , 2015 .

[78]  David Power,et al.  Legal Determinants of External Finance Revisited: The Inverse Relationship Between Investor Protection and Societal Well-Being , 2012 .

[79]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[80]  Jeffrey M. Woodbridge Econometric Analysis of Cross Section and Panel Data , 2002 .

[81]  Nancy Cartwright,et al.  Hunting causes and using them: approaches in philosophy and economics: summary , 2010 .

[82]  John Law,et al.  Seeing Like a Survey , 2009 .

[83]  Arch G. Woodside,et al.  Deepening Understanding of Certification Adoption and Non-Adoption of International-Supplier Ethical Standards , 2015 .

[84]  Eric Abrahamson,et al.  A More Relevant Approach to Relevance in Management Studies: An Essay on Performativity , 2016 .

[85]  T. Falleti,et al.  Context and Causal Mechanisms in Political Analysis , 2009 .

[86]  Trisha Greenhalgh,et al.  Recognizing rhetoric in health care policy analysis , 2008, Journal of health services research & policy.

[87]  Stewart Clegg,et al.  Relativity Without Relativism: Reflexivity in Post-Paradigm Organization Studies , 1997 .

[88]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[89]  Nancy Cartwright Hunting Causes and Using Them: Case studies: Bayes nets and invariance theories , 2007 .

[90]  Justin Keeble,et al.  Using Indicators to Measure Sustainability Performance at a Corporate and Project Level , 2003 .

[91]  I. Hacking The Social Construction of What , 1999 .

[92]  Sandra B. Rosenthal,et al.  The Unholy Alliance of Business and Science , 2008 .

[93]  Ian Hacking,et al.  An Introduction to Probability and Inductive Logic: Contents , 2001 .

[94]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .