An Introduction to the General Monotone Model with Application to Two Problematic Data Sets

We argue that the mismatch between data and analytical methods, along with common practices for dealing with “messy” data, can lead to inaccurate conclusions. Specifically, using previously published data on racial bias and culture of honor, we show that manifest effects, and therefore theoretical conclusions, are highly dependent on how researchers decide to handle extreme scores and nonlinearities when data are analyzed with traditional approaches. Within LS approaches, statistical effects appeared or disappeared on the basis of the inclusion or exclusion of as little as 1.5% (3 of 198) of the data, and highly predictive variables were masked by nonlinearities. We then demonstrate a new statistical modeling technique called the general monotone model (GeMM) and show that it has a number of desirable properties that may make it more appropriate for modeling messy data: It is more robust to extreme scores, less affected by outlier analyses, and more robust to violations of linearity on both the response and predictor variables compared with a variety of well-established statistical algorithms and frequently possesses greater statistical power. We argue that using procedures that make fewer assumptions about the data, such as GeMM, can lessen the need for researchers to use data-editing strategies (e.g., to apply transformations or to engage outlier analyses) on their data to satisfy often unrealistic statistical assumptions, leading to more consistent and accurate conclusions about data than traditional approaches of data analysis.

[1]  Svenn-Åge Dahl,et al.  Health differences between European countries. , 2007, Social science & medicine.

[2]  R. Nisbett,et al.  Violence and U.S. regional culture. , 1993, The American psychologist.

[3]  G. Loewenstein,et al.  Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling , 2012, Psychological science.

[4]  Russell H. Fazio,et al.  An Individual Difference Measure of Motivation to Control Prejudiced Reactions , 1997 .

[5]  Olesya Govorun,et al.  An inkblot for attitudes: affect misattribution as implicit measurement. , 2005, Journal of personality and social psychology.

[6]  Rick P. Thomas,et al.  Robust Decision Making in a Nonlinear World We Thank Randy Engle and Lael Schooler for Providing Their Data Sets And , 2022 .

[7]  Rick P. Thomas,et al.  Order‐constrained linear optimization , 2017, The British journal of mathematical and statistical psychology.

[8]  Alan S. Gerber,et al.  Publication Bias in Empirical Sociological Research , 2008 .

[9]  P. Devine,et al.  Internal and external motivation to respond without prejudice , 1998 .

[10]  P. Devine,et al.  The Bogus Pipeline and Motivations to Respond without Prejudice: Revisiting the Fading and Faking of Racial Prejudice , 2003 .

[11]  A. Greenwald,et al.  Measuring individual differences in implicit cognition: the implicit association test. , 1998, Journal of personality and social psychology.

[12]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[13]  Ryan P. Brown,et al.  Culture of Honor and Violence Against the Self , 2011, Personality & social psychology bulletin.

[14]  J. Vandello,et al.  Male honor and female fidelity: implicit cultural scripts that perpetuate domestic violence. , 2003, Journal of personality and social psychology.

[15]  D. C. Howell Statistical Methods for Psychology , 1987 .

[16]  Ryan P. Brown,et al.  School Violence and the Culture of Honor , 2009, Psychological science.

[17]  Jeremy Freese,et al.  Replication Standards for Quantitative Social Science , 2007 .

[18]  William P. Dunlap,et al.  Approximating Pearson Product-Moment Correlations from Kendall's Tau and Spearman's Rho , 1996 .

[19]  Erin E Leahey,et al.  Diversity in Everyday Research Practice , 2003 .

[20]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.

[21]  Guillermina Jasso,et al.  Is It Outlier Deletion or Is It Sample Truncation? Notes on Science and Sexuality (Reply to Kahn and Udry) , 1986 .

[22]  R. Fazio,et al.  Variability in automatic activation as an unobtrusive measure of racial attitudes: a bona fide pipeline? , 1995, Journal of personality and social psychology.

[23]  R. Shepard Metric structures in ordinal data , 1966 .

[24]  Jennifer Crocker,et al.  The road to fraud starts with a single step , 2011, Nature.

[25]  F. Al-Shamali,et al.  Author Biographies. , 2015, Journal of social work in disability & rehabilitation.

[26]  N. Lewin-Epstein,et al.  Wealth Inequality: Ethnic Disparities in Israeli Society , 2011 .

[27]  Erin E Leahey,et al.  Alphas and Asterisks: The Development of Statistical Significance Testing Standards in Sociology , 2005 .

[28]  N. Cliff Ordinal methods for behavioral data analysis , 1996 .

[29]  Mariano Sana,et al.  Insiders, Outsiders, and the Editing of Inconsistent Survey Data , 2008 .

[30]  E. Leahey Overseeing Research Practice , 2008 .

[31]  J. Udry,et al.  Marital coital frequency: unnoticed outliers and unspecified interactions lead to erroneous conclusions. , 1986 .

[32]  R. Sherman,et al.  Rank estimators for monotonic index models , 1998 .

[33]  E. Harmon-Jones,et al.  The regulation of explicit and implicit race bias: the role of motivations to respond without prejudice. , 2002, Journal of personality and social psychology.

[34]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. I. , 1962 .

[35]  Ryan P. Brown,et al.  Culture of Honor, Violence, and Homicide , 2012 .

[36]  Daniel Lederman,et al.  Violent Crime: Does Social Capital Matter?* , 2002, Economic Development and Cultural Change.

[37]  A. Casadevall,et al.  Misconduct accounts for the majority of retracted scientific publications , 2012, Proceedings of the National Academy of Sciences.

[38]  T. Micceri The unicorn, the normal curve, and other improbable creatures. , 1989 .

[39]  M. Brandt,et al.  Low-status compensation: A theory for understanding the role of status in cultures of honor. , 2009, Journal of personality and social psychology.

[40]  Blaine G. Robbins,et al.  Social Capital, Economic Development, and Homicide: A Cross-National Investigation , 2012 .

[41]  Aaron K. Han Non-parametric analysis of a generalized regression model: the maximum rank correlation estimator , 1987 .

[42]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[43]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[44]  Uri Simonsohn,et al.  Just Post It , 2013, Psychological science.

[45]  W. Levelt,et al.  Flawed science: The fraudulent research practices of social psychologist Diederik Stapel , 2012 .

[46]  T. Yamagishi,et al.  Cultural Inertia, Economic Incentives, and the Persistence of “Southern Violence” , 2011 .

[47]  Grey Giddins,et al.  Statistics , 2016, The Journal of hand surgery, European volume.

[48]  Viviana A. Weekes-Shackelford,et al.  Evolutionary Perspectives on Violence, Homicide, and War , 2012 .

[49]  Nathaniel N. Beck,et al.  Beyond linearity by default: Generalized additive models , 1998 .

[50]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[51]  M. Dougherty,et al.  Manipulating the role of cognitive control while taking the implicit association test , 2012 .

[52]  Michael Tamborski,et al.  Living Dangerously , 2012 .

[53]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[54]  B. Payne,et al.  Why do implicit and explicit attitude tests diverge? The role of structural fit. , 2008, Journal of personality and social psychology.