Do Women Respond Less to Performance Pay? Building Evidence from Multiple Experiments

Performance pay increases productivity but also earnings inequality. Can it widen the gender gap because women are less responsive? We provide answers by aggregating evidence from existing experiments on performance pay that have both male and female subjects, regardless of whether they test for gender differences. We develop a Bayesian hierarchical model (BHM) that allows us to estimate both the average effect and the heterogeneity across studies. We find that the gender response difference is close to zero and heterogeneity across studies is small. We also find that the average effect of performance pay is positive, increasing output by 0.28 standard deviations. The data are thus strongly supportive of agency theory for men and women alike.

[1]  Patrick M. Kline,et al.  Bargaining, Sorting, and the Gender Wage Gap: Quantifying the Impact of Firms on the Relative Pay of Women , 2015 .

[2]  Alan Manning,et al.  Published by , 2005 .

[3]  J. Andreoni,et al.  Which is the Fair Sex? Gender Differences in Altruism , 2001 .

[4]  A. Falk,et al.  Individual Risk Attitudes: Measurement, Determinants and Behavioral Consequences , 2009 .

[5]  Pedro Rey-Biel,et al.  The Emergence of Male Leadership in Competitive Environments , 2012, SSRN Electronic Journal.

[6]  Lawrence F. Katz,et al.  Dynamics of the Gender Gap for Young Professionals in the Financial and Corporate Sectors , 2010 .

[7]  Angus Deaton.  Instruments, Randomization, and Learning about Development , 2010 .

[8]  Eva Vivalt,et al.  Heterogeneous Treatment Effects in Impact Evaluation , 2015 .

[9]  Rachael Meager,et al.  Understanding the Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of 7 Randomised Experiments , 2015, 1506.06669.

[10]  P. Gustafson,et al.  Conservative prior distributions for variance parameters in hierarchical models , 2006 .

[11]  David Gill,et al.  Nuffield Centre for Experimental Social Sciences Discussion Paper Series a Structural Analysis of Disappointment Aversion in a Real Effort Competition a Structural Analysis of Disappointment Aversion in a Real Effort Competition , 2022 .

[12]  A. Deaton,et al.  Understanding and Misunderstanding Randomized Controlled Trials , 2016, Social science & medicine.

[13]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[14]  Armin Falk,et al.  Performance Pay and Multi-Dimensional Sorting: Productivity, Preferences and Gender , 2006, SSRN Electronic Journal.

[15]  Lant Pritchett,et al.  Learning from Experiments When Context Matters , 2015 .

[16]  Andrew Gelman,et al.  Bayesian Measures of Explained Variance and Pooling in Multilevel (Hierarchical) Models , 2006, Technometrics.

[17]  Ghazala Azmat,et al.  Gender and the Labor Market: What Have We Learned from Field and Lab Experiments? , 2014, SSRN Electronic Journal.

[18]  J. Neyman,et al.  INADMISSIBILITY OF THE USUAL ESTIMATOR FOR THE MEAN OF A MULTIVARIATE NORMAL DISTRIBUTION , 2005 .

[19]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[20]  Abhijit Banerjee,et al.  The Experimental Approach to Development Economics , 2008 .

[21]  D. Rubin.  Estimation in Parallel Randomized Experiments , 1981 .

[22]  Philip Oreopoulos,et al.  Incentives and Services for College Achievement: Evidence from a Randomized Trial , 2007, SSRN Electronic Journal.

[23]  C. Palazzolo.  LibGuides: Educational Studies--Current Research: Journal of Educational and Behavioral Statistics , 2010 .

[24]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[25]  O. Bandiera,et al.  Social preferences and the response to incentives: Evidence from personnel data , 2005 .

[26]  G. Charness,et al.  Strong Evidence for Gender Differences in Risk Taking , 2012 .

[27]  Victor Lavy,et al.  The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial , 2009 .

[28]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[29]  Kathrin Pokorny.  Pay—but do not pay too much: An experimental study on the impact of incentives , 2008 .

[30]  M. Burke,et al.  Quantifying the Influence of Climate on Human Conflict , 2013, Science.

[31]  Adrian Pagan,et al.  Econometric Issues in the Analysis of Regressions with Generated Regressors. , 1984 .

[32]  Rachel T. A. Croson,et al.  Gender Differences in Preferences , 2009 .

[33]  G. Imbens,et al.  Machine Learning Methods for Estimating Heterogeneous Causal Eects , 2015 .

[34]  Amadou Boly.  On the incentive effects of monitoring: evidence from the lab and the field , 2011 .

[35]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[36]  Christos Genakos,et al.  Management Practices Across Firms and Countries , 2012 .

[37]  Claudia Olivetti,et al.  The Evolution of the Gender Gap in Industrialized Countries , 2016 .

[38]  Marie-Claire Villeval,et al.  Does Monitoring Decrease Work Effort? The Complementarity between Agency and Crowding-Out Theories , 2004, Games Econ. Behav..

[39]  Catherine C. Eckel,et al.  Are Women Less Selfish Than Men?: Evidence From Dictator Experiments , 1998 .

[40]  G. Imbens,et al.  Machine Learning Methods for Estimating Heterogeneous Causal Eects , 2015 .

[41]  B. Efron,et al.  Limiting the Risk of Bayes and Empirical Bayes Estimators—Part I: The Bayes Case , 1971 .

[42]  J. V. Reenen,et al.  Why Do Management Practices Differ across Firms and Countries ? , 2010 .

[43]  J. Carpenter,et al.  Tournaments and Office Politics: Evidence from a Real Effort Experiment , 2007, SSRN Electronic Journal.

[44]  Oriana Bandiera,et al.  No Margin, no Mission? A Field Experiment on Incentives for public service delivery , 2014 .

[45]  Daniel Parent,et al.  Performance Pay and Wage Inequality , 2007, SSRN Electronic Journal.

[46]  Catherine C. Eckel,et al.  Differences in the Economic Decisions of Men and Women: Experimental Evidence , 2008 .

[47]  Richard B. Freeman,et al.  Prize Structure and Information in Tournaments: Experimental Evidence , 2009 .

[48]  Rebecca M. Blank,et al.  Race and gender in the labor market , 1999 .

[49]  Dorota Kurowicka,et al.  Generating random correlation matrices based on vines and extended onion method , 2009, J. Multivar. Anal..

[50]  M. Burke,et al.  Climate and Conflict , 2014 .

[51]  D. Rodrik.  Diagnostics before Prescription , 2010 .

[52]  Benjamin A. Olken,et al.  Promises and Perils of Pre-analysis Plans , 2015 .

[53]  Guido Imbens,et al.  Site Selection Bias in Program Evaluation , 2014 .

[54]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[55]  B. Efron,et al.  Stein's Paradox in Statistics , 1977 .

[56]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[57]  Claudia Goldin,et al.  A Grand Gender Convergence: Its Last Chapter , 2014 .

[58]  Oriana Bandiera,et al.  NO MARGIN, NO MISSION? A FIELD EXPERIMENT ON INCENTIVES FOR PRO-SOCIAL TASKS , 2011 .

[59]  Marianne Bertrand,et al.  New Perspectives on Gender , 2011 .

[60]  Toniann Pitassi,et al.  The reusable holdout: Preserving validity in adaptive data analysis , 2015, Science.

[61]  Edward Miguel,et al.  Reshaping Institutions: Evidence on Aid Impacts Using a Pre-Analysis Plan , 2011 .

[62]  D. Ariely,et al.  Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially , 2007, SSRN Electronic Journal.

[63]  M. Betancourt,et al.  Hamiltonian Monte Carlo for Hierarchical Models , 2013, 1312.0906.

[64]  Ghazala Azmat,et al.  Gender Gaps in Performance: Evidence from Young Lawyers , 2015, Journal of Political Economy.

[65]  E. Fehr,et al.  Do Workers Work More If Wages are High? Evidence from a Randomized Field Experiment , 2005 .

[66]  Gary E. Bolton,et al.  An Experimental Test for Gender Differences in Beneficent Behavior , 1995 .

[67]  B. Holmlund,et al.  Vacancy Referrals, Job Search, and the Duration of Unemployment: A Randomized Experiment , 2009, SSRN Electronic Journal.