The potential impact of emerging technologies on democratic representation: Evidence from a field experiment

Advances in machine learning have led to the creation natural language models that can mimic human writing style and substance. Here we investigate the challenge that machine-generated content, such as that produced by the model GPT-3, presents to democratic representation by assessing the extent to which machine-generated content can pass as constituent sentiment. We conduct a field experiment in which we send both handwritten and machine-generated letters (a total of 32,398 emails) to 7132 state legislators. We compare legislative response rates for the human versus machine-generated constituency letters to gauge whether language models can approximate inauthentic constituency voices at scale. Legislators were only slightly less likely to respond to artificial intelligence (AI)-generated content than to human-written emails; the 2% difference in response rate was statistically significant but substantively small. Qualitative evidence sheds light on the potential perils that this technology presents for democratic representation, but also suggests potential techniques that legislators might employ to guard against misuses of language models.

[1]  M. Tesconi,et al.  On pushing DeepFake Tweet Detection capabilities to the limits , 2022, WebSci.

[2]  Yue Zhang,et al.  Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts , 2020, AAAI.

[3]  T. Gschwend,et al.  The importance of personal vote intentions for the responsiveness of legislators: A field experiment , 2020 .

[4]  M. Landgrave Can We Reduce Deception in Elite Field Experiments? Evidence from a Field Experiment with State Legislative Offices , 2020, State Politics & Policy Quarterly.

[5]  Xiao Ma,et al.  AI-Mediated Communication: How the Perception that Profile Text was Written by AI Affects Trustworthiness , 2019, CHI.

[6]  D. Castiglione,et al.  Creating Political Presence , 2019 .

[7]  K. Einstein,et al.  Does Race Affect Access to Government Services? An Experiment Exploring Street-Level Bureaucrats and Access to Public Housing , 2017 .

[8]  Daniel M. Butler,et al.  How Politicians Discount the Opinions of Constituents with Whom They Disagree , 2016 .

[9]  Brendan Nyhan,et al.  The Effect of Fact-Checking on Elites: A Field Experiment on U.S. State Legislators , 2015 .

[10]  Michele Claibourn,et al.  Citizen Participation and Congressional Responsiveness: New Evidence that Participation Matters , 2013 .

[11]  Daniel M. Butler,et al.  Can Learning Constituency Opinion Affect How Legislators Vote? Results from a Field Experiment , 2011 .

[12]  David E. Broockman,et al.  Do Politicians Racially Discriminate Against Constituents? A Field Experiment on State Legislators , 2011 .

[13]  A. Campbell How Policies Make Citizens , 2011 .

[14]  Michael Saward,et al.  Representation and democracy : revisions and possibilities , 2008 .

[15]  John D. Griffin,et al.  Are Voters Better Represented? , 2005, The Journal of Politics.

[16]  Grant M. Hayden The False Promise of One Person, One Vote , 2003 .

[17]  Hermann Schmitt,et al.  Dynamic Representation , 1995, American Political Science Review.

[18]  L. Dexter What Do Congressmen Hear: The Mail , 1956 .