The Slodderwetenschap (Sloppy Science) of Stochastic Parrots - A Plea for Science to NOT take the Route Advocated by Gebru and Bender

This article is a position paper written in reaction to the now-infamous paper titled "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" by Timnit Gebru, Emily Bender, and others who were, as of the date of this writing, still unnamed. I find the ethics of the Parrot Paper lacking, and in that lack, I worry about the direction in which computer science, machine learning, and artificial intelligence are heading. At best, I would describe the argumentation and evidentiary practices embodied in the Parrot Paper as Slodderwetenschap (Dutch for Sloppy Science) – a word which the academic world last widely used in conjunction with the Diederik Stapel affair in psychology [2]. What is missing in the Parrot Paper are three critical elements: 1) acknowledgment that it is a position paper/advocacy piece rather than research, 2) explicit articulation of the critical presuppositions, and 3) explicit consideration of cost/benefit trade-offs rather than a mere recitation of potential "harms" as if benefits did not matter. To leave out these three elements is not good practice for either science or research.

[1]  Emily M. Bender,et al.  On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 , 2021, FAccT.

[2]  Michael Lissack,et al.  When explanations "cause" error: A look at representations and compressions , 2012, Inf. Knowl. Syst. Manag..

[3]  The Oxford Handbook of Ethics of AI , 2020 .

[4]  Mohsen Imani,et al.  DUAL: Acceleration of Clustering Algorithms using Digital-based Processing In-Memory , 2020, 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[5]  Cary Funk,et al.  Trust and mistrust in Americans’ views of scientific experts , 2019 .

[6]  Michael Lissack,et al.  Second Order Science: Examining Hidden Presuppositions in the Practice of Science , 2017 .

[7]  Mariarosaria Taddeo,et al.  The ethics of algorithms: Mapping the debate , 2016, Big Data Soc..

[8]  Michael Lissack,et al.  What Second Order Science Reveals About Scientific Claims: Incommensurability, Doubt, and a Lack of Explication , 2017 .

[9]  Dan W. Brockt,et al.  The Theory of Justice , 2017 .

[10]  John Paul Lederach,et al.  The moral imagination : the art and soul of building peace , 2007 .

[11]  Michael R. Lissack,et al.  When Modeling Social Systems, Models ≠ the Modeled: Reacting to Wolfram's A New Kind of Science , 2001 .

[12]  S. Merz Race after technology. Abolitionist tools for the new Jim Code , 2020, Ethnic and Racial Studies.

[13]  Vinay Uday Prabhu,et al.  Large image datasets: A pyrrhic win for computer vision? , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[14]  Robert Hauptman,et al.  Faking Science: A True Story of Academic Fraud , 2016 .

[15]  Michael Lissack,et al.  Understanding Is a Design Problem: Cognizing from a Designerly Thinking Perspective. Part 1 , 2019, She Ji: The Journal of Design, Economics, and Innovation.