The Dark (Patterns) Side of UX Design

Interest in critical scholarship that engages with the complexity of user experience (UX) practice is rapidly expanding, yet the vocabulary for describing and assessing criticality in practice is currently lacking. In this paper, we outline and explore the limits of a specific ethical phenomenon known as "dark patterns," where user value is supplanted in favor of shareholder value. We assembled a corpus of examples of practitioner-identified dark patterns and performed a content analysis to determine the ethical concerns contained in these examples. This analysis revealed a wide range of ethical issues raised by practitioners that were frequently conflated under the umbrella term of dark patterns, while also underscoring a shared concern that UX designers could easily become complicit in manipulative or unreasonably persuasive practices. We conclude with implications for the education and practice of UX designers, and a proposal for broadening research on the ethics of user experience.

[1]  Daniel Fallman,et al.  The new good: exploring the potential of philosophy of technology to contribute to human-computer interaction , 2011, CHI.

[2]  P. Verbeek,et al.  Materializing Morality , 2006 .

[3]  Steve Harrison,et al.  Making epistemological trouble: Third-paradigm HCI as successor science , 2011, Interact. Comput..

[4]  Christopher A. Paul.  Values at play in digital games , 2016, New Media Soc..

[5]  B. J. Fogg,et al.  A behavior model for persuasive design , 2009, Persuasive '09.

[6]  Erik Stolterman,et al.  Reprioritizing the relationship between HCI research and practice: bubble-up and trickle-down effects , 2014, Conference on Designing Interactive Systems.

[7]  Liam J. Bannon,et al.  The turn to practice in HCI: towards a research agenda , 2014, CHI.

[8]  Erik Stolterman,et al.  Why ‘design research practice’ is not design as we know it , 2014 .

[9]  Katie Shilton,et al.  Blended, Not Bossy: Ethics Roles, Responsibilities and Expertise in Design , 2017, Interact. Comput..

[10]  Colin M. Gray.  "It's More of a Mindset Than a Method": UX Practitioners' Conception of Design Methods , 2016, CHI.

[11]  Lynn Dombrowski,et al.  Social Justice-Oriented Interaction Design: Outlining Key Design Strategies and Commitments , 2016, Conference on Designing Interactive Systems.

[12]  Alan Borning,et al.  Next steps for value sensitive design , 2012, CHI.

[13]  Susan Wyche,et al.  Values as lived experience: evolving value sensitive design in support of value discovery , 2009, CHI.

[14]  Johan Redström.  Persuasive Design: Fringes and Foundations , 2006, PERSUASIVE.

[15]  William E. Kastenberg,et al.  Making ethics explicit: Relocating ethics to the core of engineering education , 2013 .

[16]  Shaowen Bardzell,et al.  What is "critical" about critical design? , 2013, CHI.

[17]  Paul Dourish,et al.  Reflective HCI: articulating an agenda for critical practice , 2006, CHI Extended Abstracts.

[18]  Elizabeth Boling,et al.  Inscribing ethics and values in designs for learning: a problematic , 2016 .

[19]  Jes A. Koepfler,et al.  How to see values in social computing: methods for studying values dimensions , 2014, CSCW.

[20]  Chris Nodder,et al.  Evil by Design: Interaction Design to Lead Us into Temptation , 2013 .

[21]  Ellen Balka,et al.  Inside the belly of the beast: the challenges and successes of a reformist participatory agenda , 2006, PDC '06.

[22]  Aimee van Wynsberghe,et al.  Designing Robots for Care: Care Centered Value-Sensitive Design , 2013, Sci. Eng. Ethics.

[23]  Vincent Koenig,et al.  User experience: A concept without consensus? Exploring practitioners' perspectives through an international survey , 2015, Comput. Hum. Behav..

[24]  Katie Shilton,et al.  Values Levers , 2013 .

[25]  Alan Borning,et al.  Value Sensitive Design: Theory and Methods , 2002 .

[26]  D. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[27]  Elise van den Hoven,et al.  Crossing the bridge over Norman's Gulf of Execution: revealing feedforward's true identity , 2013, CHI.

[28]  Patrick Olivier,et al.  Digital Civics: Citizen Empowerment With and Through Technology , 2016, CHI Extended Abstracts.

[29]  Shaowen Bardzell,et al.  Analyzing critical designs: categories, distinctions, and canons of exemplars , 2014, Conference on Designing Interactive Systems.

[30]  Roisin McNaney,et al.  Ethical Encounters in Human-Computer Interaction , 2016, CHI Extended Abstracts.

[31]  Shaowen Bardzell,et al.  Humanistic HCI , 2015, Synthesis Lectures on Human-Centered Informatics.

[32]  Glenn A. Bowen.  Document Analysis as a Qualitative Research Method , 2009 .

[33]  Neville A. Stanton,et al.  Design with Intent: Persuasive Technology in a Wider Context , 2008, PERSUASIVE.

[34]  William W. Gaver.  Technology affordances , 1991, CHI.

[35]  Steve Benford,et al.  The Ethical Implications of HCI's Turn to the Cultural , 2015, TCHI.

[36]  Christopher Frauenberger,et al.  In-Action Ethics , 2016, Interact. Comput..

[37]  P. H. Kahn,et al.  Human values, ethics, and design , 2002 .

[38]  Phoebe Sengers,et al.  Expanding and Refining Design and Criticality in HCI , 2015, CHI.

[40]  Colin M. Gray,et al.  UX Practitioners' Engagement with Intermediate-Level Knowledge , 2017, Conference on Designing Interactive Systems.

[41]  Sean A. Munson,et al.  Translational Resources: Reducing the Gap Between Academic Research and HCI Practice , 2017, Conference on Designing Interactive Systems.

[42]  Daniel Berdichevsky,et al.  Toward an ethics of persuasive technology , 1999, CACM.

[43]  Aimee van Wynsberghe,et al.  Ethicist as Designer: A Pragmatic Approach to Ethics in the Lab , 2014, Sci. Eng. Ethics.

[44]  K. Mcphail,et al.  The Other Objective of Ethics Education: Re-humanising the Accounting Profession – A Study of Ethics Education in Law, Engineering, Medicine and Accountancy , 2001 .

[45]  Marty J. Wolf.  The ACM code of ethics , 2016, Commun. ACM.

[46]  Mario Romero,et al.  Situational Ethics: Re-thinking Approaches to Formal Ethics Requirements for Human-Computer Interaction , 2015, CHI.

[47]  Erik Stolterman,et al.  The Nature of Design Practice and Implications for Interaction Design Research , 2008 .

[48]  Jennifer Ann Rode,et al.  Does Technology Have Race? , 2016, CHI Extended Abstracts.

[49]  Jeroen J. G. van Merriënboer,et al.  The design way , 2005, Br. J. Educ. Technol..

[50]  Andrew Koenig,et al.  Patterns and Antipatterns , 1998, J. Object Oriented Program..

[51]  Janet Davis.  Design methods for ethical persuasive computing , 2009, Persuasive '09.

[52]  Paul Dourish,et al.  Values & design in HCI education , 2014, CHI Extended Abstracts.

[53]  Adam Fourney,et al.  These Aren't the Commands You're Looking For: Addressing False Feedforward in Feature-Rich Software , 2015, UIST.

[54]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[55]  S. Yelavich.  Speculative Everything: Design, Fiction, and Social Dreaming , 2015 .

[56]  William P. Moore,et al.  First Things First , 2002, Science's STKE.

[57]  Sebastian Boring,et al.  Dark patterns in proxemic interactions: a critical perspective , 2014, Conference on Designing Interactive Systems.

[58]  Peter Lloyd,et al.  Ethical imagination and design , 2009 .

[59]  Anders Albrechtslund,et al.  Ethics and technology design , 2007, Ethics and Information Technology.

[60]  Shaowen Bardzell,et al.  Reading critical designs: supporting reasoned interpretations of critical design , 2014, CHI.

[61]  Alain Findeli.  Rethinking Design Education for the 21st Century: Theoretical, Methodological, and Ethical Discussion , 2001, Design Issues.

[62]  Phoebe Sengers,et al.  Reflective design , 2005, Critical Computing.

[63]  John Zimmerman,et al.  Critical design and critical theory: the challenge of designing for provocation , 2012, DIS '12.