The Ethics of Data-Driven Personas

Quantitative methods are becoming more common for persona creation, but it is not clear to which extent online data and opaque machine learning algorithms introduce bias at various steps of data-driven persona creation (DDPC) and if these methods violate user rights. In this conceptual analysis, we use Gillespie's framework of algorithmic ethics to analyze DDPC for ethical considerations. We propose five design questions for evaluating the ethics of DDPC. DDPC should demonstrate the diversity of the user base but represent the actual data, be accompanied by explanations of their creation, and mitigate the possibility of unfair decisions.

[1]  K. Foot,et al.  Media Technologies: Essays on Communication, Materiality, and Society , 2014 .

[2]  Min Kyung Lee,et al.  Procedural Justice in Algorithmic Fairness , 2019, Proc. ACM Hum. Comput. Interact..

[3]  Nicola Marsden,et al.  Stereotypes and Politics: Reflections on Personas , 2016, CHI.

[4]  J. Söderberg.  Media Technologies - Essays on Communication, Materiality, and Society , 2014 .

[5]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[6]  Seth Neel,et al.  Rawlsian Fairness for Machine Learning , 2016, ArXiv.

[7]  Margaret M. Burnett,et al.  Gender-Inclusiveness Personas vs. Stereotyping: Can We Have it Both Ways? , 2017, CHI.

[8]  Bernard J. Jansen,et al.  Customer segmentation using online platforms: isolating behavioral and demographic segments for persona creation via aggregated user data , 2018, Social Network Analysis and Mining.

[9]  Steven Walczak,et al.  Comparing Semi-Automated Clustering Methods for Persona Development , 2012, IEEE Transactions on Software Engineering.

[10]  Munmun De Choudhury,et al.  A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media , 2019, FAT.

[11]  Daniel Neyland,et al.  Bearing Account-able Witness to the Ethical Algorithmic System , 2016 .

[12]  Michael Veale,et al.  Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making , 2018, CHI.

[13]  Bernard J. Jansen,et al.  Imaginary People Representing Real Numbers , 2018, ACM Trans. Web.

[14]  Bernard J. Jansen,et al.  Automatic Persona Generation (APG): A Rationale and Demonstration , 2018, CHIIR.

[15]  Adam Tauman Kalai,et al.  Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings , 2016, NIPS.

[16]  Kari Rönkkö,et al.  An Empirical Study Demonstrating How Different Design Constraints, Project Organization and Contexts Limited the Utility of Personas , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[17]  Malte Ziewitz.  Governing Algorithms , 2016 .

[18]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[19]  Bernard J. Jansen,et al.  “Is More Better?”: Impact of Multiple Photos on Perception of Persona Profiles , 2018, CHI.

[20]  Ching-I Teng,et al.  Voluntary sharing and mandatory provision: Private information disclosure on social networking sites , 2020, Inf. Process. Manag..

[21]  Bernard J. Jansen,et al.  Detecting Demographic Bias in Automatically Generated Personas , 2019, CHI Extended Abstracts.

[22]  Bernard J. Jansen,et al.  Personas Changing Over Time: Analyzing Variations of Data-Driven Personas During a Two-Year Period , 2019, CHI Extended Abstracts.

[23]  Mike Ananny,et al.  Toward an Ethics of Algorithms , 2016 .

[24]  BEN GREEN,et al.  The Principles and Limits of Algorithm-in-the-Loop Decision Making , 2019, Proc. ACM Hum. Comput. Interact..

[25]  Mariarosaria Taddeo,et al.  The ethics of algorithms: Mapping the debate , 2016, Big Data Soc..

[26]  Karrie Karahalios,et al.  Communicating Algorithmic Process in Online Behavioral Advertising , 2018, CHI.

[27]  Christian Sandvig,et al.  Algorithmic Authority: the Ethics, Politics, and Economics of Algorithms that Interpret, Decide, and Manage , 2016, CHI Extended Abstracts.

[28]  Irina Shklovski,et al.  The Algorithm and the User: How Can HCI Use Lay Understandings of Algorithmic Systems? , 2018, CHI Extended Abstracts.

[29]  Krishna P. Gummadi,et al.  Beyond Distributive Fairness in Algorithmic Decision Making: Feature Selection for Procedurally Fair Learning , 2018, AAAI.

[30]  David A. Siegel.  The mystique of numbers: belief in quantitative approaches to segmentation and persona development , 2010, CHI EA '10.

[31]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[32]  Bernard J. Jansen,et al.  The Future of Data-driven Personas: A Marriage of Online Analytics Numbers and Human Attributes , 2019, ICEIS.

[33]  Bernard J. Jansen,et al.  Automatic Persona Generation for Online Content Creators: Conceptual Rationale and a Research Agenda , 2019, Personas - User Focused Design.

[34]  Bernard J. Jansen,et al.  Persona Transparency: Analyzing the Impact of Explanations on Perceptions of Data-Driven Personas , 2019, Int. J. Hum. Comput. Interact..

[35]  Steve Whittaker,et al.  How do designers and user experience professionals actually perceive and use personas? , 2012, CHI.

[36]  Susan Turner,et al.  Is stereotyping inevitable when designing with personas , 2011 .

[37]  Reuben Binns,et al.  Fairness in Machine Learning: Lessons from Political Philosophy , 2017, FAT.

[38]  Bernard J. Jansen,et al.  Persona Generation from Aggregated Social Media Data , 2017, CHI Extended Abstracts.

[39]  Bernard J. Jansen,et al.  Are personas done? Evaluating their usefulness in the age of digital analytics , 2018, Persona Studies.

[40]  Tal Z. Zarsky,et al.  The Trouble with Algorithmic Decisions , 2016 .