Biometric Mirror: Exploring Ethical Opinions towards Facial Analysis and Automated Decision-Making

Facial analysis applications are increasingly being applied to inform decision-making processes. However, as global reports of unfairness emerge, governments, academia and industry have recognized the ethical limitations and societal implications of this technology. Alongside initiatives that aim to formulate ethical frameworks, we believe that the public should be invited to participate in the debate. In this paper, we discuss Biometric Mirror, a case study that explored opinions about the ethics of an emerging technology. The interactive application distinguished demographic and psychometric information from people's facial photos and presented speculative scenarios with potential consequences based on their results. We analyzed the interactions with Biometric Mirror and media reports covering the study. Our findings demonstrate the nature of public opinion about the technology's possibilities, reliability, and privacy implications. Our study indicates an opportunity for case study-based digital ethics research, and we provide practical guidelines for designing future studies.

[1]  J. F. Kelley,et al.  An iterative design methodology for user-friendly natural language office information applications , 1984, TOIS.

[2]  Wendy E. Mackay,et al.  Ethics, lies and videotape… , 1995, CHI '95.

[3]  M. Bland.  Communicating Out Of A Crisis , 1998 .

[4]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[5]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[6]  Anoop Gupta,et al.  Linking public spaces: technical and social issues , 2001, CHI.

[7]  P. Kollock,et al.  Reading race online , 2002 .

[8]  Yvonne Rogers,et al.  Enticing People to Interact with Large Public Displays in Public Spaces , 2003, INTERACT.

[9]  David J. Fleet,et al.  Design and Use of Linear Models for Image Motion Analysis , 2000, International Journal of Computer Vision.

[10]  J. Bosson,et al.  Role rigidity: a problem of identity misclassification? , 2005, Journal of personality and social psychology.

[11]  Gary N. Burns,et al.  The Good Judge Revisited: Individual Differences in the Accuracy of Personality Judgments , 2005 .

[12]  James Fogarty,et al.  Putting people in their place: an anonymous and privacy-sensitive approach to collecting sensed data in location-based applications , 2006, CHI.

[13]  B. Penders,et al.  Research in the wild , 2007, Nature.

[14]  Batya Friedman,et al.  Office window of the future? - Field-based analyses of a new use of a large display , 2008, Int. J. Hum. Comput. Stud..

[15]  Ryan Tonkens,et al.  A Challenge for Machine Ethics , 2009, Minds and Machines.

[16]  Antonio Krüger,et al.  ReflectiveSigns: Digital Signs That Adapt to Audience Attention , 2009, Pervasive.

[17]  Batya Friedman,et al.  The Watcher and the Watched: Social Judgments About Privacy in a Public Place , 2006, Media Space 20+ Years of Mediated Life.

[18]  Albrecht Schmidt,et al.  Display Blindness: The Effect of Expectations on Attention towards Digital Signage , 2009, Pervasive.

[19]  Natalie C. Ebner,et al.  FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation , 2010, Behavior research methods.

[20]  Barry A. T. Brown,et al.  Into the wild: challenges and opportunities for field trial methods , 2011, CHI.

[21]  Mark Billinghurst,et al.  Seamless interaction in space , 2011, OZCHI.

[22]  Sharath Pankanti,et al.  Privacy Protection and Face Recognition , 2011, Handbook of Face Recognition.

[23]  Ron Wakkary,et al.  Design fictions , 2012, TEI.

[24]  Yvonne Rogers,et al.  HCI Theory: Classical, Modern, and Contemporary , 2012, HCI Theory.

[25]  Yvonne Rogers,et al.  Research in the wild: understanding 'in the wild' approaches to design and development , 2012, DIS '12.

[26]  D. Boyd,et al.  CRITICAL QUESTIONS FOR BIG DATA , 2012 .

[27]  Joe Marshall,et al.  Uncomfortable interactions , 2012, CHI.

[28]  Florian Alt,et al.  Looking glass: a field study on noticing interactivity of a shop window , 2012, CHI.

[29]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[30]  David Coyle,et al.  Designing wellbeing , 2012, DIS '12.

[31]  Carl DiSalvo,et al.  Adversarial Design , 2012 .

[32]  Frank Leymann,et al.  How to adapt applications for the Cloud environment , 2012, Computing.

[33]  Anthony Dunne,et al.  Speculative Everything: Design, Fiction, and Social Dreaming , 2013 .

[34]  Wendy Moncur,et al.  The emotional wellbeing of researchers: considerations for practice , 2013, CHI.

[35]  Wilma A. Bainbridge,et al.  The intrinsic memorability of face photographs. , 2013, Journal of experimental psychology. General.

[36]  Mary Beth Rosson,et al.  Wild at Home: The Neighborhood as a Living Laboratory for HCI , 2013, TCHI.

[37]  Tadayoshi Kohno,et al.  In situ with bystanders of augmented reality glasses: perspectives on recording and privacy-mediating technologies , 2014, CHI.

[38]  Ernest A. Edmonds,et al.  Human Computer Interaction, Art and Experience , 2014, Interactive Experience in the Digital Age.

[39]  Eliezer Yudkowsky,et al.  The Ethics of Artificial Intelligence , 2014, Artificial Intelligence Safety and Security.

[40]  Linda Candy,et al.  Interactive Experience in the Digital Age , 2014, Springer Series on Cultural Computing.

[41]  David J. Crandall,et al.  Privacy behaviors of lifeloggers using wearable cameras , 2014, UbiComp.

[42]  Xu Sun,et al.  Enhancing self-reflection with wearable sensors , 2014, MobileHCI '14.

[43]  Shaowen Bardzell,et al.  Reading critical designs: supporting reasoned interpretations of critical design , 2014, CHI.

[44]  W. Ramsey,et al.  The Cambridge Handbook of Artificial Intelligence , 2014 .

[45]  A. Pincus,et al.  Intrapersonal Resilience Moderates the Association Between Exposure-Severity and PTSD Symptoms Among Civilians Exposed to the 2014 Israel–Gaza Conflict , 2015 .

[46]  Tom Rodden,et al.  Datawear: Self-reflection on the Go or How to Ethically Use Wearable Cameras for Research , 2015, CHI Extended Abstracts.

[47]  Steve Benford,et al.  The Ethical Implications of HCI's Turn to the Cultural , 2015, TCHI.

[48]  Kevin A. McLemore.  Experiences with Misgendering: Identity Misclassification of Transgender Spectrum Individuals , 2015 .

[49]  Stuart J. Russell,et al.  Research Priorities for Robust and Beneficial Artificial Intelligence , 2015, AI Mag..

[50]  L. Kulik,et al.  Ethics in Evaluating a Sociotechnical Intervention With Socially Isolated Older Adults , 2015, Qualitative health research.

[51]  Andy Crabtree,et al.  The Ethical Challenges of Experience Sampling Using Wearable Cameras , 2015, MobileHCI Adjunct.

[52]  Steve Benford,et al.  Behind The Scenes at HCI's Turn to the Arts , 2015, CHI Extended Abstracts.

[53]  Christian Sandvig,et al.  Algorithmic Authority: the Ethics, Politics, and Economics of Algorithms that Interpret, Decide, and Manage , 2016, CHI Extended Abstracts.

[54]  Peter C. Wright,et al.  Anti-Solutionist Strategies: Seriously Silly Design Fiction , 2016, CHI.

[55]  Lone Koefoed Hansen,et al.  PeriodShare: A Bloody Design Fiction , 2016, NordiCHI.

[56]  Andrew McStay.  Empathic media and advertising: Industry, policy, legal and citizen perspectives (the case for intimacy) , 2016, Big Data Soc..

[57]  S. Kapusta.  Misgendering and Its Moral Contestability , 2016 .

[58]  Christopher T. Lowenkamp,et al.  False Positives, False Negatives, and False Analyses: A Rejoinder to "Machine Bias: There's Software Used across the Country to Predict Future Criminals. and It's Biased against Blacks" , 2016 .

[59]  R. Hogan,et al.  New Talent Signals: Shiny New Objects or a Brave New World? , 2016, Industrial and Organizational Psychology.

[60]  Yair Zick,et al.  Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning Systems , 2016, 2016 IEEE Symposium on Security and Privacy (SP).

[61]  Keith Kirkpatrick,et al.  Battling algorithmic bias , 2016, Commun. ACM.

[62]  Bettina Nissen,et al.  On Speculative Enactments , 2017, CHI.

[63]  Paul D. Clough,et al.  Competent Men and Warm Women: Gender Stereotypes and Backlash in Image Search Results , 2017, CHI.

[64]  Christopher Frauenberger,et al.  Research Ethics in HCI: A Town Hall Meeting , 2017, CHI Extended Abstracts.

[65]  Yvonne Rogers,et al.  Research in the Wild , 2017, Synthesis Lectures on Human-Centered Informatics.

[66]  Jennifer Marlow,et al.  Surveying User Reactions to Recommendations Based on Inferences Made by Face Detection Technology , 2017, RecSys.

[67]  Timnit Gebru,et al.  Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification , 2018, FAT.

[68]  S. Noble.  Algorithms of Oppression: How Search Engines Reinforce Racism , 2018 .

[69]  Mohan S. Kankanhalli,et al.  Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda , 2018, CHI.

[70]  Allison Woodruff,et al.  A Qualitative Exploration of Perceptions of Algorithmic Fairness , 2018, CHI.

[71]  Morgan Klaus Scheuerman,et al.  Safe Spaces and Safe Places , 2018, Proc. ACM Hum. Comput. Interact..

[72]  Matthias Scheutz,et al.  The “big red button” is too late: an alternative model for the ethical evaluation of AI systems , 2018, Ethics and Information Technology.

[73]  L. Floridi.  Artificial Intelligence, Deepfakes and a Future of Ectypes , 2018, Philosophy & Technology.

[74]  Emilee J. Rader,et al.  Explanations as Mechanisms for Supporting Algorithmic Transparency , 2018, CHI.

[75]  Francesca Rossi,et al.  AI4People—An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations , 2018, Minds and Machines.

[76]  Susanne Boll,et al.  Beyond LED Status Lights - Design Requirements of Privacy Notices for Body-worn Cameras , 2018, TEI.

[77]  E. Hafen,et al.  Will Democracy Survive Big Data and Artificial Intelligence? , 2017, Towards Digital Enlightenment.

[78]  Hal Berghel,et al.  Malice Domestic: The Cambridge Analytica Dystopia , 2018, Computer.

[79]  M. Kosinski,et al.  Deep Neural Networks Are More Accurate Than Humans at Detecting Sexual Orientation From Facial Images , 2018, Journal of personality and social psychology.

[80]  Os Keyes,et al.  The Misgendering Machines , 2018, Proc. ACM Hum. Comput. Interact..

[81]  Annika Wærn,et al.  Towards Algorithmic Experience: Initial Efforts for Social Media Contexts , 2018, CHI.

[82]  Michael D. Ekstrand,et al.  Privacy for All: Ensuring Fair and Equitable Privacy Protections , 2018, FAT.

[83]  Tom Yeh,et al.  More Than a Show: Using Personalized Immersive Theater to Educate and Engage the Public in Technology Ethics , 2018, CHI.

[84]  Patrick Pérez,et al.  Deep video portraits , 2018, ACM Trans. Graph..

[85]  Morgan Klaus Scheuerman,et al.  Gender Recognition or Gender Reductionism?: The Social Implications of Embedded Gender Recognition Systems , 2018, CHI.

[86]  Carl Landwher,et al.  2018 , 2019, Communications of the ACM.

[87]  Proceedings of the Conference on Fairness, Accountability, and Transparency , 2019, FAT.