Ethical Dimensions of Visualization Research

Visualizations have a potentially enormous influence on how data are used to make decisions across all areas of human endeavor. However, it is not clear how this power connects to ethical duties: what obligations do we have when it comes to visualizations and visual analytics systems, beyond our duties as scientists and engineers? Drawing on historical and contemporary examples, I address the moral components of the design and use of visualizations, identify some ongoing areas of visualization research with ethical dilemmas, and propose a set of additional moral obligations that we have as designers, builders, and researchers of visualizations.

[1]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[2]  Jean Baudrillard,et al.  The Gulf War Did Not Take Place , 1991 .

[3]  Deborah Willis,et al.  A Small Nation of People:: W.E.B. DuBois & African American Portraits of Progress , 2003 .

[4]  A. Hochschild,et al.  The Managed Heart: Commercialization of Human Feeling. , 1985 .

[5]  Donna Harawy.  Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective , 2022, Philosophical Literary Journal Logos.

[6]  Cathy O'Neil,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2016, Vikalpa: The Journal for Decision Makers.

[7]  D. Citron.  Technological Due Process , 2007 .

[8]  Lauren F. Klein,et al.  Feminist Data Visualization , 2016 .

[9]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[10]  R. Weisberg.  A-N-D , 2011 .

[11]  Martin Wattenberg,et al.  Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow , 2018, IEEE Transactions on Visualization and Computer Graphics.

[12]  M. Sheelagh T. Carpendale,et al.  Critical InfoVis: exploring the politics of visualization , 2013, CHI Extended Abstracts.

[13]  Robert Kosara,et al.  Skipping the Replication Crisis in Visualization: Threats to Study Validity and How to Address Them : Position Paper , 2018, 2018 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV).

[14]  Ian Muehlenhaus,et al.  The design and composition of persuasive maps , 2013 .

[15]  Aditya G. Parameswaran,et al.  SeeDB: Efficient Data-Driven Visualization Recommendations to Support Visual Analytics , 2015, Proc. VLDB Endow..

[16]  Krishna Subramanian,et al.  Statsplorer: Guiding Novices in Statistical Analysis , 2015, CHI.

[17]  Tim Kraska,et al.  Toward Sustainable Insights, or Why Polygamy is Bad for You , 2017, CIDR.

[18]  Hannah Arendt,et al.  Eichmann in Jerusalem , 1963 .

[19]  Chong Wang,et al.  Reading Tea Leaves: How Humans Interpret Topic Models , 2009, NIPS.

[20]  C. Moskowitz.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. , 2016 .

[21]  Jesse F. Dillard,et al.  Professional Services, IBM, and the Holocaust , 2003, J. Inf. Syst..

[22]  James Mussell.  Raw Data is an Oxymoron , 2014 .

[23]  Ronald E. Anderson.  ACM code of ethics and professional conduct , 1992, CACM.

[24]  J. Henrich,et al.  Most people are not WEIRD , 2010, Nature.

[25]  Paul Bloom,et al.  Against empathy: The case for rational compassion , 2018 .

[26]  J. Krygier,et al.  An Introduction to Critical Cartography , 2005 .

[27]  Helen Kennedy,et al.  The work that visualisation conventions do , 2016 .

[28]  Michael Gleicher,et al.  Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error , 2014, IEEE Transactions on Visualization and Computer Graphics.

[29]  Oded Nov,et al.  The Persuasive Power of Data Visualization , 2014, IEEE Transactions on Visualization and Computer Graphics.

[30]  Desney S. Tan,et al.  EnsembleMatrix: interactive visualization to support machine learning with multiple classifiers , 2009, CHI.

[31]  Michael Gleicher,et al.  Explainers: Expert Explorations with Crafted Projections , 2013, IEEE Transactions on Visualization and Computer Graphics.

[32]  Robert Kosara,et al.  Adaptive Privacy-Preserving Visualization Using Parallel Coordinates , 2011, IEEE Transactions on Visualization and Computer Graphics.

[33]  Oded Nov,et al.  Showing People Behind Data: Does Anthropomorphizing Visualizations Elicit More Empathy for Human Rights Data? , 2017, CHI.

[34]  M. Heidegger.  The question concerning technology , 2024, East Asian Journal of Philosophy.

[35]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[36]  Wolzt,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2003, The Journal of the American College of Dentists.

[37]  A. Gelman,et al.  The garden of forking paths : Why multiple comparisons can be a problem , even when there is no “ fishing expedition ” or “ p-hacking ” and the research hypothesis was posited ahead of time ∗ , 2019 .

[38]  Colleen Cotter.  News Talk: SPJ Code of Ethics , 2010 .

[39]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[40]  Norman G. Lederman,et al.  The Death of Expertise , 2014 .

[41]  J. Tropman,et al.  The Managed Heart: Commercialization of Human Feeling , 1984 .

[42]  T. Nagel.  Moral Luck , 2009 .

[43]  Dumitru Erhan,et al.  The (Un)reliability of saliency methods , 2017, Explainable AI.

[44]  Karrie Karahalios,et al.  Frames and Slants in Titles of Visualizations on Controversial Topics , 2018, CHI.

[45]  Cláudio T. Silva,et al.  VisTrails: visualization meets data management , 2006, SIGMOD Conference.

[46]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[47]  Edwin Black,et al.  Book Reviews: IBM and the Holocaust: The Strategic Alliance between Nazi Germany and America's Most Powerful Corporation , 2002 .

[48]  Mark Ward.  Deadly Documents: Technical Communication, Organizational Discourse, and the Holocaust: Lessons from the Rhetorical Work of Everyday Texts , 2014 .

[49]  Kwan-Liu Ma,et al.  GraphProtector: A Visual Interface for Employing and Assessing Multiple Privacy Preserving Graph Algorithms , 2019, IEEE Transactions on Visualization and Computer Graphics.

[50]  Alex Endert,et al.  Warning, Bias May Occur: A Proposed Approach to Detecting Cognitive Bias in Interactive Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[51]  Pierre Dragicevic,et al.  The Attraction Effect in Information Visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[52]  Gervase Vernon,et al.  Virtue ethics. , 2003, The British journal of general practice : the journal of the Royal College of General Practitioners.

[53]  M. Gentzkow,et al.  Social Media and Fake News in the 2016 Election , 2017 .

[54]  Helen Kennedy,et al.  Visualizing Junk , 2016 .

[55]  Tobias Isenberg,et al.  Sketchy Rendering for Information Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[56]  Anne R. Richards.  Argument and Authority in the Visual Representations of Science , 2003 .

[57]  Alan L. Porter,et al.  Automated extraction and visualization of information for technological intelligence and forecasting , 2002 .

[58]  Solon Barocas,et al.  Engaging the ethics of data science in practice , 2017, Commun. ACM.

[59]  Carl Gutwin,et al.  Useful junk?: the effects of visual embellishment on comprehension and memorability of charts , 2010, CHI.

[60]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[61]  Jeffrey P. Bigham,et al.  It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process , 2021, ArXiv.

[62]  Zachary Chase Lipton.  The mythos of model interpretability , 2016, ACM Queue.

[63]  Tim Kraska,et al.  Investigating the Effect of the Multiple Comparisons Problem in Visual Analysis , 2018, CHI.

[64]  John Ashworth,et al.  Everyone likes a winner: An empirical test of the effect of electoral closeness on turnout in a context of expressive voting , 2006 .

[65]  W. E. B. collector Du Bois.  [A series of statistical charts illustrating the condition of the descendants of former African slaves now in residence in the United States of America] Illiteracy of the American Negroes compared with that of other nations. , .

[66]  Tadayoshi Kohno,et al.  Exploring ADINT: Using Ad Targeting for Surveillance on a Budget - or - How Alice Can Buy Ads to Track Bob , 2017, WPES@CCS.

[67]  Sean A. Munson,et al.  When (ish) is My Bus?: User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems , 2016, CHI.

[68]  Phillip Rogaway,et al.  The Moral Character of Cryptographic Work , 2015, IACR Cryptol. ePrint Arch..

[69]  Jarke J. van Wijk,et al.  The value of visualization , 2005, VIS 05. IEEE Visualization, 2005..

[70]  Orit Shaer,et al.  Designing for Uncertainty in HCI: When Does Uncertainty Help? , 2017, CHI Extended Abstracts.

[71]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[72]  Oluwasanmi Koyejo,et al.  Examples are not enough, learn to criticize! Criticism for Interpretability , 2016, NIPS.

[73]  Matthew Kay,et al.  The Garden of Forking Paths in Visualization: A Design Space for Reliable Exploratory Visual Analytics : Position Paper , 2018, 2018 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV).

[74]  Michelle A. Borkin,et al.  What Makes a Visualization Memorable? , 2013, IEEE Transactions on Visualization and Computer Graphics.

[75]  Jeffrey Heer,et al.  Black Hat Visualization , 2017 .

[76]  Sarah Rothstein,et al.  Mapping A Critical Introduction To Cartography And Gis , 2016 .

[77]  David J. Duke,et al.  Uncertainty visualization: why might it fail? , 2009, CHI Extended Abstracts.

[78]  J. Krygier,et al.  Rethinking the Power of Maps , 2010 .

[79]  Nicholas Diakopoulos,et al.  Visualization Rhetoric: Framing Effects in Narrative Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[80]  Steven Franconeri,et al.  Mitigating the Attraction Effect with Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[81]  Robert B. Louden,et al.  ON SOME VICES OF VIRTUE ETHICS , 1997 .

[82]  Matthew Kay,et al.  In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation , 2019, IEEE Transactions on Visualization and Computer Graphics.

[83]  Donald H. House,et al.  Non-expert interpretations of hurricane forecast uncertainty visualizations , 2016, CogSci.

[84]  Chris Russell,et al.  Counterfactual Explanations Without Opening the Black Box: Automated Decisions and the GDPR , 2017, ArXiv.

[85]  Cheng Deng,et al.  HindSight: Encouraging Exploration through Direct Encoding of Personal Interaction History , 2017, IEEE Transactions on Visualization and Computer Graphics.

[86]  Jason Dykes,et al.  Design Exposition with Literate Visualization , 2019, IEEE Transactions on Visualization and Computer Graphics.

[87]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[88]  Hanspeter Pfister,et al.  Beyond Memorability: Visualization Recognition and Recall , 2016, IEEE Transactions on Visualization and Computer Graphics.

[89]  Johanna Drucker.  Humanistic Theory and Digital Scholarship , 2012 .