Toward a Bias-Aware Future for Mixed-Initiative Visual Analytics

Mixed-initiative visual analytics systems incorporate well-established design principles that improve users' abilities to solve problems. As these systems consider whether to take initiative towards achieving user goals, many current systems address the potential for cognitive bias in human initiatives statically, relying on fixed initiatives they can take instead of identifying, communicating and addressing the bias as it occurs. We argue that mixed-initiative design principles can and should incorporate cognitive bias mitigation strategies directly through development of mitigation techniques embedded in the system to address cognitive biases in situ. We identify domain experts in machine learning adopting visual analytics techniques and systems that incorporate existing mixed-initiative principles and examine their potential to support bias mitigation strategies. This examination considers the unique perspective these experts bring to visual analytics and is situated in existing user-centered systems that make exemplary use of design principles informed by cognitive theory. We then suggest informed opportunities for domain experts to take initiative toward addressing cognitive biases in light of their existing contributions to the field. Finally, we contribute open questions and research directions for designers seeking to adopt visual analytics techniques that incorporate bias-aware initiatives in future systems.

[1]  Karthic Madanagopal,et al.  Analytic Provenance in Practice: The Role of Provenance in Real-World Visualization and Data Analysis Environments , 2019, IEEE Computer Graphics and Applications.

[2]  Alex Endert,et al.  Toward a Design Space for Mitigating Cognitive Bias in Vis , 2019, 2019 IEEE Visualization Conference (VIS).

[3]  Alex Endert,et al.  The State of the Art in Integrating Machine Learning into Visual Analytics , 2017, Comput. Graph. Forum.

[4]  Minsuk Kahng,et al.  FAIRVIS: Visual Analytics for Discovering Intersectional Bias in Machine Learning , 2019, 2019 IEEE Conference on Visual Analytics Science and Technology (VAST).

[5]  Alex Endert,et al.  Warning, Bias May Occur: A Proposed Approach to Detecting Cognitive Bias in Interactive Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[6]  Alex Endert,et al.  Four Perspectives on Human Bias in Visual Analytics , 2018, Cognitive Biases in Visualizations.

[7]  Alex Endert,et al.  Putting the “I” in Interaction: Interactive Interfaces Personalized to Individuals , 2020, IEEE Computer Graphics and Applications.

[8]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[9]  Steven Franconeri,et al.  Mitigating the Attraction Effect with Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[10]  Alex Endert,et al.  Broadening Intellectual Diversity in Visualization Research Papers , 2019, IEEE Computer Graphics and Applications.

[11]  Alex Endert,et al.  A Formative Study of Interactive Bias Metrics in Visual Analytics Using Anchoring Bias , 2019, INTERACT.

[12]  Silvia Miksch,et al.  Characterizing Guidance in Visual Analytics , 2017, IEEE Transactions on Visualization and Computer Graphics.

[13]  Katrien Verbert,et al.  A Framework for Cognitive Bias Detection and Feedback in a Visual Analytics Environment , 2016, 2016 European Intelligence and Security Informatics Conference (EISIC).

[14]  Pierre Dragicevic,et al.  The Attraction Effect in Information Visualization , 2017, IEEE Transactions on Visualization and Computer Graphics.

[15]  Lionel M. Ni,et al.  Visual Analytics in Urban Computing: An Overview , 2016, IEEE Transactions on Big Data.

[16]  Sylvia Pantaleo Warning , 1933 .

[17]  Minsuk Kahng,et al.  Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers , 2018, IEEE Transactions on Visualization and Computer Graphics.

[18]  Richards J. Heuer,et al.  Structured Analytic Techniques for Intelligence Analysis , 2014 .

[19]  Alex Endert,et al.  Characterizing Provenance in Visualization and Data Analysis: An Organizational Framework of Provenance Types and Purposes , 2016, IEEE Transactions on Visualization and Computer Graphics.

[20]  Mary Hegarty,et al.  Correction to: Decision making with visualizations: a cognitive framework across disciplines , 2018, Cognitive Research: Principles and Implications.

[21]  Xiting Wang,et al.  Towards better analysis of machine learning models: A visual analytics perspective , 2017, Vis. Informatics.

[22]  Cheng Deng,et al.  HindSight: Encouraging Exploration through Direct Encoding of Personal Interaction History , 2017, IEEE Transactions on Visualization and Computer Graphics.