Fixation and Confusion: Investigating Eye-tracking Participants' Exposure to Information in Personas

To more effectively convey relevant information to end users of persona profiles, we conducted a user study consisting of 29 participants engaging with three persona layout treatments. We were interested in confusion engendered by the treatments on the participants, and conducted a within-subjects study in the actual work environment, using eye-tracking and talk-aloud data collection. We coded the verbal data into classes of informativeness and confusion and correlated it with fixations and durations on the Areas of Interests recorded by the eye-tracking device. We used various analysis techniques, including Mann-Whitney, regression, and Levenshtein distance, to investigate how confused users differed from non-confused users, what information of the personas caused confusion, and what were the predictors of confusion of end users of personas. We consolidate our various findings into a confusion ratio measure, which highlights in a succinct manner the most confusing elements of the personas. Findings show that inconsistencies among the informational elements of the persona generate the most confusion, especially with the elements of images and social media quotes. The research has implications for the design of personas and related information products, such as user profiling and customer segmentation.

[1]  Bernard J. Jansen,et al.  Validating social media data for automatic persona generation , 2016, 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA).

[2]  Lori Lorigo,et al.  Eye Monitoring in Online Search , 2008 .

[3]  B. Carnahan,et al.  A drowsy driver detection system for heavy vehicles , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[4]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[5]  Bernard J. Jansen,et al.  Towards Automatic Persona Generation Using Social Media , 2016, 2016 IEEE 4th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW).

[6]  John S. Pruitt,et al.  The Persona Lifecycle: Keeping People in Mind Throughout Product Design , 2006 .

[7]  Yvonne Dittrich,et al.  Personas is not applicable: local remedies interpreted in a wider context , 2004, PDC 04.

[8]  Joan Meyers-Levy,et al.  Exploring Differences in Males' and Females' Processing Strategies , 1991 .

[9]  Iftikhar Ahmed,et al.  Making personas memorable , 2007, CHI Extended Abstracts.

[10]  Thomas Ertl,et al.  Triangulating user behavior using eye movement, interaction, and think aloud data , 2016, ETRA.

[11]  Thierry Baccino,et al.  New insights into ambient and focal visual fixations using an automatic classification algorithm , 2011, i-Perception.

[12]  Stephanie Wilson,et al.  Identifying web usability problems from eye-tracking data , 2007, BCS HCI.

[13]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[14]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[15]  Bernard J. Jansen,et al.  Personas for Content Creators via Decomposed Aggregate Audience Statistics , 2017, 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[16]  Chris Chapman,et al.  The Personas' New Clothes: Methodological and Practical Arguments against a Popular Method , 2006 .

[17]  David Beymer,et al.  An Eye Tracking Study of How Pictures Influence Online Reading , 2007, INTERACT.

[18]  Hyeon-Seung Lee,et al.  Attentional processing of emotional faces in schizophrenia: Evidence from eye tracking. , 2016, Journal of abnormal psychology.

[19]  Jan Stage,et al.  Going Global with Personas , 2013, INTERACT.

[20]  Margaret M. Burnett,et al.  Gender-Inclusiveness Personas vs. Stereotyping: Can We Have it Both Ways? , 2017, CHI.

[21]  Stephanie Wilson,et al.  Identifying web usability problems from eye-tracking data , 2007 .

[22]  T. Tenbrink Cognitive Discourse Analysis: accessing cognitive representations and processes through language data* , 2014, Language and Cognition.

[23]  Joseph H. Goldberg,et al.  Scanpath clustering and aggregation , 2010, ETRA.

[24]  Edward Cutrell,et al.  What are you looking for?: an eye-tracking study of information usage in web search , 2007, CHI.

[25]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[26]  Steve Whittaker,et al.  How do designers and user experience professionals actually perceive and use personas? , 2012, CHI.

[27]  Linden J. Ball,et al.  An Eye Movement Analysis of Web Page Usability , 2002 .

[28]  Lene Nielsen,et al.  Personas is applicable: a study on the use of personas in Denmark , 2014, CHI.

[29]  Ganesh R. Naik,et al.  Classification of EEG based-mental fatigue using principal component analysis and Bayesian neural network , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Fumio Mizoguchi,et al.  Evaluation model of cognitive distraction state based on eye-tracking data using neural networks , 2013, 2013 IEEE 12th International Conference on Cognitive Informatics and Cognitive Computing.

[31]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[32]  Mounia Lalmas,et al.  Measuring User Engagement , 2014, Measuring User Engagement.

[33]  Yeliz Yesilada,et al.  Eye tracking scanpath analysis techniques on web pages: A survey, evaluation and comparison , 2015 .

[34]  Claudio M Privitera The scanpath theory: its definition and later developments , 2006, Electronic Imaging.

[35]  Lene Nielsen,et al.  Personas - User Focused Design , 2012, Human–Computer Interaction Series.

[36]  Toyotoshi Yainada,et al.  Pattern recognition of emotion with Neural Network , 1995 .

[37]  Bernard J. Jansen,et al.  Persona Generation from Aggregated Social Media Data , 2017, CHI Extended Abstracts.

[38]  Woodrow Barfield,et al.  Virtual environments and advanced interface design , 1995 .

[39]  Kerry Rodden,et al.  Incorporating Eyetracking into User Studies at Google , 2006 .

[40]  Yeliz Yesilada,et al.  Scanpath Trend Analysis on Web Pages , 2016, ACM Trans. Web.

[41]  Bernard J. Jansen,et al.  Generating Cultural Personas from Social Data: A Perspective of Middle Eastern Users , 2017, 2017 5th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW).

[42]  Ian Ruthven,et al.  An eye-tracking approach to the analysis of relevance judgments on the Web: The case of Google search engine , 2012, J. Assoc. Inf. Sci. Technol..

[43]  Jonathan Grudin,et al.  Personas: practice and theory , 2003, DUX '03.

[44]  Thorsten Joachims,et al.  The influence of task and gender on search and evaluation behavior using Google , 2006, Inf. Process. Manag..

[45]  Stephan Heckers,et al.  Schizophrenia and cognitive function , 2000, Current Opinion in Neurobiology.

[46]  Thomas Ertl,et al.  AOI hierarchies for visual exploration of fixation sequences , 2016, ETRA.