EventAction

People use recommender systems to improve their decisions; for example, item recommender systems help them find films to watch or books to buy. Despite the ubiquity of item recommender systems, they can be improved by giving users greater transparency and control. This article develops and assesses interactive strategies for transparency and control, as applied to event sequence recommender systems, which provide guidance in critical life choices such as medical treatments, careers decisions, and educational course selections. This article’s main contribution is the use of both record attributes and temporal event information as features to identify similar records and provide appropriate recommendations. While traditional item recommendations are based on choices by people with similar attributes, such as those who looked at this product or watched this movie, our event sequence recommendation approach allows users to select records that share similar attribute values and start with a similar event sequence. Then users see how different choices of actions and the orders and times between them might lead to users’ desired outcomes. This paper applies a visual analytics approach to present and explain recommendations of event sequences. It presents a workflow for event sequence recommendation that is implemented in EventAction and reports on three case studies in two domains to illustrate the use of generating event sequence recommendations based on personal histories. It also offers design guidelines for the construction of user interfaces for event sequence recommendation and discusses ethical issues in dealing with personal histories. A demo video of EventAction is available at https://hcil.umd.edu/eventaction.

[1]  Richard T. Snodgrass,et al.  The temporal query language TQuel , 1987, TODS.

[2]  Tamara Munzner,et al.  Design Study Methodology: Reflections from the Trenches and the Stacks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Fei Wang,et al.  Frequence: interactive mining and visualization of temporal frequent event sequences , 2014, IUI.

[4]  Helen Nissenbaum,et al.  Computing and accountability , 1994, CACM.

[5]  David Gotz,et al.  DecisionFlow: Visual Analytics for High-Dimensional Temporal Event Sequence Data , 2014, IEEE Transactions on Visualization and Computer Graphics.

[6]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[7]  Barry Smyth,et al.  Case-based recommender systems , 2005, The Knowledge Engineering Review.

[8]  David Gotz,et al.  Data-driven exploration of care plans for patients , 2013, CHI Extended Abstracts.

[9]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[10]  Abhijit Guha,et al.  Ending the wage gap , 2013 .

[11]  Ben Shneiderman,et al.  Finding comparable temporal categorical records: A similarity measure with an interactive visualization , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[12]  Ben Shneiderman,et al.  Simplifying Overviews of Temporal Event Sequences , 2016, CHI Extended Abstracts.

[13]  J. Frost,et al.  Sharing Health Data for Better Outcomes on PatientsLikeMe , 2010, Journal of medical Internet research.

[14]  Bruce Krulwich,et al.  LIFESTYLE FINDER: Intelligent User Profiling Using Large-Scale Demographic Data , 1997, AI Mag..

[15]  I. Douven,et al.  Similarity After Goodman , 2010, Review of philosophy and psychology.

[16]  Adam Godzik,et al.  Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences , 2006, Bioinform..

[17]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[18]  International Human Genome Sequencing Consortium.  Initial sequencing and analysis of the human genome , 2001, Nature.

[19]  Panos Vassiliadis,et al.  Similarity measures for multidimensional data , 2011, 2011 IEEE 27th International Conference on Data Engineering.

[20]  Kanit Wongsuphasawat,et al.  Voyager 2: Augmenting Visual Analysis with Partial View Specifications , 2017, CHI.

[21]  Camilla Forsell,et al.  A Qualitative Study of Similarity Measures in Event-Based Data , 2011, HCI.

[22]  D. Fesenmaier,et al.  Case-based travel recommendations. , 2006 .

[23]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[24]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[25]  Wolfgang Jank,et al.  Similarity-Based Forecasting with Simultaneous Previews: A River Plot Interface for Time Series Forecasting , 2007, 2007 11th International Conference Information Visualization (IV '07).

[26]  Ling Chen,et al.  A context-aware personalized travel recommendation system based on geotagged social media data mining , 2013, Int. J. Geogr. Inf. Sci..

[27]  Fabio Grandi,et al.  T-SPARQL: A TSQL2-like Temporal Query Language for RDF , 2010, ADBIS.

[28]  Josua Krause,et al.  Supporting Iterative Cohort Construction with Visual Temporal Queries , 2016, IEEE Transactions on Visualization and Computer Graphics.

[29]  Johannes Gehrke,et al.  Sequential PAttern mining using a bitmap representation , 2002, KDD.

[30]  D. J. White,et al.  Real Applications of Markov Decision Processes , 1985 .

[31]  Anders Ynnerman,et al.  Are we what we do? Exploring group behaviour through user-defined event-sequence similarity , 2014, Inf. Vis..

[32]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[33]  Mehran Sahami,et al.  Evaluating similarity measures: a large-scale study in the orkut social network , 2005, KDD '05.

[34]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[35]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[36]  Jeffrey Heer,et al.  The Effects of Interactive Latency on Exploratory Visual Analysis , 2014, IEEE Transactions on Visualization and Computer Graphics.

[37]  Guy Shani,et al.  An MDP-Based Recommender System , 2002, J. Mach. Learn. Res..

[38]  Ben Shneiderman,et al.  Coping with Volume and Variety in Temporal Event Sequences: Strategies for Sharpening Analytic Focus , 2017, IEEE Transactions on Visualization and Computer Graphics.

[39]  Jianyong Wang,et al.  Mining sequential patterns by pattern-growth: the PrefixSpan approach , 2004, IEEE Transactions on Knowledge and Data Engineering.

[40]  W. R. Thompson.  ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES , 1933 .

[41]  Mira Dontcheva,et al.  MatrixWave: Visual Comparison of Event Sequence Data , 2015, CHI.

[42]  Gonzalo Navarro,et al.  A guided tour to approximate string matching , 2001, CSUR.

[43]  Ben Shneiderman,et al.  High-Volume Hypothesis Testing , 2016, ACM Trans. Interact. Intell. Syst..

[44]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[45]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.

[46]  W. B. Cavnar,et al.  N-gram-based text categorization , 1994 .

[47]  Silvia Miksch,et al.  Connecting time-oriented data and information to a coherent interactive visualization , 2004, CHI.

[48]  Ben Shneiderman,et al.  Finding Similar People to Guide Life Choices: Challenge, Design, and Evaluation , 2017, CHI.

[49]  Sean M. McNee,et al.  On the recommending of citations for research papers , 2002, CSCW '02.

[50]  Katharina Kaiser,et al.  CareCruiser: Exploring and visualizing plans, events, and effects interactively , 2011, 2011 IEEE Pacific Visualization Symposium.

[51]  Catherine Plaisant,et al.  Mining clinical big data for drug safety: Detecting inadequate treatment with a DNA sequence alignment algorithm , 2018, AMIA.

[52]  Gerald M. Karam,et al.  Visualization using timelines , 1994, ISSTA '94.

[53]  J. Leeuw,et al.  A new computational method to fit the weighted euclidean distance model , 1978 .

[54]  Mark Claypool,et al.  Combining Content-Based and Collaborative Filters in an Online Newspaper , 1999, SIGIR 1999.

[55]  Ben Shneiderman,et al.  Visual Interfaces for Recommendation Systems , 2018, ACM Trans. Intell. Syst. Technol..

[56]  Ashish Sureka,et al.  An Empirical Study on the Effect of Different Similarity Measures on User-Based Collaborative Filtering Algorithms , 2008, PRICAI.

[57]  Ben Shneiderman,et al.  TreatmentExplorer: an Interactive Decision Aid for Medical Risk Communication and Treatment Exploration , 2016, Interact. Comput..

[58]  Xin Jin,et al.  Semantically Enhanced Collaborative Filtering on the Web , 2003, EWMF.

[59]  Simone Santini,et al.  Similarity Measures , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Rodrygo L. T. Santos,et al.  Context-Aware Event Recommendation in Event-based Social Networks , 2015, RecSys.

[61]  Heikki Mannila,et al.  Discovery of Frequent Episodes in Event Sequences , 1997, Data Mining and Knowledge Discovery.

[62]  M. Swan.  Crowdsourced Health Research Studies: An Important Emerging Complement to Clinical Trials in the Public Health Research Ecosystem , 2012, Journal of medical Internet research.

[63]  Ben Shneiderman,et al.  LifeFlow: visualizing an overview of event sequences , 2011, CHI.

[64]  CARLOS A. GOMEZ-URIBE,et al.  The Netflix Recommender System , 2015, ACM Trans. Manag. Inf. Syst..

[65]  Emanuel Zgraggen,et al.  (s|qu)eries: Visual Regular Expressions for Querying and Exploring Event Sequences , 2015, CHI.

[66]  Alfred Kobsa.  User Modeling and User-Adapted Interaction , 2005, User Modeling and User-Adapted Interaction.

[67]  David Gotz,et al.  Exploring Flow, Factors, and Outcomes of Temporal Event Sequences with the Outflow Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[68]  Hans Hagen,et al.  Collaborative visualization: Definition, challenges, and research agenda , 2011, Inf. Vis..

[69]  Ben Shneiderman,et al.  Temporal Event Sequence Simplification , 2013, IEEE Transactions on Visualization and Computer Graphics.

[70]  Beverly L. Harrison,et al.  Timelines: An Interactive System for the Collection and Visualization of Temporal Data , 1994 .

[71]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[72]  Ben Shneiderman,et al.  EventAction: Visual analytics for temporal event sequence recommendation , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[73]  Mohammed J. Zaki,et al.  SPADE: An Efficient Algorithm for Mining Frequent Sequences , 2004, Machine Learning.

[74]  Zheng Wen,et al.  An Interactive Points of Interest Guidance System , 2017, IUI Companion.

[75]  Shie Mannor,et al.  Thompson Sampling for Learning Parameterized Markov Decision Processes , 2014, COLT.

[76]  Oded Berger-Tal,et al.  The Exploration-Exploitation Dilemma: A Multidisciplinary Framework , 2014, PloS one.

[77]  P. S. Sastry,et al.  A survey of temporal data mining , 2006 .

[78]  Zheng Wen,et al.  Scalar Posterior Sampling with Applications , 2018, NeurIPS.

[79]  B. Bornstein,et al.  Rationality in medical decision making: a review of the literature on doctors' decision-making biases. , 2001, Journal of evaluation in clinical practice.

[80]  Ben Shneiderman,et al.  Aligning temporal data by sentinel events: discovering patterns in electronic health records , 2008, CHI.

[81]  Gilbert Ritschard,et al.  Analyzing state sequences with probabilistic suffix trees: the PST R package , 2016 .

[82]  Tony Doyle,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Inf. Soc..

[83]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[84]  R. Mason.  Four ethical issues of the information age , 1986 .

[85]  Ben Shneiderman,et al.  The challenges of specifying intervals and absences in temporal queries: a graphical language approach , 2013, CHI.

[86]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[87]  Heikki Mannila,et al.  Similarity of event sequences , 1997, Proceedings of TIME '97: 4th International Workshop on Temporal Representation and Reasoning.

[88]  Katia P. Sycara,et al.  WebMate: a personal agent for browsing and searching , 1998, AGENTS '98.