CRISP: an interruption management algorithm based on collaborative filtering

Interruptions can have a significant impact on users working to complete a task. When people are collaborating, either with other users or with systems, coordinating interruptions is an important factor in maintaining efficiency and preventing information overload. Computer systems can observe user behavior, model it, and use this to optimize the interruptions to minimize disruption. However, current techniques often require long training periods that make them unsuitable for online collaborative environments where new users frequently participate. In this paper, we present a novel synthesis between Collaborative Filtering methods and machine learning classification algorithms to create a fast learning algorithm, CRISP. CRISP exploits the similarities between users in order to apply data from known users to new users, therefore requiring less information on each person. Results from user studies indicate the algorithm significantly improves users' performances in completing the task and their perception of how long it took to complete each task.

[1]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors , 2005, TCHI.

[2]  Deborah A. Boehm-Davis,et al.  What Makes Us Resilient to Interruptions? Understanding the Role of Individual Differences in Resumption , 2011 .

[3]  Kaizhu Huang,et al.  Machine Learning: Modeling Data Locally and Globally , 2008 .

[4]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[5]  Ernesto Arroyo,et al.  Attention and Intention Goals Can Mediate Disruption in Human-Computer Interaction , 2011, INTERACT.

[6]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[7]  William J. Byrne,et al.  Choosing your Moment: Interruptions in Multimedia Annotation , 2011, INTERACT.

[8]  Steve Benford,et al.  Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications , 2011, Mobile HCI.

[9]  Alex Richardson,et al.  Please Do Not Disturb: Managing Interruptions And Task Complexity , 2011, PACIS.

[10]  Ben Shneiderman,et al.  Maintaining concentration to achieve task completion , 2005, DUX '05.

[11]  Aniket Kittur,et al.  Instrumenting the crowd: using implicit behavioral measures to predict task performance , 2011, UIST.

[12]  Belur V. Dasarathy,et al.  Nearest neighbor (NN) norms: NN pattern classification techniques , 1991 .

[13]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[14]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[15]  Robin Cohen,et al.  A User Modeling Approach to Determining System Initiative in Mixed-Initiative AI Systems , 2001, User Modeling.

[16]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[17]  Dario D. Salvucci,et al.  Multitasking and monotasking: the effects of mental workload on deferred task interruptions , 2010, CHI.

[18]  Sarit Kraus,et al.  Leveraging Users for Efficient Interruption Management in Agent-User Systems , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[19]  Stuart E. Middleton,et al.  Ontological user profiling in recommender systems , 2004, TOIS.

[20]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[21]  Brian P. Bailey,et al.  Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption , 2005, CHI Extended Abstracts.

[22]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[23]  Víctor M. González,et al.  "Constant, constant, multi-tasking craziness": managing multiple working spheres , 2004, CHI.

[24]  Michael R. Lyu,et al.  Maxi–Min Margin Machine: Learning Large Margin Classifiers Locally and Globally , 2008, IEEE Transactions on Neural Networks.

[25]  George Karypis,et al.  Evaluation of Item-Based Top-N Recommendation Algorithms , 2001, CIKM '01.

[26]  Liang-Jie Zhang,et al.  The development and prospect of personalized TV program recommendation systems , 2002, Fourth International Symposium on Multimedia Software Engineering, 2002. Proceedings..

[27]  Milind Tambe,et al.  Electric Elves: What Went Wrong and Why , 2006, AAAI Spring Symposium: What Went Wrong and Why: Lessons from AI Research and Applications.

[28]  Brian P. Bailey,et al.  Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management , 2008, TCHI.

[29]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[30]  Eric Horvitz,et al.  Learning and reasoning about interruption , 2003, ICMI '03.