Look what you've done! Task recognition based on PC activities

days many people do their work on PCs. Due to interruptions and task switches it is quite common that at the end of a working day these people experience a feeling of having lost track of what they have been doing during the day. In this thesis a tool was developed which automatically recognizes the tasks a user is performing and presents these in an overview. It was investigated which task labels humans intuitively use and in how far it is possible to recognize these tasks on the basis of low level computer activity, like used applications and clicking and typing behavior. Results show that after only a few hours of training a reasonable classification accuracy can be reached. Comparison of several classification approaches reveals that there is not one classifier that suits all users best in terms of classification performance and learning Individual differences, due to mix of performed tasks and the individual work style, indicate that the tool should be personalized.

[1]  Eric Horvitz,et al.  Layered representations for learning and inferring office activity from multiple sensory channels , 2004, Comput. Vis. Image Underst..

[2]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[3]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[4]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[5]  Nuria Oliver,et al.  SWISH: semantic analysis of window titles and switching history , 2006, IUI '06.

[6]  Andreas S. Rath,et al.  Context-Aware Knowledge Services , 2008 .

[7]  John G. Cleary,et al.  K*: An Instance-based Learner Using and Entropic Distance Measure , 1995, ICML.

[8]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[10]  Clay Spinuzzi,et al.  Context and consciousness: Activity theory and human-computer interaction , 1997 .

[11]  Stuart K. Card,et al.  A taxonomic analysis of what world wide web activities significantly impact people's decisions and actions , 2001, CHI Extended Abstracts.

[12]  Andreas S. Rath,et al.  UICO: an ontology-based user interaction context model for automatic task detection on the computer desktop , 2009, CIAO '09.

[13]  Johan Kwisthout,et al.  How Action Understanding can be Rational, Bayesian and Tractable , 2010 .

[14]  Jack Park,et al.  IRIS: Integrate. Relate. Infer. Share , 2005, Semantic Desktop Workshop.

[15]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[16]  Robert P. Goldman,et al.  A New Model of Plan Recognition , 1999, UAI.

[17]  Deborah L. McGuinness,et al.  An Intelligent Personal Assistant for Task and Time Management , 2007, AI Mag..

[18]  Weng-Keen Wong,et al.  Logical Hierarchical Hidden Markov Models for Modeling User Activities , 2008, ILP.

[19]  Thomas G. Dietterich,et al.  TaskTracer: a desktop environment to support multi-tasking knowledge workers , 2005, IUI.

[20]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[21]  J S Bailey,et al.  The effects of self-monitoring and supervisor feedback on staff performance in a residential setting. , 1988, Journal of applied behavior analysis.

[22]  A. Bandura Social cognitive theory of self-regulation☆ , 1991 .

[23]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[24]  Stephen M. Johnson,et al.  Self-observation as an agent of behavioral change , 1971 .

[25]  H. P. Sims,et al.  Self-Management as a Substitute for Leadership: A Social Learning Theory Perspective , 1980 .

[26]  Karim A. Tahboub,et al.  Journal of Intelligent and Robotic Systems (2005) DOI: 10.1007/s10846-005-9018-0 Intelligent Human–Machine Interaction Based on Dynamic Bayesian Networks Probabilistic Intention Recognition , 2004 .

[27]  Thomas G. Dietterich,et al.  A hybrid learning system for recognizing user tasks from desktop activities and email messages , 2006, IUI '06.

[28]  Wessel Kraaij,et al.  Activity-logging for self-coaching of knowledge workers , 2011, ECIR 2011.