Tasks = Data + Action + Context: Automated Task Assistance through Data-Oriented Analysis

Human activity unfolds partly through planning and learnt sequences of actions, and partly through reaction to the physical objects and digital data in the environment. This paper describes various techniques related to automatic task assistance that take this role of data as central. Although this brings additional complexity, it also offers ways to simplify or bypass problems in task inference that otherwise appear difficult or impossible. Although the focus in this paper is on automated task support, the importance of objects and data in understanding tasks is one that applies to other forms of task analysis in the design process.

[1]  Stefano Levialdi,et al.  MADCOW: a multimedia digital annotation system , 2004, AVI.

[2]  Alan J. Dix,et al.  Towards a Ubiquitous Semantics of Interaction: Phenomenology, Scenarios, and Traces , 2002, DSV-IS.

[3]  Alan Dix,et al.  Grammatically interpreted task analysis for supply chain forecasting , 2005 .

[4]  Bonnie A. Nardi,et al.  Collaborative, programmable intelligent agents , 1998, CACM.

[5]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[6]  Edwin D. Reilly,et al.  Interactive system , 2003 .

[7]  Andy Clark,et al.  Microcognition: Philosophy, Cognitive Science, and Parallel Distributed Processing , 1989 .

[8]  Akrivi Katifori,et al.  From Information to Interaction: in Pursuit of Task-centred Infornation Management , 2007 .

[9]  Akrivi Katifori,et al.  Intelligent context-sensitive interactions on desktop and the web , 2006, CAI '06.

[10]  Allen Cypher,et al.  EAGER: programming repetitive tasks by example , 1991, CHI.

[11]  Alan J. Dix,et al.  Managing the Ecology of Interaction , 2002, TAMODIA.

[12]  Leo Sauermann,et al.  The Gnowsis Semantic Desktop for Information Integration , 2005, Wissensmanagement.

[13]  Akrivi Katifori,et al.  Personal Ontology Creation and Visualization for a Personal Interaction Management System , 2008 .

[14]  Gregory D. Abowd,et al.  CyberDesk: automated integration of desktop and network services , 1997, CHI.

[15]  John M. Carroll,et al.  Human-Computer Interaction in the New Millennium , 2001 .

[16]  Neville A. Stanton,et al.  Book preview , 2003, INTR.

[17]  Gregory D. Abowd,et al.  Human-Computer Interaction (3rd Edition) , 2003 .

[18]  Jørgen Staunstrup Design Specification and Verification , 1997 .

[19]  Russell Beale,et al.  Architectures to make simple visualisations using simple systems , 2000, AVI '00.

[20]  Milind S. Pandit,et al.  The selection recognition agent: instant access to relevant information and operations , 1997, IUI '97.

[21]  Bernhard Haslhofer,et al.  Joining the BRICKS Network - A Piece of Cake , 2005 .

[22]  Hugh C. Davis,et al.  Rethinking hypermedia - the microcosm approach , 1996 .

[23]  Akrivi Katifori,et al.  Using Spreading Activation through Ontologies to Support Personal Information Management , 2008, CSKGOI.

[24]  Akrivi Katifori,et al.  Task-Centred Information Management , 2007, DELOS.

[25]  Henry Lieberman,et al.  A goal-oriented web browser , 2006, CHI.

[26]  Brad A. Myers,et al.  Citrine: providing intelligent copy-and-paste , 2004, UIST '04.

[27]  Russell Beale,et al.  Neural networks and pattern recognition in human-computer interaction , 1993, SGCH.

[28]  John R. Anderson A spreading activation theory of memory. , 1983 .

[29]  Alan Dix,et al.  At the Right Time: when to sort web history and bookmarks , 2003 .

[30]  Mathias Lux,et al.  Common sense knowledge and goal-oriented interfaces , 2008, IUI '08.

[31]  Devina Ramduny-Ellis,et al.  Trigger Analysis - understanding broken tasks , 2003 .

[32]  Alan J. Dix,et al.  Artefacts as designed, artefacts as used: resources for uncovering activity dynamics , 2005, Cognition, Technology & Work.

[33]  Russell Beale,et al.  Analysis of user behaviour as time series , 1993 .

[34]  Gregory D. Abowd,et al.  Human-Computer Interaction, third edition , 2004 .

[35]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.