Capturing Common Knowledge about Tasks: Intelligent Assistance for To-Do Lists

Although to-do lists are a ubiquitous form of personal task management, there has been no work on intelligent assistance to automate, elaborate, or coordinate a user’s to-dos. Our research focuses on three aspects of intelligent assistance for to-dos. We investigated the use of intelligent agents to automate to-dos in an office setting. We collected a large corpus from users and developed a paraphrase-based approach to matching agent capabilities with to-dos. We also investigated to-dos for personal tasks and the kinds of assistance that can be offered to users by elaborating on them on the basis of substep knowledge extracted from the Web. Finally, we explored coordination of user tasks with other users through a to-do management application deployed in a popular social networking site. We discuss the emergence of Social Task Networks, which link users‘ tasks to their social network as well as to relevant resources on the Web. We show the benefits of using common sense knowledge to interpret and elaborate to-dos. Conversely, we also show that to-do lists are a valuable way to create repositories of common sense knowledge about tasks.

[1]  Regina Barzilay,et al.  Learning to Paraphrase: An Unsupervised Approach Using Multiple-Sequence Alignment , 2003, NAACL.

[2]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[3]  Henry Lieberman,et al.  The why UI: using goal networks to improve user interfaces , 2010, IUI '10.

[4]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[5]  James F. Allen,et al.  An architecture for more realistic conversational systems , 2001, IUI '01.

[6]  Eric K. Ringger,et al.  A Robust System for Natural Spoken Dialogue , 1996, ACL.

[7]  Jean Oh,et al.  Electric Elves: Agent Technology for Supporting Human Organizations , 2002, AI Mag..

[8]  Donald A. Norman,et al.  Cognitive artifacts , 1991 .

[9]  Jens Lehmann,et al.  Triplify: light-weight linked data publication from relational databases , 2009, WWW '09.

[10]  Karen L. Myers,et al.  The SPARK agent framework , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[11]  Bradley R. Schmerl,et al.  Agent-assisted task management that reduces email overload , 2010, IUI '10.

[12]  Alexander I. Rudnicky,et al.  Creating natural dialogs in the carnegie mellon communicator system , 1999, EUROSPEECH.

[13]  Stephanie Seneff,et al.  TINA: A Natural Language System for Spoken Language Applications , 1992, Comput. Linguistics.

[14]  Gregory D. Abowd,et al.  Practices for capturing short important thoughts , 2003, CHI Extended Abstracts.

[15]  Yolanda Gil,et al.  Automating To-Do Lists for Users: Interpretation of To-Dos for Selecting and Tasking Agents , 2008, AAAI.

[16]  Ye-Yi Wang,et al.  Grammar learning for spoken language understanding , 2001, IEEE Workshop on Automatic Speech Recognition and Understanding, 2001. ASRU '01..

[17]  Ian Smith,et al.  Taking email to task: the design and evaluation of a task management centered email tool , 2003, CHI '03.

[18]  Erik T. Mueller,et al.  Open Mind Common Sense: Knowledge Acquisition from the General Public , 2002, OTM.

[19]  Candace L. Sidner,et al.  COLLAGEN: when agents collaborate with people , 1997, AGENTS '97.

[20]  Emmon W. Bach,et al.  Universals in Linguistic Theory , 1970 .

[21]  Barbara Barry,et al.  Beating Some Common Sense into Interactive Applications , 2003 .

[22]  H. scharrer A robust system , 1989 .

[23]  Peter J. Thomas,et al.  Empirical assessment of individuals' 'personal information management systems' , 1997, Behav. Inf. Technol..

[24]  Yolanda Gil,et al.  An Analysis of Knowledge Collected from Volunteer Contributors , 2005, AAAI.

[25]  Charles J. Fillmore,et al.  THE CASE FOR CASE. , 1967 .

[26]  Chung Hee Hwang,et al.  The TRAINS project: a case study in building a conversational planning agent , 1994, J. Exp. Theor. Artif. Intell..

[27]  Judges,et al.  Dublin Core Metadata Terms , 2011 .

[28]  Tom M. Mitchell,et al.  Extracting Knowledge about Users' Activities from Raw Workstation Contents , 2006, AAAI.

[29]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[30]  Deborah L. McGuinness,et al.  An Intelligent Personal Assistant for Task and Time Management , 2007, AI Mag..

[31]  Richard Halstead-Nussloch,et al.  Shaping User Input: A Strategy for Natural Language Dialogue Design , 1989, Interact. Comput..

[32]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[33]  Susan McRoy,et al.  Using Multiple Knowledge Sources for Word Sense Discrimination , 1992, Comput. Linguistics.

[34]  David Kirsh,et al.  The Context of Work , 2001, Hum. Comput. Interact..

[35]  Yolanda Gil,et al.  Want world domination? win at risk!: matching to-do items with how-tos from the web , 2011, IUI '11.

[36]  Huajun Chen,et al.  The Semantic Web , 2011, Lecture Notes in Computer Science.

[37]  Elizabeth Zoltan-Ford,et al.  How to Get People to Say and Type What Computers Can Understand , 1991, Int. J. Man Mach. Stud..

[38]  Jacek Gwizdka,et al.  Email in personal information management , 2006, CACM.

[39]  Yolanda Gil,et al.  Towards intelligent assistance for to-do lists , 2008, IUI '08.

[40]  James Carpenter,et al.  Towel: Towards an Intelligent To-Do List , 2007, Interaction Challenges for Intelligent Assistants.

[41]  Siegfried Handschuh,et al.  The NEPOMUK Project - On the way to the Social Semantic Desktop , 2007 .

[42]  Monica M. C. Schraefel,et al.  Tabulator Redux: Browsing and Writing Linked Data , 2008, LDOW.

[43]  Shawn F. Blau Getting Things Done: The Art of Stress-Free Productivity , 2001 .

[44]  John M. Carroll,et al.  Designing Interaction: Psychology at the Human-Computer Interface , 1991 .

[45]  Eric Horvitz,et al.  Attention-Sensitive Alerting , 1999, UAI.

[46]  Milind Tambe,et al.  Adjustable Autonomy Challenges in Personal Assistant Agents: A Position Paper , 2003, Agents and Computational Autonomy.

[47]  Timothy Chklovski,et al.  Collecting paraphrase corpora from volunteer contributors , 2005, K-CAP '05.

[48]  Yolanda Gil,et al.  Leveraging Social Networking Sites to Acquire Rich Task Structure , 2009 .

[49]  Timothy Chklovski,et al.  Learner: a system for acquiring commonsense knowledge by analogy , 2003, K-CAP '03.

[50]  Tomás E. Uribe,et al.  Deploying a personalized time management agent , 2006, AAMAS '06.

[51]  Alexander H. Waibel,et al.  Growing Semantic Grammars , 1998, COLING-ACL.

[52]  Thomas G. Dietterich,et al.  A hybrid learning system for recognizing user tasks from desktop activities and email messages , 2006, IUI '06.

[53]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[54]  Jim Blythe,et al.  Task learning by instruction in tailor , 2005, IUI.

[55]  Patrick Pantel,et al.  VerbOcean: Mining the Web for Fine-Grained Semantic Verb Relations , 2004, EMNLP.

[56]  Daniel G. Bobrow,et al.  What a to-do: studies of task management towards the design of a personal task list manager , 2004, CHI.

[57]  Leo Sauermann,et al.  The Semantic Desktop as a foundation for PIM research , 2007 .

[58]  Stephanie Seneff,et al.  Automatic induction of language model data for a spoken dialogue system , 2006, SIGDIAL.

[59]  Patrick Pantel,et al.  Global Path-Based Refinement of Noisy Graphs Applied to Verb Semantics , 2005, IJCNLP.

[60]  James R. Glass,et al.  A Framework for Developing Conversational User Interfaces , 2004, CADUI.

[61]  Tessa A. Lau,et al.  Automated email activity management: an unsupervised learning approach , 2005, IUI.

[62]  D. Allen Getting Things Done: The Art of Stress-Free Productivity , 2001 .

[63]  Anne H. Anderson,et al.  Proceedings of Eurospeech , 2003, ISCA 2003.

[64]  Alex Acero,et al.  Evaluation of spoken language grammar learning in the ATIS domain , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[65]  Michael Freed,et al.  RADAR: A Personal Assistant that Learns to Reduce Email Overload , 2008, AAAI.

[66]  Jack Park,et al.  IRIS: Integrate. Relate. Infer. Share , 2005, Semantic Desktop Workshop.