Common Sense on the Go : Giving Mobile Applications an Understanding of Everyday Life

Mobile devices such as cell phones and PDAs present unique challenges and opportunities. The challenge is that user interaction is limited by small screens and keyboards (if the device has them at all!). Naive transfer of applications from full-size computers often fails because the interaction becomes too cumbersome for the user. The opportunity is that, because the device is carried by the user at all times and used in a much wider range of situations than a desk-bound computer, new possibilities emerge to provide intelligent and appropriate assistance to the user in a just-in-time fashion. We aim to address these challenges and opportunities by giving portable devices Commonsense Knowledge -a large collection of simple facts about people and everyday life. Common Sense can reduce the need for explicit user input because the machine can make better guesses about what the user might want in a particular situation than could a conventional application. Common Sense can also make better use of contextual information like time, location, personal data, user preferences, and partial recognition, because it can better understand the implication of context for helping the user. We will illustrate our approach with descriptions of several applications we have implemented for portable devices using Open Mind, a collection of over 688,000 commonsense statements. These include a dynamic phrasebook for tourists, an assistant for searching personal social networks, and a predictive typing aid that uses semantic information rather than statistics to suggest word completions.

[1]  R. Conrad,et al.  STANDARD TYPEWRITER VERSUS CHORD KEYBOARD – AN EXPERIMENTAL COMPARISON , 1965 .

[2]  I. Witten,et al.  The Reactive Keyboard: a predictive typing aid , 1990, Computer.

[3]  Ian H. Witten,et al.  Managing Gigabytes: Compressing and Indexing Documents and Images , 1999 .

[4]  C. Fellbaum An Electronic Lexical Database , 1998 .

[5]  Daniel B. Horn,et al.  Patterns of entry and correction in large vocabulary continuous speech recognition systems , 1999, CHI '99.

[6]  I. Scott MacKenzie,et al.  Predicting text entry speed on mobile phones , 2000, CHI.

[7]  Henry Lieberman,et al.  Agents to assist in finding help , 2000, CHI.

[8]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[9]  Henry Lieberman,et al.  GOOSE: A Goal-Oriented Search Engine with Commonsense , 2002, AH.

[10]  Push Singh,et al.  The Open Mind Common Sense project , 2002 .

[11]  Erik T. Mueller,et al.  Open Mind Common Sense: Knowledge Acquisition from the General Public , 2002, OTM.

[12]  Push Singh,et al.  Common Sense Conversations: Understanding Casual Conversation using a Common Sense Database , 2003 .

[13]  Hugo Liu,et al.  Unpacking Meaning from Words: A Context-Centered Approach to Computational Lexicon Design , 2003, CONTEXT.

[14]  Shumin Zhai,et al.  Shorthand writing on stylus keyboard , 2003, CHI '03.

[15]  Rami Musa,et al.  GloBuddy, a Dynamic Broad Context Phrase Book , 2003, CONTEXT.

[16]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[17]  Henry Lieberman,et al.  A commonsense approach to predictive text entry , 2004, CHI EA '04.