Harnessing Language in Mobile Environments

We describe StartMobile, a prototype system that enables users of cellular telephones and other mobile devices to access information, create information and execute commands on the basis of written requests expressed in natural language. Interacting with mobile devices through the use of language offers several potential benefits that include: scalability in handling huge numbers of concepts and operations, substantial device-independence, and opportunities for remote interaction. StartMobile uses the START information access system to perform initial interpretation of requests and to generate responses to general information requests. Requests that require further interpretation and/or fulfillment in the distributed mobile environment are encoded in a new, language-based intermediate representation called Moebius, then conveyed to appropriate devices and systems, where special-purpose software serves to complete the interpretation and fulfillment of those requests.

[1]  Marcel Worring,et al.  A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval , 2007, IEEE Transactions on Multimedia.

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Michael G. Christel.  Establishing the utility of non-text search for news video retrieval with real world users , 2007, ACM Multimedia.

[4]  Michael G. Christel,et al.  Mining Novice User Activity with TRECVID Interactive Retrieval Tasks , 2006, CIVR.

[5]  Rong Yan,et al.  Merging storyboard strategies and automatic retrieval for improving interactive video search , 2007, CIVR '07.

[6]  Boris Katz,et al.  Natural Language Annotations for Question Answering , 2006, FLAIRS Conference.

[7]  Boris Katz,et al.  Exploiting Lexical Regularities in Designing Natural Language Systems , 1988, COLING.

[8]  Gerold Schneider,et al.  Attempto Controlled English Meets the Challenges of Knowledge Representation, Reasoning, Interoperability and User Interfaces , 2006, FLAIRS.

[9]  Milind R. Naphade,et al.  Assessing the Filtering and Browsing Utility of Automatic Semantic Concepts for Multimedia Retrieval , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[10]  Eero Sormunen,et al.  End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive , 2004, Information Retrieval.

[11]  Peter Clark,et al.  Acquiring and Using World Knowledge Using a Restricted Subset of English , 2005, FLAIRS Conference.

[12]  Stéphane Marchand-Maillet,et al.  Managing video collections at large , 2004, CVDB '04.

[13]  H. Grice.  Logic and conversation , 1975 .

[14]  Boris Katz,et al.  Using English for Indexing and Retrieving , 1991 .

[15]  Michael G. Christel,et al.  Finding the right shots: assessing usability and performance of a digital video library interface , 2004, MULTIMEDIA '04.

[16]  Ted Briscoe,et al.  Parser evaluation: a survey and a new proposal , 1998, LREC.

[17]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[18]  Yan Song,et al.  Multi-Concept Multi-Modality Active Learning for Interactive Video Annotation , 2007 .

[19]  Boris Katz,et al.  Annotating the World Wide Web using Natural Language , 1997, RIAO.

[20]  Sue Felshin,et al.  Answering English Questions using Foreign-Language, Semi-Structured Sources , 2007 .

[21]  Marcel Worring,et al.  Learned Lexicon-Driven Interactive Video Retrieval , 2006, CIVR.