Context-aware web search in ubiquitous sensor environments

This article proposes a new concept for a context-aware Web search method that automatically retrieves a webpage related to the daily activity that a user currently is engaged in and displays the page on nearby Internet-connected home appliances such as televisions. For example, when a user is washing a coffeemaker, a webpage is retrieved that includes tips such as “cleaning a coffee maker with vinegar removes stains well,” and the page is displayed on a nearby appliance. In this article, we design and implement a Web search method that employs ubiquitous sensors to monitor a user's daily life. Our proposed method automatically searches for a webpage related to a daily activity by using a query constructed from the use of daily objects employed in the activity that is detected with object-attached sensors. We evaluate the search method with real datasets collected from vast numbers of sensors and achieve very accurate webpage retrieval. We then investigate the usefulness and effectiveness of a daily life Web search with Wizard-of-Oz (WOz)-like experiments. We confirm that the presentation of webpages related to daily activities improves participants' future daily lives and triggers communication among the participants in the experiment.

[1]  Joseph F. McCarthy,et al.  UniCast, OutCast & GroupCast: Three Steps Toward Ubiquitous, Peripheral Displays , 2001, UbiComp.

[2]  Elizabeth D. Mynatt,et al.  Digital family portraits: supporting peace of mind for extended family members , 2001, CHI.

[3]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[4]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[5]  Takuya Maekawa,et al.  Recognizing the Use of Portable Electrical Devices with Hand-Worn Magnetic Sensors , 2011, Pervasive.

[6]  Mary Czerwinski,et al.  Scope: providing awareness of multiple notifications at a glance , 2002, AVI '02.

[7]  Shaul Markovitch,et al.  The Role of Forgetting in Learning , 1988, ML.

[8]  M. F. Porter,et al.  An algorithm for suffix stripping , 1997 .

[9]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[10]  C. Lee Giles,et al.  Inquirus, the NECI Meta Search Engine , 1998, Comput. Networks.

[11]  Henry Lieberman,et al.  Letizia: An Agent That Assists Web Browsing , 1995, IJCAI.

[12]  Mark Sanderson,et al.  Advantages of query biased summaries in information retrieval , 1998, SIGIR '98.

[13]  Wonyong Sung,et al.  A statistical model-based voice activity detection , 1999, IEEE Signal Processing Letters.

[14]  Monika Henzinger,et al.  Query-Free News Search , 2003, WWW '03.

[15]  Tor Erlend Fægri,et al.  AmbieSense - A System and Reference Architecture for Personalised Context-Sensitive Information Services for Mobile Users , 2004, EUSAI.

[16]  Georg Buscher,et al.  Attention-based information retrieval , 2007, SIGIR.

[17]  Takuya Maekawa,et al.  Object-Blog System for Environment-Generated Content , 2008, IEEE Pervasive Computing.

[18]  MaekawaTakuya,et al.  Context-aware web search in ubiquitous sensor environments , 2012 .

[19]  Tara Matthews,et al.  A Peripheral Display Toolkit , 2003 .

[20]  Michael G. Lamming,et al.  Activity-based Information Retrieval: Technology in Support of Personal Memory , 1992, IFIP Congress.

[21]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[22]  Bradley J. Rhodes.  Using Physical Context for Just-in-Time Information Retrieval , 2003, IEEE Trans. Computers.

[23]  D. Scott McCrickard,et al.  Attuning notification design to user goals and attention costs , 2003, Commun. ACM.

[24]  Ravi Kumar,et al.  Searching with context , 2006, WWW '06.

[25]  Takuya Maekawa,et al.  Web searching for daily living , 2009, SIGIR.

[26]  Matthai Philipose,et al.  Unsupervised Activity Recognition Using Automatically Mined Common Sense , 2005, AAAI.

[27]  Matthai Philipose,et al.  Mining models of human activities from the web , 2004, WWW '04.

[28]  Antonio Krüger,et al.  ReflectiveSigns: Digital Signs That Adapt to Audience Attention , 2009, Pervasive.

[29]  Gareth Jones,et al.  The role of context in information retrieval , 2004, SIGIR 2004.

[30]  Bill N. Schilit,et al.  Linking by inking: trailblazing in a paper-like hypertext , 1998, HYPERTEXT '98.

[31]  CHENGXIANG ZHAI,et al.  A study of smoothing methods for language models applied to information retrieval , 2004, TOIS.

[32]  Ronald Fagin,et al.  Efficient similarity search and classification via rank aggregation , 2003, SIGMOD '03.

[33]  Raymie Stata,et al.  Finding buying guides with a Web carnivore , 2003, Proceedings of the IEEE/LEOS 3rd International Conference on Numerical Simulation of Semiconductor Optoelectronic Devices (IEEE Cat. No.03EX726).

[34]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[35]  Takuya Maekawa,et al.  Object-Based Activity Recognition with Heterogeneous Sensors on Wrist , 2010, Pervasive.

[36]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[37]  Garrison W. Cottrell,et al.  Automatic combination of multiple ranked retrieval systems , 1994, SIGIR '94.

[38]  Gareth J. F. Jones,et al.  Context-aware Retrieval: Exploring a New Environment for Information Retrieval and Information Filtering , 2001, Personal and Ubiquitous Computing.

[39]  Peter J. Brown,et al.  The Stick-e Document: a Framework for Creating Context-aware Applications , 1996 .

[40]  Hiroshi Ishii,et al.  Pinwheels: visualizing information flow in an architectural space , 2001, CHI Extended Abstracts.