Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts

The use of context in mobile devices is receiving increasing attention in mobile and ubiquitous computing research. In this article we consider how to augment mobile devices with awareness of their environment and situation as context. Most work to date has been based on integration of generic context sensors, in particular for location and visual context. We propose a different approach based on integration of multiple diverse sensors for awareness of situational context that can not be inferred from location, and targeted at mobile device platforms that typically do not permit processing of visual context. We have investigated multi-sensor context-awareness in a series of projects, and report experience from development of a number of device prototypes. These include development of an awareness module for augmentation of a mobile phone, of the Mediacup exemplifying context-enabled everyday artifacts, and of the Smart-Its platform for aware mobile devices. The prototypes have been explored in various applications to validate the multi-sensor approach to awareness, and to develop new perspectives of how embedded context-awareness can be applied in mobile and ubiquitous computing.

[1]  Gregory D. Abowd,et al.  Rapid prototyping of mobile context-aware applications: the Cyberguide case study , 1996, MobiCom '96.

[2]  A. Harter,et al.  A distributed location system for the active office , 1994, IEEE Network.

[3]  Pieter D. Biemond,et al.  Wearable Sensor Badge & Sensor Jacket for Context Awareness , 1999 .

[4]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[5]  Alex Pentland,et al.  Recognizing user context via wearable sensors , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[6]  Jonny Farringdon,et al.  Visual Augmented Memory (VAM) , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[7]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[8]  Keith Cheverst,et al.  The Role of Connectivity in Supporting Context-Sensitive Applications , 1999, HUC.

[9]  Albrecht Schmidt,et al.  Mediacups: experience with design and use of computer-augmented everyday artefacts , 2001, Comput. Networks.

[10]  Gerd Kortuem,et al.  NETMAN: The design of a collaborative wearable computer system , 1999, Mob. Networks Appl..

[11]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[12]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[13]  Jennifer Healey,et al.  Affective wearables , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[14]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[15]  Alex Pentland,et al.  Visual contextual awareness in wearable computing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[16]  Keith Cheverst,et al.  'Caches in the air': disseminating tourist information in the GUIDE system , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[17]  Mark Weiser.  The computer for the 21st century , 1991 .

[18]  Albrecht Schmidt,et al.  Sensor-Based Context-Awareness for Situated Computing , 2000 .

[19]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[20]  Bernt Schiele,et al.  Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts , 2001, UbiComp.

[21]  Kristof Van Laerhoven,et al.  How to build smart appliances? , 2001, IEEE Personal Communications.

[22]  Keith Cheverst,et al.  Caches in the Air: Disseminating Information in the Guide System , 1999 .

[23]  Albrecht Schmidt,et al.  Context-Aware Telephony Over WAP , 2000 .

[24]  Jun Rekimoto,et al.  Tilting operations for small screen interfaces , 1996, UIST '96.

[25]  Alex Pentland,et al.  Auditory Context Awareness via Wearable Computing , 1998 .

[26]  Albrecht Schmidt,et al.  Advanced Interaction in Context , 1999, HUC.

[27]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[28]  Neal Lesh,et al.  Indoor navigation using a diverse set of cheap, wearable sensors , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[29]  Michael Beigl,et al.  The MediaCup: Awareness Technology Embedded in a Everyday Object , 1999, HUC.

[30]  Peter J. Brown,et al.  Context-aware applications: from the laboratory to the marketplace , 1997, IEEE Wirel. Commun..

[31]  M.T. Smith.  Smart Cards: Integrating for Portable Complexity , 1998, Computer.

[32]  Kristof Van Laerhoven,et al.  Real-time analysis of data from many sensors with neural networks , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[33]  Bill N. Schilit,et al.  The Parctab Ubiquitous Computing Experiment , 1994, Mobidata.

[34]  Jonathan Trevor,et al.  Exploiting space and location as a design framework for interactive mobile systems , 2000, TCHI.

[35]  R. W. Peterson,et al.  OPTICAL INTERFEROMETRY OF SURFACES , 1991 .