Context-aware mobile computing: learning context- dependent personal preferences from a wearable sensor array

Context-aware computing describes the situation where a wearable/mobile computer is aware of its user's state and surroundings and modifies its behavior based on this information. We designed, implemented, and evaluated a wearable system which can learn context-dependent personal preferences by identifying individual user states and observing how the user interacts with the system in these states. This learning occurs online and does not require external supervision. The system relies on techniques from machine learning and statistical analysis. A case study integrates the approach in a context-aware mobile phone. The results indicate that the method is able to create a meaningful user context model while only requiring data from comfortable wearable sensor devices.

[1]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[2]  Kristof Van Laerhoven.  Combining the Kohonen Self-Organizing Map and K-Means for On-Line Classification of Sensordata , 2001 .

[3]  Daniel J. Barrett,et al.  An Introduction to Computerized Experience Sampling in Psychology , 2001 .

[4]  James Fogarty,et al.  Examining the robustness of sensor-based statistical models of human interruptibility , 2004, CHI.

[5]  Teuvo Kohonen,et al.  Things you haven't heard about the self-organizing map , 1993, IEEE International Conference on Neural Networks.

[6]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Brian Patrick Clarkson,et al.  Life patterns : structure from wearable sensors , 2002 .

[8]  Yeuvo Jphonen,et al.  Self-Organizing Maps , 1995 .

[9]  Kristof Van Laerhoven.  Combining the Self-Organizing Map and K-Means Clustering for On-Line Classification of Sensor Data , 2001, ICANN.

[10]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[11]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[12]  Alex Pentland,et al.  MIThril 2003: applications and architecture , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[13]  Asim Smailagic,et al.  Location sensing and privacy in a context-aware computing environment , 2002, IEEE Wirel. Commun..

[14]  Pieter D. Biemond,et al.  Wearable Sensor Badge & Sensor Jacket for Context Awareness , 1999 .

[15]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[16]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[17]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[18]  Paul Lukowicz,et al.  SoundButton: design of a low power wearable audio classification system , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[19]  R. French.  Catastrophic forgetting in connectionist networks , 1999, Trends in Cognitive Sciences.

[20]  Andreas Krause,et al.  Unsupervised, dynamic identification of physiological and activity context in wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[21]  Daniel P. Siewiorek,et al.  Application Design for Wearable and Context-Aware Computers , 2002, IEEE Pervasive Comput..

[22]  Andreas Krause,et al.  SenSay: a context-aware mobile phone , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[23]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000, Softw. Pract. Exp..

[24]  Richard Martin,et al.  Design for wearability , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[25]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[26]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.