Extending Context Spaces Theory by Proactive Adaptation

Context awareness is one of the core features of pervasive computing systems. Pervasive systems can also be improved by smart application of context prediction. This paper addresses subsequent challenge of how to act according to predicted context in order to strengthen the system. Novel reinforcement learning based architecture is proposed to overcome the drawbacks of existing approaches to proactive adaptation. Context spaces theory is used as an example of how existing context awareness systems can be enhanced to achieve proactive adaptation. This recently developed theory addresses problems related to sensors uncertainty and high-level situation reasoning and it can be enhanced to achieve efficient proactive adaptation as well. This article also discusses implementation options and possible testbed to evaluate the solutions.

[1]  Diane J. Cook,et al.  The role of prediction algorithms in the MavHome smart home architecture , 2002, IEEE Wirel. Commun..

[2]  Arkady B. Zaslavsky,et al.  Towards a theory of context spaces , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[3]  Hee Yong Youn,et al.  Proceedings of the 10th international conference on Ubiquitous computing , 2008, UbiComp 2008.

[4]  Stephan Sigg,et al.  Minimising the Context Prediction Error , 2007, 2007 IEEE 65th Vehicular Technology Conference - VTC2007-Spring.

[5]  Michael R. James,et al.  Approximate predictive state representations , 2008, AAMAS.

[6]  Jesse Hoey,et al.  Assisting persons with dementia during handwashing using a partially observable Markov decision process. , 2007, ICVS 2007.

[7]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[8]  Michael C. Mozer,et al.  Lessons from an Adaptive Home , 2005 .

[9]  Arkady B. Zaslavsky,et al.  Extending Context Spaces Theory by Predicting Run-Time Context , 2009, NEW2AN.

[10]  Anind K. Dey,et al.  Navigate like a cabbie: probabilistic reasoning from observed context-aware behavior , 2008, UbiComp.

[11]  M.A. Wiering,et al.  Reinforcement Learning in Continuous Action Spaces , 2007, 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning.

[12]  Martin T. Hagan,et al.  Neural networks for control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[13]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[14]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[15]  Andrew James Smith,et al.  Applications of the self-organising map to reinforcement learning , 2002, Neural Networks.

[16]  Bernt Schiele,et al.  Location- and Context-Awareness, Third International Symposium, LoCA 2007, Oberpfaffenhofen, Germany, September 20-21, 2007, Proceedings , 2007, LoCA.

[17]  Arpad Gellert,et al.  Person Movement Prediction Using Hidden Markov Models , 2006 .

[18]  Sergey Balandin,et al.  Smart Spaces and Next Generation Wired/Wireless Networking , 2009, Lecture Notes in Computer Science.

[19]  Po-Chiang Lin,et al.  A neural network based context-aware handoff algorithm for multimedia computing , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[20]  Z. Zenn Bien,et al.  Context Aware Life Pattern Prediction Using Fuzzy-State Q-Learning , 2007, ICOST.

[21]  Stathes Hadjiefthymiades,et al.  Prediction intelligence in context-aware applications , 2005, MDM '05.

[22]  Euiho Suh,et al.  Context-aware system for proactive personalized service based on context history , 2009, Expert Syst. Appl..

[23]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[24]  Andreas Pietzowski,et al.  Prediction of Indoor Movements Using Bayesian Networks , 2005, LoCA.

[25]  Diane J. Cook,et al.  Smart environments - technology, protocols and applications , 2004 .

[26]  Arkady B. Zaslavsky,et al.  The ECORA framework: A hybrid architecture for context-oriented pervasive computing , 2008, Pervasive Mob. Comput..

[27]  Wolfgang Trumler,et al.  Context Prediction Based on Branch Prediction Methods , 2003 .

[28]  Diane J. Cook,et al.  How smart are our environments? An updated look at the state of the art , 2007, Pervasive Mob. Comput..