Context Feature Learning through Deep Learning for Adaptive Context-Aware Decision Making in the Home

In Intelligent Environments, prediction and decision must take the context of interaction into account to adapt themselves to the evolving environment. If most of the approaches to deal with this problem have used a formal representation of context, we present in this paper a direct extraction of the context from raw sensor data using deep neural network and reinforcement learning. Experiments undertaken in a voice controlled smart home showed which elements are useful to perform context-aware decision-making in the home and the adequacy of reinforcement learning to tackle an evolving environment.

[1]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[2]  Michel Vacher,et al.  Preliminary Study of Adaptive Decision-Making System for Vocal Command in Smart Home , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[3]  Arkady B. Zaslavsky,et al.  A probabilistic context-aware approach for quality of experience measurement in pervasive systems , 2011, SAC.

[4]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[5]  Michael C. Mozer,et al.  The Neural Network House: An Environment that Adapts to its Inhabitants , 1998 .

[6]  Miguel A. Patricio,et al.  Context-based scene recognition from visual data in smart homes: an Information Fusion approach , 2012, Personal and Ubiquitous Computing.

[7]  Maurizio Omologo,et al.  The DIRHA-ENGLISH corpus and related tasks for distant-speech recognition in domestic environments , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[8]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[9]  Carlo Curino,et al.  A data-oriented survey of context models , 2007, SGMD.

[10]  Long-Ji Lin,et al.  Reinforcement learning for robots using neural networks , 1992 .

[11]  Hsien-Chou Liao,et al.  A RDF and OWL-Based Temporal Context Reasoning Model for Smart Home , 2007 .

[12]  Wolfgang Kastner,et al.  A semantic representation of energy-related information in future smart homes , 2012 .

[13]  John E. R. Staddon,et al.  The dynamics of behavior: Review of Sutton and Barto: Reinforcement Learning : An Introduction (2 nd ed.) , 2020 .

[14]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[15]  VacherMichel,et al.  Evaluation of a Context-Aware Voice Interface for Ambient Assisted Living , 2015 .

[16]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[17]  Michel Vacher,et al.  Embedded Implementation of Distress Situation Identification through Sound Analysis , 2008 .

[18]  Takashi Nishiyama,et al.  Development of agent system based on decision model for creating an ambient space , 2010, AI & SOCIETY.

[19]  Claus Nebauer,et al.  Evaluation of convolutional neural networks for visual recognition , 1998, IEEE Trans. Neural Networks.

[20]  Michel Vacher,et al.  On-line human activity recognition from audio and home automation sensors: Comparison of sequential and non-sequential models in realistic Smart Homes , 2016, J. Ambient Intell. Smart Environ..

[21]  Paul Lukowicz,et al.  Transforming sensor data to the image domain for deep learning — An application to footstep detection , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[22]  Heiner Stuckenschmidt,et al.  A probabilistic ontological framework for the recognition of multilevel human activities , 2013, UbiComp.

[23]  Berardina De Carolis,et al.  C@sa: Intelligent Home Control and Simulation , 2004, International Conference on Computational Intelligence.

[24]  Michel Vacher,et al.  Distant Speech Recognition in a Smart Home: Comparison of Several Multisource ASRs in Realistic Conditions , 2011, INTERSPEECH.

[25]  Michel Vacher,et al.  Context-aware decision making under uncertainty for voice-based control of smart home , 2017, Expert Syst. Appl..

[26]  Marwa Hassan,et al.  Action Prediction in Smart Home Based on Reinforcement Learning , 2014, ICOST.

[27]  Patrick Reignier,et al.  Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant , 2011 .

[28]  Jon Barker,et al.  Multi-microphone speech recognition in everyday environments , 2017, Comput. Speech Lang..

[29]  Manuel P. Cuéllar,et al.  A fuzzy ontology for semantic modelling and recognition of human behaviour , 2014, Knowl. Based Syst..

[30]  Atta Badii,et al.  CompanionAble: integrated cognitive assistive and domotic companion robotic systems for ability and security , 2009 .

[31]  Manuel P. Cuéllar,et al.  A survey on ontologies for human behavior recognition , 2014, ACM Comput. Surv..

[32]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[33]  Petros Maragos,et al.  Room-localized spoken command recognition in multi-room, multi-microphone environments , 2017, Comput. Speech Lang..

[34]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[35]  Riza Cenk Erdur,et al.  iConAwa - An intelligent context-aware system , 2012, Expert Syst. Appl..

[36]  Diane J. Cook,et al.  "Intelligent Environments: a manifesto" , 2013, Human-centric Computing and Information Sciences.

[37]  Brigitte Meillon,et al.  Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects , 2011, Personal and Ubiquitous Computing.

[38]  Brigitte Meillon,et al.  The Sweet-Home speech and multimodal corpus for home automation interaction , 2014, LREC.

[39]  Juan Carlos Augusto,et al.  Engineering context-aware systems and applications: A survey , 2016, J. Syst. Softw..

[40]  Bin Hu,et al.  Rule Strategies for Intelligent Context-Aware Systems: The Application of Conditional Relationships in Decision-Support , 2011, 2011 International Conference on Complex, Intelligent, and Software Intensive Systems.

[41]  Siegfried Handschuh,et al.  Ontology-based situation recognition for context-aware systems , 2013, I-SEMANTICS '13.

[42]  John N. Tsitsiklis,et al.  Analysis of temporal-difference learning with function approximation , 1996, NIPS 1996.

[43]  Francis Jambon,et al.  Une plateforme usage pour l'intégration de l'informatique ambiante dans l'habitat. L'appartement Domus , 2013, Tech. Sci. Informatiques.