Duration models for activity recognition and prediction in buildings using Hidden Markov Models

Activity recognition and prediction in buildings can have multiple positive effects in buildings: improve elderly monitoring, detect intrusions, maximize energy savings and optimize occupant comfort. In this paper we apply human activity recognition by using data coming from a network of motion and door sensors distributed in a Smart Home environment. We use Hidden Markov Models (HMM) as the basis of a machine learning algorithm on data collected over an 8-month period from a single-occupant home available as part of the WSU CASAS Smart Home project. In the first implementation the HMM models 24 hours of activities and classifies them in 8 distinct activity categories with an accuracy rate of 84.6%. To improve the identification rate and to help detect potential abnormalities related with the duration of an activity (i.e. when certain activities last too much), we implement minimum duration modeling where the algorithm is forced to remain in a certain state for a specific amount of time. Two subsequent implementations of the minimum duration HMM (mean-based length modeling and quantile length modeling) yield a further 2% improvement of the identification rate. To predict the sequence of activities in the future, Artificial Neural Networks (ANN) are employed and identified activities clustered in 3 principal activity groups with an average accuracy rate of 71-77.5%, depending on the forecasting window. To explore the energy savings potential, we apply thermal dynamic simulations on buildings in central European climate for a period of 65 days during the winter and we obtain energy savings for space heating of up to 17% with 3-hour forecasting for two different types of buildings.

[1]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Svetha Venkatesh,et al.  Recognising Behaviours of Multiple People with Hierarchical Probabilistic Model and Statistical Data Association , 2006, BMVC.

[4]  Eric Horvitz,et al.  Layered representations for learning and inferring office activity from multiple sensory channels , 2004, Comput. Vis. Image Underst..

[5]  Michel Vacher,et al.  SVM-Based Multimodal Classification of Activities of Daily Living in Health Smart Homes: Sensors, Algorithms, and First Experimental Results , 2010, IEEE Transactions on Information Technology in Biomedicine.

[6]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[7]  Chris D. Nugent,et al.  Using duration to learn activities of daily living in a smart home environment , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[8]  Urs Wilke,et al.  Probabilistic Bottom-up Modelling of Occupancy and Activities to Predict Electricity Demand in Residential Buildings , 2013 .

[9]  Bernadette Dorizzi,et al.  Human activities of daily living recognition using fuzzy logic for elderly home monitoring , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[10]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[11]  David Daum,et al.  On the Adaptation of Building Controls to the Envelope and the Occupants , 2011 .

[12]  Rolf Ingold,et al.  A language-independent, open-vocabulary system based on HMMs for recognition of ultra low resolution words , 2008, SAC '08.

[13]  Jian Lu,et al.  Sensor-Based Human Activity Recognition in a Multi-user Scenario , 2009, AmI.

[14]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[15]  Diane J. Cook,et al.  Recognizing independent and joint activities among multiple residents in smart environments , 2010, J. Ambient Intell. Humaniz. Comput..

[16]  Nikolaos Zarkadis,et al.  Novel models towards predictive control of advanced building systems and occupant comfort in buildings , 2015 .

[17]  Svetha Venkatesh,et al.  Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[19]  Shaogang Gong,et al.  Recognition of group activities using dynamic probabilistic networks , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[21]  Diane J. Cook,et al.  Using a Hidden Markov Model for Resident Identification , 2010, 2010 Sixth International Conference on Intelligent Environments.

[22]  Liming Chen,et al.  Activity Recognition: Approaches, Practices and Trends , 2011 .

[23]  Adel M. Alimi,et al.  Duration Models for Arabic Text Recognition Using Hidden Markov Models , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[24]  Horst Bunke,et al.  Hidden Markov model length optimization for handwriting recognition systems , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[25]  Nicolas Morel,et al.  NEUROBAT, A PREDICTIVE AND ADAPTIVE HEATING CONTROL SYSTEM USING ARTIFICIAL NEURAL NETWORKS , 2001 .

[26]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[27]  J. Kämpf,et al.  A simplified thermal model to support analysis of urban resource flows , 2007 .

[28]  T. V. Kasteren,et al.  Activity recognition for health monitoring elderly using temporal probabilistic models , 2007 .

[29]  Svetha Venkatesh,et al.  Human Behavior Recognition with Generic Exponential Family Duration Modeling in the Hidden Semi-Markov Model , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[30]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[31]  Darren Robinson,et al.  On the behaviour and adaptation of office occupants , 2008 .

[32]  Diane J. Cook,et al.  The role of prediction algorithms in the MavHome smart home architecture , 2002, IEEE Wirel. Commun..

[33]  Diane J Cook,et al.  Tracking Activities in Complex Settings Using Smart Environment Technologies. , 2009, International journal of biosciences, psychiatry, and technology.