Recognition of Human Behavior Patterns Using Depth Information and Gaussian Feature Maps

The representation of human behavior patterns is challenging due to the complex dependencies between features gathered by a sensor and their spatial and temporal context. In this work we propose a new Gaussian feature map representation that uses the Kinect depth sensor, can easily be integrated in home environments, and allows learning unsupervised behavior patterns. The approach divides the living space into grid cells and models each grid cell with a Gaussian distribution of features like height, duration, magnitude and orientation of the velocity. Experimental results show that the method is able to recognize anomalies regarding the spatial and temporal context.

[1]  Svetha Venkatesh,et al.  Recognition of emergent human behaviour in a smart home: A data mining approach , 2007, Pervasive Mob. Comput..

[2]  Rama Chellappa,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2 , 2022 .

[3]  Alex Pentland,et al.  Human computing and machine understanding of human behavior: a survey , 2006, ICMI '06.

[4]  Hamid K. Aghajan,et al.  Learning human behaviour patterns in work environments , 2011, CVPR 2011 WORKSHOPS.

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Ian D. Reid,et al.  Behaviour understanding in video: a combined method , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Juan Carlos Augusto,et al.  Learning about preferences and common behaviours of the user in an intelligent environment , 2009, BMI Book.

[9]  Juan Carlos Augusto,et al.  Learning patterns in ambient intelligence environments: a survey , 2010, Artificial Intelligence Review.

[10]  Hongjun Lu,et al.  Beyond intratransaction association analysis: mining multidimensional intertransaction association rules , 2000, TOIS.

[11]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[12]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Maja Pantic,et al.  Spatiotemporal Localization and Categorization of Human Actions in Unsegmented Image Sequences , 2011, IEEE Transactions on Image Processing.