Unsupervised daily routine modelling from a depth sensor using top-down and bottom-up hierarchies

A person's routine incorporates the frequent and regular behaviour patterns over a time scale, e.g. daily routine. In this work we present a method for unsupervised discovery of a single person's daily routine within an indoor environment using a static depth sensor. Routine is modelled using top down and bottom up hierarchies, formed from location and silhouette spatio-temporal information. We employ and evaluate stay point estimation and time envelopes for better routine modelling. The method is tested for three individuals modelling their natural activity in an office kitchen. Results demonstrate the ability to automatically discover unlabelled routine patterns related to daily activities as well as discard infrequent events.

[1]  Joseph L. Hellerstein,et al.  Mining partially periodic event patterns with unknown periods , 2001, Proceedings 17th International Conference on Data Engineering.

[2]  Lawrence B. Holder,et al.  Discovering Activities to Recognize and Track in a Smart Environment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[3]  Irfan A. Essa,et al.  Structure from Statistics - Unsupervised Activity Analysis using Suffix Trees , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Jean-Marc Odobez,et al.  Topic models for scene analysis and abnormality detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[5]  Luc Van Gool,et al.  Exploiting simple hierarchies for unsupervised human behavior analysis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Shuicheng Yan,et al.  Detecting Anomaly in Videos from Trajectory Similarity Analysis , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[7]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception by Hierarchical Bayesian Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Shaogang Gong,et al.  Video Behaviour Mining Using a Dynamic Topic Model , 2011, International Journal of Computer Vision.

[9]  François Brémond,et al.  Unsupervised Discovery, Modeling, and Analysis of Long Term Activities , 2011, ICVS.

[10]  Xing Xie,et al.  Collaborative location and activity recommendations with GPS history data , 2010, WWW '10.

[11]  Andreas Savvides,et al.  Extracting spatiotemporal human activity patterns in assisted living using a home sensor network , 2008, PETRA.

[12]  A. Savvides,et al.  Discovering Routine Events and their Periods in Sensor Time Series Data , 2009 .

[13]  Daniel Gatica-Perez,et al.  Discovering routines from large-scale human locations using probabilistic topic models , 2011, TIST.

[14]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Monique Thonnat,et al.  Unsupervised discovery of human activities from long-time videos , 2015, IET Comput. Vis..