Routine Modeling with Time Series Metric Learning

Traditionally, the automatic recognition of human activities is performed with supervised learning algorithms on limited sets of specific activities. This work proposes to recognize recurrent activity patterns, called routines, instead of precisely defined activities. The modeling of routines is defined as a metric learning problem, and an architecture, called SS2S, based on sequence-to-sequence models is proposed to learn a distance between time series. This approach only relies on inertial data and is thus non intrusive and preserves privacy. Experimental results show that a clustering algorithm provided with the learned distance is able to recover daily routines.

[1]  Konstantinos Kalpakis,et al.  Distance measures for effective clustering of ARIMA time-series , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[2]  Li Wei,et al.  Fast time series classification using numerosity reduction , 2006, ICML.

[3]  James L. Crowley,et al.  Human Activity Recognition Using Place-Based Decision Fusion in Smart Homes , 2017, CONTEXT.

[4]  P. Lally,et al.  How are habits formed: Modelling habit formation in the real world , 2010 .

[5]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[6]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[7]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[8]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[9]  Nuno Constantino Castro,et al.  Time Series Data Mining , 2009, Encyclopedia of Database Systems.

[10]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[11]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jeffrey M. Hausdorff,et al.  Does the Evaluation of Gait Quality During Daily Life Provide Insight Into Fall Risk? A Novel Approach Using 3-Day Accelerometer Recordings , 2013, Neurorehabilitation and neural repair.

[14]  Ying Wah Teh,et al.  Time-series clustering - A decade review , 2015, Inf. Syst..

[15]  Richard J. Martin.  A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[18]  Fu Jie Huang,et al.  A Tutorial on Energy-Based Learning , 2006 .

[19]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[20]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[21]  Jonas Mueller,et al.  Siamese Recurrent Architectures for Learning Sentence Similarity , 2016, AAAI.

[22]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[23]  Yuan Li,et al.  Finding Structural Similarity in Time Series Data Using Bag-of-Patterns Representation , 2009, SSDBM.

[24]  Shengcai Liao,et al.  Deep Metric Learning for Person Re-identification , 2014, 2014 22nd International Conference on Pattern Recognition.

[25]  Samuel Berlemont,et al.  Class-balanced siamese neural networks , 2018, Neurocomputing.

[26]  Harald Bohr,et al.  Zur Theorie der Fastperiodischen Funktionen , 1925 .

[27]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[28]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[29]  Harald Bohr,et al.  Zur Theorie der fastperiodischen Funktionen , 1926 .

[30]  Abubakar Abid,et al.  Autowarp: Learning a Warping Distance from Unlabeled Time Series Using Sequence Autoencoders , 2018, NeurIPS.

[31]  Albert-László Barabási,et al.  Understanding individual human mobility patterns , 2008, Nature.

[32]  Fatih Porikli,et al.  Large-Scale Metric Learning: A Voyage From Shallow to Deep , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Manolis Tsiknakis,et al.  Human Daily Activity and Fall Recognition Using a Smartphone's Acceleration Sensor , 2016, ICT4AgeingWell.