Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding

Change Point Detection techniques aim to capture changes in trends and sequences in time-series data to describe the underlying behaviour of the system. Detecting changes and anomalies in the web services, the trend of applications usage can provide valuable insight towards the system, however, many existing approaches are done in a supervised manner, requiring well-labelled data. As the amount of data produced and captured by sensors are growing rapidly, it is getting harder and even impossible to annotate the data. Therefore, coming up with a self-supervised solution is a necessity these days. In this work, we propose TSCP2 a novel self-supervised technique for temporal change point detection, based on representation learning with Temporal Convolutional Network (TCN). To the best of our knowledge, our proposed method is the first method which employs Contrastive Learning for prediction with the aim change point detection. Through extensive evaluations, we demonstrate that our method outperforms multiple state-of-the-art change point detection and anomaly detection baselines, including those adopting either unsupervised or semi-supervised approach. TSCP2 is shown to improve both non-Deep learning- and Deep learning-based methods by 0.28 and 0.12 in terms of average F1-score across three datasets.

[1]  Eamonn J. Keogh,et al.  Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progress , 2020, IEEE Transactions on Knowledge and Data Engineering.

[2]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[3]  Chenliang Xu,et al.  Weakly-Supervised Action Segmentation with Iterative Soft Boundary Assignment , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[5]  Koray Kavukcuoglu,et al.  Learning word embeddings efficiently with noise-contrastive estimation , 2013, NIPS.

[6]  Yann Dauphin,et al.  Pay Less Attention with Lightweight and Dynamic Convolutions , 2019, ICLR.

[7]  Mi Zhang,et al.  USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors , 2012, UbiComp.

[8]  Alexander Bertrand,et al.  Change Point Detection in Time Series Data Using Autoencoders With a Time-Invariant Representation , 2020, IEEE Transactions on Signal Processing.

[9]  Nobuhiko Nishio,et al.  HASC2011corpus: towards the common ground of human activity recognition , 2011, UbiComp '11.

[10]  Kenji Yamanishi,et al.  A unifying framework for detecting outliers and change points from non-stationary time series data , 2002, KDD.

[11]  Alexander J. Smola,et al.  Sampling Matters in Deep Embedding Learning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Neil Zeghidour,et al.  Contrastive Learning of General-Purpose Audio Representations , 2020, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Yang Hua,et al.  Ranked List Loss for Deep Metric Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yanwen Wang,et al.  Modeling RFID Signal Reflection for Contact-free Activity Recognition , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[16]  Martin Jaggi,et al.  Unsupervised Scalable Representation Learning for Multivariate Time Series , 2019, NeurIPS.

[17]  Flora D. Salim,et al.  Federated Self-Supervised Learning of Multisensor Representations for Embedded Intelligence , 2020, IEEE Internet of Things Journal.

[18]  Tero Kokkonen,et al.  Network Anomaly Detection Based on WaveNet , 2019, NEW2AN.

[19]  Eamonn J. Keogh,et al.  Domain agnostic online semantic segmentation for multi-dimensional time series , 2018, Data Mining and Knowledge Discovery.

[20]  Paul J. M. Havinga,et al.  Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors , 2016, Sensors.

[21]  Oriol Vinyals,et al.  Representation Learning with Contrastive Predictive Coding , 2018, ArXiv.

[22]  Yongli Ren,et al.  What Will You Do for the Rest of the Day? , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[23]  Johan Lukkien,et al.  Multi-task Self-Supervised Learning for Human Activity Detection , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[24]  Bülent Sankur,et al.  A Bayesian change point model for detecting SIP-based DDoS attacks , 2017, Digit. Signal Process..

[25]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[26]  Takuya Maekawa,et al.  Robust Unsupervised Factory Activity Recognition with Body-worn Accelerometer Using Temporal Structure of Multiple Sensor Data Motifs , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[27]  Iasonas Kokkinos,et al.  Discriminative Learning of Deep Convolutional Feature Point Descriptors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Kotagiri Ramamohanarao,et al.  Unsupervised online change point detection in high-dimensional time series , 2019, Knowledge and Information Systems.

[29]  Masashi Sugiyama,et al.  Sequential change‐point detection based on direct density‐ratio estimation , 2012, Stat. Anal. Data Min..

[30]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[31]  Yazan Abu Farha,et al.  MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Diane J. Cook,et al.  A survey of methods for time series change point detection , 2017, Knowledge and Information Systems.

[33]  Yongli Ren,et al.  Information gain-based metric for recognizing transitions in human activities , 2017, Pervasive Mob. Comput..

[34]  Sudeep Sarkar,et al.  A Perceptual Prediction Framework for Self Supervised Event Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Dong Wang,et al.  Au-Id , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[36]  N. Vayatis,et al.  Selective review of offline change point detection methods , 2019 .

[37]  Faicel Chamroukhi,et al.  Joint segmentation of multivariate time series with hidden process regression for human activity recognition , 2013, Neurocomputing.

[38]  Ali Razavi,et al.  Data-Efficient Image Recognition with Contrastive Predictive Coding , 2019, ICML.

[39]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Masashi Sugiyama,et al.  Change-Point Detection in Time-Series Data by Relative Density-Ratio Estimation , 2011 .

[41]  Sudeep Sarkar,et al.  Temporal Event Segmentation using Attention-based Perceptual Prediction Model for Continual Learning , 2020, ArXiv.

[42]  Yeti Li,et al.  Automated Rehabilitation System: Movement Measurement and Feedback for Patients and Physiotherapists in the Rehabilitation Clinic , 2016, Hum. Comput. Interact..

[43]  Kihyuk Sohn,et al.  Improved Deep Metric Learning with Multi-class N-pair Loss Objective , 2016, NIPS.

[44]  Diane J. Cook,et al.  Enhancing activity recognition using CPD-based activity segmentation , 2019, Pervasive Mob. Comput..

[45]  Gillian Dobbie,et al.  Detecting Changes in Rare Patterns from Data Streams , 2014, PAKDD.

[46]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[47]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Nobuhiko Nishio,et al.  HASC Challenge: gathering large scale human activity corpus for the real-world activity understandings , 2011, AH '11.

[49]  Flora D. Salim,et al.  Optimal time window for temporal segmentation of sensor streams in multi-activity recognition , 2016, MobiQuitous.

[50]  Hiroshi Sawada,et al.  Change-Point Detection with Feature Selection in High-Dimensional Time-Series Data , 2013, IJCAI.

[51]  Radomír Mech,et al.  Sequence-to-Segment Networks for Segment Detection , 2018, NeurIPS.

[52]  Stephen P. Boyd,et al.  Greedy Gaussian segmentation of multivariate time series , 2016, Advances in Data Analysis and Classification.

[53]  Aapo Hyvärinen,et al.  Noise-contrastive estimation: A new estimation principle for unnormalized statistical models , 2010, AISTATS.

[54]  Jiwen Lu,et al.  Deep Embedding Learning With Discriminative Sampling Policy , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Yiming Yang,et al.  Kernel Change-point Detection with Auxiliary Deep Generative Models , 2019, ICLR.

[56]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[57]  Eamonn J. Keogh,et al.  Matrix Profile II: Exploiting a Novel Algorithm and GPUs to Break the One Hundred Million Barrier for Time Series Motifs and Joins , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[58]  Daniel V. Smith,et al.  ESPRESSO: Entropy and ShaPe awaRe timE-Series SegmentatiOn for processing heterogeneous sensor data , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[59]  Shaowen Lu,et al.  Segmentation of Multivariate Industrial Time Series Data Based on Dynamic Latent Variable Predictability , 2020, IEEE Access.