Detecting Multiple Periods and Periodic Patterns in Event Time Sequences

Periodicity is prevalent in physical world, and many events involve more than one periods, eg individual's mobility, tide pattern, and massive transportation utilization. Knowing the true periods of events can benefit a number of applications, such as traffic prediction, time-aware recommendation and advertisement, and anomaly detection. However, detecting multiple periods is a very challenging task due to not only the interwoven periodic patterns but also the low quality of event tracking records. In this paper, we study the problem of discovering all true periods and the corresponded occurring patterns of an event from a noisy and incomplete observation sequence. We devise a novel scoring function, by maximizing which we can identify the true periodic patterns involved in the sequence. We prove that, however, optimizing the objective function is an NP-hard problem. To address this challenge, we develop a heuristic algorithm named Timeslot Coverage Model (TiCom), for identifying the periods and periodic patterns approximately. The results of extensive experiments on both synthetic and real-life datasets show that our model outperforms the state-of-the-art baselines significantly in various tasks, including period detection, periodic pattern identification, and anomaly detection.

[1]  Philip S. Yu,et al.  On Periodicity Detection and Structural Periodic Similarity , 2005, SDM.

[2]  Jiawei Han,et al.  Mining event periodicity from incomplete observations , 2012, KDD.

[3]  G. V. Padma Raju,et al.  Periodic Pattern Mining – Algorithms and Applications , 2014 .

[4]  N. Lomb Least-squares frequency analysis of unequally spaced data , 1976 .

[5]  Lidan Shou,et al.  Splitter: Mining Fine-Grained Sequential Patterns in Semantic Trajectories , 2014, Proc. VLDB Endow..

[6]  Mohammed Al-Shalalfa,et al.  Efficient Periodicity Mining in Time Series Databases Using Suffix Trees , 2011, IEEE Transactions on Knowledge and Data Engineering.

[7]  Jiawei Han,et al.  Mining Segment-Wise Periodic Patterns in Time-Related Databases , 1998, KDD.

[8]  Nadia Magnenat-Thalmann,et al.  Time-aware point-of-interest recommendation , 2013, SIGIR.

[9]  Srinivasan Parthasarathy,et al.  Robust periodicity detection algorithms , 2006, CIKM '06.

[10]  Jiawei Han,et al.  Mining periodic behaviors for moving objects , 2010, KDD.

[11]  Tzung-Pei Hong,et al.  Projection-based partial periodic pattern mining for event sequences , 2013, Expert Syst. Appl..

[12]  Guanling Lee,et al.  Efficient partial multiple periodic patterns mining without redundant rules , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[13]  Walid G. Aref,et al.  Periodicity detection in time series databases , 2005, IEEE Transactions on Knowledge and Data Engineering.

[14]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[15]  Nadia Magnenat-Thalmann,et al.  Who, where, when and what: discover spatio-temporal topics for twitter users , 2013, KDD.

[16]  Jiawei Han,et al.  Efficient mining of partial periodic patterns in time series database , 1999, Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337).

[17]  Jiawei Han,et al.  ePeriodicity: Mining Event Periodicity from Incomplete Observations , 2015, IEEE Transactions on Knowledge and Data Engineering.

[18]  Joseph L. Hellerstein,et al.  Mining partially periodic event patterns with unknown periods , 2001, Proceedings 17th International Conference on Data Engineering.

[19]  Ilya Shmulevich,et al.  Robust regression for periodicity detection in non-uniformly sampled time-course gene expression data , 2007, BMC Bioinformatics.

[20]  Philip S. Yu,et al.  Mining asynchronous periodic patterns in time series data , 2000, KDD '00.

[21]  Philip S. Yu,et al.  InfoMiner+: mining partial periodic patterns with gap penalties , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[22]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.

[23]  Luming Zhang,et al.  GMove: Group-Level Mobility Modeling Using Geo-Tagged Social Media , 2016, KDD.

[24]  H P Van Dongen,et al.  A procedure of multiple period searching in unequally spaced time-series with the Lomb-Scargle method. , 1999, Biological rhythm research.

[25]  Jie Chen,et al.  Bioinformatics Original Paper Detecting Periodic Patterns in Unevenly Spaced Gene Expression Time Series Using Lomb–scargle Periodograms , 2022 .

[26]  Irma J. Terpenning,et al.  STL : A Seasonal-Trend Decomposition Procedure Based on Loess , 1990 .

[27]  Sridhar Ramaswamy,et al.  Cyclic association rules , 1998, Proceedings 14th International Conference on Data Engineering.

[28]  Ivan Junier,et al.  Periodic pattern detection in sparse boolean sequences , 2010, Algorithms for Molecular Biology.

[29]  Zhijun Ding,et al.  Mining Multiple Periods in Event Time Sequence , 2015, APSCC.

[30]  Philip S. Yu,et al.  Meta-patterns: revealing hidden periodic patterns , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[31]  Manziba Akanda Nishi,et al.  Effective periodic pattern mining in time series databases , 2013, Expert Syst. Appl..

[32]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[33]  Philip S. Yu,et al.  Mining Asynchronous Periodic Patterns in Time Series Data , 2003, IEEE Trans. Knowl. Data Eng..

[34]  Ji-Rong Wen,et al.  Prediction-based Unobstructed Route Planning , 2016, Neurocomputing.

[35]  Walid G. Aref,et al.  Multiple and Partial Periodicity Mining in Time Series Databases , 2002, ECAI.

[36]  A. Salomaa,et al.  Chinese remainder theorem: applications in computing, coding, cryptography , 1996 .

[37]  Walid G. Aref,et al.  STAGGER: Periodicity Mining of Data Streams Using Expanding Sliding Windows , 2006, Sixth International Conference on Data Mining (ICDM'06).

[38]  Philip S. Yu,et al.  Infominer: mining surprising periodic patterns , 2001, KDD '01.

[39]  Mong-Li Lee,et al.  Mining Dense Periodic Patterns in Time Series Data , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[40]  Walid G. Aref,et al.  WARP: time warping for periodicity detection , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[41]  Wei Zhang,et al.  PRED: Periodic Region Detection for Mobility Modeling of Social Media Users , 2017, WSDM.

[42]  J. Rosser,et al.  Approximate formulas for some functions of prime numbers , 1962 .