Toward Better Structure and Constraint to Mine Negative Sequential Patterns

Nonoccurring behavior (NOB) studies have attracted the growing attention of scholars as a crucial part of behavioral science. As an effective method to discover both NOB and occurring behaviors (OB), negative sequential pattern (NSP) mining is successfully used in analyzing medical treatment and abnormal behavior patterns. At this time, NSP mining is still an active and challenging research domain. Most of the algorithms are inefficient in practice. Briefly, the key weaknesses of NSP mining are: 1) an inefficient positive sequential pattern (PSP) mining process, 2) a strict constraint of negative containment, and 3) the lack of an effective Negative Sequential Candidate (NSC) generation method. To address these weaknesses, we propose a highly efficient algorithm with improved techniques, named sc-NSP, to mine NSP efficiently. We first propose an improved PrefixSpan algorithm in the PSP mining process, which connects to a bitmap storage structure instead of the original structure. Second, sc-NSP loosens the frequency constraint and exploits the NSC generation method of positive and negative sequential patterns mining (PNSP) (a classic NSP mining method). Furthermore, a novel pruning strategy is designed to reduce the computational complexity of sc-NSP. Finally, sc-NSP obtains the support of NSC by using the most efficient bitwise-based calculation operation. Theoretical analyses show that sc-NSP performs particularly well on data sets with a large number of elements and items in sequence. Comparison and extensive experiments along with case studies on health data show that sc-NSP is 10 times more efficient than other state-of-the-art methods, and the number of NSPs obtained is 5 times greater than other methods.

[1]  Wei Wang,et al.  Interactive Sequential Basket Recommendation by Learning Basket Couplings and Positive/Negative Feedback , 2021, ACM Trans. Inf. Syst..

[2]  John See,et al.  Spatio-Temporal Point Process for Multiple Object Tracking , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Longbing Cao,et al.  e-RNSP: An Efficient Method for Mining Repetition Negative Sequential Patterns , 2020, IEEE Transactions on Cybernetics.

[4]  Junchi Yan,et al.  Modeling and Applications for Temporal Point Processes , 2019, KDD.

[5]  Michelle Taub,et al.  Integrating metacognitive judgments and eye movements using sequential pattern mining to understand processes underlying multimedia learning , 2019, Comput. Hum. Behav..

[6]  Xiangjun Dong,et al.  Campus Data Analysis Based on Positive and Negative Sequential Patterns , 2019, Int. J. Pattern Recognit. Artif. Intell..

[7]  Le Song,et al.  Learning Time Series Associated Event Sequences With Recurrent Point Process Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Longbing Cao,et al.  Mining Top- ${k}$ Useful Negative Sequential Patterns via Learning , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Longbing Cao,et al.  F-NSP+: A fast negative sequential patterns mining method with self-adaptive data storage , 2018, Pattern Recognit..

[10]  C. Carter,et al.  Staged Treatment in Early Psychosis: A sequential multiple assignment randomised trial of interventions for ultra high risk of psychosis patients , 2018, Early intervention in psychiatry.

[11]  Xiangjun Dong,et al.  Efficient High Utility Negative Sequential Patterns Mining in Smart Campus , 2018, IEEE Access.

[12]  Thomas Guyet,et al.  NegPSpan: efficient extraction of negative sequential patterns with embedding constraints , 2018, Data Mining and Knowledge Discovery.

[13]  Zhendong Niu,et al.  A hybrid recommender system for e-learning based on context awareness and sequential pattern mining , 2017, Soft Computing.

[14]  Seokho Kang,et al.  Personalized prediction of drug efficacy for diabetes treatment via patient-level sequential modeling with neural networks , 2018, Artif. Intell. Medicine.

[15]  Kenji Araki,et al.  Fast Generation of Clinical Pathways including Time Intervals in Sequential Pattern Mining on Electronic Medical Record Systems , 2017, 2017 International Conference on Computational Science and Computational Intelligence (CSCI).

[16]  Xiangjun Dong,et al.  NegI-NSP: Negative sequential pattern mining based on loose constraints , 2017, IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society.

[17]  Yongshun Gong,et al.  e-NSPFI: Efficient Mining Negative Sequential Pattern from Both Frequent and Infrequent Positive Sequential Patterns , 2017, Int. J. Pattern Recognit. Artif. Intell..

[18]  Jianliang Xu,et al.  E-msNSP: Efficient Negative Sequential Patterns Mining Based on Multiple Minimum Supports , 2017, Int. J. Pattern Recognit. Artif. Intell..

[19]  Okko Johannes Räsänen,et al.  Sequence Prediction With Sparse Distributed Hyperdimensional Coding Applied to the Analysis of Mobile Phone Use Patterns , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Longbing Cao,et al.  An effective contrast sequential pattern mining approach to taxpayer behavior analysis , 2016, World Wide Web.

[21]  Longbing Cao,et al.  e-NSP: Efficient negative sequential pattern mining , 2016, Artif. Intell..

[22]  Dmitriy Fradkin,et al.  Under Consideration for Publication in Knowledge and Information Systems Mining Sequential Patterns for Classification , 2022 .

[23]  Philip S. Yu,et al.  Nonoccurring Behavior Analytics: A New Area , 2015, IEEE Intelligent Systems.

[24]  Yongshun Gong,et al.  Research on Typical Algorithms in Negative Sequential Pattern Mining , 2015 .

[25]  Xiangjun Dong,et al.  SAPNSP: Select actionable positive and negative sequential patterns based on a contribution metric , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[26]  Adam Wright,et al.  The use of sequential pattern mining to predict next prescribed medications , 2015, J. Biomed. Informatics.

[27]  Yongshun Gong,et al.  Comparisons of typical algorithms in negative sequential pattern mining , 2014, 2014 IEEE Workshop on Electronics, Computer and Applications.

[28]  Jeffrey Xu Yu,et al.  Learning Phenotype Structure Using Sequence Model , 2014, IEEE Transactions on Knowledge and Data Engineering.

[29]  Diane J. Cook,et al.  Learning frequent behaviours of the users in Intelligent Environments , 2010, J. Ambient Intell. Smart Environ..

[30]  Xindong Wu,et al.  Coupled behavior analysis for capturing coupling relationships in group-based market manipulations , 2012, KDD.

[31]  Philip S. Yu,et al.  Coupled Behavior Analysis with Applications , 2012, IEEE Transactions on Knowledge and Data Engineering.

[32]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Chengqi Zhang,et al.  e-NSP: efficient negative sequential pattern mining based on identified positive patterns without database rescanning , 2011, CIKM '11.

[34]  Luisa Franzini,et al.  McAllen And El Paso revisited: Medicare variations not always reflected in the under-sixty-five population. , 2010, Health affairs.

[35]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[36]  Chengpeng Bi,et al.  Comparison of optimization techniques for sequence pattern discovery by maximum-likelihood , 2010, Pattern Recognit. Lett..

[37]  Yanchang Zhao,et al.  An Efficient GA-Based Algorithm for Mining Negative Sequential Patterns , 2010, PAKDD.

[38]  Yanchang Zhao,et al.  Negative-GSP: An Efficient Method for Mining Negative Sequential Patterns , 2009, AusDM.

[39]  Ming-Yen Lin,et al.  Mining Negative Sequential Patterns for E-commerce Recommendations , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.

[40]  Jie Zhou,et al.  Non-stationary data sequence classification using online class priors estimation , 2008, Pattern Recognit..

[41]  Wei-Min Ouyang,et al.  Mining Negative Sequential Patterns in Transaction Databases , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[42]  Wei-Hua Hao,et al.  Mining negative sequential patterns , 2007 .

[43]  Ming-Syan Chen,et al.  Mining Mobile Sequential Patterns in a Mobile Commerce Environment , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[44]  Qiming Chen,et al.  PrefixSpan,: mining sequential patterns efficiently by prefix-projected pattern growth , 2001, Proceedings 17th International Conference on Data Engineering.

[45]  Ramakrishnan Srikant,et al.  Mining Sequential Patterns: Generalizations and Performance Improvements , 1996, EDBT.

[46]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[47]  Longbing Cao Health and medical behavior informatics , 2020, Biomedical Information Technology.

[48]  Wei Wang,et al.  Negative Sequence Analysis , 2019, ACM Comput. Surv..

[49]  Xiangjun Dong,et al.  Select actionable positive or negative sequential patterns , 2015, J. Intell. Fuzzy Syst..

[50]  Suresh C. Sood Book Review: Behavior Computing: Modeling, Analysis, Mining and Decision , 2012, IEEE Intell. Informatics Bull..