A Survey of Utility-Oriented Pattern Mining

The main purpose of data mining and analytics is to find novel, potentially useful patterns that can be utilized in real-world applications to derive beneficial knowledge. For identifying and evaluating the usefulness of different kinds of patterns, many techniques and constraints have been proposed, such as support, confidence, sequence order, and utility parameters (e.g., weight, price, profit, quantity, satisfaction, etc.). In recent years, there has been an increasing demand for utility-oriented pattern mining (UPM, or called utility mining). UPM is a vital task, with numerous high-impact applications, including cross-marketing, e-commerce, finance, medical, and biomedical applications. This survey aims to provide a general, comprehensive, and structured overview of the state-of-the-art methods of UPM. First, we introduce an in-depth understanding of UPM, including concepts, examples, and comparisons with related concepts. A taxonomy of the most common and state-of-the-art approaches for mining different kinds of high-utility patterns is presented in detail, including Apriori-based, tree-based, projection-based, vertical-/horizontal-data-format-based, and other hybrid approaches. A comprehensive review of advanced topics of existing high-utility pattern mining techniques is offered, with a discussion of their pros and cons. Finally, we present several well-known open-source software packages for UPM. We conclude our survey with a discussion on open and practical challenges in this field.

[1]  A. Marshall Principles of Economics , .

[2]  Ron Rymon,et al.  Search through Systematic Set Enumeration , 1992, KR.

[3]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[4]  R. Agarwal Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[5]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[6]  Abraham Silberschatz,et al.  On Subjective Measures of Interestingness in Knowledge Discovery , 1995, KDD.

[7]  Philip S. Yu,et al.  Data Mining: An Overview from a Database Perspective , 1996, IEEE Trans. Knowl. Data Eng..

[8]  Jiawei Han,et al.  Maintenance of discovered association rules in large databases: an incremental updating technique , 1996, Proceedings of the Twelfth International Conference on Data Engineering.

[9]  David Wai-Lok Cheung,et al.  A General Incremental Technique for Maintaining Discovered Association Rules , 1997, DASFAA.

[10]  Ada Wai-Chee Fu,et al.  Mining association rules with weighted items , 1998, Proceedings. IDEAS'98. International Database Engineering and Applications Symposium (Cat. No.98EX156).

[11]  Nicolas Pasquier,et al.  Efficient Mining of Association Rules Using Closed Itemset Lattices , 1999, Inf. Syst..

[12]  Rakesh Agrawal,et al.  Privacy-preserving data mining , 2000, SIGMOD 2000.

[13]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[14]  Philip S. Yu,et al.  Efficient mining of weighted association rules (WAR) , 2000, KDD '00.

[15]  Yehuda Lindell,et al.  Privacy Preserving Data Mining , 2002, Journal of Cryptology.

[16]  Tzung-Pei Hong,et al.  A new incremental data mining algorithm using pre-large itemsets , 2001, Intell. Data Anal..

[17]  Mohammed J. Zaki,et al.  Efficiently mining maximal frequent itemsets , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[18]  Qiming Chen,et al.  PrefixSpan,: mining sequential patterns efficiently by prefix-projected pattern growth , 2001, Proceedings 17th International Conference on Data Engineering.

[19]  Laks V. S. Lakshmanan,et al.  Mining frequent itemsets with convertible constraints , 2001, Proceedings 17th International Conference on Data Engineering.

[20]  Qiang Yang,et al.  Objective-oriented utility-based association mining , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[21]  Toon Calders,et al.  Mining All Non-derivable Frequent Itemsets , 2002, PKDD.

[22]  Fionn Murtagh,et al.  Weighted Association Rule Mining using weighted support and significance framework , 2003, KDD '03.

[23]  Qiang Yang,et al.  Mining high utility itemsets , 2003, Third IEEE International Conference on Data Mining.

[24]  Lukasz Golab,et al.  Issues in data stream management , 2003, SGMD.

[25]  Howard J. Hamilton,et al.  Measuring the interestingness of discovered knowledge: A principled approach , 2003, Intell. Data Anal..

[26]  Heikki Mannila,et al.  Discovery of Frequent Episodes in Event Sequences , 1997, Data Mining and Knowledge Discovery.

[27]  Jean-François Boulicaut,et al.  Free-Sets: A Condensed Representation of Boolean Data for the Approximation of Frequency Queries , 2004, Data Mining and Knowledge Discovery.

[28]  Jaideep Srivastava,et al.  Selecting the right objective measure for association analysis , 2004, Inf. Syst..

[29]  Cory J. Butz,et al.  A Foundational Approach to Mining Itemset Utilities from Databases , 2004, SDM.

[30]  Philip S. Yu,et al.  Moment: maintaining closed frequent itemsets over a stream sliding window , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[31]  Chin-Chen Chang,et al.  Direct Candidates Generation: A Novel Algorithm for Discovering Complete Share-Frequent Itemsets , 2005, FSKD.

[32]  Ying Liu,et al.  A Two-Phase Algorithm for Fast Discovery of High Utility Itemsets , 2005, PAKDD.

[33]  Kenneth McGarry,et al.  A survey of interestingness measures for knowledge discovery , 2005, The Knowledge Engineering Review.

[34]  Howard J. Hamilton,et al.  Interestingness measures for data mining: A survey , 2006, CSUR.

[35]  Howard J. Hamilton,et al.  A Unified Framework for Utility Based Measures for Mining Itemsets , 2006 .

[36]  Jian Pei,et al.  Mining Frequent Patterns without Candidate Generation: A Frequent-Pattern Tree Approach , 2006, Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06).

[37]  Howard J. Hamilton,et al.  Mining itemset utilities from transaction databases , 2006, Data Knowl. Eng..

[38]  Jianying Hu,et al.  High-utility pattern mining: A method for discovery of high-utility item sets , 2007, Pattern Recognit..

[39]  Suh-Yin Lee,et al.  DSM-FI: an efficient algorithm for mining frequent itemsets in data streams , 2008, Knowledge and Information Systems.

[40]  Edward Hung,et al.  Mining Frequent Itemsets from Uncertain Data , 2007, PAKDD.

[41]  Raj P. Gopalan,et al.  CTU-Mine: An Efficient High Utility Itemset Mining Algorithm Using the Pattern Growth Approach , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[42]  Yue-Shi Lee,et al.  Mining High Utility Quantitative Association Rules , 2007, DaWaK.

[43]  Philip S. Yu,et al.  A General Survey of Privacy-Preserving Data Mining Models and Algorithms , 2008, Privacy-Preserving Data Mining.

[44]  Chin-Chen Chang,et al.  Isolated items discarding strategy for discovering high utility itemsets , 2008, Data Knowl. Eng..

[45]  Raj P. Gopalan,et al.  Efficient Mining of High Utility Itemsets from Large Datasets , 2008, PAKDD.

[46]  Jieh-Shan Yeh,et al.  Novel Algorithms for Privacy Preserving Utility Mining , 2008, 2008 Eighth International Conference on Intelligent Systems Design and Applications.

[47]  Vincent S. Tseng,et al.  An efficient algorithm for mining temporal high utility itemsets from data streams , 2008, J. Syst. Softw..

[48]  Chia-Hui Chang,et al.  Efficient mining of frequent episodes from complex sequences , 2008, Inf. Syst..

[49]  Bingru Yang,et al.  Index-BitTableFI: An improved algorithm for mining frequent itemsets , 2008, Knowl. Based Syst..

[50]  Suh-Yin Lee,et al.  Fast and Memory Efficient Mining of High Utility Itemsets in Data Streams , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[51]  Ke Sun,et al.  Mining Weighted Association Rules without Preassigned Weights , 2008, IEEE Transactions on Knowledge and Data Engineering.

[52]  Young-Koo Lee,et al.  An Efficient Candidate Pruning Technique for High Utility Pattern Mining , 2009, PAKDD.

[53]  Charu C. Aggarwal,et al.  Frequent pattern mining with uncertain data , 2009, KDD.

[54]  Young-Koo Lee,et al.  Efficient Tree Structures for High Utility Pattern Mining in Incremental Databases , 2009, IEEE Transactions on Knowledge and Data Engineering.

[55]  Young-Koo Lee,et al.  Efficient mining of utility-based web path traversal patterns , 2009, 2009 11th International Conference on Advanced Communication Technology.

[56]  Sanjay Ghemawat,et al.  MapReduce: a flexible data processing tool , 2010, CACM.

[57]  Longbing Cao,et al.  Domain-Driven Data Mining: Challenges and Prospects , 2010, IEEE Transactions on Knowledge and Data Engineering.

[58]  Tijl De Bie,et al.  Maximum entropy models and subjective interestingness: an application to tiles in binary databases , 2010, Data Mining and Knowledge Discovery.

[59]  Philip S. Yu,et al.  UP-Growth: an efficient algorithm for high utility itemset mining , 2010, KDD.

[60]  Byeong-Soo Jeong,et al.  A Novel Approach for Mining High‐Utility Sequential Patterns in Sequence Databases , 2010 .

[61]  Jieh-Shan Yeh,et al.  HHUIF and MSICF: Novel algorithms for privacy preserving utility mining , 2010, Expert Syst. Appl..

[62]  Philip S. Yu,et al.  Online mining of temporal maximal utility itemsets from data streams , 2010, SAC '10.

[63]  Tzung-Pei Hong,et al.  Effective utility mining with the measure of average utility , 2011, Expert Syst. Appl..

[64]  Avinash Achar,et al.  A unified view of the apriori-based algorithms for frequent episode discovery , 2011, Knowledge and Information Systems.

[65]  Philip S. Yu,et al.  Mining High Utility Mobile Sequential Patterns in Mobile Commerce Environments , 2011, DASFAA.

[66]  Kunle Olukotun,et al.  Efficient Parallel Graph Exploration on Multi-Core CPU and GPU , 2011, 2011 International Conference on Parallel Architectures and Compilation Techniques.

[67]  Tzung-Pei Hong,et al.  Discovery of high utility itemsets from on-shelf time periods of products , 2011, Expert Syst. Appl..

[68]  Tzung-Pei Hong,et al.  An effective tree structure for mining high utility itemsets , 2011, Expert Syst. Appl..

[69]  Ho-Jin Choi,et al.  A framework for mining interesting high utility patterns with a strong frequency affinity , 2011, Inf. Sci..

[70]  Byeong-Soo Jeong,et al.  A Framework for Mining High Utility Web Access Sequences , 2011 .

[71]  Benjamin C. M. Fung,et al.  Direct Discovery of High Utility Itemsets without Candidate Generation , 2012, 2012 IEEE 12th International Conference on Data Mining.

[72]  Ho-Jin Choi,et al.  Interactive mining of high utility patterns over data streams , 2012, Expert Syst. Appl..

[73]  Approximate Frequency Counts over Data Streams , 2012, Proc. VLDB Endow..

[74]  Vincent S. Tseng,et al.  Efficient algorithms for discovering high utility user behavior patterns in mobile commerce environments , 2013, Knowledge and Information Systems.

[75]  Longbing Cao,et al.  USpan: an efficient algorithm for mining high utility sequential patterns , 2012, KDD.

[76]  Mengchi Liu,et al.  Mining high utility itemsets without candidate generation , 2012, CIKM.

[77]  Tzung-Pei Hong,et al.  Efficiently Mining High Average-Utility Itemsets with an Improved Upper-Bound Strategy , 2012, Int. J. Inf. Technol. Decis. Mak..

[78]  Philip S. Yu,et al.  Efficient algorithms for mining maximal high utility itemsets from data streams with different models , 2012, Expert Syst. Appl..

[79]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[80]  Tzung-Pei Hong,et al.  An incremental mining algorithm for high utility itemsets , 2012, Expert Syst. Appl..

[81]  Vincent S. Tseng,et al.  Mining differential top-k co-expression patterns from time course comparative gene expression datasets , 2013, BMC Bioinformatics.

[82]  Engelbert Mephu Nguifo,et al.  CMRules: Mining sequential rules common to several sequences , 2012, Knowl. Based Syst..

[83]  Philip S. Yu,et al.  Mining top-K high utility itemsets , 2012, KDD.

[84]  Frans Coenen,et al.  A survey of frequent subgraph mining algorithms , 2012, The Knowledge Engineering Review.

[85]  Tzung-Pei Hong,et al.  Incrementally mining high utility patterns based on pre-large concept , 2014, Applied Intelligence.

[86]  B. Nath,et al.  Incremental association rule mining: a survey , 2013, WIREs Data Mining Knowl. Discov..

[87]  Philip S. Yu,et al.  Efficient Algorithms for Mining High Utility Itemsets from Transactional Databases , 2013, IEEE Transactions on Knowledge and Data Engineering.

[88]  Yu Liu,et al.  Mining high utility itemsets by dynamically pruning the tree structure , 2013, Applied Intelligence.

[89]  Songchun Moon,et al.  Utility-based association rule mining: A marketing solution for cross-selling , 2013, Expert Syst. Appl..

[90]  Rupali A. Mahajan,et al.  Survey on Mining High Utility Itemset from Transactional Database , 2013 .

[91]  Avinash Achar,et al.  Pattern-growth based frequent serial episode discovery , 2013, Data Knowl. Eng..

[92]  Philip S. Yu,et al.  Mining high utility episodes in complex event sequences , 2013, KDD.

[93]  Laurence T. Yang,et al.  Data Mining for Internet of Things: A Survey , 2014, IEEE Communications Surveys & Tutorials.

[94]  Vincent S. Tseng,et al.  FHM: Faster High-Utility Itemset Mining Using Estimated Utility Co-occurrence Pruning , 2014, ISMIS.

[95]  Tzung-Pei Hong,et al.  Applying the maximum utility measure in high utility sequential pattern mining , 2014, Expert Syst. Appl..

[96]  Tzung-Pei Hong,et al.  A GA-Based Approach to Hide Sensitive High Utility Itemsets , 2014, TheScientificWorldJournal.

[97]  Tzung-Pei Hong,et al.  Updating high-utility pattern trees with transaction modification , 2014, Multimedia Tools and Applications.

[98]  Aijun An,et al.  Mining top-k high utility patterns over data streams , 2014, Inf. Sci..

[99]  Enhong Chen,et al.  High Utility Episode Mining Made Practical and Fast , 2014, ADMA.

[100]  Vincent S. Tseng,et al.  Efficient vertical mining of high utility quantitative itemsets , 2014, 2014 IEEE International Conference on Granular Computing (GrC).

[101]  Vincent S. Tseng,et al.  Mining High Utility Itemsets in Big Data , 2015, PAKDD.

[102]  Vincent S. Tseng,et al.  Mining closed+ high utility itemsets without candidate generation , 2015, 2015 Conference on Technologies and Applications of Artificial Intelligence (TAAI).

[103]  Srikumar Krishnamoorthy,et al.  Pruning strategies for mining high utility itemsets , 2015, Expert Syst. Appl..

[104]  Ashok Kumar Das,et al.  An efficient fast algorithm for discovering closed+ high utility itemsets , 2016, Applied Intelligence.

[105]  Vincent S. Tseng,et al.  UP-Miner: A Utility Pattern Mining Toolbox , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[106]  Philip S. Yu,et al.  Efficient Algorithms for Mining the Concise and Lossless Representation of High Utility Itemsets , 2015, IEEE Transactions on Knowledge and Data Engineering.

[107]  Vincent S. Tseng,et al.  Discovering utility-based episode rules in complex event sequences , 2015, Expert Syst. Appl..

[108]  Tzung-Pei Hong,et al.  An Incremental High-Utility Mining Algorithm with Transaction Insertion , 2015, TheScientificWorldJournal.

[109]  Yi-Cheng Chen,et al.  On efficiently mining high utility sequential patterns , 2016, Knowledge and Information Systems.

[110]  Ashok Kumar Das,et al.  An efficient approach for mining association rules from high utility itemsets , 2015, Expert Syst. Appl..

[111]  Vincent S. Tseng,et al.  Efficient Mining of High-Utility Sequential Rules , 2015, MLDM.

[112]  Pinar Senkul,et al.  CRoM and HuspExt: Improving Efficiency of High Utility Sequential Pattern Extraction , 2015, IEEE Transactions on Knowledge and Data Engineering.

[113]  Unil Yun,et al.  A fast perturbation algorithm using tree structure for privacy preserving utility mining , 2015, Expert Syst. Appl..

[114]  Tzung-Pei Hong,et al.  Weighted frequent itemset mining over uncertain databases , 2015, Applied Intelligence.

[115]  Wei Song,et al.  A high utility itemset mining algorithm based on subsume index , 2015, Knowledge and Information Systems.

[116]  Vincent S. Tseng,et al.  EFIM: A Highly Efficient Algorithm for High-Utility Itemset Mining , 2015, MICAI.

[117]  Tzung-Pei Hong,et al.  Efficient updating of discovered high-utility itemsets for transaction deletion in dynamic databases , 2015, Adv. Eng. Informatics.

[118]  Tzung-Pei Hong,et al.  Efficient algorithms for mining up-to-date high-utility patterns , 2015, Adv. Eng. Informatics.

[119]  Tzung-Pei Hong,et al.  RWFIM: Recent weighted-frequent itemsets mining , 2015, Eng. Appl. Artif. Intell..

[120]  Jerry Chun-Wei Lin,et al.  Efficient Incremental High Utility Itemset Mining , 2015, ASE BD&SI.

[121]  Tzung-Pei Hong,et al.  A fast updated algorithm to maintain the discovered high-utility itemsets for transaction modification , 2015, Adv. Eng. Informatics.

[122]  Tzung-Pei Hong,et al.  Mining high utility itemsets for transaction deletion in a dynamic database , 2015, Intell. Data Anal..

[123]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[124]  Vincent S. Tseng,et al.  Mining high-utility itemsets with various discount strategies , 2015, DSAA.

[125]  Vincent S. Tseng,et al.  EFIM-Closed: Fast and Memory Efficient Discovery of Closed High-Utility Itemsets , 2016, MLDM.

[126]  Antonio Gomariz,et al.  The SPMF Open-Source Data Mining Library Version 2 , 2016, ECML/PKDD.

[127]  Tzung-Pei Hong,et al.  Efficient algorithms for mining high-utility itemsets in uncertain databases , 2016, Knowl. Based Syst..

[128]  Dhaval Patel,et al.  Top-K High Utility Episode Mining from a Complex Event Sequence , 2016, COMAD.

[129]  Aijun An,et al.  Memory-adaptive high utility sequential pattern mining over data streams , 2017, Machine Learning.

[130]  Justin Zhijun Zhan,et al.  Fast algorithms for hiding sensitive high-utility itemsets in privacy-preserving utility mining , 2016, Eng. Appl. Artif. Intell..

[131]  Keun Ho Ryu,et al.  Fast algorithm for high utility pattern mining with the sum of item quantities , 2016, Intell. Data Anal..

[132]  Aijun An,et al.  Approximate Parallel High Utility Itemset Mining , 2016, Big Data Res..

[133]  Tzung-Pei Hong,et al.  FDHUP: Fast algorithm for mining discriminative high utility patterns , 2017, Knowledge and Information Systems.

[134]  Philippe Fournier-Viger,et al.  FHN: An efficient algorithm for mining high-utility itemsets with negative unit profits , 2016, Knowl. Based Syst..

[135]  Tzung-Pei Hong,et al.  Efficient mining of high-utility itemsets using multiple minimum utility thresholds , 2016, Knowl. Based Syst..

[136]  Yun Sing Koh DRAFT 0 Unsupervised Rare Pattern Mining : A Survey , 2016 .

[137]  Yonggang Hu,et al.  Distributed and parallel high utility sequential pattern mining , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[138]  Philippe Fournier-Viger,et al.  Mining Recent High-Utility Patterns from Temporal Databases with Time-Sensitive Constraint , 2016, DaWaK.

[139]  Heungmo Ryang,et al.  Indexed list-based high utility pattern mining with utility upper-bound reduction and pattern combination techniques , 2017, Knowledge and Information Systems.

[140]  Tzung-Pei Hong,et al.  An efficient algorithm to mine high average-utility itemsets , 2016, Adv. Eng. Informatics.

[141]  Tzung-Pei Hong,et al.  A fast maintenance algorithm of the discovered high-utility itemsets with transaction deletion , 2016, Intell. Data Anal..

[142]  P. Sunley Principles of economics, 8th Ed. , 2017 .

[143]  Justin Zhijun Zhan,et al.  Exploiting highly qualified pattern with frequency and weight occupancy , 2018, Knowledge and Information Systems.

[144]  Vincent S. Tseng,et al.  A novel methodology for stock investment using high utility episode mining and genetic algorithm , 2017, Appl. Soft Comput..

[145]  Philippe Fournier-Viger,et al.  A survey of itemset mining , 2017, WIREs Data Mining Knowl. Discov..

[146]  Justin Zhijun Zhan,et al.  Data mining in distributed environment: a survey , 2017, WIREs Data Mining Knowl. Discov..

[147]  Yun Sing Koh,et al.  mHUIMiner: A Fast High Utility Itemset Mining Algorithm for Sparse Datasets , 2017, PAKDD.

[148]  Justin Zhijun Zhan,et al.  Efficient hiding of confidential high-utility itemsets with minimal side effects , 2017, J. Exp. Theor. Artif. Intell..

[149]  Yun Sing Koh,et al.  A Survey of Sequential Pattern Mining , 2017 .

[150]  Tzung-Pei Hong,et al.  Efficiently mining uncertain high-utility itemsets , 2017, Soft Comput..

[151]  Justin Zhijun Zhan,et al.  Extracting recent weighted-based patterns from uncertain temporal databases , 2017, Eng. Appl. Artif. Intell..

[152]  Philip S. Yu,et al.  Differentially Private Data Publishing and Analysis: A Survey , 2017, IEEE Transactions on Knowledge and Data Engineering.

[153]  Jerry Chun-Wei Lin,et al.  EHAUPM: Efficient High Average-Utility Pattern Mining With Tighter Upper Bounds , 2017, IEEE Access.

[154]  Philippe Fournier-Viger,et al.  Exploiting High Utility Occupancy Patterns , 2017, APWeb/WAIM.

[155]  Vincent S. Tseng,et al.  Mining High-Utility Itemsets with Both Positive and Negative Unit Profits from Uncertain Databases , 2017, PAKDD.

[156]  Aijun An,et al.  Mining significant high utility gene regulation sequential patterns , 2017, BMC Systems Biology.

[157]  Hamido Fujita,et al.  Damped window based high average utility pattern mining over data streams , 2017, Knowl. Based Syst..

[158]  Philip S. Yu,et al.  Privacy Preserving Utility Mining: A Survey , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[159]  Philip S. Yu,et al.  CoUPM: Correlated Utility-based Pattern Mining , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[160]  Hamido Fujita,et al.  Extracting Non-redundant Correlated Purchase Behaviors by Utility Measure , 2017, DaWaK.

[161]  Hamido Fujita,et al.  A survey of incremental high‐utility itemset mining , 2018, WIREs Data Mining Knowl. Discov..

[162]  Philip S. Yu,et al.  Fast Utility Mining on Complex Sequences , 2019, ArXiv.

[163]  Philip S. Yu,et al.  A Survey of Parallel Sequential Pattern Mining , 2018, ACM Trans. Knowl. Discov. Data.

[164]  Philip S. Yu,et al.  ProUM: Projection-based Utility Mining on Sequence Data , 2019, Inf. Sci..

[165]  Philip S. Yu,et al.  HUOPM: High-Utility Occupancy Pattern Mining , 2018, IEEE Transactions on Cybernetics.

[166]  Philip S. Yu,et al.  Fast Utility Mining on Sequence Data , 2020, IEEE Transactions on Cybernetics.