Three-way concept learning based on cognitive operators: An information fusion viewpoint

The theory of three-way decisions is to consider a decision-making problem as a ternary classification one which is realized by the acceptance, rejection and non-commitment. Recently, this theory has been integrated with formal concept analysis in two different ways: constructive and axiomatic methods. The constructive method is to define certain three-way concepts in a formal context to support three-way concept analysis, while the axiomatic one is to characterize general three-way concepts by axioms so as to perform three-way concept learning. Nevertheless, there are similarities between the constructive and the axiomatic methods. In fact, both three-way concept analysis induced by the constructive method and three-way concept learning induced by the axiomatic one are realized by incorporating the idea of ternary classification into the design of extent or intent of a concept. However, their information fusion abilities need to be improved since neither of them is able to deal with large or multi-source data effectively. Motivated by this problem, our paper is to reconsider three-way concept learning based on cognitive operators from the perspective of information fusion. That is, the parallel computing techniques of learning three-way concepts are developed for large and multi-source data. Specifically, for large data, the relationship between the global granular concept and the local ones is first clarified, and then it is employed to design an information fusion algorithm. For multi-source data, the whole evaluation function used to induce three-way decisions is established by aggregating the results obtained in each single-source data, and three-way concept learning is made by constructing lower and upper approximation concepts. Finally, we conduct some numerical experiments to evaluate the effectiveness of the proposed parallel computing algorithms. We propose three-way concept learning methods for large data.We present three-way concept learning methods for multi-source data.Experiments are conducted to evaluate the performance of our learning methods.

[1]  Jonas Poelmans,et al.  Knowledge representation and processing with formal concept analysis , 2013, WIREs Data Mining Knowl. Discov..

[2]  Weihua Xu,et al.  Granular Computing Approach to Two-Way Learning Based on Formal Concept Analysis in Fuzzy Datasets , 2016, IEEE Transactions on Cybernetics.

[3]  Yiyu Yao,et al.  An Outline of a Theory of Three-Way Decisions , 2012, RSCTC.

[4]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[5]  D. Ciucci Orthopairs and granular computing , 2016 .

[6]  Jing-Yu Yang,et al.  Test cost sensitive multigranulation rough set: Model and minimal cost selection , 2013, Inf. Sci..

[7]  Yiyu Yao,et al.  Interpreting Concept Learning in Cognitive Informatics and Granular Computing , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Wen-Xiu Zhang,et al.  A mathematical model for concept granular computing systems , 2010, Science China Information Sciences.

[9]  Heung Wong,et al.  The aggregation of multiple three-way decision spaces , 2016, Knowl. Based Syst..

[10]  Yiyu Yao,et al.  Three-Way Decisions and Cognitive Computing , 2016, Cognitive Computation.

[11]  Xiaodong Liu,et al.  Concept analysis via rough set and AFS algebra , 2008, Inf. Sci..

[12]  Jianhua Dai,et al.  On the union and intersection operations of rough sets based on various approximation spaces , 2015, Inf. Sci..

[13]  Sergei O. Kuznetsov,et al.  Complexity of learning in concept lattices from positive and negative examples , 2004, Discret. Appl. Math..

[14]  Yiyu Yao,et al.  Three-Way Formal Concept Analysis , 2014, RSKT.

[15]  Weihua Xu,et al.  A novel cognitive system model and approach to transformation of information granules , 2014, Int. J. Approx. Reason..

[16]  Kan Zheng,et al.  Three-Way Decisions Solution to Filter Spam Email: An Empirical Study , 2012, RSCTC.

[17]  Witold Pedrycz,et al.  Three-way decisions based on decision-theoretic rough sets under linguistic assessment with the aid of group decision making , 2015, Appl. Soft Comput..

[18]  Vladik Kreinovich,et al.  Handbook of Granular Computing , 2008 .

[19]  Caihui Liu,et al.  On multi-granulation covering rough sets , 2014, Int. J. Approx. Reason..

[20]  Chu Kiong Loo,et al.  Formal concept analysis approach to cognitive functionalities of bidirectional associative memory , 2015, BICA 2015.

[21]  Jingtao Yao,et al.  Modelling Multi-agent Three-way Decisions with Decision-theoretic Rough Sets , 2012, Fundam. Informaticae.

[22]  Wen-Xiu Zhang,et al.  Axiomatic characterizations of dual concept lattices , 2013, Int. J. Approx. Reason..

[23]  Yiyu Yao,et al.  Three-way Investment Decisions with Decision-theoretic Rough Sets , 2011, Int. J. Comput. Intell. Syst..

[24]  Xiangping Kang,et al.  Formal concept analysis based on fuzzy granularity base for different granulations , 2012, Fuzzy Sets Syst..

[25]  Guoyin Wang,et al.  Generic normal cloud model , 2014, Inf. Sci..

[26]  Yuhua Qian,et al.  Three-way cognitive concept learning via multi-granularity , 2017, Inf. Sci..

[27]  Bernhard Ganter,et al.  Scale Coarsening as Feature Selection , 2008, ICFCA.

[28]  Yuhua Qian,et al.  Concept learning via granular computing: A cognitive viewpoint , 2014, Information Sciences.

[29]  Yiyu Yao,et al.  MGRS: A multi-granulation rough set , 2010, Inf. Sci..

[30]  Ling Wei,et al.  The connections between three-way and classical concept lattices , 2016, Knowl. Based Syst..

[31]  Yingxu Wang,et al.  On Concept Algebra: A Denotational Mathematical Structure for Knowledge and Software Modeling , 2008, Int. J. Cogn. Informatics Nat. Intell..

[32]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[33]  Yee Leung,et al.  Theory and applications of granular labelled partitions in multi-scale decision tables , 2011, Inf. Sci..

[34]  Qing Wan,et al.  Granular Transformation and Irreducible Element Judgment Theory Based on Pictorial Diagrams , 2016, IEEE Transactions on Cybernetics.

[35]  Jiye Liang,et al.  An information fusion approach by combining multigranulation rough sets and evidence theory , 2015, Inf. Sci..

[36]  Zhang Yi,et al.  Efficient updating of probabilistic approximations with incremental objects , 2016, Knowl. Based Syst..

[37]  Sergei O. Kuznetsov,et al.  Comparing performance of algorithms for generating concept lattices , 2002, J. Exp. Theor. Artif. Intell..

[38]  Jinhai Li,et al.  Incomplete decision contexts: Approximate concept construction, rule acquisition and knowledge reduction , 2013, Int. J. Approx. Reason..

[39]  Hong-Ying Zhang,et al.  Ranking interval sets based on inclusion measures and applications to three-way decisions , 2016, Knowl. Based Syst..

[40]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[41]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[42]  Yee Leung,et al.  Granular Computing and Knowledge Reduction in Formal Contexts , 2009, IEEE Transactions on Knowledge and Data Engineering.

[43]  Rudolf Wille,et al.  Restructuring Lattice Theory: An Approach Based on Hierarchies of Concepts , 2009, ICFCA.

[44]  Bing Shi,et al.  Regression-based three-way recommendation , 2017, Inf. Sci..

[45]  Bing Huang,et al.  Intuitionistic fuzzy multigranulation rough sets , 2014, Inf. Sci..

[46]  Yiyu Yao,et al.  A Comparative Study of Formal Concept Analysis and Rough Set Theory in Data Analysis , 2004, Rough Sets and Current Trends in Computing.

[47]  Y. Yao Information granulation and rough set approximation , 2001 .

[48]  J. Deogun,et al.  Concept approximations based on rough sets and similarity measures , 2001 .

[49]  Yanhong She,et al.  On the structure of the multigranulation rough set model , 2012, Knowl. Based Syst..

[50]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[51]  Bao Qing Hu,et al.  Three-way decisions space and three-way decisions , 2014, Inf. Sci..

[52]  Yiyu Yao,et al.  Interval sets and three-way concept analysis in incomplete contexts , 2016, International Journal of Machine Learning and Cybernetics.

[53]  Lotfi A. Zadeh,et al.  Fuzzy sets and information granularity , 1996 .

[54]  Ming-Wen Shao,et al.  Set approximations in fuzzy formal concept analysis , 2007, Fuzzy Sets Syst..

[55]  Ivo Düntsch,et al.  Modal-style operators in qualitative data analysis , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[56]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[57]  Davide Ciucci,et al.  Orthopairs: A Simple and Widely UsedWay to Model Uncertainty , 2011, Fundam. Informaticae.

[58]  Sergei O. Kuznetsov,et al.  Mathematical aspects of concept analysis , 1996 .

[59]  Guoyin Wang,et al.  A tree-based incremental overlapping clustering method using the three-way decision theory , 2016, Knowl. Based Syst..

[60]  Bernhard Ganter,et al.  Hypotheses and Version Spaces , 2003, ICCS.

[61]  Yiyu Yao,et al.  Detecting and refining overlapping regions in complex networks with three-way decisions , 2016, Inf. Sci..

[62]  Yuhua Qian,et al.  Cognitive concept learning via granular computing for big data , 2015, 2015 International Conference on Machine Learning and Cybernetics (ICMLC).

[63]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[64]  Sergei O. Kuznetsov,et al.  Fitting Pattern Structures to Knowledge Discovery in Big Data , 2013, ICFCA.

[65]  Witold Pedrycz,et al.  Granular Computing: Perspectives and Challenges , 2013, IEEE Transactions on Cybernetics.

[66]  Jiye Liang,et al.  Pessimistic rough set based decisions: A multigranulation fusion strategy , 2014, Inf. Sci..

[67]  Vilém Vychodil,et al.  Parallel algorithm for computing fixpoints of Galois connections , 2010, Annals of Mathematics and Artificial Intelligence.

[68]  Witold Pedrycz,et al.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[69]  Guoyin Wang,et al.  A Decision-Theoretic Rough Set Approach for Dynamic Data Mining , 2015, IEEE Transactions on Fuzzy Systems.

[70]  Yiyu Yao,et al.  Concept lattices in rough set theory , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[71]  D. Angluin Queries and Concept Learning , 1988 .

[72]  Zhang Yi,et al.  Matrix approach to decision-theoretic rough sets for evolving data , 2016, Knowl. Based Syst..

[73]  Yingxu Wang,et al.  On Cognitive Computing , 2009, Int. J. Softw. Sci. Comput. Intell..

[74]  Dun Liu,et al.  Incremental updating approximations in probabilistic rough sets under the variation of attributes , 2015, Knowl. Based Syst..

[75]  Yiyu Yao,et al.  Decision-theoretic three-way approximations of fuzzy sets , 2014, Inf. Sci..