Granular Fuzzy Rule-Based Modeling With Incomplete Data Representation

Incomplete data are frequently encountered and bring difficulties when it comes to further processing. The concepts of granular computing (GrC) help deliver a higher level of abstraction to address this problem. Most of the existing data imputation and related modeling methods are of numeric nature and require prior numeric models to be provided. The underlying objective of this study is to introduce a novel and straightforward approach that uses information granules as a vehicle to effectively represent missing data and build granular fuzzy models directly from resulting hybrid granular and numeric data. The evaluation and optimization of this method are guided by the principle of justifiable granularity engaging the coverage and specificity criteria and carried out with the help of particle swarm optimization. We provide a collection of experimental studies using a synthetic dataset and several publicly available real-world datasets to demonstrate the feasibility and analyze the main features of this method.

[1]  IEEE SYSTEMS, MAN, AND CYBERNETICS SOCIETY , 2023, IEEE Transactions on Cybernetics.

[2]  Luiz Alberto Queiroz Cordovil,et al.  Uncertain Data Modeling Based on Evolving Ellipsoidal Fuzzy Information Granules , 2020, IEEE Transactions on Fuzzy Systems.

[3]  Igor Škrjanc,et al.  Incremental Missing-Data Imputation for Evolving Fuzzy Granular Prediction , 2020, IEEE Transactions on Fuzzy Systems.

[4]  Wei Li,et al.  Boosted K-nearest neighbor classifiers based on fuzzy granules , 2020, Knowl. Based Syst..

[5]  Zheng Zhang,et al.  Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion , 2020, IEEE Transactions on Cybernetics.

[6]  Xin Liu,et al.  Takagi-Sugeno Modeling of Incomplete Data for Missing Value Imputation With the Use of Alternate Learning , 2020, IEEE Access.

[7]  Mingli Song,et al.  Granular neural networks: The development of granular input spaces and parameters spaces through a hierarchical allocation of information granularity , 2020, Inf. Sci..

[8]  Zong-fang Ma,et al.  A new incomplete pattern belief classification method with multiple estimations based on KNN , 2020, Appl. Soft Comput..

[9]  Yong Shi,et al.  Fuzzy-Based Concept Learning Method: Exploiting Data With Fuzzy Conceptual Clustering , 2020, IEEE Transactions on Cybernetics.

[10]  Jianmin Wang,et al.  Enriching Data Imputation under Similarity Rule Constraints , 2020, IEEE Transactions on Knowledge and Data Engineering.

[11]  Can Gao,et al.  Multigranulation rough-fuzzy clustering based on shadowed sets , 2020, Inf. Sci..

[12]  Xiaofeng Zhu,et al.  Efficient Utilization of Missing Data in Cost-Sensitive Learning , 2019, IEEE Transactions on Knowledge and Data Engineering.

[13]  K. Thangavel,et al.  Missing value imputation using unsupervised machine learning techniques , 2019, Soft Computing.

[14]  Witold Pedrycz,et al.  Granular Fuzzy Modeling Guided Through the Synergy of Granulating Output Space and Clustering Input Subspaces , 2019, IEEE Transactions on Cybernetics.

[15]  Chih-Fong Tsai,et al.  Missing value imputation: a review and analysis of the literature (2006–2017) , 2019, Artificial Intelligence Review.

[16]  Witold Pedrycz,et al.  Clustering Homogeneous Granular Data: Formation and Evaluation , 2019, IEEE Transactions on Cybernetics.

[17]  Linlin Zhu,et al.  Facial semantic descriptors based on information granules , 2019, Inf. Sci..

[18]  Witold Pedrycz,et al.  A Development of Granular Input Space in System Modeling , 2019, IEEE Transactions on Cybernetics.

[19]  Guohua Wu,et al.  Ensemble strategies for population-based optimization algorithms - A survey , 2019, Swarm Evol. Comput..

[20]  Chih-Fong Tsai,et al.  A class center based approach for missing value imputation , 2018, Knowl. Based Syst..

[21]  Mihaela van der Schaar,et al.  GAIN: Missing Data Imputation using Generative Adversarial Nets , 2018, ICML.

[22]  Qinghua Hu,et al.  Locally Linear Approximation Approach for Incomplete Data , 2018, IEEE Transactions on Cybernetics.

[23]  Jared S. Murray,et al.  Multiple Imputation: A Review of Practical and Theoretical Findings , 2018, 1801.04058.

[24]  Witold Pedrycz,et al.  Granular Fuzzy Rule-Based Models: A Study in a Comprehensive Evaluation and Construction of Fuzzy Models , 2017, IEEE Transactions on Fuzzy Systems.

[25]  Jun Zhang,et al.  Fuzzy-Based Information Decomposition for Incomplete and Imbalanced Data Learning , 2017, IEEE Transactions on Fuzzy Systems.

[26]  Chia-Wen Chang,et al.  A Novel Approach to Implement Takagi-Sugeno Fuzzy Models , 2017, IEEE Transactions on Cybernetics.

[27]  Witold Pedrycz,et al.  From fuzzy rule-based models to their granular generalizations , 2017, Knowl. Based Syst..

[28]  Nor Ashidi Mat Isa,et al.  Knowledge base to fuzzy information granule: A review from the interpretability-accuracy perspective , 2017, Appl. Soft Comput..

[29]  Weihua Xu,et al.  A novel approach to information fusion in multi-source datasets: A granular computing viewpoint , 2017, Inf. Sci..

[30]  Zeshui Xu,et al.  Probabilistic linguistic vector-term set and its application in group decision making with multi-granular linguistic information , 2016, Appl. Soft Comput..

[31]  Mehran Amiri,et al.  Missing data imputation using fuzzy-rough methods , 2016, Neurocomputing.

[32]  Xizhao Wang,et al.  Learning from Uncertainty for Big Data: Future Analytical Challenges and Strategies , 2016, IEEE Systems, Man, and Cybernetics Magazine.

[33]  Abel Folch-Fortuny,et al.  Missing Data Imputation Toolbox for MATLAB , 2016 .

[34]  J. Josse,et al.  missMDA: A Package for Handling Missing Values in Multivariate Data Analysis , 2016 .

[35]  Quan Pan,et al.  Adaptive imputation of missing values for incomplete pattern classification , 2016, Pattern Recognit..

[36]  Md. Geaur Rahman,et al.  Missing value imputation using a fuzzy clustering-based EM approach , 2016, Knowledge and Information Systems.

[37]  Quan Pan,et al.  A New Incomplete Pattern Classification Method Based on Evidential Reasoning , 2015, IEEE Transactions on Cybernetics.

[38]  Witold Pedrycz,et al.  From Numeric Models to Granular System Modeling , 2015 .

[39]  Ahmet Arslan,et al.  A hybrid method for imputation of missing values using optimized fuzzy c-means with support vector regression and a genetic algorithm , 2013, Inf. Sci..

[40]  W. Pedrycz.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[41]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[42]  Zeshui Xu,et al.  Interval multiplicative transitivity for consistency, missing values and priority weights of interval fuzzy preference relations , 2010, Inf. Sci..

[43]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[44]  P. Mal,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[45]  John F. Kolen,et al.  Reducing the time complexity of the fuzzy c-means algorithm , 2002, IEEE Trans. Fuzzy Syst..

[46]  James C. Bezdek,et al.  Fuzzy c-means clustering of incomplete data , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[47]  Dan Shan,et al.  Interval Granular Fuzzy Models: Concepts and Development , 2019, IEEE Access.

[48]  M. Fay,et al.  Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules. , 2010, Statistics surveys.

[49]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[50]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .