A randomization mechanism for realizing granular models in distributed system modeling

Abstract This study contributes to a development of granular models, which are realized through an aggregation of the outputs produced by numeric models formed at a lower level of hierarchy. The aim is to form a consensus through adjusting local sources of knowledge such that the granular outputs could reflect and quantify the diversity of local knowledge. The aggregation process is accomplished in an active mode by introducing a certain level of randomness to the numeric outputs of each individual model. The numeric outputs produced by numeric models are weighted by the analysis of the root mean squared error associated with the corresponding numeric constructs. Granular models are formed at a higher level of abstraction as the results of the aggregation mechanism. An augmented version of the principle of justifiable granularity is used as the underlying development vehicle for constructing granular outputs (intervals, fuzzy sets, etc.). The performance of the granular model is optimized through adjusting the random deviation added to the outputs of each local model and quantified by the coverage and specificity of the granular results. Experimental studies demonstrate that the proposed active aggregation mechanism can effectively improve the performance of the resulting granular models.

[1]  Witold Pedrycz,et al.  Granular Fuzzy Regression Domain Adaptation in Takagi–Sugeno Fuzzy Models , 2018, IEEE Transactions on Fuzzy Systems.

[2]  Madhu S. Nair,et al.  Image reconstruction from random samples using multiscale regression framework , 2016, Neurocomputing.

[3]  Reza Aghajani,et al.  The hydrodynamic limit of a randomized load balancing network , 2017, The Annals of Applied Probability.

[4]  Witold Pedrycz,et al.  Development of granular models through the design of a granular output spaces , 2017, Knowl. Based Syst..

[5]  Lotfi A. Zadeh,et al.  Toward a generalized theory of uncertainty (GTU)--an outline , 2005, Inf. Sci..

[6]  Witold Pedrycz,et al.  Granular Data Aggregation: An Adaptive Principle of the Justifiable Granularity Approach , 2019, IEEE Transactions on Cybernetics.

[7]  J. Domingo-Ferrer,et al.  Multi-Dimensional Randomized Response , 2020, IEEE Transactions on Knowledge and Data Engineering.

[8]  Witold Pedrycz,et al.  From fuzzy rule-based models to their granular generalizations , 2017, Knowl. Based Syst..

[9]  Witold Pedrycz,et al.  Cluster-Centric Fuzzy Modeling , 2014, IEEE Transactions on Fuzzy Systems.

[10]  Pierre Moulin,et al.  On Information-Theoretic Characterizations of Markov Random Fields and Subfields , 2019, IEEE Transactions on Information Theory.

[11]  Yiyu Yao,et al.  Three-way granular computing, rough sets, and formal concept analysis , 2020, Int. J. Approx. Reason..

[12]  Yubo Du,et al.  Asynchronous Stochastic Gradient Descent Over Decentralized Datasets , 2021, IEEE Transactions on Control of Network Systems.

[13]  Tsau Young Lin,et al.  Topological and Fuzzy Rough Sets , 1992, Intelligent Decision Support.

[14]  Wen Yu,et al.  Randomized algorithms for nonlinear system identification with deep learning modification , 2016, Inf. Sci..

[15]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[16]  Witold Pedrycz,et al.  Hierarchical System Modeling , 2018, IEEE Transactions on Fuzzy Systems.

[17]  Jinhai Li,et al.  Granule description in knowledge granularity and representation , 2020, Knowl. Based Syst..

[18]  Richa Singh,et al.  Adaptive latent fingerprint segmentation using feature selection and random decision forest classification , 2017, Inf. Fusion.

[19]  Chang-Dong Wang,et al.  A Local Consensus Index Scheme for Random-Valued Impulse Noise Detection Systems , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Witold Pedrycz,et al.  Granular Computing: Perspectives and Challenges , 2013, IEEE Transactions on Cybernetics.

[21]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[22]  Wei-Zhi Wu,et al.  A comparison study of similarity measures for covering-based neighborhood classifiers , 2018, Inf. Sci..

[23]  Peng-Bo Zhang,et al.  A New Learning Paradigm for Random Vector Functional-Link Network: RVFL+ , 2017, Neural Networks.

[24]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[25]  Wen Yu,et al.  Data-Driven Fuzzy Modeling Using Restricted Boltzmann Machines and Probability Theory , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  Ming Li,et al.  Insights into randomized algorithms for neural networks: Practical issues and common pitfalls , 2017, Inf. Sci..

[27]  Giuseppe Marino,et al.  Object similarity measures and Pawlak's indiscernibility on decision tables , 2020, Inf. Sci..

[28]  Degang Chen,et al.  Information fusion and numerical characterization of a multi-source information system , 2018, Knowl. Based Syst..

[29]  Fabio Roli,et al.  Randomized Prediction Games for Adversarial Machine Learning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Witold Pedrycz,et al.  A Development of Granular Input Space in System Modeling , 2019, IEEE Transactions on Cybernetics.

[31]  Wang-Chien Lee,et al.  Querying Distributed Spatial Datasets with Unknown Regions , 2014, IEEE Transactions on Knowledge and Data Engineering.

[32]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[33]  Ian C. Marschner,et al.  Random Ordering of Semiprimes , 2018, Exp. Math..

[34]  W. Pedrycz,et al.  Construction and Evaluation of Information Granules: From the Perspective of Clustering , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Witold Pedrycz,et al.  A Development of Hierarchically Structured Granular Models Realized Through Allocation of Information Granularity , 2021, IEEE Transactions on Fuzzy Systems.

[36]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[37]  Rajeev Motwani,et al.  Randomized Algorithms , 1995, SIGA.

[38]  Lotfi A. Zadeh,et al.  From Computing with Numbers to Computing with Words - from Manipulation of Measurements to Manipulation of Perceptions , 2005, Logic, Thought and Action.

[39]  Witold Pedrycz,et al.  Building the fundamentals of granular computing: A principle of justifiable granularity , 2013, Appl. Soft Comput..

[40]  Huaxiang Zhang,et al.  RWO-Sampling: A random walk over-sampling approach to imbalanced data classification , 2014, Inf. Fusion.

[41]  Hyun Ah Song,et al.  Efficient and Distributed Generalized Canonical Correlation Analysis for Big Multiview Data , 2019, IEEE Transactions on Knowledge and Data Engineering.