Granule Vectors and Granular Convolutional Classifiers

Convolutional operations can extract effective features and have been widely used in the field of deep learning. For the deficiency of convolution mainly dealing with numerical data, we propose a novel convolutional operator on granules with a set form, further we build a classifier on it. Firstly, feature granules are constructed on each single feature of a classification system by introducing neighborhood rough sets. Synchronously, decision granules are generated on the labels of samples. Secondly, feature granule vectors and weighted granule vectors are constructed from these granules, and a convolutional operation is proposed on feature granule vectors and weighted granule vectors, then a predicted granule is produced as a result of the convolutional operation. The predicted granule is compared with the decision granule, and their residual error is back propagated to the weighted granule vector for tuning its value. After multiple iterations of the granular convolutional operations and back propagation corrections, the weight of the granular vector is convergent and optimized. Furthermore, a granular classifier is designed based on the convolutional operation. The constringency of the granular convolution and the classification performance of the granular classifier are tested on some UCI datasets. Theoretical analysis and experimental results show that the granular convolution has a characteristic of fast convergence, and the granular convolutional classifier has a better classification performance.

[1]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[2]  Witold Pedrycz,et al.  Positive approximation: An accelerator for attribute reduction in rough set theory , 2010, Artif. Intell..

[3]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Sara Tedmori,et al.  Consensus-based combining method for classifier ensembles , 2018, Int. Arab J. Inf. Technol..

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jafar A. Alzubi,et al.  Diversity Based Improved Bagging Algorithm , 2015 .

[7]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[8]  Huai Li,et al.  Artificial convolution neural network for medical image pattern recognition , 1995, Neural Networks.

[9]  Harish Bhaskar,et al.  Supervised remote sensing image segmentation using boosted convolutional neural networks , 2016, Knowl. Based Syst..

[10]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[11]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[12]  Markus Thom,et al.  Rapid Exact Signal Scanning With Deep Convolutional Neural Networks , 2015, IEEE Transactions on Signal Processing.

[13]  Wen-Jyi Hwang,et al.  Fast kNN classification algorithm based on partial distance search , 1998 .

[14]  Piotr J. Slomka,et al.  Deep Learning for Quantification of Epicardial and Thoracic Adipose Tissue From Non-Contrast CT , 2018, IEEE Transactions on Medical Imaging.

[15]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[16]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[17]  Shunzhi Zhu,et al.  A binary granule representation for uncertainty measures in rough set theory , 2015, J. Intell. Fuzzy Syst..

[18]  Shunzhi Zhu,et al.  A granulated fuzzy rough set and its measures , 2018, J. Intell. Fuzzy Syst..

[19]  Rama Chellappa,et al.  On the size of Convolutional Neural Networks and generalization performance , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[20]  Jun Wang,et al.  Patch strategy for deep face recognition , 2018, IET Image Process..

[21]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[22]  Jeffrey C Grossman,et al.  Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties. , 2017, Physical review letters.

[23]  Seok-Beom Roh,et al.  A design of granular fuzzy classifier , 2014, Expert Syst. Appl..

[24]  T. Y. Lin Data Mining : Granular Computing Approach , .

[25]  Andrzej Skowron,et al.  Rough sets and Boolean reasoning , 2007, Inf. Sci..

[26]  Qinghua Hu,et al.  Adaptive neighborhood granularity selection and combination based on margin distribution optimization , 2013, Inf. Sci..

[27]  Wei Li,et al.  Granule structures, distances and measures in neighborhood systems , 2019, Knowl. Based Syst..

[28]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[29]  Rodrigo Fernandes de Mello,et al.  Designing architectures of convolutional neural networks to solve practical problems , 2018, Expert Syst. Appl..

[30]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[31]  Jiye Liang,et al.  A new measure of uncertainty based on knowledge granulation for rough sets , 2009, Inf. Sci..

[32]  Vijay K. Bhargava,et al.  Forward error correction schemes for digital communications , 1983, IEEE Communications Magazine.

[33]  Tao Zhang,et al.  Unsupervised learning to detect loops using deep neural networks for visual SLAM system , 2017, Auton. Robots.

[34]  Chao Zhang,et al.  Greedy Projected Gradient-Newton Method for Sparse Logistic Regression , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Y. Yao Information granulation and rough set approximation , 2001 .

[36]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[37]  Deepak Khosla,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2014, International Journal of Computer Vision.

[38]  Wenqi Ren,et al.  Anisotropic second and fourth order diffusion models based on Convolutional Virtual Electric Field for image denoising , 2013, Comput. Math. Appl..

[39]  G. David Forney,et al.  Convolutional codes I: Algebraic structure , 1970, IEEE Trans. Inf. Theory.

[40]  Jafar A. Alzubi,et al.  Diversity-Based Boosting Algorithm , 2016 .

[41]  Witold Pedrycz,et al.  The design of granular classifiers: A study in the synergy of interval calculus and fuzzy sets in pattern recognition , 2008, Pattern Recognit..

[42]  Yiyu Yao,et al.  Set-theoretic Approaches to Granular Computing , 2012, Fundam. Informaticae.

[43]  Tsau Young Lin,et al.  Special issue on granular computing and data mining , 2004, Int. J. Intell. Syst..

[44]  Andrew Zisserman,et al.  Reading Text in the Wild with Convolutional Neural Networks , 2014, International Journal of Computer Vision.

[45]  Vishal M. Patel,et al.  Convolutional Sparse and Low-Rank Coding-Based Image Decomposition , 2017, IEEE Transactions on Image Processing.

[46]  Xiaohui Xie,et al.  HLA class I binding prediction via convolutional neural networks , 2017, bioRxiv.