Realizing Two-View TSK Fuzzy Classification System by Using Collaborative Learning

In this paper, a novel Takagi-Sugeno-Kang (TSK) fuzzy classification system (FCS) is firstly presented for pattern classification tasks. It is distinguished by having the large margin criterion properly integrated into its objective function. In order to exploit the applicability of fuzzy systems in multiview scenarios, the proposed TSK-FCS is extended to a two-view version, called two-view TSK-FCS (TwoV-TSK-FCS), by using a collaborative learning mechanism. The adopted collaborative learning mechanism not only fully considers the independent information of each view, but also effectively discovers the correlation information hidden in the two views. Thus, the performance of TwoV-TSK-FCS can be enhanced accordingly. Comprehensive experiments on two-view synthetic and UCI datasets demonstrate the effectiveness of the proposed two-view FCS.

[1]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Pengjiang Qian,et al.  Collaborative Fuzzy Clustering From Multiple Weighted Views , 2015, IEEE Transactions on Cybernetics.

[3]  Ioannis B. Theocharis,et al.  A GA-based fuzzy modeling approach for generating TSK models , 2002, Fuzzy Sets Syst..

[4]  Ruonan Li,et al.  Discriminative virtual views for cross-view action recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Zhaohong Deng,et al.  Scalable TSK Fuzzy Modeling for Very Large Datasets Using Minimal-Enclosing-Ball Approximation , 2011, IEEE Transactions on Fuzzy Systems.

[6]  Ryohei Nakano,et al.  Optimizing Support Vector regression hyperparameters based on cross-validation , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[7]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[8]  Grigorios Tzortzis,et al.  Multiple View Clustering Using a Weighted Combination of Exemplar-Based Mixture Models , 2010, IEEE Transactions on Neural Networks.

[9]  R. Bharat Rao,et al.  Bayesian Co-Training , 2007, J. Mach. Learn. Res..

[10]  Chia-Feng Juang,et al.  TS-fuzzy system-based support vector regression , 2009, Fuzzy Sets Syst..

[11]  Cheng-Chew Lim,et al.  Dual /spl nu/-support vector machine with error rate and training size biasing , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[12]  Aristidis Likas,et al.  Convex Mixture Models for Multi-view Clustering , 2009, ICANN.

[13]  John Shawe-Taylor,et al.  Two view learning: SVM-2K, Theory and Practice , 2005, NIPS.

[14]  Chia-Feng Juang,et al.  Speedup of Implementing Fuzzy Neural Networks With High-Dimensional Inputs Through Parallel Processing on Graphic Processing Units , 2011, IEEE Transactions on Fuzzy Systems.

[15]  Dan Zhang,et al.  Multi-view transfer learning with a large margin approach , 2011, KDD.

[16]  Chia-Feng Juang,et al.  Object Detection Using Color Entropies and a Fuzzy Classifier , 2013, IEEE Computational Intelligence Magazine.

[17]  Sham M. Kakade,et al.  Multi-view Regression Via Canonical Correlation Analysis , 2007, COLT.

[18]  A. Belmehdi,et al.  Multi-objective optimization of TSK fuzzy models , 2008, SSD 2008.

[19]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[20]  James C. Bezdek,et al.  Some new indexes of cluster validity , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Zhaohong Deng,et al.  Knowledge-leverage-based TSK Fuzzy System modeling. , 2013, IEEE transactions on neural networks and learning systems.

[22]  E. H. Mamdani,et al.  Application of Fuzzy Logic to Approximate Reasoning Using Linguistic Synthesis , 1976, IEEE Transactions on Computers.

[23]  G. Feng,et al.  A Survey on Analysis and Design of Model-Based Fuzzy Control Systems , 2006, IEEE Transactions on Fuzzy Systems.

[24]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..

[25]  Witold Pedrycz,et al.  COLLABORATIVE AND KNOWLEDGE-BASED FUZZY CLUSTERING , 2007 .

[26]  Hisao Ishibuchi,et al.  Effect of rule weights in fuzzy rule-based classification systems , 2001, IEEE Trans. Fuzzy Syst..

[27]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[28]  Song-Shyong Chen,et al.  Robust TSK fuzzy modeling for function approximation with outliers , 2001, IEEE Trans. Fuzzy Syst..

[29]  Chia-Feng Juang,et al.  Evolutionary Fuzzy Control and Navigation for Two Wheeled Robots Cooperatively Carrying an Object in Unknown Environments , 2015, IEEE Transactions on Cybernetics.

[30]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[31]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[32]  Zhaohong Deng,et al.  Knowledge-Leverage-Based Fuzzy System and Its Modeling , 2013, IEEE Transactions on Fuzzy Systems.

[33]  John Yen,et al.  Improving the interpretability of TSK fuzzy models by combining global learning and local learning , 1998, IEEE Trans. Fuzzy Syst..

[34]  Ivor W. Tsang,et al.  Co-labeling: A New Multi-view Learning Approach for Ambiguous Problems , 2012, 2012 IEEE 12th International Conference on Data Mining.

[35]  Chia-Feng Juang,et al.  A Fuzzy Model With Online Incremental SVM and Margin-Selective Gradient Descent Learning for Classification Problems , 2014, IEEE Transactions on Fuzzy Systems.

[36]  Ioannis B. Theocharis,et al.  Decision Fusion of GA Self-Organizing Neuro-Fuzzy Multilayered Classifiers for Land Cover Classification Using Textural and Spectral Features , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Korris Fu-Lai Chung,et al.  Cascaded centralized TSK fuzzy system: universal approximator and high interpretation , 2005, Appl. Soft Comput..

[38]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[39]  Gerardo M. Mendez,et al.  Hybrid learning mechanism for interval A2-C1 type-2 non-singleton type-2 Takagi-Sugeno-Kang fuzzy logic systems , 2013, Inf. Sci..

[40]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[41]  Yunming Ye,et al.  TW-k-means: Automated two-level variable weighting clustering algorithm for multiview data , 2013, IEEE Transactions on Knowledge and Data Engineering.

[42]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[43]  Guillaume Cleuziou,et al.  CoFKM: A Centralized Method for Multiple-View Clustering , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[44]  Steven C. H. Hoi,et al.  Multiview Semi-Supervised Learning with Consensus , 2012, IEEE Transactions on Knowledge and Data Engineering.

[45]  Longbing Cao,et al.  Minimax Probability TSK Fuzzy System Classifier: A More Transparent and Highly Interpretable Classification Model , 2015, IEEE Transactions on Fuzzy Systems.

[46]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[47]  Saharon Rosset,et al.  A new multi-view regression approach with an application to customer wallet estimation , 2006, KDD '06.

[48]  Vikas Sindhwani,et al.  An RKHS for multi-view learning and manifold co-regularization , 2008, ICML '08.

[49]  Rama Chellappa,et al.  View Invariance for Human Action Recognition , 2005, International Journal of Computer Vision.

[50]  Ling Shao,et al.  Multi-view action recognition using local similarity random forests and sensor fusion , 2013, Pattern Recognit. Lett..

[51]  José M. Alonso,et al.  Multi-objective design of highly interpretable fuzzy rule-based classifiers with semantic cointension , 2011, 2011 IEEE 5th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[52]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[53]  Shiliang Sun,et al.  Multi-view Laplacian Support Vector Machines , 2011, ADMA.

[54]  Jesús Alcalá-Fdez,et al.  A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning , 2011, IEEE Transactions on Fuzzy Systems.

[55]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[56]  Francisco Herrera,et al.  A Review of the Application of Multiobjective Evolutionary Fuzzy Systems: Current Status and Further Directions , 2013, IEEE Transactions on Fuzzy Systems.

[57]  Wan-Jui Lee,et al.  A TSK-type neurofuzzy network approach to system modeling problems , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[58]  Virginia R. de Sa,et al.  Learning Classification with Unlabeled Data , 1993, NIPS.

[59]  Shiliang Sun,et al.  An Algorithm on Multi-View Adaboost , 2010, ICONIP.

[60]  Panos M. Pardalos,et al.  hGA: Hybrid genetic algorithm in fuzzy rule-based classification systems for high-dimensional problems , 2012, Appl. Soft Comput..

[61]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[62]  Markus Reischl,et al.  Takagi--Sugeno--Kang Fuzzy Classifiers for a Special Class of Time-Varying Systems , 2008, IEEE Transactions on Fuzzy Systems.

[63]  Fuchun Sun,et al.  Hierarchical Structured Sparse Representation for T–S Fuzzy Systems Identification , 2013, IEEE Transactions on Fuzzy Systems.

[64]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[65]  Patrick Pérez,et al.  Cross-View Action Recognition from Temporal Self-similarities , 2008, ECCV.

[66]  Gerardo M. Mendez,et al.  Interval Type-1 Non-Singleton Type-2 TSK Fuzzy Logic Systems Using the Hybrid Training Method RLS-BP , 2007, FOCI.

[67]  Chia-Feng Juang,et al.  Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color Segmentation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[68]  Aristidis Likas,et al.  Kernel-Based Weighted Multi-view Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining.

[69]  Yu-Ching Lin,et al.  A TSK-type fuzzy neural network (TFNN) systems for dynamic systems identification , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[70]  Ferenc Szeifert,et al.  Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization , 2003, Int. J. Approx. Reason..

[71]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[72]  M. Masudur Rahman,et al.  Moving Vehicle Classification Using Eigenspace , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Hiok Chai Quek,et al.  GA-TSKfnn: Parameters tuning of fuzzy neural network using genetic algorithms , 2005, Expert Syst. Appl..

[74]  Chia-Feng Juang,et al.  Evolutionary Robot Wall-Following Control Using Type-2 Fuzzy Controller With Species-DE-Activated Continuous ACO , 2013, IEEE Transactions on Fuzzy Systems.

[75]  George W. Irwin,et al.  A New Gradient Descent Approach for Local Learning of Fuzzy Neural Models , 2013, IEEE Transactions on Fuzzy Systems.

[76]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.