A naive learning algorithm for class‐bridge‐decomposable multidimensional Bayesian network classifiers

Multidimensional Bayesian network classifier (MBC) has become a popular classification model because of their intuitive graphical representation ability among class variables. But learning MBC and performing multidimensional classification based on the MBC can be very computationally demanding. For the tractability of performing multidimensional classification, a class‐bridge‐decomposable (CB‐decomposable) MBC model is proposed and it alleviates the computation complexity. But there are few works to efficiently and systematically learn the CB‐decomposable MBC model. Thus, we focus on addressing a naive learning algorithm of CB‐decomposable MBCs. Briefly, we learn the CB‐decomposable MBC model by dividing it into three components: class subgraph, bridge subgraph, and feature subgraph. First, we analyze why the class subgraph can be learned based on general Bayesian network learning methods. Second, we give how to learn bridge subgraph based on information gain ratio. Third, to make the CB‐decomposable MBC model effective and simple, we also study the learning and updating strategies of feature subgraph. Further, we propose the naive learning algorithm of the CB‐decomposable MBC. Finally, by comparing with other methods on several benchmark datasets, experimental results illustrate that our naive learning algorithm not only has higher accuracies, lower learning, and classification times but also has simple and intuitive representation ability.

[1]  Jinjun Chen,et al.  Differential Privacy Techniques for Cyber Physical Systems: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[2]  Zhihua Cui,et al.  Hybrid many-objective particle swarm optimization algorithm for green coal production problem , 2020, Inf. Sci..

[3]  Yun Zhou,et al.  When and where to transfer for Bayesian network parameter learning , 2016, Expert Syst. Appl..

[4]  Jinjun Chen,et al.  A Novel Bat Algorithm with Multiple Strategies Coupling for Numerical Optimization , 2019, Mathematics.

[5]  Jinjun Chen,et al.  A two-stage locality-sensitive hashing based approach for privacy-preserving mobile service recommendation in cross-platform edge environment , 2018, Future Gener. Comput. Syst..

[6]  Qingming Huang,et al.  Joint Feature Selection and Classification for Multilabel Learning , 2018, IEEE Transactions on Cybernetics.

[7]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[8]  Penghong Wang,et al.  Multi-Objective Three-Dimensional DV-Hop Localization Algorithm With NSGA-II , 2019, IEEE Sensors Journal.

[9]  Jinjun Chen,et al.  Special Focus on Pigeon-Inspired Optimization A pigeon-inspired optimization algorithm for many-objective optimization problems , 2019 .

[10]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[11]  Zhi-Hua Zhou,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006, IEEE Transactions on Knowledge and Data Engineering.

[12]  Zhihua Cui,et al.  An under‐sampled software defect prediction method based on hybrid multi‐objective cuckoo search , 2019, Concurr. Comput. Pract. Exp..

[13]  Yu Xue,et al.  A novel oriented cuckoo search algorithm to improve DV-Hop performance for cyber-physical systems , 2017, J. Parallel Distributed Comput..

[14]  Glenn Fung,et al.  Automated Heart Wall Motion Abnormality Detection from Ultrasound Images Using Bayesian Networks , 2007, IJCAI.

[15]  ZhouZhi-Hua,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006 .

[16]  Concha Bielza,et al.  International Journal of Approximate Reasoning Tractability of most probable explanations in multidimensional Bayesian network classifiers ✩ , 2022 .

[17]  Penghong Wang,et al.  A Gaussian error correction multi‐objective positioning model with NSGA‐II , 2019, Concurr. Comput. Pract. Exp..

[18]  Lei Du,et al.  Malicious code detection based on CNNs and multi-objective algorithm , 2019, J. Parallel Distributed Comput..

[19]  Linda C. van der Gaag,et al.  Multi-dimensional Bayesian Network Classifiers , 2006, Probabilistic Graphical Models.

[20]  Harry Zhang,et al.  A Fast Decision Tree Learning Algorithm , 2006, AAAI.

[21]  Tieniu Tan,et al.  Deep semantic ranking based hashing for multi-label image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  José Antonio Lozano,et al.  Multi-Objective Learning of Multi-Dimensional Bayesian Classifiers , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[23]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[24]  Jinjun Chen,et al.  Detection of Malicious Code Variants Based on Deep Learning , 2018, IEEE Transactions on Industrial Informatics.

[25]  Linda C. van der Gaag,et al.  Inference and Learning in Multi-dimensional Bayesian Network Classifiers , 2007, ECSQARU.

[26]  Kun Zhang,et al.  Multi-label learning by exploiting label dependency , 2010, KDD.

[27]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[28]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[29]  Concha Bielza,et al.  Multi-dimensional classification with Bayesian networks , 2011, Int. J. Approx. Reason..