An Intelligent Multi-View Active Learning Method Based on a Double-Branch Network

Artificial intelligence is one of the most popular topics in computer science. Convolutional neural network (CNN), which is an important artificial intelligence deep learning model, has been widely used in many fields. However, training a CNN requires a large amount of labeled data to achieve a good performance but labeling data is a time-consuming and laborious work. Since active learning can effectively reduce the labeling effort, we propose a new intelligent active learning method for deep learning, which is called multi-view active learning based on double-branch network (MALDB). Different from most existing active learning methods, our proposed MALDB first integrates two Bayesian convolutional neural networks (BCNNs) with different structures as two branches of a classifier to learn the effective features for each sample. Then, MALDB performs data analysis on unlabeled dataset and queries the useful unlabeled samples based on different characteristics of two branches to iteratively expand the training dataset and improve the performance of classifier. Finally, MALDB combines multiple level information from multiple hidden layers of BCNNs to further improve the stability of sample selection. The experiments are conducted on five extensively used datasets, Fashion-MNIST, Cifar-10, SVHN, Scene-15 and UIUC-Sports, the experimental results demonstrate the validity of our proposed MALDB.

[1]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[2]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[4]  Chenggang Yan,et al.  Towards Better Uncertainty Sampling: Active Learning with Multiple Views for Deep Convolutional Neural Network , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Andrew Y. Ng,et al.  Reading Digits in Natural Images with Unsupervised Feature Learning , 2011 .

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Baowei Wang,et al.  Air Quality Forecasting Based on Gated Recurrent Long Short Term Memory Model in Internet of Things , 2019, IEEE Access.

[8]  Shuren Zhou,et al.  Improved VGG Model for Road Traffic Sign Recognition , 2018 .

[9]  Chin-Teng Lin,et al.  Multi-View Vehicle Detection Based on Fusion Part Model With Active Learning , 2020 .

[10]  Zoubin Ghahramani,et al.  Deep Bayesian Active Learning with Image Data , 2017, ICML.

[11]  Jinoh Kim,et al.  An Empirical Study on Network Anomaly Detection Using Convolutional Neural Networks , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[12]  José Bento,et al.  Generative Adversarial Active Learning , 2017, ArXiv.

[13]  Silvio Savarese,et al.  Active Learning for Convolutional Neural Networks: A Core-Set Approach , 2017, ICLR.

[14]  Dongfeng Yuan,et al.  Deep Transfer Learning for Intelligent Cellular Traffic Prediction Based on Cross-Domain Big Data , 2019, IEEE Journal on Selected Areas in Communications.

[15]  Ion Muslea,et al.  Active Learning with Multiple Views , 2009, Encyclopedia of Data Warehousing and Mining.

[16]  Zoubin Ghahramani,et al.  Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference , 2015, ArXiv.

[17]  Giuseppe Aceto,et al.  Mobile Encrypted Traffic Classification Using Deep Learning: Experimental Evaluation, Lessons Learned, and Challenges , 2019, IEEE Transactions on Network and Service Management.

[18]  Baoxue Zhang,et al.  Active Discriminative Dictionary Learning for Weather Recognition , 2016 .

[19]  Shiliang Sun,et al.  Multiple-view multiple-learner active learning , 2010, Pattern Recognit..

[20]  Giuseppe Aceto,et al.  MIMETIC: Mobile encrypted traffic classification using multimodal deep learning , 2019, Comput. Networks.

[21]  Wei Li,et al.  A Dual-Chaining Watermark Scheme for Data Integrity Protection in Internet of Things , 2019 .

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Dan Wang,et al.  A new active labeling method for deep learning , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[24]  Ruimao Zhang,et al.  Cost-Effective Active Learning for Deep Image Classification , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Rui Wang,et al.  Multi-task Joint Sparse Representation Classification Based on Fisher Discrimination Dictionary Learning , 2018 .

[26]  Huiyu Sun,et al.  Analyzing Cross-domain Transportation Big Data of New York City with Semi-supervised and Active Learning , 2018 .

[27]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[28]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[30]  Chao Bi,et al.  Multicriteria-Based Active Discriminative Dictionary Learning for Scene Recognition , 2018, IEEE Access.

[31]  Marco Fiore,et al.  Multi-Service Mobile Traffic Forecasting via Convolutional Long Short-Term Memories , 2019, 2019 IEEE International Symposium on Measurements & Networking (M&N).

[32]  Saeid Homayouni,et al.  A GA-Based Multi-View, Multi-Learner Active Learning Framework for Hyperspectral Image Classification , 2020, Remote. Sens..

[33]  R. Bharat Rao,et al.  Bayesian Co-Training , 2007, J. Mach. Learn. Res..

[34]  Lei Zhang,et al.  Fine-Tuning Convolutional Neural Networks for Biomedical Image Analysis: Actively and Incrementally , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[36]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[37]  Sheng-Jun Huang,et al.  Cost-Effective Training of Deep CNNs with Active Model Adaptation , 2018, KDD.

[38]  Fei-Fei Li,et al.  What, where and who? Classifying events by scene and object recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[39]  Ashish Kapoor,et al.  Active learning for large multi-class problems , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Yugen Yi,et al.  Scene Recognition via Semi-Supervised Multi-Feature Regression , 2019, IEEE Access.

[41]  Zhi-Hua Zhou,et al.  On multi-view active learning and the combination with semi-supervised learning , 2008, ICML '08.