Multi-view Multi-label Learning with Dual-Attention Networks for Stroke Screen

With the acceleration of urbanization, there is an explosive growth trend of the stroke burden in China. Consequently, it is necessary to adopt a regular screen to reduce brain damage and other complications. For one thing, the risk factors screened can be divided into 6 subsets: medical history, family history, fasting blood, lifestyle, physical characteristics, and demographic information. For another, the screen results can be categorized into 5 groups: normal carotid plaque, thickening, unstable plaque, and arterial stenosis. To address the above problems, Multi-View Multi-Label (MVML) learning provides a fundamental framework for handling such tasks, which treats the risk factors as multi-view data and the screen results as multi-label data. Besides, it is a challenging issue of how to effectively utilize view correlations and label correlations in MVML learning. In this paper, we propose a novel Multi-view Multi-label Learning with Dual-Attention Networks (MML-DAN) for stroke screen, which can strike a balance between label-specific views and label correlations. Meanwhile, the attention mechanism aims to focus on the most pertinent information of the corresponding labels rather than using all available risk factors equally. Experiments on one real-world dataset of stroke screen demonstrate the superiority of the proposed MML-DAN for stroke screen prediction. To further validate the effectiveness and generalization capability of MML-DAN, extensive experiments on 5 benchmark MVML datasets show that MML-DAN significantly outperforms other state-of-the-art MVML algorithms.

[1]  Zili Zhang,et al.  Multi-Label Co-Training , 2018, IJCAI.

[2]  Xiaobo Wang,et al.  Multi-View Multi-Label Learning with View-Specific Information Extraction , 2019, IJCAI.

[3]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[4]  Qinghua Hu,et al.  Latent Semantic Aware Multi-View Multi-Label Classification , 2018, AAAI.

[5]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Xiaolin Li,et al.  College Student Scholarships and Subsidies Granting: A Multi-modal Multi-label Approach , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[7]  Jieping Ye,et al.  Jointly Modeling Label and Feature Heterogeneity in Medical Informatics , 2016, ACM Trans. Knowl. Discov. Data.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[10]  Ji Liu,et al.  Deep Embedded Complementary and Interactive Information for Multi-View Classification , 2020, AAAI.

[11]  Zhi-Hua Zhou,et al.  Dual Set Multi-Label Learning , 2018, AAAI.

[12]  Xindong Wu,et al.  Learning Label Specific Features for Multi-label Classification , 2015, 2015 IEEE International Conference on Data Mining.

[13]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[14]  Zhongfei Zhang,et al.  Simultaneously Combining Multi-view Multi-label Learning with Maximum Margin Classification , 2012, 2012 IEEE 12th International Conference on Data Mining.

[15]  Feiping Nie,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Multi-View K-Means Clustering on Big Data , 2022 .

[16]  Bo An,et al.  Collaboration based Multi-Label Learning , 2019, AAAI.

[17]  Andrew McCallum,et al.  Collective multi-label classification , 2005, CIKM '05.

[18]  Ming Yang,et al.  Bidirectional Long Short-Term Memory Networks for Relation Classification , 2015, PACLIC.

[19]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jun Zhou,et al.  Semi-supervised Multi-view Individual and Sharable Feature Learning for Webpage Classification , 2019, WWW.

[21]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[22]  Zhi-Hua Zhou,et al.  Multi-Label Learning with Global and Local Label Correlation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[23]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[24]  Hao Cheng,et al.  Many Could be Better Than All: A Novel Instance-Oriented Algorithm for Multi-modal Multi-label Problem , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.