Fuzzy Explainable Attention-based Deep Active Learning on Mental-Health Data

In this paper, we propose a fuzzy classification deep attention-based model that expands emotional lexicons by using linguistic properties of actual patient authored texts. The active learning methods can expand the trained dataset and fuzzy rules over some time. As a result, the model itself can reduce its labeling efforts for mental health application. Thus, the designed model can solve issues related to vocabulary sizes per class, data sources, methods of creation, and create a baseline for human performance levels. This paper also gives fuzzy explainability by visualizing weighted words. Our proposed method uses a similarity-based method that includes a subset of unstructured data as the training set. Next, using an active learning mechanism cycle, our method updates the training model using new training points. This cycle is repeatedly performed until an optimal solution is reached. The designed model also converts all unlabeled texts into the training set. Our in-depth experimental results show that the emotion-based expansion enhances the testing accuracy and helps to build quality rules.

[1]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[2]  Gautam Srivastava,et al.  A load balance multi-scheduling model for OpenCL kernel tasks in an integrated cluster , 2020, Soft Comput..

[3]  Oscar Castillo,et al.  A novel multi-objective evolutionary algorithm with fuzzy logic based adaptive selection of operators: FAME , 2019, Inf. Sci..

[4]  Jirí Filip,et al.  Classification based on Associations (CBA) - A Performance Analysis , 2018, RuleML+RR.

[5]  Palash Dutta,et al.  Fuzzy Decision Making in Medical Diagnosis Using an Advanced Distance Measure on Intuitionistic Fuzzy Sets , 2018 .

[6]  Satrajit S. Ghosh,et al.  Natural Language Processing Reveals Vulnerable Mental Health Support Groups and Heightened Health Anxiety on Reddit During COVID-19: Observational Study , 2020, Journal of medical Internet research.

[7]  Walter F. Stewart,et al.  Doctor AI: Predicting Clinical Events via Recurrent Neural Networks , 2015, MLHC.

[8]  Haniye Sadat Sajadi,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017 , 2018, The Lancet.

[9]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[10]  Qi Li,et al.  User-level psychological stress detection from social media using deep neural network , 2014, ACM Multimedia.

[11]  Kevin Bretonnel Cohen,et al.  Natural Language Processing for Rapid Response to Emergent Diseases: Case Study of Calcium Channel Blockers and Hypertension in the COVID-19 Pandemic , 2020, Journal of medical Internet research.

[12]  Kristina Lerman,et al.  Tracking Social Media Discourse About the COVID-19 Pandemic: Development of a Public Coronavirus Twitter Data Set , 2020, JMIR public health and surveillance.

[13]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[14]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[15]  Ka I Pun,et al.  Adaptive Elements in Internet-Delivered Psychological Treatment Systems: Systematic Review , 2020, Journal of medical Internet research.

[16]  J. Kohn,et al.  Are we facing a crashing wave of neuropsychiatric sequelae of COVID-19? Neuropsychiatric symptoms and potential immunologic mechanisms , 2020, Brain, Behavior, and Immunity.

[17]  B. Strauss,et al.  Online-Befragung zur Bekanntheit von Angeboten zur Aufklärung, Prävention, Beratung und Nachsorge bei Essstörungen , 2020, Prävention und Gesundheitsförderung.

[18]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[19]  Robin C. Feldman,et al.  Artificial Intelligence in the Health care Space: How We Can Trust What We Cannot Know , 2019 .

[20]  Michael Chau,et al.  A Hybrid System for Online Detection of Emotional Distress , 2012, PAISI.

[21]  Yngve Lamo,et al.  Adaptation of IDPT System Based on Patient-Authored Text Data using NLP , 2020, 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS).

[22]  E. Bantum,et al.  Identification of Emotional Expression With Cancer Survivors: Validation of Linguistic Inquiry and Word Count , 2020, JMIR formative research.