Using an analogical reasoning framework to infer language patterns for negative life events

BackgroundFeelings of depression can be caused by negative life events (NLE) such as the death of a family member, a quarrel with one’s spouse, job loss, or strong criticism from an authority figure. The automatic and accurate identification of negative life event language patterns (NLE-LP) can help identify individuals potentially in need of psychiatric services. An NLE-LP combines a person (subject) and a reasonable negative life event (action), e.g. or < boyfriend:break_up>.MethodsThis paper proposes an analogical reasoning framework which combines a word representation approach and a pattern inference method to mine/extract NLE-LPs from psychiatric consultation documents. Word representation approaches such as skip-gram (SG) and continuous bag-of-words (CBOW) are used to generate word embeddings. Pattern inference methods such as cosine similarity (COSINE) and cosine multiplication similarity (COSMUL) are used to infer patterns.ResultsExperimental results show our proposed analogical reasoning framework outperforms the traditional methods such as positive pairwise mutual information (PPMI) and hyperspace analog to language (HAL), and can effectively mine highly precise NLE-LPs based on word embeddings. CBOW with COSINE of analogical reasoning is the best word representation and inference engine. In addition, both word embeddings and the inference engine provided by the analogical reasoning framework can further be used to improve the HAL model.ConclusionsOur proposed framework is a very simple matching function based on these word representation approaches and is applied to significantly improve HAL model mining performance.

[1]  Shu-Ping Wan,et al.  A cosine similarity based QUALIFLEX approach with hesitant fuzzy linguistic term sets for financial performance evaluation , 2018, Appl. Soft Comput..

[2]  Ana Cristina Mendes,et al.  Pattern Mining with Natural Language Processing: An Exploratory Approach , 2009, MLDM.

[3]  Tim van de Cruys.  Two Multivariate Generalizations of Pointwise Mutual Information , 2011, Proceedings of the Workshop on Distributional Semantics and Compositionality.

[4]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[5]  D. Sheffield,et al.  The relationship between adult romantic attachment anxiety, negative life events, and compliance , 2011 .

[6]  Liang-Chih Yu,et al.  Mining association language patterns using a distributional semantic model for negative life event classification , 2011, J. Biomed. Informatics.

[7]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[8]  D. Gentner,et al.  The analogical mind : perspectives from cognitive science , 2001 .

[9]  Jingcheng Du,et al.  Extracting psychiatric stressors for suicide from social media using deep learning , 2018, BMC Medical Informatics and Decision Making.

[10]  Charles L. A. Clarke,et al.  Frequency Estimates for Statistical Word Similarity Measures , 2003, NAACL.

[11]  Paolo Gastaldo,et al.  An ELM-based model for affective analogical reasoning , 2015, Neurocomputing.

[12]  Gabriel Recchia,et al.  More data trumps smarter algorithms: Comparing pointwise mutual information with latent semantic analysis , 2009, Behavior research methods.

[13]  Chung-Hsien Wu,et al.  HAL-Based Evolutionary Inference for Pattern Induction From Psychiatry Web Resources , 2008, IEEE Transactions on Evolutionary Computation.

[14]  T. Joiner,et al.  The impact of perceived social support and negative life events on bulimic symptoms. , 2011, Eating behaviors.

[15]  Dan Feng,et al.  Analogical Reasoning for Answer Ranking in Social Question Answering , 2012, IEEE Intelligent Systems.

[16]  Stijn Heymans,et al.  Large-Scale Analogical Reasoning , 2014, AAAI.

[17]  Peter Bruza,et al.  Towards context sensitive information inference , 2003, J. Assoc. Inf. Sci. Technol..

[18]  Omer Levy,et al.  Linguistic Regularities in Sparse and Explicit Word Representations , 2014, CoNLL.

[19]  Harris Wu,et al.  Evaluating Web-based Question Answering Systems , 2002, LREC.

[20]  Yoshua Bengio,et al.  A Neural Probabilistic Language Model , 2003, J. Mach. Learn. Res..

[21]  Peter Bruza,et al.  Discovering information flow suing high dimensional conceptual space , 2001, SIGIR '01.

[22]  Yoshua Bengio,et al.  Context-dependent word representation for neural machine translation , 2016, Comput. Speech Lang..

[23]  Yue Zhang,et al.  Syntactic Dependencies and Distributed Word Representations for Analogy Detection and Mining , 2015, EMNLP.

[24]  Zhao Lu,et al.  Chinese Analogy Search Considering Multi Relations , 2012, 2012 International Conference on Cloud and Service Computing.

[25]  Lung-Hao Lee,et al.  Building Chinese Affective Resources in Valence-Arousal Dimensions , 2016, NAACL.

[26]  Yue Zhang,et al.  Syntactic Dependencies and Distributed Word Representations for Chinese Analogy Detection and Mining , 2015 .

[27]  Tal Linzen,et al.  Issues in evaluating semantic spaces using word analogies , 2016, RepEval@ACL.

[28]  K. Robert Lai,et al.  Dimensional Sentiment Analysis Using a Regional CNN-LSTM Model , 2016, ACL.

[29]  Xuejie Zhang,et al.  Refining Word Embeddings Using Intensity Scores for Sentiment Analysis , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[30]  Peter D. Turney.  Similarity of Semantic Relations , 2006, CL.

[31]  Hua Xu,et al.  Recognizing clinical entities in hospital discharge summaries using Structural Support Vector Machines with word representation features , 2013, BMC Medical Informatics and Decision Making.

[32]  Surapati Pramanik,et al.  Hybrid vector similarity measures and their applications to multi-attribute decision making under neutrosophic environment , 2015, Neural Computing and Applications.

[33]  Danushka Bollegala,et al.  Using Relational Similarity between Word Pairs for Latent Relational Search on the Web , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[34]  Chung-Hsien Wu,et al.  Mining Association Language Patterns for Negative Life Event Classification , 2009, ACL.

[35]  Yi Wang,et al.  Chinese Word Segmentation based on analogy and majority voting , 2015, PACLIC.

[36]  Curt Burgess,et al.  Explorations in context space: Words, sentences, discourse , 1998 .

[37]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[38]  M. Leboyer,et al.  Positive and negative life events and reasons for living modulate suicidal ideation in a sample of patients with history of suicide attempts. , 2017, Journal of psychiatric research.

[39]  Mirna Adriani,et al.  Predicting Answer Location Using Shallow Semantic Analogical Reasoning in a Factoid Question Answering System , 2012, PACLIC.

[40]  Gilles Richard,et al.  A Short Introduction to Computational Trends in Analogical Reasoning , 2014, Computational Approaches to Analogical Reasoning.

[41]  Jen-Tzung Chien,et al.  Association pattern language modeling , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[42]  Parham Moradi,et al.  OSFSMI: Online stream feature selection method based on mutual information , 2017, Appl. Soft Comput..

[43]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[44]  Jihad S. Obeid,et al.  Word2Vec inversion and traditional text classifiers for phenotyping lupus , 2017, BMC Medical Informatics and Decision Making.

[45]  Gilles Richard,et al.  Experimenting Analogical Reasoning in Recommendation , 2015, ISMIS.