Understanding Negations in Information Processing: Learning from Replicating Human Behavior

Information systems experience an ever-growing volume of unstructured data, particularly in the form of textual materials. This represents a rich source of information from which one can create value for people, organizations and businesses. For instance, recommender systems can benefit from automatically understanding preferences based on user reviews or social media. However, it is difficult for computer programs to correctly infer meaning from narrative content. One major challenge is negations that invert the interpretation of words and sentences. As a remedy, this paper proposes a novel learning strategy to detect negations: we apply reinforcement learning to and a policy that replicates the human perception of negations based on an exogenous response, such as a user rating for reviews. Our method yields several benefits, as it eliminates the former need for expensive and subjective manual labeling in an intermediate stage. Moreover, the inferred policy can be used to derive statistical inferences and implications regarding how humans process and act on negations.

[1]  Christopher S. G. Khoo,et al.  Aspect-based sentiment analysis of movie reviews on discussion boards , 2010, J. Inf. Sci..

[2]  Tim Loughran,et al.  When is a Liability not a Liability? Textual Analysis, Dictionaries, and 10-Ks , 2010 .

[3]  Maite Taboada,et al.  A machine‐learning approach to negation and speculation detection for sentiment analysis , 2016, J. Assoc. Inf. Sci. Technol..

[4]  J. Campbell,et al.  Event Studies in Economics and Finance , 1997 .

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Michael P. Wellman,et al.  Nash Q-Learning for General-Sum Stochastic Games , 2003, J. Mach. Learn. Res..

[7]  Manuel J. Maña López,et al.  A machine-learning approach to negation and speculation detection in clinical texts , 2012, J. Assoc. Inf. Sci. Technol..

[8]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[9]  Alan R. Hevner,et al.  Towards a NeuroIS Research Methodology: Intensifying the Discussion on Methods, Tools, and Measurement , 2014, J. Assoc. Inf. Syst..

[10]  Param Vir Singh,et al.  Blog, Blogger, and the Firm: Can Negative Employee Posts Lead to Positive Outcomes? , 2012, Inf. Syst. Res..

[11]  Robert O. Briggs Special Section: Cognitive Perspectives on Information Systems , 2015, J. Manag. Inf. Syst..

[12]  Jay F. Nunamaker,et al.  Toward a broader vision for Information Systems , 2011, TMIS.

[13]  Dharmendra S. Modha,et al.  Cognitive Computing , 2011, Informatik-Spektrum.

[14]  Isaac G. Councill,et al.  What's great and what's not: learning to classify the scope of negation for improved sentiment analysis , 2010, NeSp-NLP@ACL.

[15]  Stefan Stieglitz,et al.  Emotions and Information Diffusion in Social Media—Sentiment of Microblogs and Sharing Behavior , 2013, J. Manag. Inf. Syst..

[16]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[17]  William N. Robinson,et al.  Two Rule-Based Natural Language Strategies for Requirements Discovery and Classification in Open Source Software Development Projects , 2012, J. Manag. Inf. Syst..

[18]  Clement T. Yu,et al.  The effect of negation on sentiment analysis and retrieval effectiveness , 2009, CIKM.

[19]  Wen-Ran Zhang,et al.  POOL: A Semantic Model for Approximate Reasoning and Its Application in Decision Support , 1987, J. Manag. Inf. Syst..

[20]  Uzay Kaymak,et al.  Determining negation scope and strength in sentiment analysis , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[21]  Gregory E. Kersten,et al.  Effects of Language Familiarity on e-Negotiation: Use of Native vs. Nonnative Language , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[22]  Angelika Dimoka,et al.  THE POTENTIAL OF COGNITIVE NEUROSCIENCE FOR INFORMATION SYSTEMS RESEARCH , 2008 .

[23]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[24]  Dietrich Klakow,et al.  A survey on the role of negation in sentiment analysis , 2010, NeSp-NLP@ACL.

[25]  Sofus A. Macskassy,et al.  More than Words: Quantifying Language to Measure Firms' Fundamentals the Authors Are Grateful for Assiduous Research Assistance from Jie Cao and Shuming Liu. We Appreciate Helpful Comments From , 2007 .

[26]  Maite Taboada,et al.  Lexicon-Based Methods for Sentiment Analysis , 2011, CL.

[27]  Samuel Gershman,et al.  Statistical Computations Underlying the Dynamics of Memory Updating , 2014, PLoS Comput. Biol..

[28]  Mary Lacity,et al.  Understanding Qualitative Data: A Framework of Text Analysis Methods , 1994, J. Manag. Inf. Syst..

[29]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[30]  Lior Rokach,et al.  Negation recognition in medical narrative reports , 2008, Information Retrieval.

[31]  Christie M. Fuller,et al.  An Examination and Validation of Linguistic Constructs for Studying High-Stakes Deception , 2013 .

[32]  Daniel Gooch,et al.  Communications of the ACM , 2011, XRDS.

[33]  S. Jay Samuels,et al.  Toward a theory of automatic information processing in reading , 1974 .

[34]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[35]  Douglas P. Twitchell,et al.  Negotiation Outcome Classification Using Language Features , 2012, Group Decision and Negotiation.

[36]  Jennifer Jie Xu,et al.  Business Intelligence in Blogs: Understanding Consumer Interactions and Communities , 2012, MIS Q..

[37]  Daniel E. O'Leary,et al.  Event Study Methodologies in Information Systems Research , 2011, Int. J. Account. Inf. Syst..

[38]  Christopher D. Manning,et al.  Advances in natural language processing , 2015, Science.

[39]  Fred D. Davis,et al.  NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research , 2008, ICIS.

[40]  Peter D. Turney Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[41]  Jason J. Jung,et al.  Understanding Effect of Sentiment Content Toward Information Diffusion Pattern in Online Social Networks: A Case Study on TweetScope , 2013, ICCASA.

[42]  Jan Muntermann,et al.  Intraday Stock Price Effects of Ad Hoc Disclosures: The German Case , 2007 .

[43]  Daniel Robey,et al.  Human Information Processing in Information and Decisoin Support Systems , 1982, MIS Q..

[44]  P. Johnson-Laird,et al.  Negation: A theory of its meaning, representation, and use , 2012 .

[45]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[46]  Jay F. Nunamaker,et al.  A Comparison of Classification Methods for Predicting Deception in Computer-Mediated Communication , 2004, J. Manag. Inf. Syst..

[47]  Shahper Vodanovich,et al.  Research Commentary - Digital Natives and Ubiquitous Information Systems , 2010, Inf. Syst. Res..

[48]  Stefan Feuerriegel,et al.  Detecting Negation Scopes for Financial News Sentiment Using Reinforcement Learning , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[49]  Angelika Dimoka,et al.  On the Use of Neuropyhsiological Tools in IS Research: Developing a Research Agenda for NeuroIS , 2012, MIS Q..

[50]  Stefan Feuerriegel,et al.  Enhancing Sentiment Analysis of Financial News by Detecting Negation Scopes , 2015, 2015 48th Hawaii International Conference on System Sciences.

[51]  Matthew L. Jensen,et al.  Credibility of Anonymous Online Product Reviews: A Language Expectancy Perspective , 2013, J. Manag. Inf. Syst..

[52]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[53]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[54]  Franciska de Jong,et al.  Scope of negation detection in sentiment analysis , 2011 .

[55]  Alan R. Dennis,et al.  Putting on the Thinking Cap: Using NeuroIS to Understand Information Processing Biases in Virtual Teams , 2014, J. Manag. Inf. Syst..

[56]  Kate Sweeny,et al.  Do You Want the Good News or the Bad News First? The Nature and Consequences of News Order Preferences , 2014, Personality & social psychology bulletin.

[57]  Norman A. Johnson,et al.  Understanding the Influence of Instant Messaging on Ending Concessions During Negotiations , 2015, J. Manag. Inf. Syst..

[58]  S. Sameen Fatima,et al.  Evaluating Sentiment Analysis Methods and Identifying Scope of Negation in Newspaper Articles , 2014 .

[59]  Chenchuramaiah T. Bathala Giving Content to Investor Sentiment: The Role of Media in the Stock Market , 2007 .

[60]  E. Henry Are Investors Influenced By How Earnings Press Releases Are Written? , 2006 .

[61]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[62]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[63]  Robert C. Wilson,et al.  Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms , 2015, The Journal of Neuroscience.