Uniting the Tribes: Using Text for Marketing Insight

Words are part of almost every marketplace interaction. Online reviews, customer service calls, press releases, marketing communications, and other interactions create a wealth of textual data. But how can marketers best use such data? This article provides an overview of automated textual analysis and details how it can be used to generate marketing insights. The authors discuss how text reflects qualities of the text producer (and the context in which the text was produced) and impacts the audience or text recipient. Next, they discuss how text can be a powerful tool both for prediction and for understanding (i.e., insights). Then, the authors overview methodologies and metrics used in text analysis, providing a set of guidelines and procedures. Finally, they further highlight some common metrics and challenges and discuss how researchers can address issues of internal and external validity. They conclude with a discussion of potential areas for future work. Along the way, the authors note how textual analysis can unite the tribes of marketing. While most marketing problems are interdisciplinary, the field is often fragmented. By involving skills and ideas from each of the subareas of marketing, text analysis has the potential to help unite the field with a common set of tools and approaches.

[1]  D. Mladenović,et al.  Social media in use , 2021, Management.

[2]  Grant Packard,et al.  How Concrete Language Shapes Customer Satisfaction , 2020 .

[3]  Koen Pauwels,et al.  Social Media's Impact on the Consumer Mindset: When to Use Which Sentiment Extraction Tool? , 2020, Journal of Interactive Marketing.

[4]  David A. Schweidel,et al.  Capturing Changes in Social Media Content: A Multiple Latent Changepoint Topic Model , 2020, Mark. Sci..

[5]  Grant Packard,et al.  Thinking of You: How Second-Person Pronouns Shape Cultural Success , 2020, Psychological science.

[6]  Mark Heitmann,et al.  The Power of Brand Selfies in Consumer-Generated Brand Images , 2020, SSRN Electronic Journal.

[7]  Jonah A. Berger,et al.  How the voice persuades. , 2020, Journal of personality and social psychology.

[8]  Robert W. Palmatier,et al.  Challenging the Boundaries of Marketing , 2019, Journal of Marketing.

[9]  R. Meyer,et al.  A Tale of Two Twitterspheres: Political Microblogging During and After the 2016 Primary and Presidential Debates , 2019, Journal of Marketing Research.

[10]  J. Aspara,et al.  Can Advertising Investments Counter the Negative Impact of Shareholder Complaints on Firm Value? , 2019, Journal of Marketing.

[11]  Gerard J. Tellis,et al.  What Drives Virality (Sharing) of Online Digital Content? The Critical Role of Information, Emotion, and Brand Prominence , 2019, Journal of Marketing.

[12]  Carey K. Morewedge,et al.  Resistance To Medical Artificial Intelligence , 2019, Journal of Consumer Research.

[13]  Beth L. Fossen,et al.  Social TV, Advertising, and Sales: Are Social Shows Good for Advertisers? , 2019, Mark. Sci..

[14]  Mark Heitmann,et al.  Comparing automated text classification methods , 2019, International Journal of Research in Marketing.

[15]  Moonhee Cho,et al.  Hashtag activism and message frames among social movement organizations: Semantic network analysis and thematic analysis of Twitter during the #MeToo movement , 2019, Public Relations Review.

[16]  Gary F. Gebhardt,et al.  Market Intelligence Dissemination Practices , 2019, Journal of Marketing.

[17]  Florian Stahl,et al.  The Extreme Distribution of Online Reviews: Prevalence, Drivers and Implications , 2019 .

[18]  Oded Netzer,et al.  When Words Sweat: Identifying Signals for Loan Default in the Text of Loan Applications , 2019, Journal of Marketing Research.

[19]  D. Mahr,et al.  Cutting through Content Clutter: How Speech and Image Acts Drive Consumer Sharing of Social Media Brand Messages , 2019 .

[20]  Hongju Liu,et al.  Creation and Consumption of Mobile Word of Mouth: How Are Mobile Reviews Different? , 2019, Mark. Sci..

[21]  Michel Tuan Pham,et al.  Selectively Emotional: How Smartphone Use Changes User-Generated Content , 2019, Journal of Marketing Research.

[22]  Dhruv Grewal,et al.  Detecting, Preventing, and Mitigating Online Firestorms in Brand Communities , 2019, Journal of Marketing.

[23]  John R. Hauser,et al.  Identifying Customer Needs from User-Generated Content , 2019, Mark. Sci..

[24]  Sven Molner,et al.  Lost in a Universe of Markets: Toward a Theory of Market Scoping for Early-Stage Technologies , 2019, Journal of Marketing.

[25]  Olivier Toubia,et al.  Extracting Features of Entertainment Products: A Guided Latent Dirichlet Allocation Approach Informed by the Psychology of Media Consumption , 2018, Journal of Marketing Research.

[26]  Robert W. Palmatier,et al.  JM as a Marketplace of Ideas , 2018, Journal of Marketing.

[27]  Kannan Srinivasan,et al.  Analyzing Bank Overdraft Fees with Big Data , 2018, Mark. Sci..

[28]  Olivier Toubia,et al.  A Semantic Approach for Estimating Consumer Content Preferences from Online Search Queries , 2018, Mark. Sci..

[29]  Vamsi K. Kanuri,et al.  Scheduling Content on Social Media: Theory, Evidence, and Application , 2018, Journal of Marketing.

[30]  Jennifer Edson Escalas,et al.  What Happens in Vegas Stays on TripAdvisor? A Theory and Technique to Understand Narrativity in Consumer Reviews , 2018, Journal of Consumer Research.

[31]  Derek D. Rucker,et al.  The Evaluative Lexicon 2.0: The measurement of emotionality, extremity, and valence in language , 2017, Behavior Research Methods.

[32]  Brent McFerran,et al.  (I'm) Happy to Help (You): The Impact of Personal Pronoun Use in Customer–Firm Interactions , 2018, Journal of Marketing Research.

[33]  Michel Wedel,et al.  Video Content Marketing: The Making of Clips , 2018, Journal of Marketing.

[34]  Liu Liu,et al.  Visual Listening In: Extracting Brand Image Portrayed on Social Media , 2018, AAAI Workshops.

[35]  Michael Lewis,et al.  A Border Strategy Analysis of Ad Source and Message Tone in Senatorial Campaigns , 2018, Mark. Sci..

[36]  Grant Packard,et al.  Are Atypical Things More Popular? , 2018, Psychological science.

[37]  Rebecca Jen-Hui Wang,et al.  Automated Text Analysis for Consumer Research , 2018 .

[38]  P. Fader,et al.  Customer-Based Corporate Valuation for Publicly Traded Noncontractual Firms , 2018, Journal of Marketing Research.

[39]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[40]  A. Anderson Social Media Use in 2018 , 2018 .

[41]  Daniel Jurafsky,et al.  Word embeddings quantify 100 years of gender and ethnic stereotypes , 2017, Proceedings of the National Academy of Sciences.

[42]  Yoon Duk Kim,et al.  Emotional Volatility and Cultural Success , 2018 .

[43]  Olivier Toubia,et al.  Extracting Features of Entertainment Products: A Guided LDA Approach Informed by the Psychology of Media Consumption , 2018 .

[44]  Miad Faezipour,et al.  A review of influenza detection and prediction through social networking sites , 2018, Theoretical Biology and Medical Modelling.

[45]  Amir Goldberg,et al.  Language as a Window into Culture , 2017 .

[46]  Jonah Berger,et al.  How Language Shapes Word of Mouth's Impact , 2017 .

[47]  Vrinda Kadiyali,et al.  The Effect of Calorie Posting Regulation on Consumer Opinion: A Flexible Latent Dirichlet Allocation Model with Informative Priors , 2017, Mark. Sci..

[48]  Francesca Gino,et al.  It Doesn’t Hurt to Ask: Question-Asking Increases Liking , 2017, Journal of personality and social psychology.

[49]  K. Ruyter,et al.  Unveiling What Is Written in the Stars: Analyzing Explicit, Implicit, and Discourse Patterns of Sentiment in Social Media , 2017 .

[50]  Wagner A. Kamakura,et al.  A picture is worth a thousand words: translating product reviews into a product positioning map , 2017 .

[51]  Olivier Toubia,et al.  Idea Generation, Creativity, and Prototypicality , 2017, Mark. Sci..

[52]  Kevin Lane Keller,et al.  Integrating Marketing Communications: New Findings, New Lessons, and New Ideas , 2016 .

[53]  T. Laer What happens in Vegas stays on TripAdvisor , 2016 .

[54]  Tim Loughran,et al.  Textual Analysis in Accounting and Finance: A Survey: TEXTUAL ANALYSIS IN ACCOUNTING AND FINANCE , 2016 .

[55]  Gregory J. Park,et al.  Gaining insights from social media language: Methodologies and challenges. , 2016, Psychological methods.

[56]  Greg M. Allenby,et al.  Sentence-Based Text Analysis for Customer Reviews , 2016, Mark. Sci..

[57]  Christopher M. Danforth,et al.  The emotional arcs of stories are dominated by six basic shapes , 2016, EPJ Data Science.

[58]  Bill McDonald,et al.  Textual Analysis in Accounting and Finance: A Survey , 2016 .

[59]  Christopher E. Moody,et al.  Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec , 2016, ArXiv.

[60]  Stephan Ludwig,et al.  Untangling a Web of Lies: Exploring Automated Detection of Deception in Computer-Mediated Communication , 2016, J. Manag. Inf. Syst..

[61]  Gerard J. Tellis,et al.  Halo (Spillover) Effects in Social Media: Do Product Recalls of One Brand Hurt or Help Rival Brands? , 2016 .

[62]  Aldo Musacchio,et al.  Mapping frontier economies. (cover story) , 2016 .

[63]  D. Holt Branding in the age of social media , 2016 .

[64]  Mario Baum,et al.  Culture And The Evolutionary Process , 2016 .

[65]  Christian Homburg,et al.  Measuring and Managing Consumer Sentiment in an Online Community Environment , 2015 .

[66]  Sunder Kekre,et al.  The Squeaky Wheel Gets the Grease - An Empirical Analysis of Customer Voice and Firm Intervention on Twitter , 2015, Mark. Sci..

[67]  Ronen Feldman,et al.  Utilizing Text Mining on Online Medical Forums to Predict Label Change due to Adverse Drug Reactions , 2015, KDD.

[68]  Victor Kuperman,et al.  Concreteness and Psychological Distance in Natural Language Use , 2015, Psychological science.

[69]  Jonah A. Berger,et al.  Drivers of cultural success: The case of sensory metaphors. , 2015, Journal of personality and social psychology.

[70]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[71]  Murtaza Haider,et al.  Beyond the hype: Big data concepts, methods, and analytics , 2015, Int. J. Inf. Manag..

[72]  Puneet Manchanda,et al.  Social Dollars: The Economic Impact of Customer Participation in a Firm-Sponsored Online Customer Community , 2015, Mark. Sci..

[73]  Tracy L. Tuten,et al.  Creative Strategies in Social Media Marketing: An Exploratory Study of Branded Social Content and Consumer Engagement , 2015 .

[74]  R. Fazio,et al.  The Evaluative Lexicon: Adjective use as a means of assessing and distinguishing attitude valence, extremity, and emotionality , 2015 .

[75]  Stephan Ludwig,et al.  Take Their Word for It: The Symbolic Role of Linguistic Style Matches in User Communities , 2014, MIS Q..

[76]  Jonah A. Berger Word of mouth and interpersonal communication: A review and directions for future research , 2014 .

[77]  David A. Schweidel,et al.  Listening in on Social Media: A Joint Model of Sentiment and Venue Format Choice , 2014 .

[78]  G. Tellis,et al.  Mining Marketing Meaning from Online Chatter: Strategic Brand Analysis of Big Data Using Latent Dirichlet Allocation , 2014 .

[79]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[80]  Dipti Kulkarni Exploring Jakobson’s ‘phatic function’ in instant messaging interactions , 2014 .

[81]  Roger H. L. Chiang,et al.  Database Submission - Market Dynamics and User-Generated Content About Tablet Computers , 2014, Mark. Sci..

[82]  Eric T. Anderson,et al.  Reviews without a Purchase: Low Ratings, Loyal Customers, and Deception , 2014 .

[83]  Noah A. Smith,et al.  Narrative framing of consumer sentiment in online restaurant reviews , 2014, First Monday.

[84]  Z. John Zhang,et al.  Assessing Box Office Performance Using Movie Scripts: A Kernel-Based Approach , 2014, IEEE Transactions on Knowledge and Data Engineering.

[85]  Cindy Chan,et al.  Broadcasting and Narrowcasting: How Audience Size Affects What People Share , 2014 .

[86]  Ashlee Humphreys,et al.  Framing the Game: Assessing the Impact of Cultural Representations on Consumer Perceptions of Legitimacy , 2013 .

[87]  David M. Blei,et al.  Scalable Recommendation with Poisson Factorization , 2013, ArXiv.

[88]  Nicholas H. Lurie,et al.  Temporal Contiguity and Negativity Bias in the Impact of Online Word of Mouth , 2013 .

[89]  Li Xiao,et al.  An Introduction to Audio and Visual Research and Applications in Marketing , 2013 .

[90]  Edward F. McQuarrie,et al.  The Megaphone Effect: Taste and Audience in Fashion Blogging , 2013 .

[91]  Jure Leskovec,et al.  No country for old members: user lifecycle and linguistic change in online communities , 2013, WWW.

[92]  T. Hennig-Thurau,et al.  Does Twitter matter? The impact of microblogging word of mouth on consumers’ adoption of new movies , 2013 .

[93]  Jonathan Bean,et al.  Taste Regimes and Market-Mediated Practice , 2013 .

[94]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[95]  Martin Wetzels,et al.  More than Words: The Influence of Affective Content and Linguistic Style Matches in Online Reviews on Conversion Rates , 2013 .

[96]  Derek D. Rucker,et al.  On Braggarts and Gossips: A Self-Enhancement Account of Word-of-Mouth Generation and Transmission , 2012 .

[97]  Jacob Goldenberg,et al.  Mine Your Own Business: Market-Structure Surveillance Through Text Mining , 2012, Mark. Sci..

[98]  David Godes,et al.  Sequential and Temporal Dynamics of Online Opinion , 2012, Mark. Sci..

[99]  David A. Schweidel,et al.  Online Product Opinions: Incidence, Evaluation, and Evolution , 2012, Mark. Sci..

[100]  Claire Cardie,et al.  Estimating the prevalence of deception in online review communities , 2012, WWW.

[101]  Irene Pollach,et al.  Taming Textual Data: The Contribution of Corpus Linguistics to Computer-Aided Text Analysis , 2012 .

[102]  Katherine L. Milkman,et al.  What Makes Online Content Viral? , 2012 .

[103]  Gerard J. Tellis,et al.  Does Chatter Really Matter? Dynamics of User-Generated Content and Stock Performance , 2011, Mark. Sci..

[104]  Wendy W. Moe,et al.  Measuring the Value of Social Dynamics in Online Product Ratings Forums , 2010 .

[105]  Feng Li,et al.  Who is talking? An ontology-based opinion leader identification framework for word-of-mouth marketing in online social blogs , 2011, Decis. Support Syst..

[106]  Thomas W. Valente,et al.  Opinion Leadership and Social Contagion in New Product Diffusion , 2011, Mark. Sci..

[107]  Christopher M. Danforth,et al.  Temporal Patterns of Happiness and Information in a Global Social Network: Hedonometrics and Twitter , 2011, PloS one.

[108]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[109]  Panagiotis G. Ipeirotis,et al.  Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics , 2010, IEEE Transactions on Knowledge and Data Engineering.

[110]  Puneet Manchanda,et al.  Social Dollars: The Economic Impact of Consumer Participation in a Firm-sponsored Brand Community , 2011 .

[111]  Sepandar D. Kamvar,et al.  The Shifting Meaning of Happiness , 2010 .

[112]  Ashlee Humphreys,et al.  Semiotic Structure and the Legitimation of Consumption Practices: The Case of Casino Gambling , 2010 .

[113]  Eric T. Bradlow,et al.  Automated Marketing Research Using Online Customer Reviews , 2010 .

[114]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[115]  Foster Provost,et al.  Audience selection for on-line brand advertising: privacy-friendly social network targeting , 2009, KDD.

[116]  T. Nagachinta,et al.  A Review of Influenza , 2009 .

[117]  K. Ruyter,et al.  Social Capital Production in a Virtual P3 Community , 2008 .

[118]  Jeffrey T. Hancock,et al.  On Lying and Being Lied To: A Linguistic Analysis of Deception in Computer-Mediated Communication , 2007 .

[119]  R. Chandy,et al.  Managing the Future: CEO Attention and Innovation Outcomes , 2007 .

[120]  Robert W. Palmatier,et al.  A Comparative Longitudinal Analysis of Theoretical Perspectives of Interorganizational Relationship Performance , 2007 .

[121]  J. Tsai Ideal Affect: Cultural Causes and Behavioral Consequences , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[122]  Mike Y. Chen,et al.  Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web , 2007, Manag. Sci..

[123]  Gokcen Coskuner-Balli,et al.  Countervailing market responses to corporate co-optation and the ideological recruitment of consumption communities , 2007 .

[124]  Z. John Zhang,et al.  From Story Line to Box Office: A New Approach for Green-Lighting Movie Scripts , 2007, Manag. Sci..

[125]  Susan McManus Archaeologies of the Future: The Desire Called Utopia and Other Science Fictions , 2007 .

[126]  Eileen Fischer,et al.  Frustrated Fatshionistas: An Institutional Theory Perspective on Consumer Quests for Greater Choice in Mainstream Markets , 2013 .

[127]  Leyland Pitt,et al.  Communicating brand personality: Are the websites doing the talking for the top South African Business Schools? , 2006 .

[128]  M. Devous,et al.  A Picture is Worth … , 2006, Experimental biology and medicine.

[129]  Michel Wedel,et al.  Leveraging Missing Ratings to Improve Online Recommendation Systems , 2006 .

[130]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[131]  Chip Heath,et al.  Idea Habitats: How the Prevalence of Environmental Cues Influences the Success of Ideas , 2005, Cogn. Sci..

[132]  K. Weber A toolkit for analyzing corporate cultural toolkits , 2005 .

[133]  Peer C. Fiss,et al.  The Discourse of Globalization: Framing and Sensemaking of an Emerging Concept , 2005 .

[134]  J. Pennebaker,et al.  Language use of depressed and depression-vulnerable college students , 2004 .

[135]  Frank M. Bass,et al.  A New Product Growth for Model Consumer Durables , 2004, Manag. Sci..

[136]  Sridhar Narayanan,et al.  Return on Investment Implications for Pharmaceutical Promotional Expenditures: The Role of Marketing-Mix Interactions , 2004 .

[137]  J. Pennebaker,et al.  Linguistic Markers of Psychological Change Surrounding September 11, 2001 , 2004, Psychological science.

[138]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[139]  J. Pennebaker,et al.  The Secret Life of Pronouns , 2003, Psychological science.

[140]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[141]  David Godes,et al.  Using Online Conversations to Study Word-of-Mouth Communication , 2004 .

[142]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[143]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[144]  Magnus Ljung Newspaper genres and newspaper English , 2000 .

[145]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[146]  Kathleen M. Carley,et al.  An approach to identifying consensus in a subfield: The case of organizational culture , 1999 .

[147]  J. Porac,et al.  Sociocognitive Dynamics in a Product Market , 1999 .

[148]  Boris Kabanoff,et al.  Computer-aided content analysis: What do 240 advertising slogans have in common? , 1996 .

[149]  W. Bielby,et al.  "All Hits Are Flukes": Institutionalized Decision Making and the Rhetoric of Network Prime-Time Program Development , 1994, American Journal of Sociology.

[150]  Grant Mccracken The long interview , 1988 .

[151]  A. R. Hirsch The Last "Last Hurrah" , 1986 .

[152]  M. Feldman,et al.  Cultural transmission and evolution: a quantitative approach. , 1981, Monographs in population biology.

[153]  Dean Keith Simonton,et al.  Thematic fame, melodic originality, and musical zeitgeist: A biographical and transhistorical content analysis. , 1980 .

[154]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[155]  D. Shaw,et al.  Agenda setting function of mass media , 1972 .

[156]  P. Hirsch Processing Fads and Fashions: An Organization-Set Analysis of Cultural Industry Systems , 1972, American Journal of Sociology.

[157]  E. Goffman The moral career of the mental patient. , 1959, Psychiatry.