Visual electronic Word of Mouth: a multimodal brand approach and case study

An emerging activity on internet is to create and share visual content, our understanding of this activity and its impact however is limited. In this paper we aim to define and operationalize the concept of visual eWom and embed it in the current eWom literature. Different from existing eWom research which relies on textual information only, we conceptualize visual eWom as a multimodal construct consisting of textual and visual concepts. We test our operationalization on a dataset of 6435 consumer posts crawled from Instagram. We apply stateoftheart machine learning techniques, convolutional neural networks, for detecting the visual concepts in images posted on Instagram. We use OLS regression to test the impact of textual and visual concepts on image popularity. The results in our case study show that textual and visual concepts provide complementary information and have a different impact on image popularity.

[1]  Jonah A. Berger,et al.  Communication Channels and Word of Mouth: How the Medium Shapes the Message , 2013 .

[2]  Eric Gilbert,et al.  Faces engage us: photos with faces attract more likes and comments on Instagram , 2014, CHI.

[3]  Claire Cardie,et al.  Properties, Prediction, and Prevalence of Useful User-Generated Comments for Descriptive Annotation of Social Media Objects , 2013, ICWSM.

[4]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[5]  T. Graepel,et al.  Private traits and attributes are predictable from digital records of human behavior , 2013, Proceedings of the National Academy of Sciences.

[6]  P. Leeflang,et al.  Popularity of Brand Posts on Brand Fan Pages: An Investigation of the Effects of Social Media Marketing , 2012 .

[7]  Rong Yan,et al.  An efficient manual image annotation approach based on tagging and browsing , 2007, MS '07.

[8]  Terry L. Childers,et al.  Conditions for a Picture-Superiority Effect on Consumer Memory , 1984 .

[9]  David A. Schweidel,et al.  Listening in on Social Media: A Joint Model of Sentiment and Venue Format Choice , 2014 .

[10]  J. Arndt.  Word of mouth advertising : a review of the literature , 1967 .

[11]  F. Völckner,et al.  Managing Brands in the Social Media Environment , 2013 .

[12]  Andrew N. Smith,et al.  How Does Brand-related User-generated Content Differ across YouTube, Facebook, and Twitter? , 2012 .

[13]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[14]  Rik Pieters,et al.  Attention Capture and Transfer in Advertising: Brand, Pictorial, and Text-Size Effects , 2004 .

[15]  Bernard J. Jaworski,et al.  Information Processing from Advertisements: Toward an Integrative Framework , 1989 .

[16]  Xirong Li,et al.  TagBook: A Semantic Video Representation Without Supervision for Event Detection , 2015, IEEE Transactions on Multimedia.

[17]  Tammo H. A. Bijmolt,et al.  The Effect of Electronic Word of Mouth on Sales: A Meta-Analytic Review of Platform, Product, and Metric Factors , 2016 .

[18]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[20]  Dwayne D. Gremler,et al.  Electronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the Internet? , 2004 .

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  R. Shachar,et al.  On Brands and Word of Mouth , 2013 .