SentiCart: Cartography and Geo-contextualization for Multilingual Visual Sentiment

Where in the world are pictures of cute animals or ancient architecture most shared from? And are they equally sentimentally perceived across different languages? We demonstrate a series of visualization tools, that we collectively call SentiCart, for answering such questions and navigating the landscape of how sentiment-biased images are shared around the world in multiple languages. We present visualizations using a large-scale, self-gathered geodata corpus of >1.54M geo-references coming from over 235 countries mined from >15K visual concepts over 12 languages. We also highlight several compelling data-driven findings about multilingual visual sentiment in geo-social interactions.

[1]  References , 1971 .

[2]  Ramesh C. Jain,et al.  Social pixels: genesis and evaluation , 2010, ACM Multimedia.

[3]  Christopher D. Manning,et al.  Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling , 2005, ACL.

[4]  Daniel A. Keim,et al.  Visual sentiment analysis on twitter data streams , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[5]  Tao Chen,et al.  Visual Affect Around the World: A Large-scale Multilingual Visual Sentiment Ontology , 2015, ACM Multimedia.

[6]  Thorsten Joachims,et al.  Taste Space Versus the World: an Embedding Analysis of Listening Habits and Geography , 2014, ISMIR.

[7]  Jiebo Luo,et al.  Geotagging in multimedia and computer vision—a survey , 2010, Multimedia Tools and Applications.

[8]  Lars Backstrom,et al.  Find me if you can: improving geographical prediction with social and spatial proximity , 2010, WWW '10.

[9]  Kentaro Toyama,et al.  Geographic location tags on digital images , 2003, ACM Multimedia.

[10]  Christian S. Jensen,et al.  Google fusion tables: data management, integration and collaboration in the cloud , 2010, SoCC '10.

[11]  Yang Song,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Daniel McDuff,et al.  Event detection: Ultra large-scale clustering of facial expressions , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).