Multimodal Analytics Dashboard for Story Detection and Visualization

The InVID Multimodal Analytics Dashboard is a visual content exploration and retrieval system to analyze user-generated video content from social media platforms including YouTube, Twitter, Facebook, Reddit, Vimeo, and Dailymotion. It uses automated knowledge extraction methods to analyze each of the collected postings and stores the extracted metadata for later analyses. The real-time synchronization mechanisms of the dashboard help to track information flows within the resulting information space. Cluster analysis is used to group related postings and detect evolving stories, to be analyzed along multiple semantic dimensions such as sentiment and geographic location. Data journalists can not only visualize the latest trends across communication channels, but also identify opinion leaders (persons or organizations) as well as the relations among these opinion leaders.

[1]  Ioannis Patras,et al.  Multimodal Video Annotation for Retrieval and Discovery of Newsworthy Video in a News Verification Scenario , 2018, MMM.

[2]  Adrian M. P. Brasoveanu,et al.  Mining and Leveraging Background Knowledge for Improving Named Entity Linking , 2018, WIMS.

[3]  Arno Scharl,et al.  Semantic Systems and Visual Tools to Support Environmental Communication , 2017, IEEE Systems Journal.

[4]  Erik Cambria,et al.  Affective Computing and Sentiment Analysis , 2016, IEEE Intelligent Systems.

[5]  Arno Scharl,et al.  The Geospatial Web: How Geobrowsers, Social Software and the Web 2.0 are Shaping the Network Society , 2007, The Geospatial Web.

[6]  Michael L. Nelson,et al.  Comparing the Archival Rate of Arabic, English, Danish, and Korean Language Web Pages , 2017, ACM Trans. Inf. Syst..

[7]  Arno Scharl,et al.  Metadata enriched visualization of keywords in context , 2014, EICS.

[8]  Arno Scharl,et al.  Aspect-Based Extraction and Analysis of Affective Knowledge from Social Media Streams , 2017, IEEE Intelligent Systems.

[9]  Jay Pujara,et al.  Mining Knowledge Graphs From Text , 2018, WSDM.

[10]  Arno Scharl,et al.  Tourism Intelligence and Visual Media Analytics for Destination Management Organizations , 2017 .

[11]  Martin Wattenberg,et al.  The Word Tree, an Interactive Visual Concordance , 2008, IEEE Transactions on Visualization and Computer Graphics.

[12]  Yiannis Kompatsiaris,et al.  Location Extraction from Social Media , 2018, ACM Trans. Inf. Syst..

[13]  Giovanni Toffetti Carughi,et al.  Web Usability: Principles and Evaluation Methods , 2006, Web Engineering.

[14]  Arno Scharl,et al.  Analyzing the public discourse on works of fiction – Detection and visualization of emotion in online coverage about HBO’s Game of Thrones , 2016, Inf. Process. Manag..

[15]  Arno Scharl,et al.  Multiple coordinated views for searching and navigating Web content repositories , 2009, Inf. Sci..

[16]  Arno Scharl,et al.  An Automated Approach to Investigating the Online Media Coverage of U.S. Presidential Elections , 2008 .