EventBuilder: Real-time Multimedia Event Summarization by Visualizing Social Media

Due to the ubiquitous availability of smartphones and digital cameras, the number of photos/videos online has increased rapidly. Therefore, it is challenging to efficiently browse multimedia content and obtain a summary of an event from a large collection of photos/videos aggregated in social media sharing platforms such as Flickr and Instagram. To this end, this paper presents the EventBuilder system that enables people to automatically generate a summary for a given event in real-time by visualizing different social media such as Wikipedia and Flickr. EventBuilder has two novel characteristics: (i) leveraging Wikipedia as event background knowledge to obtain more contextual information about an input event, and (ii) visualizing an interesting event in real-time with a diverse set of social media activities. According to our initial experiments on the YFCC100M dataset from Flickr, the proposed algorithm efficiently summarizes knowledge structures based on the metadata of photos/videos and Wikipedia articles.

[1]  László Böszörményi,et al.  Summarization and Presentation of Real-Life Events Using Community-Contributed Content , 2012, MMM.

[2]  László Böszörményi,et al.  Summarization of Real-Life Events Based on Community-Contributed Content , 2012, MMEDIA 2012.

[3]  Vasileios Mezaris.  Social event detection at MediaEval: a 3-year retrospect of tasks and results , 2014 .

[4]  Vasileios Mezaris,et al.  Concept-based Image Clustering and Summarization of Event-related Image Collections , 2014, HuEvent '14.

[5]  Mohan S. Kankanhalli,et al.  Effective multimedia surveillance using a human-centric approach , 2010, Multimedia Tools and Applications.

[6]  Mor Naaman,et al.  Towards automatic extraction of event and place semantics from flickr tags , 2007, SIGIR.

[7]  David A. Shamma,et al.  The New Data and New Challenges in Multimedia Research , 2015, ArXiv.

[8]  Mohan S. Kankanhalli,et al.  Real-life events in multimedia: detection, representation, retrieval, and applications , 2013, Multimedia Tools and Applications.

[9]  Georgios Petkos,et al.  Social Event Detection at MediaEval : a three-year retrospect of tasks and results , 2014 .

[10]  Wolfgang Nejdl,et al.  Bringing order to your photos: event-driven classification of flickr images based on social knowledge , 2010, CIKM.

[11]  Yi Yu,et al.  ATLAS: Automatic Temporal Segmentation and Annotation of Lecture Videos Based on Modelling Transition Time , 2014, ACM Multimedia.

[12]  Francesco G. B. De Natale,et al.  HuEvent'14: 2014 workshop on human-centered event understanding from multimedia , 2014, ACM Multimedia.

[13]  Haixun Wang,et al.  An algorithmic approach to event summarization , 2010, SIGMOD Conference.

[14]  Ansgar Scherp,et al.  Survey on modeling and indexing events in multimedia , 2014, Multimedia Tools and Applications.

[15]  Vasileios Hatzivassiloglou,et al.  Event-Based Extractive Summarization , 2004 .

[16]  Richard Chbeir,et al.  Foto2Events: From Photos to Event Discovery and Linking in Online Social Networks , 2014, 2014 IEEE Fourth International Conference on Big Data and Cloud Computing.

[17]  Christian Breiteneder,et al.  Automated social event detection in large photo collections , 2013, ICMR.