When face-tracking meets social networks: a story of politics in news videos

In the age of data processing, news videos are rich mines of information. After all, the news are essentially created to convey information to the public. But can we go beyond what is directly presented to us and see a wider picture? Many works already focus on what we can discover and understand from the analysis of years of news broadcasting. These analysis bring monitoring and understanding of the activity of public figures, political strategies, explanation and even prediction of critical media events. Such tools can help public figures in managing their public image, as well as support the work of journalists, social scientists and other media experts. News analysis can also be seen from the lens of complex systems, gathering many types of entities, attributes and interactions over time. As many public figures intervene in different news stories, a first interesting task is to observe the social interactions between these actors. Towards this goal, we propose to use video analysis to automatise the process of constructing social networks directly from news video archives. In this paper we are introducing a system deriving multiple social networks from face detections in news videos. We present preliminary results obtained from analysis of these networks, by monitoring the activity of more than a hundred public figures. We finally use these networks as a support for political studies and we provide an overview of the political landscape presented by the Japanese public broadcaster NHK over a decade of the 7 PM news archives.

[1]  Guy Melançon,et al.  Tulip III , 2014, Encyclopedia of Social Network Analysis and Mining.

[2]  Sean A. Munson,et al.  Bursting your (filter) bubble: strategies for promoting diverse exposure , 2013, CSCW '13.

[3]  WILLY JOU,et al.  Presidentialization of Japanese Politics? Examining Political Leader Evaluations and Vote Choice , 2015, Japanese Journal of Political Science.

[4]  Vito Latora,et al.  Structural measures for multiplex networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Nello Cristianini,et al.  Automating Quantitative Narrative Analysis of News Data , 2011, WAPA.

[6]  Olivier Buisson,et al.  OTMedia: the French TransMedia news observatory , 2013, MM '13.

[7]  Fernando Alonso-Fernandez,et al.  Face Tracking using Optical Flow Development of a Real-Time AdaBoost Cascade Face Tracker , 2015, BIOSIG.

[8]  Andrew Zisserman,et al.  Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video , 2006, BMVC.

[9]  Samet Atdag,et al.  A comparison of named entity recognition tools applied to biographical texts , 2013, 2nd International Conference on Systems and Computer Science.

[10]  Tony Hey,et al.  The Fourth Paradigm: Data-Intensive Scientific Discovery , 2009 .

[11]  Guy Melançon,et al.  Entanglement in Multiplex Networks: Understanding Group Cohesion in Homophily Networks , 2014, Social Network Analysis.

[12]  Hugues Bersini,et al.  Topology Analysis of Social Networks Extracted from Literature , 2015, PloS one.

[13]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Frank Nack,et al.  [Invited Paper] Explain This to Me! , 2013 .

[15]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[16]  Richard Sproat,et al.  Mining correlated bursty topic patterns from coordinated text streams , 2007, KDD '07.

[17]  Shin'ichi Satoh,et al.  Topic Threading for Structuring a Large-Scale News Video Archive , 2004, CIVR.

[18]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[19]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Duy-Dinh Le,et al.  An efficient method for face retrieval from large video datasets , 2010, CIVR '10.

[21]  Helen G. Reets.  Explain to Me , 1933 .

[22]  Burleigh B. Gardner,et al.  Deep South: A Social Anthropological Study of Caste and Class , 1942 .

[23]  Christopher D. Manning,et al.  Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling , 2005, ACL.

[24]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Olivier Buisson,et al.  Interactive components for visual exploration of multimedia archives , 2008, CIVR '08.

[26]  Julia Cagé,et al.  Media Competition, Information Provision and Political Participation: Evidence from French Local Newspapers and Elections, 1944-2014 , 2017, Journal of Public Economics.

[27]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[28]  Gianmarco De Francisci Morales,et al.  Says who?: automatic text-based content analysis of television news , 2013, UnstructureNLP@CIKM.

[29]  Ivan Herman,et al.  Density functions for visual attributes and effective partitioning in graph visualization , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[30]  Lada A. Adamic,et al.  The political blogosphere and the 2004 U.S. election: divided they blog , 2005, LinkKDD '05.

[31]  Martin Harrop,et al.  Media and the presidentialization of parliamentary elections , 2002 .

[32]  John Street,et al.  Mass Media, Politics and Democracy , 2001 .

[33]  Stephen B. Seidman,et al.  Network structure and minimum degree , 1983 .

[34]  Robert Hazell,et al.  Assessing the performance of freedom of information , 2010, Gov. Inf. Q..

[35]  Kathleen M. Carley,et al.  Network text analysis of conceptual overlap in interviews, newspaper articles and keywords , 2013, Social Network Analysis and Mining.

[36]  Tomoya Iwakura,et al.  Error Analysis of Named Entity Recognition in BCCWJ , 2015 .

[37]  Shin'ichi Satoh,et al.  Image Flows Visualization for Inter-media Comparison , 2014, 2014 IEEE Pacific Visualization Symposium.

[38]  Duy-Dinh Le,et al.  Face Retrieval in Large-Scale News Video Datasets , 2013, IEICE Trans. Inf. Syst..

[39]  Jianping Fan,et al.  Analyzing Large-Scale News Video Databases to Support Knowledge Visualization and Intuitive Retrieval , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[40]  Matthieu Latapy,et al.  Computing maximal cliques in link streams , 2015, Theor. Comput. Sci..

[41]  Andreas Ranftl,et al.  Face Tracking Using Optical Flow , 2015, 2015 International Conference of the Biometrics Special Interest Group (BIOSIG).

[42]  Mason A. Porter,et al.  Multilayer networks , 2013, J. Complex Networks.

[43]  D. Lazer.  Networks in Political Science: Back to the Future , 2011, PS: Political Science & Politics.

[44]  Shin'ichi Satoh,et al.  Mining Large-Scale Broadcast Video Archives Towards Inter-video Structuring , 2004, PCM.

[45]  James Allan,et al.  Topic detection and tracking: event-based information organization , 2002 .

[46]  Benjamin Nyblade,et al.  ‘Presidentialization’ in Japan? The Prime Minister, Media and Elections in Japan , 2005, British Journal of Political Science.

[47]  Byoung-Tak Zhang,et al.  Social network analysis of TV drama characters via deep concept hierarchies , 2015, 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[48]  Wolfgang Kienreich,et al.  Visual Analysis and Knowledge Discovery for Text , 2014, Large-Scale Data Analytics.