Migration-Related Semantic Concepts for the Retrieval of Relevant Video Content

Migration, and especially irregular migration, is a critical issue for border agencies and society in general. Migration-related situations and decisions are influenced by various factors, including the perceptions about migration routes and target countries. An improved understanding of such factors can be achieved by systematic automated analyses of media and social media channels, and the videos and images published in them. However, the multifaceted nature of migration and the variety of ways migration-related aspects are expressed in images and videos make the finding and automated analysis of migration-related multimedia content a challenging task. We propose a novel approach that effectively bridges the gap between a substantiated domain understanding encapsulated into a set of Migration-related semantic concepts and the expression of such concepts in a video, by introducing an advanced video analysis and retrieval method for this purpose.

[1]  Bruce E. Moon,et al.  Paradigms in migration research: exploring 'moorings' as a schema , 1995, Progress in human geography.

[2]  George J. Borjas,et al.  Economic Theory and International Migration , 1989, The International migration review.

[3]  A. Portes,et al.  Immigrant America: A Portrait. , 1991 .

[4]  A. Portes,et al.  Contemporary Immigration: Theoretical Perspectives on its Determinants and Modes of Incorporation 1 , 1989, The International migration review.

[5]  Ilse Ruyssen,et al.  Determinants of international migration , 2013 .

[6]  D. Baines The new helots: migrants in the international division of labour , 1990 .

[7]  Cees Snoek,et al.  Video2vec Embeddings Recognize Events When Examples Are Scarce , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Tao Mei,et al.  MSR-VTT: A Large Video Description Dataset for Bridging Video and Language , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[10]  C. Delbruck,et al.  [The theory of migration]. , 1993, Jahrbucher fur Nationalokonomie und Statistik.

[11]  Yale Song,et al.  TGIF: A New Dataset and Benchmark on Animated GIF Description , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[13]  F. Castelli Drivers of migration: why do people move? , 2018, Journal of travel medicine.

[14]  D. Jolivet,et al.  Broadcasting Migration Outcomes , 2016 .

[15]  P. Cohen,et al.  Multi-Racist Britain , 1988 .

[16]  T. Sales The mobility of labor and capital , 2014 .

[17]  O. Bakewell,et al.  Push-pull plus: reconsidering the drivers of migration , 2017, Aspiration, Desire and the Drivers of Migration.

[18]  Vasileios Mezaris,et al.  Attention Mechanisms, Signal Encodings and Fusion Strategies for Improved Ad-hoc Video Search with Dual Encoding Networks , 2020, ICMR.

[19]  Xirong Li,et al.  Predicting Visual Features From Text for Image and Video Caption Retrieval , 2017, IEEE Transactions on Multimedia.

[20]  Yiannis Kompatsiaris,et al.  ITI-CERTH participation to TRECVID 2015 , 2015, TRECVID.

[21]  David J. Fleet,et al.  VSE++: Improving Visual-Semantic Embeddings with Hard Negatives , 2017, BMVC.

[22]  Ioannis Patras,et al.  Deep Multi-task Learning with Label Correlation Constraint for Video Concept Detection , 2016, ACM Multimedia.

[23]  Brian Antonishek TRECVID 2010 – An Introduction to the Goals , Tasks , Data , Evaluation Mechanisms , and Metrics , 2010 .

[24]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[25]  K. Eriksson, Concept determination as part of the development of knowledge in caring science. , 2010, Scandinavian journal of caring sciences.

[26]  Ioannis Patras,et al.  Query and Keyframe Representations for Ad-hoc Video Search , 2017, ICMR.

[27]  R. Cohen The New Helots: Migrants In The International Division Of Labour , 1988 .

[28]  C. Timmerman,et al.  Imagining Europe from the Outside: The Role of Perceptions of Human Rights in Europe in Migration Aspirations in Turkey, Morocco, Senegal and Ukraine , 2014 .