Multi-Domain Integration and Correlation Engine

As Machine Learning becomes more prominent in the military, we are faced with a different take on the old problem of how to collect data relevant to some military mission need. We can now embrace the paradigm of too much data where previously we needed to focus on data reduction because humans can only process a finite amount of information. Commanders, analysts, and intelligence officers are often tasked with understanding the current situation in a mission area to create a common operating picture in order to complete their mission objectives. Data pertaining to missions can often be scraped from multiple domains, including patrol reports, newswire, and RF sensors, image sensors, and various other sensor types in the field. In this paper, we describe a system called the Multi-Domain Integration and Correlation Engine (MD-ICE), which ingests data which ingests data from two domains: textual open source information (newswire and social media)and sensor network information, and processes it using tools from various machine learning research areas. MD-ICE manipulates the resulting data into a machine readable unified format to allow for labelling and inference of inter-domain correlations. The goal of MD-ICE is to utilize these information domains to better understand situational context, where open source information provides semantic context (i.e. what type of event, who is involved, etc…)and the sensor network information provides the fine-grain detail (how many people involved, exact area of the event, etc …). This understanding of situational context in turn can, with further research, help commanders reach their mission objectives faster through better situational understanding and prediction of future needs.

[1]  Nitesh V. Chawla,et al.  metapath2vec: Scalable Representation Learning for Heterogeneous Networks , 2017, KDD.

[2]  Sibel Adali,et al.  Assessing the News Landscape: A Multi-Module Toolkit for Evaluating the Credibility of News , 2018, WWW.

[3]  Nitish Srivastava,et al.  Multimodal learning with deep Boltzmann machines , 2012, J. Mach. Learn. Res..

[4]  Jiawei Han,et al.  Automated Phrase Mining from Massive Text Corpora , 2017, IEEE Transactions on Knowledge and Data Engineering.

[5]  Heng Ji,et al.  Cross-lingual Name Tagging and Linking for 282 Languages , 2017, ACL.

[6]  Ram Ramanathan,et al.  An efficient alternative to Ollivier-Ricci curvature based on the Jaccard metric , 2017, ArXiv.

[7]  Ambuj K. Singh,et al.  Spectral Algorithms for Temporal Graph Cuts , 2017, WWW.

[8]  Louis-Philippe Morency,et al.  Multimodal Machine Learning: A Survey and Taxonomy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[10]  Elizabeth K. Bowman,et al.  Applying traditional signal processing techniques to social media exploitation for situational understanding , 2016, SPIE Defense + Security.

[11]  Hao Wu,et al.  Joint Reasoning for Temporal and Causal Relations , 2018, ACL.

[12]  Donald F. Towsley,et al.  Sparse Diffusion-Convolutional Neural Networks , 2017, ArXiv.

[13]  Nitesh V. Chawla,et al.  Representing higher-order dependencies in networks , 2015, Science Advances.

[14]  Ramesh Govindan,et al.  Athena: Towards Decision-Centric Anticipatory Sensor Information Delivery , 2018, J. Sens. Actuator Networks.

[15]  Yuhui Wang,et al.  Socializing Multimodal Sensors for Information Fusion , 2015, ACM Multimedia.

[16]  Ambuj K. Singh,et al.  Graph Wavelets via Sparse Cuts , 2016, KDD.