MOSAIC: Multimodal analytics for the protection of critical assets

This paper presents an overview of the MOSAIC architecture and the validated Demonstrator resulting from an EU-co-funded research project concerned with the development of an advanced system for the use and integration of multimodal analytics for the protection of critical assets. The paper motivates the MOSAIC vision and describes the major components of the integrated solution; including the ontological framework, the data representation, text mining, data mining, video analytics, social network analysis and decision support. In the descriptions of these components, it is illustrated how MOSAIC can be used to improve the protection of critical assets without necessitating data gathering that goes beyond what is already currently being gathered by relevant security organisations such as police forces by improving data analytics techniques, integration of analysis outputs and decision support mechanisms.

[1]  Atta Badii,et al.  User-intimate requirements hierarchy resolution framework (UI-REF) in work-flow design for 3D media production and distribution , 2008 .

[2]  Sahin Albayrak,et al.  Human action recognition using Lagrangian descriptors , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[3]  Volker Eiselein,et al.  Real-Time Multi-human Tracking Using a Probability Hypothesis Density Filter and Multiple Detectors , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[4]  Rubén Heras Evangelio,et al.  On building decentralized wide-area surveillance networks based on ONVIF , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[5]  Keith Hanna,et al.  Integrated homeland security system with passive thermal imaging and advanced video analytics , 2007, SPIE Defense + Commercial Sensing.

[6]  Francesco Flammini,et al.  Dependable integrated surveillance systems for the physical security of metro railways , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[7]  Xuefei Li.  Design and implement of decision support system for police emergency response , 2011, 2011 3rd International Conference on Computer Research and Development.

[8]  Michael C. McCord,et al.  Slot Grammar: A System for Simpler Construction of Practical Natural Language Grammars , 1989, Natural Language and Logic.

[9]  Michael C. McCord,et al.  Slot Grammars , 1980, CL.

[10]  L. Philips,et al.  Hanging on the metaphone , 1990 .

[11]  Atta Badii,et al.  The Automatic Identification and Prioritisation of Criminal Networks from Police Crime Data , 2008, EuroISI.

[12]  Tobias Senst,et al.  A Lagrangian framework for video analytics , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[13]  Rubén Heras Evangelio,et al.  Complementary background models for the detection of static and moving objects in crowded environments , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[14]  Hsinchun Chen,et al.  Dynamic Social Network Analysis of a Dark Network: Identifying Significant Facilitators , 2007, 2007 IEEE Intelligence and Security Informatics.

[15]  Rubén Heras Evangelio,et al.  Adaptively Splitted GMM With Feedback Improvement for the Task of Background Subtraction , 2014, IEEE Transactions on Information Forensics and Security.

[16]  Tobias Senst,et al.  Robust local optical flow estimation using bilinear equations for sparse motion estimation , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Deborah L. McGuinness,et al.  OWL Web ontology language overview , 2004 .