Using DeepProbLog to perform Complex Event Processing on an Audio Stream

In this paper, we present an approach to Complex Event Processing (CEP) that is based on DeepProbLog. This approach has the following objectives: (i) allowing the use of subsymbolic data as an input, (ii) retaining the flexibility and modularity on the definitions of complex event rules, (iii) allowing the system to be trained in an end-to-end manner and (iv) being robust against adversarial conditions. Our approach makes use of DeepProbLog to use a hybrid neuro-symbolic architecture that combines a neural network to process the symbolic data with a probabilistic logic layer to allow the user to define the rules for the complex events. We demonstrate that our approach is capable of detecting complex events from an audio stream. We also demonstrate that our approach is fairly robust against adversarial conditions by training it with datasets under different levels of poisoning attacks.

[1]  Sebastian Rudolph,et al.  Stream reasoning and complex event processing in ETALIS , 2012, Semantic Web.

[2]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Wu Liu,et al.  T-C3D: Temporal Convolutional 3D Network for Real-Time Action Recognition , 2018, AAAI.

[4]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[5]  Justin Salamon,et al.  A Dataset and Taxonomy for Urban Sound Research , 2014, ACM Multimedia.

[6]  Federico Cerutti,et al.  A Pilot Study on Detecting Violence in Videos Fusing Proxy Models , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[7]  Adrian Paschke,et al.  Knowledge-based processing of complex stock market events , 2012, EDBT '12.

[8]  Sebastian Rudolph,et al.  REAL-TIME COMPLEX EVENT RECOGNITION AND REASONING–A LOGIC PROGRAMMING APPROACH , 2012, Appl. Artif. Intell..

[9]  Chittaranjan Hota,et al.  An Ingestion Based Analytics Framework for Complex Event Processing Engine in Internet of Things , 2018, BDA.

[10]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[11]  Luc De Raedt,et al.  Probabilistic (logic) programming concepts , 2015, Machine Learning.

[12]  Mani Srivastava,et al.  Neuroplex: learning to detect complex events in sensor networks through knowledge injection , 2020, SenSys.

[13]  Luc De Raedt,et al.  Neural probabilistic logic programming in DeepProbLog , 2019, Artif. Intell..

[14]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[15]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[16]  Juan Boubeta-Puig,et al.  Integrating complex event processing and machine learning: An intelligent architecture for detecting IoT security attacks , 2020, Expert Syst. Appl..

[17]  Luc De Raedt,et al.  DeepProbLog: Neural Probabilistic Logic Programming , 2018, BNAIC/BENELEARN.

[18]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[19]  David Luckham,et al.  The power of events - an introduction to complex event processing in distributed enterprise systems , 2002, RuleML.