A Hybrid Neuro-Symbolic Approach for Complex Event Processing

Training a model to detect patterns of interrelated events that form situations of interest can be a complex problem: such situations tend to be uncommon, and only sparse data is available. We propose a hybrid neuro-symbolic architecture based on Event Calculus that can perform Complex Event Processing (CEP). It leverages both a neural network to interpret inputs and logical rules that express the pattern of the complex event. Our approach is capable of training with much fewer labelled data than a pure neural network approach, and to learn to classify individual events even when training in an end-to-end manner. We demonstrate this comparing our approach against a pure neural network approach on a dataset based on Urban Sounds 8K.

[1]  V. S. Costa,et al.  Theory and Practice of Logic Programming , 2010 .

[2]  Federico Cerutti,et al.  A Pilot Study on Detecting Violence in Videos Fusing Proxy Models , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[3]  Aren Jansen,et al.  CNN architectures for large-scale audio classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Alexander Artikis,et al.  A probabilistic logic programming event calculus , 2012, Theory and Practice of Logic Programming.

[5]  Justin Salamon,et al.  A Dataset and Taxonomy for Urban Sound Research , 2014, ACM Multimedia.