Data-Driven Windows to Accelerate Video Stream Content Extraction in Complex Event Processing

This work presents a data-driven adaptive windowing approach to accelerate video content extraction in DNN-based Complex Event Processing (CEP) systems. The CEP windows continuously monitor low-level content of incoming video frames and exploit interframe correlations to accelerate the overall DNN content extraction process. The two main contributions are: 1) technique to create micro-batches of similar frames within the window by measuring dissimilarities among them, and 2) optimal frame resolution within micro-batches under specified accuracy thresholds for fast model processing. The initial experimental results show that our adaptive micro-batching approach improves 3.75X model throughput execution while maintaining application-level latency bounds under required accuracy constraints.

[1]  Matei Zaharia,et al.  NoScope: Optimizing Deep CNN-Based Queries over Video Streams at Scale , 2017, Proc. VLDB Endow..

[2]  CugolaGianpaolo,et al.  Processing flows of information , 2012 .

[3]  Ricard Gavaldà,et al.  Learning from Time-Changing Data with Adaptive Windowing , 2007, SDM.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Edward Curry,et al.  VEKG: Video Event Knowledge Graph to Represent Video Streams for Complex Event Pattern Matching , 2019, 2019 First International Conference on Graph Computing (GC).

[6]  Edward Curry,et al.  VidCEP: Complex Event Processing Framework to Detect Spatiotemporal Patterns in Video Streams , 2019, 2019 IEEE International Conference on Big Data (Big Data).