An Adaptive Ordering Framework for Filtering Multimedia Streams

In multimedia stream filtering scenario, there usually exist many filtering rules that specify the filtering objectives and many filtering units that estimate the filtering rules. A filtering rule may connect to several different filtering units and a filtering unit may connect to several different filtering rules. An open problem in such a filtering scenario is how to order the filtering units in an optimal sequence so as to decrease the filtering cost. Existing methods are based on a greedy strategy which orders the filtering units according to three factors of the filtering units, i.e., the selectivity, popularity, and cost. Although all these methods reported good results, there is still one important problem that hasn’t been addressed yet. The selectivity factor is set empirically, which is unable to adaptively adjust with stream passing by. Under these observations, in this paper, we propose an Adaptive ordering framework (AOF) which executes an adaptive ordering strategy. In AOF, all the temporal filtering results are preserved in each sliding window. Accordingly, the selectivity can adjust automatically and thus all the filtering units can be ordered with respect to the adapted selectivity. Experiments on both synthetic and real life multimedia streams demonstrate that our AOF method outperforms other simple filtering methods

[1]  Jennifer Widom,et al.  Adaptive ordering of pipelined stream filters , 2004, SIGMOD '04.

[2]  David J. DeWitt,et al.  NiagaraCQ: a scalable continuous query system for Internet databases , 2000, SIGMOD 2000.

[3]  Ning Wu,et al.  Flow algorithms for two pipelined filter ordering problems , 2006, PODS '06.

[4]  Marcos K. Aguilera,et al.  Matching events in a content-based subscription system , 1999, PODC '99.

[5]  Jennifer Widom,et al.  Optimization of continuous queries with shared expensive filters , 2007, PODS.

[6]  David J. DeWitt,et al.  NiagaraCQ: a scalable continuous query system for Internet databases , 2000, SIGMOD '00.

[7]  Jan Vondrák,et al.  Stochastic Covering and Adaptivity , 2006, LATIN.

[8]  Alfonso Fuggetta,et al.  Exploiting an event-based infrastructure to develop complex distributed systems , 1998, Proceedings of the 20th International Conference on Software Engineering.

[9]  David J. DeWitt,et al.  Design and evaluation of alternative selection placement strategies in optimizing continuous queries , 2002, Proceedings 18th International Conference on Data Engineering.

[10]  Surajit Chaudhuri,et al.  Optimization of queries with user-defined predicates , 1996, TODS.

[11]  S. Sudarshan,et al.  Pipelining in multi-query optimization , 2001, PODS '01.

[12]  Hao Yang,et al.  Near-optimal algorithms for shared filter evaluation in data stream systems , 2008, SIGMOD Conference.

[13]  Michael Stonebraker,et al.  Predicate migration: optimizing queries with expensive predicates , 1992, SIGMOD Conference.

[14]  Samuel Madden,et al.  Continuously adaptive continuous queries over streams , 2002, SIGMOD '02.

[15]  Krithi Ramamritham,et al.  Materialized view selection and maintenance using multi-query optimization , 2000, SIGMOD '01.