The Golden Mean Operator Scheduling Strategy in Data Stream Systems

A scheduling strategy, called Golden Mean (GM), is designed to achieve the dynamic balance between the memory usage minimization and latency minimization by taking the status of the future workload, the current memory consumption and QoS requirement of the query into account. In the GM scheduling strategy, the executing order of the operators is decided uniformly according to the Scoring Function. The static parameters in the Scoring Function can be customized to meet the need of various application scenarios, while the dynamical parameters can be adjusted automatically according to the current system status. In addition, the priority levels of queries can be guaranteed by GM. The experimental results indicate that the GM scheduling strategy is very effective in practice.

[1]  Michael Stonebraker,et al.  Operator Scheduling in a Data Stream Manager , 2003, VLDB.

[2]  Elke A. Rundensteiner,et al.  An adaptive multi-objective scheduling selection framework for continuous query processing , 2005, 9th International Database Engineering & Application Symposium (IDEAS'05).

[3]  Sharma Chakravarthy,et al.  Scheduling Strategies for Processing Continuous Queries over Streams , 2004, BNCOD.

[4]  Rajeev Motwani,et al.  Operator scheduling in data stream systems , 2004, VLDB 2004.

[5]  Mohamed A. Sharaf,et al.  Preemptive rate-based operator scheduling in a data stream management system , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..