The scientific event processing for research and development adds extra dimension to the complexities associated with scientific computing. In achieving this, experience gained building scientific computing infrastructures that could span and scale into super computing resources can be reused in significant ways. But there are many unresolved issues relating to managing event streams in such an environment that require attention. Over the years the volumes of events generated in scientific disciplines have steadily grown. The limiting factor of many of these systems have become the time and attention of scientist and with expertise to derive insight out of the high volumes of events generated by the sensors. In this tutorial we propose to share the motivating use cases, research issues and outcomes and tools and frameworks used for event processing in science gateways in conjunction with complex event processing. We would provide hands on experience to the programming model, framework and tools that had evolved as a result of research over the years and relate how the scientific workflow based programming paradigm can provide a cleaner abstraction for query based Complex event processing systems.
[1]
K. Mani Chandy,et al.
Towards a theory of events
,
2007,
DEBS '07.
[2]
Chathura Herath,et al.
Streamflow Programming Model for Data Streaming in Scientific Workflows
,
2010,
2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.
[3]
Xiaowen Wu,et al.
A new framework for on-demand virtualization, repurposing and fusion of heterogeneous sensors
,
2009,
2009 International Symposium on Collaborative Technologies and Systems.
[4]
David Luckham,et al.
The power of events - an introduction to complex event processing in distributed enterprise systems
,
2002,
RuleML.
[5]
Anne E. Trefethen,et al.
The Data Deluge: An e-Science Perspective
,
2003
.
[6]
Dennis Gannon,et al.
Workflows for e-Science, Scientific Workflows for Grids
,
2014
.
[7]
J. Done,et al.
The next generation of NWP: explicit forecasts of convection using the weather research and forecasting (WRF) model
,
2004
.
[8]
Robert Stephens,et al.
A survey of stream processing
,
1997,
Acta Informatica.