Dynamic Filtering and Mining Triggers in Mesoscale Meteorology Forecasting

Mesoscale meteorology forecasting as a data driven application is capable of reacting to events in real-time. We explore a framework for dynamic filtering and mining of data products to generate timely triggers for invoking forecasting applications. In this paper, we present our framework, which couples the Calder stream processing system developed at Indiana University for filter processing and trigger generation, and data mining algorithms developed as part of the ADaM data mining tool kit developed at ITSC, UAH, which detect events for trigger generation.

[1]  Beth Plale,et al.  Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering , 2006, IPAW.

[2]  R. Ramachandran,et al.  Mining NEXRAD Radar Data : An Investigative Study , 2003 .

[3]  Yi Huang,et al.  WS-Messenger: a Web services-based messaging system for service-oriented grid computing , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[4]  Ying Liu,et al.  Calder query grid service: insights and experimental evaluation , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[5]  Ümit V. Çatalyürek.  Supporting large scale data driven science in distributed environments , 2005 .

[6]  Rahul Ramachandran,et al.  ADaM: a data mining toolkit for scientists and engineers , 2005, Comput. Geosci..

[7]  Yi Huang,et al.  Cooperating services for data-driven computational experimentation , 2005, Computing in Science & Engineering.

[8]  Frederick Reiss,et al.  TelegraphCQ: Continuous Dataflow Processing for an Uncertain World , 2003, CIDR.

[9]  Peter Scheuermann,et al.  Active Database Systems , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[10]  Joseph M. Hellerstein,et al.  Eddies: continuously adaptive query processing , 2000, SIGMOD '00.

[11]  Michael J. Franklin,et al.  Efficient Filtering of XML Documents for Selective Dissemination of Information , 2000, VLDB.

[12]  Ying Liu,et al.  Realization of GGF DAIS Data Service Interface for Grid Access to Data Streams , 2005 .

[13]  Rahul Ramachandran,et al.  Service-oriented environments for dynamically interacting with mesoscale weather , 2005, Computing in Science & Engineering.

[14]  Beth Plale.  Framework for bringing data streams to the grid , 2004, Sci. Program..

[15]  Ying Xing,et al.  The Design of the Borealis Stream Processing Engine , 2005, CIDR.