Una Aproximación Multi-Agente para el Soporte al Proceso de Extracción- Transformación-Carga en Bodegas de Datos A Multi-Agent Approach for the Extract-Transform-Load Process Support in Data Warehouses

In order to provide an adequate solution in terms of robustness and automation in the process of Extract-Transform-Load (ETL) in data warehouses, in this article a multi-agent model that gathers the strengths of other approaches like wrappers and ad-hoc solutions is presented. Such a model considers the heterogeneity and availability of the data sources as well as their distributed nature. For its validation an experiment was performed using simulated and real data, which demonstrated not only its technical feasibility but also its effectiveness in terms of the percentage of processed data and the time to accomplish it.

[1]  Guo Chao-zhen Research of distributed ETL engine based on multi-agent and workflow , 2009 .

[2]  Nicholas R. Jennings,et al.  A Roadmap of Agent Research and Development , 2004, Autonomous Agents and Multi-Agent Systems.

[3]  François Goasdoué,et al.  The Use of CARIN Language and Algorithms for Information Integration: The PICSEL System , 2000, Int. J. Cooperative Inf. Syst..

[4]  Ghen Hong-gang Research on real-time ETL system model based on multi-Agent , 2010 .

[5]  Giancarlo Fortino,et al.  A customizable multi-agent system for distributed data mining , 2007, SAC '07.

[6]  Jennifer Widom,et al.  The TSIMMIS Project: Integration of Heterogeneous Information Sources , 1994, IPSJ.

[7]  Roger King,et al.  Generating data integration mediators that use materialization , 1996, Journal of Intelligent Information Systems.

[8]  Panos Vassiliadis,et al.  Conceptual modeling for ETL processes , 2002, DOLAP '02.

[9]  João Moura Pires,et al.  A Real Time Data Extraction, Transformation and Loading Solution for Semi-structured Text Files , 2005, EPIA.

[10]  Cass Squire,et al.  Data extraction and transformation for the data warehouse , 1995, SIGMOD '95.

[11]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[12]  Chengqi Zhang,et al.  Data preparation for data mining , 2003, Appl. Artif. Intell..

[13]  Timos K. Sellis,et al.  Optimizing ETL processes in data warehouses , 2005, 21st International Conference on Data Engineering (ICDE'05).

[14]  A. Hussain,et al.  Using Agents for Unification of Information Extraction and Data Mining , 2005, 2005 International Conference on Information and Communication Technologies.

[15]  Chantal Reynaud,et al.  Knowledge representation for information integration , 2004, Inf. Syst..