Fine-grain vs. coarse-grain web-service for ETL correctness and performance in cloud databases

Cloud services can be consumed using web service calls through the APIs provided by the cloud provider. Although using a fine-grained web-service request allows better flexibility of services, this approach will require service consumers to make multiple service requests to the cloud. The cloud will end up receiving a significantly higher number of requests, lowering the performance and increasing latency. The fine-grain APIs can also leave the data in an inconsistent state and create maintenance problems. Using coarse-grain requests will reduce the load on the server, especially necessary for cloud PAAS (Platform as a service) with governor limits on the number of API requests. In our research, we have proved that encapsulating multiple objects in a single API request will also improve the bandwidth, latency and API consumption for cloud PAAS.

[1]  D. Chiadmi,et al.  A method for modelling and organazing ETL processes , 2012, Second International Conference on the Innovative Computing Technology (INTECH 2012).

[2]  Yuqing Lan,et al.  SETL: A scalable and high performance ETL system , 2012, 2012 3rd International Conference on System Science, Engineering Design and Manufacturing Informatization.

[3]  Csilla Farkas,et al.  Coarse Grained Web Service Availability, Consistency, and Durability , 2013, 2013 IEEE 20th International Conference on Web Services.

[4]  María S. Pérez-Hernández,et al.  Consistency in the Cloud: When Money Does Matter! , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.