论文信息 - Performance Comparison of Spark Clusters Configured Conventionally and a Cloud Service

Performance Comparison of Spark Clusters Configured Conventionally and a Cloud Service

Abstract Apache Spark is an open source cluster computing technology specifically designed for large scale data processing. This paper deals with the deployment of Spark cluster as a cloud service on the OpenStack based cloud. HiBench benchmark suite is used to compare the performance of Spark cluster as a service and conventional Spark cluster. The results clearly depict how Spark as a cloud service gives more promising outcomes in terms of time, effort and throughput.

[1] Rajkumar Buyya,et al. Big Data computing and clouds: Trends and future directions , 2013, J. Parallel Distributed Comput..

[2] Muhammad Ali Ismail,et al. Performance comparison of Hadoop Clusters configured on virtual machines and as a cloud service , 2014, 2014 International Conference on Emerging Technologies (ICET).

[3] Muhammad Ali Ismail,et al. Performance optimization of Hadoop cluster using linux services , 2014, 17th IEEE International Multi Topic Conference 2014.

[4] Taghi M. Khoshgoftaar,et al. Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[5] Ciprian Dobre,et al. Parallel Programming Paradigms and Frameworks in Big Data Era , 2013, International Journal of Parallel Programming.

[6] Rohan Arora,et al. Comparing Apache Spark and Map Reduce with Performance Analysis using K-Means , 2015 .

[7] N. B. Anuar,et al. The rise of "big data" on cloud computing: Review and open research issues , 2015, Inf. Syst..

[8] Taghi M. Khoshgoftaar,et al. A survey of open source tools for machine learning with big data in the Hadoop ecosystem , 2015, Journal of Big Data.