Towards The Deployment Of Fastflow On Distributed Virtual Architectures

In this paper we investigate the deployment of FastFlow applications on multi-core virtual platforms. The overhead introduced by the virtual environment has been measured using a well-known application benchmark both in the sequential and in the FastFlow parallel setting. The overhead introduced for both the sequential and the parallel executions of CPU and memory-intensive applications is in the range of 2-30%, while the execution speedup is almost preserved. Additionally, we have ported the FastFlow benchmark to a cloud-based distributed environment in which a task-intensive application has been tested and the performance compared with the corresponding run on a smaller cluster of multi-core machines without virtualisation. From a parallel programming perspective, we have demonstrated how a unique programming framework based on the structured parallel programming paradigm can cope with very different kind of target architectures without any (or minimal) code intervention.

[1]  Peter Kilpatrick,et al.  The ParaPhrase Project: Parallel Patterns for Adaptive Heterogeneous Multicore Systems , 2011, FMCO.

[2]  Peter Kilpatrick,et al.  Accelerating Code on Multi-cores with FastFlow , 2011, Euro-Par.

[3]  Peter Kilpatrick,et al.  An Efficient Unbounded Lock-Free Queue for Multi-core Systems , 2012, Euro-Par.

[4]  Qiang Zhang,et al.  The Characteristics of Cloud Computing , 2010, 2010 39th International Conference on Parallel Processing Workshops.

[5]  Peter Kilpatrick,et al.  Targeting Distributed Systems in FastFlow , 2012, Euro-Par Workshops.

[6]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[7]  Horacio González-Vélez,et al.  Heterogeneous Algorithmic Skeletons for Fast Flow with Seamless Coordination over Hybrid Architectures , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[8]  Octavian Prostean,et al.  A survey of management interfaces for eucalyptus cloud , 2012, 2012 7th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[9]  Lizhe Wang,et al.  Scientific Cloud Computing: Early Definition and Experience , 2008, 2008 10th IEEE International Conference on High Performance Computing and Communications.

[10]  Kang G. Shin,et al.  Performance Evaluation of Virtualization Technologies for Server Consolidation , 2007 .

[11]  Sami Tabbane,et al.  State of the Art and Research Challenges of new services architecture technologies: Virtualization, SOA and Cloud Computing , 2010 .

[12]  Marco Danelutto,et al.  Parallel Patterns for General Purpose Many-Core , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[13]  Geoffrey C. Fox,et al.  High Performance Parallel Computing with Clouds and Cloud Technologies , 2009, CloudComp.

[14]  Alina Madalina Lonea.  Private Cloud Set Up Using Eucalyptus Open Source , 2012, SOFA.

[15]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[16]  Horacio González-Vélez,et al.  Streaming Dynamic Coarse-Grained CPU/GPU Workloads with Heterogeneous Pipelines in FastFlow , 2012, 2012 IEEE 14th International Conference on High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems.

[17]  Ludmila Cherkasova,et al.  Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor , 2005, USENIX ATC, General Track.

[18]  Peter Kilpatrick,et al.  Structured Data Access Annotations for Massively Parallel Computations , 2012, Euro-Par Workshops.

[19]  Tatiana Kovacikova,et al.  Grid and Cloud Computing: Opportunities for Integration with the Next Generation Network , 2009, Journal of Grid Computing.

[20]  Hong Ong,et al.  An Analysis of HPC Benchmarks in Virtual Machine Environments , 2009, Euro-Par Workshops.

[21]  Horacio González-Vélez,et al.  A survey of algorithmic skeleton frameworks: high‐level structured parallel programming enablers , 2010, Softw. Pract. Exp..