On the Performance Evaluation of IaaS Cloud Services With System-Level Benchmarks

Infrastructure-as-a-serviceisacloudservicemodelthatallowscustomerstooutsourcecomputing resourcessuchasserversandstorage.ThisarticleevaluatesfourIaaScloudservices-AmazonEC2, MicrosoftAzure,GoogleComputeEngineandRackspaceCloudinavendor-neutralapproachwith regardstosystemparameterusageincludingserver,fileI/Oandnetworkutilization.Thus,systemlevelbenchmarkingprovidesobjectivecomparisonofcloudprovidersfromperformancestandpoint. Unixbench,DbenchandIperfaretheSystem-levelbenchmarkschosentotesttheperformanceof server,fileI/Oandnetworkrespectively.Inordertocapturethevariationinperformance,thetestswere performedatdifferenttimesonweekdaysandweekends.Witheachoffering,thebenchmarksaretested ondifferentconfigurationstoprovideaninsighttothecloudusersinselectionofproviderfollowed byappropriateVMsizingaccordingtotheworkloadrequirement.Inadditiontotheperformance evaluation,price-per-performancevalueofalltheprovidersisalsoexaminedandcompared. KEyWORdS Benchmarking, Infrastructure-as-a-Service, Performance, Performance Variability