1 Cloud SLAs: Present and Future Salman A. Baset IBM Research Abstract The variability in the service level agreements (SLAs) of cloud providers prompted us to ask the question how do the SLAs compare and how should the SLAs be defined for future cloud services. We break down a cloud SLA into easy to understand components and use it to compare SLAs of public cloud providers. Our study indicates that none of the surveyed cloud providers offer any performance guarantees for compute services and leave SLA violation detection to the customer. We then provide guidance on how SLAs should be defined for future cloud services. 1 Introduction Cloud-based services are increasingly becoming commonplace. These services include infrastructureas-a-service (IaaS), platform-as-a-service (PaaS), and software-as-a-service (SaaS) ( ). Each service is typically accompanied by a service level agreement (SLA) which defines the minimal guarantees that a provider offers to its customers. The lack of standardization in cloud-based services implies a corresponding lack of clarity in the service level agreements offered by different providers. In this paper, our goal is to systematically compare the SLAs of cloud providers and to provide guidance on how SLAs should be defined for cloud-based services in future. We break down a cloud SLA into easy to understand components (which we refer to as anatomy of cloud SLA) and use it to compare the service level agreements of Amazon , Rackspace , Microsoft Windows Azure , Terremark vcloud Express , and Storm on Demand . All of the considered cloud providers offer IaaS services, and some offer PaaS services. By breaking down SLA into different components, we are able to highlight the similarities and differences among the SLAs of considered cloud providers. A common aspect of the considered SLAs is that none of the cloud providers offer any performance guarantees for the compute services. Moreover, no cloud provider automatically credits the customer for SLA violations, and leaves the burden of providing evidence for any such violation on the customer. The rest of this paper is organized as follows. Section 2 discusses the anatomy of a typical cloud SLA. Section 3 gives an overview of cloud services offered by the considered cloud providers. Section 4 describes the SLAs of the considered cloud providers. Section 5 highlights the key aspects of our comparison, and discusses what is missing from the considered SLAs. Section 6 provides guidance on defining SLAs for future cloudbased services, and the challenges involved in defining performance based SLAs. 2 Anatomy of a Typical Cloud SLA A typical SLA of a cloud provider has the following components. Service guarantee specifies the metrics which a provider strives to meet over a service guarantee time period. Failure to achieve those metrics will result in a service credit to the customer. Availability (e.g., 99.9%), response time (e.g., less than 50 ms), disaster recovery, and fault resolution time (e.g., within one hour of detection) are examples of service guarantees. Some service guarantees can be on a per action basis, such as zeroing out a VM disk when it is deprovisioned. Service guarantee time period describes the duration over which a service guarantee should be met. The time period can be a billing month or time elapsed since the last claim was filed. The time period can also be small, e.g., one hour. The smaller the time period, the more stringent is the service guarantee. 57
2 Service guarantee granularity describes the resource scale on which a provider specifies a service guarantee. For example, the granularity can be on a per service, per data center, per instance, or per transaction basis. Similar to time period, the service guarantee can be stringent if the granularity of service guarantee is fine-grained. Service guarantee granularity can also be calculated as an aggregate of the considered resources, such as instances or transactions. For example, aggregate uptime of all running instances must be greater than 99.95%. However, such a guarantee implies that some instances in the aggregate SLA computation can potentially have a lower percentage uptime than 99.95% while still meeting the aggregate SLA. As a consequence, aggregate SLA computation leaves provider the wiggle room to better manage its offered services. Service guarantee exclusions are the instances that are excluded from service guarantee metric calculations. These exclusions typically include abuse of the system by a customer, or any downtime associated with the scheduled maintenance. Service credit is the amount credited to the customer or applied towards future payments if the service guarantee is not met. The amount can be a complete or partial credit of the customer payment for the affected service. Service violation measurement and reporting describes how and who measures and reports the violation of service guarantee, respectively. 3 Cloud Providers Considered We briefly give an overview of cloud services offered by Amazon , Rackspace , Microsoft Azure , Terremark vcloud Express , and Storm on Demand . These providers offer IaaS and PaaS compute and storage services. The compute service comprises of a virtual machine (or instance) or CPU cycles that a customer can purchase on an hourly, monthly, or yearly basis. The storage service allows storage and retrieval of blob or structured data. We interchangeably use customer and user to refer to the clients of cloud providers. 3.1 Amazon Amazon  is an IaaS provider and offers compute (EC2 ) and storage (S3 ) services. In EC2, a customer can obtain virtual machines (instances) by the hour or reserve them in advance for an entire year . In addition, EC2 offers spot instances where a customer can bid for compute capacity. EC2 SLA  is applicable to hourly, spot, and reserved instances. The storage service S3 provides mechanism for storing and retrieving data objects using put(), get() operations with data size ranging from one byte to five tera bytes. Amazon also provides a remote disk capability for its virtual machines, namely, Elastic Block Store (EBS). EBS volumes are replicated within an availability zone. A data center (or region) can contain multiple availability zones. The availability zones do not have power, networking, or hardware equipment in common. EBS volumes are not backed by any SLA; however, the snapshots of EBS volumes can be stored on S3, which as mentioned before is backed by a SLA. When creating an instance, the user must specify the region and availability zone in which she creates the instance. Amazon also provides a SimpleDB  service which is a simplified relational database service. However, the service is still in beta at the time of writing of this paper. Among S3, EBS, and SimpleDB services, only S3 is backed by an SLA . 3.2 Windows Azure Windows Azure  is a PaaS and IaaS cloud provider that offers compute (Azure Compute ) and storage (Azure Storage ) services. Azure Compute comprises of three types of compute services (which it refers to as roles), namely, web, worker, and a VM. A web role provides a web based front end for an application and comprises of an IIS server . A worker role is useful for generalized development. It can run Apache Tomcat and Java Virtual Machines (JVMs) and can be used to perform background processing for a web role. A VM role is similar to instances in Amazon EC2, and gives user complete control over the virtual machine. However, at this time, VM roles are only available in beta  and are not covered by Azure Compute SLA . The compute service can only be purchased on an hourly basis, and cannot be reserved in advance for the entire year. Azure Compute service defines the notion of a fault domain and an upgrade domain. Each compute role belongs to a fault domain and an upgrade domain. A fault domain comprises of a single point of failure and is at least a physical machine, but may also be a rack of machines; the precise details of what comprises a fault domain are not available. An upgrade domain defines which compute roles can simultaneously receive the software or operating system updates. A fault domain may span several update domains. Likewise, an update domain may also span several fault domains. Azure also provides Azure Storage , an S3 like storage service, which can be used for storing and re- 58
3 trieving blob and structured data. It also provides a queuing service and remote disks (known as Azure Drive). Azure storage service is backed by a SLA . 3.3 Rackspace Rackspace  is an IaaS provider that provides compute instances similar to Amazon EC2 and VM role of Azure, which it refers to as Cloud Servers. A customer can obtain VMs on an hourly basis which are covered by an SLA . However, unlike EC2, Cloud Servers cannot be reserved in advance for the entire year. Rackspace also provides a managed service level for Cloud Servers. As part of the managed service, Rackspace is responsible for applying software and security patches for operating system and middleware. Rackspace provides a storage service called Cloud Files which allows a customer to store and retrieve files in the cloud and is covered by an SLA . The stored files are internally replicated by Rackspace. 3.4 Terremark vcloud Express Terremark vcloud Express  is an IaaS provider similar to EC2, VM role of Azure, and Rackspace. A customer can obtain VMs on an hourly basis which are covered by an SLA . Terremark does not provide a specialized storage service. 3.5 Storm on Demand Storm on Demand  is an IaaS provider similar to EC2, the VM role of Azure, Rackspace, and Terremark vcloud Express. A customer can obtain VMs on an hourly basis which are covered by an SLA . 4 Description of SLAs We describe SLAs of compute and storage services offered by cloud providers considered in this paper. 4.1 Amazon Amazon EC2 and S3 services are backed by distinct SLAs. Below, we describe the SLAs of these services in detail EC2 SLAs Amazon EC2 SLA  is defined on a per data center (region in Amazon speak) basis instead of per instance. EC2 offers a 99.95% region availability rate (service guarantee). If a user is unable to access her instances in one region during a contiguous period of five minutes or launch replacement instances, the region is deemed to be unavailable during those five minutes. The burden of providing the evidence for region unavailability is on the user. Strictly speaking, if a user is running at least one VM which she cannot access during a five minute interval and cannot launch a replacement, she is eligible for a service credit if the credit value is above one dollar. A customer can claim a service credit anytime the service falls below the availability SLA in the last 365 days or since the last time a service credit claim was filed by the customer. The service credit is up to 10% of a customer s bill (excluding any one-time costs) for the instances affected by the outage. Service credits are typically only applicable towards future EC2 payments. Amazon requires that the service credit claim be received from the customer within 30 business days of the last reported incident in the filed claim. Amazon does not provide any service credit for failures of individual instances not attributable to region unavailability. This clause means that even if a region (data center) is available, but some services in that region fail such as EBS on which an instance depends, Amazon is at least legally not bound to provide a service credit, although it may provide a credit at its own discretion. For example, Amazon provided a service credit  for its April 2011 outage due to EBS failures. Further, Amazon does not provide any service credits if VMs suffer from any performance issues. A VM can suffer performance degradation due to co-location or hardware differences of the underlying physical machine . Amazon EC2 SLA does not specify that scheduled and unscheduled maintenance are excluded from the service guarantee. EC2 SLA is defined on a data center basis, and, arguably, the data center being unavailable for scheduled maintenance is unlikely because it will impact all customers running their instances in that data center S3 SLAs Amazon S3 SLA  provides storage request completion guarantee of 99.9% over a billing month (service guarantee time period). A storage request is considered failed if S3 server returns an Internal Error or Service Unavailable response to a request. These responses correspond to HTTP response codes 500 and 503. The burden of reporting request failure and providing evidence is on the customer. S3 calculates failed requests over a five minute interval, which are then averaged over a month. The failed requests are calculated by dividing the number of requests generating an error response to the total number of requests in the five minute interval. The percentage of completed transactions in the billing month is calculated 59
4 Request type (1) PutBlob and GetBlob (includes blocks and pages) (2) Get Valid Page Blob Ranges Copy Blob PutBlockList, GetBlockList Table query, List operations Batch table operations (1) All Single Entity Table Operations (2) All other Blob and Message Operations Maximum processing time Must complete within the product of 2 seconds multiplied by the number of MBs transferred in processing the request Must complete processing within 90 seconds Must complete processing within 60 seconds Must complete processing or return a continuation within 10 seconds Must complete processing within 30 seconds Must complete processing within 2 seconds Table 1: Maximum processing times for Azure storage transactions  by subtracting from 100% the average of failed request rates from each five minute period. The service credit is 10% of the customer bill if completion rate is below 99.9% and 25% of the customer bill if completion rate is less than 99%. Amazon must receive the claim within 10 business days after the billing month in which the incident occurred. Similar to EC2 SLA, Amazon S3 SLA does not exclude scheduled and unscheduled maintenance from service guarantee. Moreover, S3 service does not specify any performance guarantees on the storage requests. 4.2 Windows Azure Azure compute and storage service are backed by separate SLAs which are described below Azure Compute SLA Azure Compute SLA  provides connectivity and uptime service guarantees for its non-beta compute roles over a billing month (service guarantee time period). For Azure Compute SLA to be applicable, a customer must deploy at least two instances of a compute role type in different update domains. Recall from Section 3.2 that an update domain comprises of compute roles which receive the software or operating system updates at the same time. Unlike Amazon EC2, which provides availability SLA on a per data center basis, Azure SLA is calculated as an aggregate over the deployed roles. Azure SLA defines two service guarantees, namely, external network connectivity and uptime which are calculated on a monthly basis. The connectivity service guarantee is defined as the aggregate time since all the Internet facing roles have been started minus the five minute intervals during which any role does not have connectivity, divided by the aggregate time since roles have been started. Like Amazon EC2, Azure calculates downtime for its compute roles 1 in increments of five minute intervals. The uptime service guarantee is defined as the aggregate time since roles have been deployed and started minus the time across all role instances which do not run for more than two minutes without corrective action being initiated, divided by the aggregate time since roles have been started. Any performance or availability issues due to regular platform upgrades and patches are excluded from the uptime service guarantee calculation. The service credit is 10% of the customer bill if connectivity and uptime percentage is below 99.95% and 99.9%, respectively, and 25% if less than 99.9%. The onus for reporting a SLA violation and providing evidence is on the customer. Microsoft requires that a customer notifies it of the incident within five business days following the incident in order to be eligible to file a claim. Then, Microsoft must receive the claim within a month of the billing month in which the incident occurred Azure Storage SLA Azure Storage SLA  defines service guarantee as percentage of completed transactions in a billing month. A request is considered failed if the maximum time to process the request exceeds the time specified in the service guarantee. Table 1 lists the maximum processing time for various transactions. The maximum processing time does not include the time taken to transfer data in or out of Azure Storage service. Azure Storage calculates failed requests over one hour interval by dividing the total number of failed requests to the total storage requests. The percentage of completed transactions within a billing month is calculated by subtracting from 100% the average of failed request rates from each one hour period in the billing month. 1 non-beta compute roles only include web and worker roles 60
5 Similar to Azure Compute, the onus for reporting an SLA violation is on the customer. Microsoft requires that a customer notifies it of the incident within five business days following the incident in order to be eligible to file a claim. Then, Microsoft must receive claim within a month of the billing month in which the incident occurred. The service credit is 10% of the customer bill if number of completed transactions are below 99.9% and 25% of the customer bill if less than 99%. Similar to S3 SLA, Azure Storage SLA excludes any transactions from SLA computation that are beyond its reasonable control, and that result from customer s fault or abuse of the system. Unlike S3 SLA, Azure storage SLA gives detailed examples of excluded transactions such as pre-authentication failures, abusive transactions, creation or deletion of containers, tables or queues, or flooding requests not obeying back off principles. 4.3 Rackspace Rackspace provides a compute service, namely, Cloud Servers, similar to EC2 and also provides a storage service for storing and retrieving files, namely, Cloud Files Cloud Servers SLA Rackspace guarantees that its data center network, HVAC, and power will be 100% available in a billing month, excluding the scheduled maintenance. The scheduled maintenance does not exceed sixty minutes in any calendar month and must be announced at least 10 days in advance to the customer. If a scheduled maintenance of sixty minutes occurs every month (30 days), the maximum uptime percentage of a VM can never exceed 99.86%. If a physical server running the virtual machine fails, Rackspace guarantees that it will be repaired within an hour of problem identification. Further, if VMs need to be migrated due to server overload, it will not take more than three hours. The SLA does not specify if Rackspace performs live or offline migration of a VM. Rackspace computes SLA violations in increments of 30 minutes for data center network, HVAC, and power, and in one hour increments for downtime associated with physical servers or migration. If data center network, HVAC, power, or physical servers are down, or if VMs need to be migrated, the service credit starts from 5% of the customer bill up to 100% of the customer bill for affected compute instances. The implication of Cloud Servers SLA is that Rackspace provides service guarantee on a per virtual machine (instance) basis. A customer must contact Rackspace within 30 days following the downtime and provide the problem evidence in order to receive a service credit. However, it Availability Credit amount 100% % 0% 99.89% % 10% 99.49% % 25% 98.99% % 40% 97.99% % 55% 97.49% % 70% 96.99% % 85% Less than 96.5% 100% Table 2: Cloud Files service credit is unclear how a customer can provide evidence for a specific problem such as HVAC, power, or network failure. Perhaps, Rackspace maps the customer s evidence to specific problems and determine the service credit accordingly Cloud Files SLA Rackspace provides a 99.9% request completion rate and Cloud Files servers availability guarantee in a billing cycle . The service is considered unavailable if data center network is down, or if the service returns an error response (HTTP status code) to a request within two or more consecutive 90 second intervals, or if average download time for a 1-byte document exceeds 0.3 seconds. The unavailability due to scheduled maintenance is excluded from the availability calculations. Similar to Cloud Servers SLA, the scheduled maintenance period does not exceed 60 minutes and must be announced 10 days in advance. A customer must contact the Rackspace within 30 days following the downtime and provide the problem evidence in order to receive a service credit. The service credit amount is described in the Table Terremark vcloud Express Terremark vcloud Express only provides IaaS compute services. Below we describe the SLA of this service Compute SLA Terremark vcloud Express provides an uptime service guarantee of 100% for its data center. The service is deemed unavailable if the data center infrastructure or network is down, or if the user cannot access the web console for a duration of 15 minutes (service guarantee time period). The unavailability period of 15 minutes is three times more than the EC2 and Azure Compute 61
6 Service guarantee Service granularity guarantee Infrastructure scheduled maintenance OS/software patches on compute instances Service guarantee time period Service credit Service violation reporting onus Service violation incident reporting Service violation claim filing SLA publish date Credit applied towards future payments only Amazon EC2 Azure Compute Rackspace Terremark Storm on Demand Cloud Servers vcloud Express Availability Availability Availability Availability Availability Data center Unclear if excluded Aggregate across all roles Included in service guarantee N/A Excluded from service guarantee if managed 365 days or since last claim 10% of CB if < 99.95% Per instance Data center + management stack Excluded from Unclear if service guarantee excluded Excluded from service guarantee if managed Per instance Excluded from service guarantee N/A Excluded from service guarantee if managed Billing month Billing month Calendar month Calendar month 10% of CB if < 99.95% 25% of CB if < 99% 5% of CB for every 30 minutes of downtime up to 100% $1 for 15 minute downtime up to 50% of CB 1000% for every hour of downtime upto CB Customer Customer Customer Customer Customer N/A within 30 business days of the last reported incident in claim 5 days of incident occurence within one billing month N/A N/A N/A within 30 days of downtime within 30 days of the last reported incident in claim within 5 days of incident in question October 23, 2008 April 9, 2010 June 23, 2009 August 31, 2009 Unknown Yes No No Yes No Table 3: Compute SLA comparison. CB is an abbreviation for customer bill. implied from SLA. unavailability period of five minutes and as a result its service guarantee is less stringent than EC2 and Azure. Terremark vcloud Express defines a service credit of one dollar for every 15 minutes of downtime up to 50% of the usage fees on a monthly basis. Similar to EC2, a customer is responsible for reporting the downtime within 30 days of the last day reported in unavailability claim and providing supportive evidence. The service credit is typically applied towards future vcloud Express payments. 4.5 Storm on Demand Like Terremark vcloud Express, Storm on Demand only provides IaaS compute services. Below we describe the SLA of this service. 62
7 4.5.1 Compute SLA Storm on Demand guarantees a 100% uptime for network and power infrastructure of its data center. However, scheduled maintenance of network and power infrastructure or physical machines is not included in the uptime guarantee. Further, unlike Rackspace Cloud Servers SLA, the maximum scheduled downtime within a month is not part of the SLA. Moreover, if the customer lets Storm on Demand manage the software and operating updates, any downtime associated with these updates is also excluded from the uptime guarantee. Storm on Demand defines a service credit for service guarantee violations due to network and power infrastructure as follows: if a server is unreachable for one hour, the customer will receive a service credit of 10 hours. In other words, a customer can receive a service credit of up to 1000% of the actual amount associated with the downtime. However, the total compensation amount may not exceed customer s monthly recurring charge. Moreover, the hourly charges applicable for service credit do not include any additional service charges such as backup or additional IP s. It is the responsibility of a customer to file a credit claim within five business days of the incident in question and provide any supportive evidence. 5 Highlights of SLA Comparison Table 3 and Table 4 show a tabular comparison of compute and storage service SLAs of the cloud providers considered in this paper. We highlight several aspects from this tabular comparison and from SLA description in Section Weak Uptime Guarantees for Compute The considered cloud providers offer only weak uptime guarantees for running VMs and do not explicitly specify uptime guarantee on a per instance basis. Amazon EC2 and Terremark vcloud Express only offer uptime guarantee on a per data center basis instead of per instance basis. Arguably, the chance of a data center being unavailable is much lower than per instance. Rackspace Cloud Servers and Storm on Demand implicitly provide SLA guarantee on per instance basis. Azure Compute provides uptime guarantees as an aggregate over all instances instead of per instance basis. 5.2 No Performance Guarantees for Compute None of the considered cloud providers offer any performance guarantees for compute instances. As a consequence, a customer can only hope for its instances to receive the provisioned CPU, memory, network, and disk resources. Lack of performance guarantees may be unacceptable in enterprise clouds. 5.3 Customer Should Detect SLA Violation The considered cloud providers leave the burden of detecting SLA violation on the customer which may be unacceptable for enterprise. Verizon, an enterprise Internet connectivity provider, detects SLA violations for its dedicated Internet service . 5.4 Service Credit Service credits for SLA violation offered by Amazon EC2, S3, and Terremark vcloud Express can only be applied towards future payments of respective cloud services. Amazon EC2 and S3, Azure Compute and Storage, and Terremark vcloud Express only partially reimburse the total cost of affected services, while Rackspace Cloud Servers and Storm on Demand can provide up to 100% reimbursement. Storm on Demand is unique, in that it offers to reimburse 1000% of the cost of affected instances. However, it is relatively a new IaaS provider. 5.5 SLA Violation Reporting Time Period Azure Compute and Storage and Storm on Demand SLAs stipulate that a customer must report the SLA violation incident within five days of the incident occurrence which is more stringent than the 30 day violation reporting and claim filing time period offered by other cloud providers. Azure does allow a customer to file a claim 30 days after reporting the incident. 5.6 SLA Jargon An SLA is a legal document and is the sole remedy for a customer for any service violations. The lack of standardization in SLAs and the use of SLAs as a potential marketing vehicle makes it difficult to compare SLAs of different cloud providers. As an example, Storm on Demand, and Rackspace guarantee their data center network, HVAC, and power to be 100% of the time, but they qualify it with scheduled maintenance. Similarly, Azure Storage performance guarantee does not include the time it takes to transfer the data in and out of data center. For a designer of cloud application, it is important to pay attention to these details. 63
8 Amazon S3 Azure Storage Rackspace Cloud Files Service guarantee Completed transactions Completed trans- Completed transac- (with no error actions (within tions, availability response) stipulated time) Service granularity Per transaction Per transaction Per transaction, data guarantee center Service guarantee Billing month Billing month Per month time period Service credit 10% of CB if < 10% of CB if < 10% of CB if < 99%, 99.9%, 25% of CB if < 99% 99.9%, 25% of CB if < 99% 100% of CB if < 96.5% Service violation reporting Customer Customer Customer onus Service violation in- N/A 5 days of incident oc- N/A cident reporting Service violation claim filing within 10 business days following the month in which the incident occurred currence within one billing month within 30 days following unavailability SLA publish date October 1, 2007 November 12, 2010 June 23, 2009 Credit applied Yes No No towards future payments only Table 4: Storage SLA comparison. CB is an abbreviation for customer bill. 5.7 Storage SLAs: Performance vs. Request Completion For the storage SLAs, only Azure provides a performance guarantee per transaction, i.e., processing time for a request (which excludes the data download or upload time). Amazon S3 and Rackspace Cloud Files do not provide any performance guarantees and instead only provide a request completion guarantee. 5.8 SLAs Offered By Business Internet Providers We briefly describe the Internet Dedicated SLA offered by Verizon  and how it compares with SLAs offered by cloud providers. Verizon Internet SLA comprises of nine service guarantees such as availability, latency, network packet latency, ticket response time for denial of service, and time to repair. Unlike SLAs of cloud providers considered in this paper, the onus for detecting SLA violation for certain metrics such as availability is on Verizon. However, a customer must explicitly request a service credit within 30 days of the incident occurrence. Scheduled maintenance is excluded from the service guarantee calculation. A customer account is then automatically credited for any service violation which is not the case with any of the considered cloud provider SLAs. 5.9 What is Missing from the SLAs? The SLAs of the considered cloud providers only focus on availability or request completion rate. An enterprise cloud SLA encompasses much more than availability, request completion rate, or performance. It defines guidelines for disaster recovery, privacy, auditability, and security. The details of which service guarantees to consider for enterprise cloud SLAs can be found in cloud computing use cases paper . Further, unlike the public cloud providers considered in this paper, the burden of detecting SLA violation may lie on the provider. 6 Future of Cloud SLAs In this section, we consider how a cloud provider may define SLAs for cloud services in the future. Service guarantee: The considered cloud providers only provide uptime guarantees for IaaS services. The cloud providers may also want to offer other guarantees such as performance, security, 64
9 and ticket resolution time. Providing a performance guarantee becomes necessary if cloud providers oversubscribe the resources of physical servers to decrease the number of physical servers used and increase their utilization. The over-subscription of the physical servers implies that performance of virtual machines running on physical servers may become a concern. Further, co-location of a virtual machine with other workloads may also impact the CPU, disk, network, and memory performance of a VM. Moreover, enterprises purchasing cloud based services may demand a minimal level of performance guarantee. Therefore, it may be necessary for a cloud provider to offer performance based SLAs for its IaaS compute services with a tiered pricing model, and charge a premium for guaranteed performance. Service guarantee time period and granularity: The service guarantee time period and granularity determine how stringent is the underlying service guarantee. A service guarantee is stringent if the metric is performance based for a fine-grained resource over a small time period, e.g. 99.9% of memory transactions in a five minute interval must complete within one micro second. Such a stringent guarantee can be loosened by aggregating the service guarantee over a group of resources (e.g., aggregate uptime percentage of all instances must be greater than 99.5%). Providers can use a combination of service guarantee granularity and service guarantee time period to price their services appropriately. For enterprise and mission critical workloads, a cloud provider may have no choice but to provide finer service guarantees. Service violation detection and credit: None of the considered providers automatically detect SLA violation and leave the burden of providing the violation proof on the customer. This aspect may not be acceptable to customers with mission critical or enterprise workloads. A cloud provider can differentiate the pricing of its offering if it automatically detects and credits the customer for SLA violation. However, the tooling cost to automatically measure, record, and audit SLA metrics can be a concern. Outcome based SLAs: The cloud providers considered in this paper offer IaaS and PaaS services. Using these services, a customer can deploy her own applications in the cloud. However, in the future, cloud providers may offer outcome based services on top of cloud, where a provider delivers a complete solution for a customer using cloud. For outcome based services, a cloud provider needs to define SLAs for the promised outcomes and how those SLAs map to the underlying IaaS and PaaS infrastructure it provides. Standardization of SLAs: The lack of standardization in cloud SLAs makes it difficult for a customer to effectively compare them. As cloud services mature, and as the vision of utility computing is realized, the standardization of SLA is likely to take center stage. Structured representation of SLAs (e.g., in XML) may be necessary for standardized SLAs. 7 Conclusion In this paper, we break down a cloud SLA into several components, and use it for comparing SLAs of well known public IaaS providers. Our study indicates that none of the IaaS providers offer any performance based SLAs for compute services. Moreover, all cloud providers leave the burden of providing evidence for SLA violation on the customer. We then discussed how SLAs should be defined for future cloud services. We believe that customers and cloud providers will benefit from this study when purchasing or selling cloud-based services. This study will also help in clarifying and defining SLAs of existing and future cloud based services. References  Amazon. https://www.amazon.com, [Online; accessed August 2011].  Amazon EC2. https://aws.amazon.com/ ec2/, [Online; accessed August 2011].  Amazon EC2 Reserved Instances. https://aws.amazon.com/ec2/ reserved-instances/, [Online; accessed August 2011].  Amazon EC2 SLA. https://aws.amazon. com/ec2-sla/, [Online; accessed August 2011].  Amazon S3. https://aws.amazon.com/ s3/, [Online; accessed August 2011].  Amazon S3 SLA. https://aws.amazon. com/s3-sla/, [Online; accessed August 2011].  Amazon SimpleDB. https://aws.amazon. com/simpledb/, [Online; accessed August 2011]. 65
10  Amazon SLAs Didn t Cover Major Outage. news/cloud-computing/software/ , [Online; accessed August 2011].  Cloud Computing Usecases Whitepaper. org/cloud_computing_use_cases_ Whitepaper-4_0.pdf, [Online; accessed August 2011].  P. Mell and T. Grance. The NIST Definition of Cloud Computing. NIST Special Publication , September  Microsoft IIS. https://www.iis.net/, [Online; accessed August 2011].  Overview of the Windows Azure VM Role. library/gg aspx, [Online; accessed August 2011].  Windows Azure. https://www.microsoft. com/windowsazure/, [Online; accessed August 2011].  Windows Azure Compute. https: //www.microsoft.com/windowsazure/ features/compute/, [Online; accessed August 2011].  Windows Azure Compute SLA. https://www. microsoft.com/download/en/details. aspx?displaylang=en&id=24434, [Online; accessed August 2011].  Windows Azure Storage. https: //www.microsoft.com/windowsazure/ features/storage/, [Online; accessed August 2011].  Windows Azure Storage SLA. https://www. microsoft.com/download/en/details. aspx?displaylang=en&id=6656, [Online; accessed August 2011].  Rackspace. https://www.rackspace.com, [Online; accessed August 2011].  Rackspace Cloud Servers SLA. rackspace.com/cloud/legal/sla/, [Online; accessed August 2011].  J. Schad, J. Dittrich, and J.-A. Quiané-Ruiz. Runtime measurements in the cloud: observing, analyzing, and reducing variance. Proc. VLDB Endow., 3: , September  Storm on Demand. stormondemand.com, [Online; accessed August 2011].  Storm on Demand SLA. https://www. stormondemand.com/about/sla.html, [Online; accessed August 2011].  Terremark vcloud Express. http: //vcloudexpress.terremark.com/, [Online; accessed August 2011].  Terremark vcloud Express SLA. https:// community.vcloudexpress.terremark. com/en-us/product_docs/w/wiki/ service-level-agreement.aspx, [Online; accessed August 2011].  Verizon Internet Dedicated Service Level Agreement. com/terms/us/products/internet/ sla/, [Online; accessed March 2012]. 66
Cloud Service Level Agreement This Cloud Service Level Agreement is part of your Cloud Terms of Service. 1. DEFINITIONS The following definitions shall apply for purposes of this Cloud Service Level Agreement:
Volume-4, Issue-3, June-2014, ISSN No.: 2250-0758 International Journal of Engineering and Management Research Available at: www.ijemr.net Page Number: 126-131 Service Level Agreement Comparison in Cloud
Service Level Agreement for Windows Azure operated by 21Vianet Last updated: November 2015 1. Introduction This Service Level Agreement for Windows Azure (this SLA ) is made by 21Vianet in connection with,
THE WINDOWS AZURE PROGRAMMING MODEL DAVID CHAPPELL OCTOBER 2010 SPONSORED BY MICROSOFT CORPORATION CONTENTS Why Create a New Programming Model?... 3 The Three Rules of the Windows Azure Programming Model...
DISTRIBUTED SYSTEMS [COMP9243] Lecture 9a: Cloud Computing Slide 1 Slide 3 A style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet.
Spanning Backup for Google Apps Service Level Agreement June 6, 2014 This Service Level Agreement ( SLA ) between Spanning Cloud Apps, Inc. ( Spanning ), and the customer ( Customer ) of the Spanning Backup
How AWS Pricing Works May 2015 (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction...
How AWS Pricing Works (Please consult http://aws.amazon.com/whitepapers/ for the latest version of this paper) Page 1 of 15 Table of Contents Table of Contents... 2 Abstract... 3 Introduction... 3 Fundamental
AVLOR SERVER CLOUD RECOVERY WHITE PAPER 1 Table of Contents Abstract... 2 1. Introduction... 3 2. Server Cloud Recovery... 3 3. Amazon AWS Cloud... 4 a. What it is... 4 b. Why Use AWS?... 5 4. Difficulties
SERVICE SCHEDULE INFRASTRUCTURE AND PLATFORM SERVICES This Product Schedule Terms & Conditions is incorporated into a Services Agreement also comprising the General Terms and Conditions which the Customer
Part 1: Price Comparison Among The 10 Top Iaas Providers Table of Contents Executive Summary 3 Estimating Cloud Spending 3 About the Pricing Report 3 Key Findings 3 The IaaS Providers 3 Provider Characteristics
Microsoft Hyper-V Powered by Rackspace & Microsoft Cloud Platform Powered by Rackspace Support Services Terms & Conditions Your use of the Microsoft Hyper-V Powered by Rackspace or Microsoft Cloud Platform
Cloud Models and Platforms Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF A Working Definition of Cloud Computing Cloud computing is a model
The remedies set forth within this SLA are your sole and exclusive remedies for any failure of the service. NETWORK INTERNAL NETWORK The internal network includes cables, switches, routers, and firewalls
Cloud Computing What is Cloud Computing? Cloud computing is where the organization outsources data processing to computers owned by the vendor. Primarily the vendor hosts the equipment while the audited
Volume 2, Issue 2, February 2012 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: A COMPARATIVE STUDY OF CLOUD
Introduction to Cloud Computing Srinath Beldona email@example.com Agenda Pre-requisites Course objectives What you will learn in this tutorial? Brief history Is cloud computing new? Why cloud computing?
SERVICE LEVEL AGREEMENT This service level agreement ( SLA ) is incorporated into the master services agreement ( MSA ) and applies to all services delivered to customers. This SLA does not apply to the
Data In The Cloud: Who Owns It, and How Do You Get it Back? Presented by Dave Millier, Soban Bhatti, and Oleg Sotnikov 2013 Sentry Metrics Inc. Agenda Reasons for Cloud Adoption How Did My Data Get There?
HOSTING SERVICES AGREEMENT 1 Introduction 1.1 Usage. This Schedule is an addition to and forms an integral part of the General Terms and Conditions, hereafter referred as the "Main Agreement". This Schedule
THIS SERVICE LEVEL AGREEMENT DEFINES THE SERVICE LEVELS PROVIDED TO YOU BY THE COMPANY. Capitalized terms used herein but not otherwise defined shall have their respective meanings set forth in the End
Cloud Computing 101 Dissipating the Fog 2012/Dec/xx Why the interest in Clouds? A method to avoid/defer CAPEX/OPEX and possibly accelerating implementation 2 It all started here - Timeshare Computers and
Cloud Computing and Amazon Web Services Gary A. McGilvary edinburgh data.intensive research 1 OUTLINE 1. An Overview of Cloud Computing 2. Amazon Web Services 3. Amazon EC2 Tutorial 4. Conclusions 2 CLOUD
A White Paper Which is Better: Virtualization or Cloud IaaS? Which is Better: Virtualization or Cloud IaaS? Why should I consider Virtualization or Cloud IaaS at all? Simply put, they can save you money.
August 2014 Cloud Computing Sourcing Key Takeaways Market Penetration As of mid-2014, 87% of tech executives reported utilizing outsourced computing power for at least one task. Market Growth The service
Amazon Web Services Primer William Strickland COP 6938 Fall 2012 University of Central Florida AWS Overview Amazon Web Services (AWS) is a collection of varying remote computing provided by Amazon.com.
CLOUD SERVICE SCHEDULE Newcastle 1 DEFINITIONS Defined terms in the Standard Terms and Conditions have the same meaning in this Service Schedule unless expressed to the contrary. In this Service Schedule,
THIS SERVICE LEVEL AGREEMENT DEFINES THE SERVICE LEVELS PROVIDED TO YOU BY THE COMPANY ( Exchange My Mail ). I. Service Definition. Exchange My Mail will provide Hosted Exchange and other Application Services
SAAS MADE EASY: SERVICE LEVEL AGREEMENT THIS SERVICE LEVEL AGREEMENT DEFINES THE SERVICE LEVELS PROVIDED TO YOU BY THE COMPANY ( SaaS Made Easy ). Capitalized terms used herein but not otherwise defined
Oracle Maps Cloud Service Enterprise Hosting and Delivery Policies Effective Date: October 1, 2015 Version 1.0 Unless otherwise stated, these Oracle Maps Cloud Service Enterprise Hosting and Delivery Policies
P3 InfoTech Solutions Pvt. Ltd http://www.p3infotech.in July 2013 Created by P3 InfoTech Solutions Pvt. Ltd., http://p3infotech.in 1 Web Application Deployment in the Cloud Using Amazon Web Services From
Introduction to Cloud Computing Cloud Computing I (intro) 15 319, spring 2010 2 nd Lecture, Jan 14 th Majd F. Sakr Lecture Motivation General overview on cloud computing What is cloud computing Services
ensurcloud Service Level Agreement (SLA) Table of Contents ensurcloud Service Level Agreement 1. Overview... 3 1.1. Definitions and abbreviations... 3 2. Duties and Responsibilities... 5 2.1. Scope and
ITIL Event Management in the Cloud An AWS Cloud Adoption Framework Addendum July 2015 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved. Notices This document is provided for informational
Application Performance Management: New Challenges Demand a New Approach Introduction Historically IT management has focused on individual technology domains; e.g., LAN, WAN, servers, firewalls, operating
WHITE PAPER: Leveraging the Cloud for Data Protection and Disaster Recovery Leveraging the Cloud for Data Protection and Disaster Recovery Bennett Klein DATA MANAGEMENT CUSTOMER SOLUTIONS MARCH 2012 Table
Cloud 101 Mike Gangl, Caltech/JPL, firstname.lastname@example.org 2015 California Institute of Technology. Government sponsorship acknowledged Outline What is cloud computing? Cloud service models Deployment
1. Computation Amazon Web Services Amazon Elastic Compute Cloud (Amazon EC2) provides basic computation service in AWS. It presents a virtual computing environment and enables resizable compute capacity.
MICROSOFT EXCHANGE HOSTING SERVICE LEVEL AGREEMENT ( SLA ) V1.20 April, 2006 PURPOSE: This purpose of this Service Level Agreement ( SLA ) is to document the level of service provided with the Microsoft
A Strawman Model NIST Cloud Computing Reference Architecture and Taxonomy Working Group January 3, 2011 Objective Our objective is to define a neutral architecture consistent with NIST definition of cloud
CLOUD SERVICE SCHEDULE 1 DEFINITIONS Defined terms in the Standard Terms and Conditions have the same meaning in this Service Schedule unless expressed to the contrary. In this Service Schedule, unless
Développement logiciel pour le Cloud (TLC) 7. Infrastructure-as-a-Service Guillaume Pierre Université de Rennes 1 Fall 2012 http://www.globule.org/~gpierre/ Développement logiciel pour le Cloud (TLC) 1
Platforms in the Cloud Where Will Your Next Application Run? Jazoon, Zurich June 2011 Copyright 2011 Chappell & Associates An Organization without Cloud Computing Users A A A VM VM VM A A A Application
Controlling Hybrid IT Spend A WHITE PAPER BY DAVID S. LINTHICUM Contents Executive Summary 3 The Rise of Hybrid IT 5 What is a Hybrid Cloud? 7 The Need for Consumption Tracking 7 The Need for Visibility
This Software Citrix CSP Service Agreement ( Service Agreement ) sets forth the specific terms and conditions under which LightEdge Solutions, Inc. ( LightEdge ) shall supply certain Services to Customer.
Cloud Computing Paradigm Shift Jan Šedivý Business expectations Improving business processes Reducing enterprise costs Increasing the use of information/analytics Improving enterprise workforce effectiveness
Hosted SharePoint: Questions every provider should answer Deciding to host your SharePoint environment in the Cloud is a game-changer for your company. The potential savings surrounding your time and money
The Cloud at Crawford Evaluating the pros and cons of cloud computing and its use in claims management The Cloud at Crawford Wikipedia defines cloud computing as Internet-based computing, whereby shared
Security & Trust in the Cloud Ray Trygstad Director of Information Technology, IIT School of Applied Technology Associate Director, Information Technology & Management Degree Programs Cloud Computing Primer
Cloud Computing Bringing the Cloud into Focus November 2011 Introduction Ken Cochrane CEO, IT/NET Partner, KPGM Performance and Technology National co-leader IT Advisory Services KPMG Andrew Brewin Vice
Making a Smooth Transition to a Hybrid Cloud with Microsoft Cloud OS Transitioning from today s highly virtualized data center environments to a true cloud environment requires solutions that let companies
SERVICE LEVEL AGREEMENT Cloud Server This Service Level Agreement (this SLA ) governs the use of the Services under the terms of the Master Service Agreement (the MSA ) between Intermedia.Net, Inc. ( Intermedia
Private & Hybrid Cloud: Risk, Security and Audit Scott Lowry, Hassan Javed VMware, Inc. March 2012 Private and Hybrid Cloud - Risk, Security and Audit Objectives: Explain the technology and benefits behind
Why Migrate to the Cloud ABSS Solutions, Inc. 2014 ASI Cloud Services Information Systems Basics Cloud Fundamentals Cloud Options Why Move to the Cloud Our Service Providers Our Process Information System
2015 Public Cloud Disaster Recovery Survey Disaster Recovery Challenges and Best Practices Executive Summary This benchmark survey presents challenges and best practices of companies that host web applications
Service Level Terms Service Level Agreement Public IaaS Service Level Terms This document (the Public IaaS Service Level Terms ) describes the Service Levels and Service Level Credits applicable to Cisco
THIS SERVICE LEVEL AGREEMENT DEFINES THE SERVICE LEVELS PROVIDED TO YOU BY COMPANY. Capitalized terms used herein but not otherwise defined shall have their respective meanings set forth in the End User
Architectural Implications of Cloud Computing Grace Lewis Research, Technology and Systems Solutions (RTSS) Program Lewis is a senior member of the technical staff at the SEI in the Research, Technology,
Volume Licensing Service Level Agreement for Microsoft Online Services August 5, 2015 Microsoft Volume Licensing Service Level Agreement for Microsoft Online Services (Worldwide English, August 5, 2015)
Cloud Services Agreement & SLA This agreement ( Agreement ) is between APH Inc. (which may be doing business as Codero, or other fictitious names, and which is referred to in this Agreement as Codero )
Schedule 2Z Virtual Servers, Firewalls and Load Balancers Definitions Additional Charges means the charges payable in accordance with this schedule. Customer Contact Centre means Interoute s Incident management
Building Success on Acquia Cloud: 10 Layers of PaaS TECHNICAL Guide Table of Contents Executive Summary.... 3 Introducing the 10 Layers of PaaS... 4 The Foundation: Five Layers of PaaS Infrastructure...
Cloud Computing: IaaS & PaaS Thomas Kurian Executive Vice President Product Development 62 Safe Harbor Statement "Safe Harbor" Statement: Statements in this presentation relating to Oracle's future plans,
UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered
Kroll Ontrack VMware Forum Survey and Report Contents I. Defining Cloud and Adoption 4 II. Risks 6 III. Challenging Recoveries with Loss 7 IV. Questions to Ask Prior to Engaging in Cloud storage Solutions
Cloud Vendor Benchmark 2015 Price & Performance Comparison Among 15 Top IaaS Providers Part 1: Pricing April 2015 (UPDATED) Table of Contents Executive Summary 3 Estimating Cloud Spending 3 About the Pricing
VMware on VMware: Private Cloud Case Study Customer Presentation 2009 VMware Inc. All rights reserved Agenda VMware IT landscape Motivations for the Cloud Private Cloud Stack Impact of moving to the Cloud
Radware Cloud Solutions for Enterprises How to Capitalize on Cloud-based Services in an Enterprise Environment - White Paper Table of Content Executive Summary...3 Introduction...3 The Range of Cloud Service
Security in Changing IT Ecosystem: Virtualization and Cloud Computing Dr. Dhiren Patel Indian Institute of Technology Gandhinagar, India email@example.com Cloud Computing World is further shrinking!!!
1 ForestSafe SaaS Service details 1.1 Service Description ForestSafe is a privileged identity management system used today to manage the Administrator passwords of 65,000 computers by the UK largest bank.
Public Cloud Service Agreements: What to Expect & What to Negotiate April 2013 The Cloud Standards Customer Council THE Customer s Voice for Cloud Standards! Provide customer-led guidance to the multiple
WINDOWS AZURE EXECUTION MODELS Windows Azure provides three different execution models for running applications: Virtual Machines, Web Sites, and Cloud Services. Each one provides a different set of services,
Oracle Platform as a Service and Infrastructure as a Service Public Cloud Service Descriptions-Metered & Non-Metered August 24, 2015 Contents GLOSSARY PUBLIC CLOUD SERVICES-NON-METERED... 4 ORACLE PLATFORM
Cloud Service Model Selecting a cloud service model Different cloud service models within the enterprise Single cloud provider AWS for IaaS Azure for PaaS Force fit all solutions into the cloud service
Windows Azure and private cloud Joe Chou Senior Program Manager China Cloud Innovation Center Customer Advisory Team Microsoft Asia-Pacific Research and Development Group 1 Agenda Cloud Computing Fundamentals
Application Performance in the Cloud Understanding and ensuring application performance in highly elastic environments Albert Mavashev, CTO Nastel Technologies, Inc. firstname.lastname@example.org What is Cloud?
CA ARCserve Replication and CA ARCserve High Availability r16 CA ARCserve Replication and CA ARCserve High Availability Deployment Options for Microsoft Hyper-V Server TYPICALLY, IT COST REDUCTION INITIATIVES
The Hybrid Cloud: Bringing Cloud-Based IT Services to State Government October 4, 2009 Prepared By: Robert Woolley and David Fletcher Introduction Provisioning Information Technology (IT) services to enterprises
1 Introduction to Cloud Computing CERTIFICATION OBJECTIVES 1.01 Cloud Computing: Common Terms and Definitions 1.02 Cloud Computing and Virtualization 1.03 Early Examples of Cloud Computing 1.04 Cloud Computing
A Gentle Introduction to Cloud Computing Source: Wikipedia Platform Computing, Inc. Platform Clusters, Grids, Clouds, Whatever Computing The leader in managing large scale shared environments o 18 years
Software Engineering Competence Center TUTORIAL An Introduction to Cloud Computing Concepts Practical Steps for Using Amazon EC2 IaaS Technology Ahmed Mohamed Gamaleldin Senior R&D Engineer-SECC email@example.com