Cloud Platform Comparison: CloudStack, Eucalyptus, vcloud Director and OpenStack

Cloud Platform Comparison: CloudStack, Eucalyptus, vcloud Director and OpenStack This vendor-independent research contains a product-by-product comparison of the most popular cloud platforms (along with tips on bug-fixing) to help you select the best-fit solution. By Vadim Truksha, IT infrastructure architect

Table of contents 1. Introduction... 3 2. CloudStack 3.0.0... 3 2.1 Main Features... 3 2.2 Price... 4 2.3 Community... 4 2.4 Documentation... 4 2.5 Experience... 4 2.6 Possible issues and bug fixes... 4 2.7 Conclusion... 5 3. Eucalyptus Open Source 2.0.3... 5 3.1 Main features... 5 3.2 Price... 5 3.3 Community... 5 3.4 Documentation... 5 3.5 Experience... 5 3.6 Possible issues and bug fixes... 6 3.7 Conclusion... 6 4. vcloud Director 1.5... 7 4.1 Main features... 7 4.2 Price... 7 4.3 Community... 7 4.4 Documentation... 7 4.5 Experience... 7 4.6 Conclusion... 7 5. OpenStack 2011.3... 8 5.1 Main features... 8 5.2 Price... 8 5.3 Community... 8 5.4 Documentation... 8 5.5 Experience... 8 5.6 Conclusion... 8 6. Summary... 9 Table: Detailed Cloud Computing Platforms Comparison... 9 7. About Altoros... 10 Altoros 2

1. Introduction Cloud computing remains one of the hottest topics in IT today given the promise of greatly improved efficiencies, significant cost savings, scalable infrastructure, high performance and secured data storage. Choosing the appropriate cloud platform, however, can be difficult. They all have pros and cons. So, when a customer asked me and my colleagues at Altoros Systems, a software product development company, what would be the best cloud platform for his project and why, we decided to take a deep look at the most notable systems available, compare their capabilities, and summarize the findings in a product-by-product table. We tested CloudStack, Eucalyptus, vcloud Director and OpenStack. Below you will find information on features available in free and commercial versions of the cloud platforms, their price, documentation completeness, and community matureness. In addition, the errors found during the deployment process are addressed by detailed instructions on bug fixing. (Please note that by the time the research is published the products may be updated by the vendors.) The goal of this unbiased comparison is to help you align your business requirements with the capabilities of a particular cloud system and finally select the best-fit product. 2. CloudStack 3.0.0 CloudStack is a console for managing data center computing resources. A number of well-known information-driven companies, such as Zynga, Nokia Research Center and Cloud Central, have deployed clouds using CloudStack. Apart from having its own API, the platform supports CloudBridge Amazon EC2, which enables converting an Amazon API into a CloudStack API. You can find a detailed list of the supported commands here. 2.1 Main Features: Hypervisors agnostic (KVM, XEN, ESXi, OVM and BareMetal) Roles (assigning and managing permissions) Virtual network (VLAN support) Resource pool (enables administrators to limit virtual resources, for example, the number of virtual machines that can be created by one account, the number of public IP addresses assigned to an account, etc.) Snapshots and volumes Virtual routers, a firewall, and a load balancer Live migration with host maintenance Altoros 3

If your data center is based on vsphere, CloudStack will use a vcenter API. This means that you will be able to manage your data processing center that has been dynamically deployed using vsphere 4.1. 2.2 Price: CloudStack is distributed for free under the GNU Public License v3. To get paid support, you should contact its developers via email. 2.3 Community: There is an online community ready to provide timely technical support for free. You can find solutions to many CloudStack issues on the Forum. There is also an IRC channel where everyone is welcome to ask questions. 2.4 Documentation: If you have a basic technical background, it will be rather easy for you to install the CloudStack platform with default settings. If a more complex and complicated installation is required, you might experience some challenges, as the documentation does not cover complex issues in full. The manual gives step-by-step instructions but does not provide any information on how the platform functions in general. 2.5 Experience: We have performed installation, configured the system, and tried VMware as well as KVM clusters. CentOS 5.5 and CentOS 6.2 were used for the hosts. In addition, our engineering team connected our private cloud deployed with CloudStack to the RightScale management console. The platform was easy to install and performed as expected. 2.6 Possible issues and bug fixes: Some errors in running libvirtd may arise when using CentOS 6. The problem can be solved by adding the following code to /etc/cgconfig.conf: group virt { cpu { cpu.shares = 9216; } } After entering the code, restart /etc/init.d/cgconfig and launch libvirtd. Using the console on a website may also cause some problems. One of them is that the vnc server uses 127.0.0.1 as the default address for the hosts. To check this, execute the following command: netstat -nlp grep kvm tcp 0 0 0.0.0.0:5900 0.0.0.0:* LISTEN 11673/qemu-kvm tcp 0 0 0.0.0.0:5901 0.0.0.0:* LISTEN 11872/qemu-kvm tcp 0 0 0.0.0.0:5902 0.0.0.0:* LISTEN 15227/qemu-kvm tcp 0 0 0.0.0.0:5903 0.0.0.0:* LISTEN 12587/qemu-kvm Altoros 4

In case the address is 127.0.0.1, you should uncomment the vnc_listen = "0.0.0.0" line in the configuration file:/etc/libvirt/qemu.conf and restart the virtual machines. 2.7 Conclusion: Working with CloudStack management console has made a rather positive impression on our engineering team. This is a rapidly developing tool that provides broad functionality and is available for free. It may be employed for production but, if you use VMware hypervisors, vcloud Director seems like a better choice. 3. Eucalyptus Open Source 2.0.3 Eucalyptus is another popular cloud platform. Sony, Puma, NASA, Trend Micro and other companies have chosen it to deploy their private clouds. Eucalyptus has a free version and a commercial edition. Obviously, the commercial edition comes with much more extended functionality. One of the greatest advantages making this platform truly convenient to work with is that the Eucalyptus API is fully compatible with the Amazon API. As a result, all the scripts and software products based on the Amazon API can be easily employed for your private cloud. Eucalyptus supports three hypervisors: XEN, KVM and ESXi. The last one is only available to the users of the Enterprise Cloud edition. 3.1 Main features: Roles (assigning and managing permissions) Hypervisor agnostic Clustering and zoning Flexible network management, security groups, and traffic isolation 3.2 Price: You can choose between the open-source free Eucalyptus Cloud and the Eucalyptus Enterprise Cloud. Information on differences in functionality is available here. 3.3 Community: Like any other open-source product, Eucalyptus has a powerful community that contributes to platform development and assists in finding and fixing bugs. We did not experience any difficulties when installing and configuring this product, so we cannot comment on how helpful the community is. Anyway, they did a great job developing the product. 3.4 Documentation: Product documentation covers the installation process but does not provide much information on any other aspects of working with the software. A prospective user should have a strong technical background, because the guides provide no information on virtualization and become useless, if a more complicated configuration is required. 3.5 Experience: Our team installed the open-source version and configured the platform following the instructions provided in the documentation. We used CentOS 5.5 for the cloud Altoros 5

controller and CentOS 5.5 together with XEN hypervisor for the hosts. Our cloud was successfully added to RightScale. There is no management console, so you have to either use euca2tools or combine Eucalyptus with RightScale. The commercial version of the product does have a management console, which makes it more user-friendly. 3.6 Possible issues and bug fixes: 1) Some of the dependencies failed to install in turns. As a solution to this, we installed them in a package at a time. rpm -Uvh python25-2.5.1-bashton1.x86_64.rpm error: Failed dependencies: libpython2.5.so.1.0()(64bit) is needed by python25-2.5.1-bashton1.x86_64 The solution: rpm -Uvh python25-2.5.1-bashton1.x86_64.rpm python25-devel-2.5.1-bashton1.x86_64.rpm python25-libs- 2.5.1-bashton1.x86_64.rpm 2) After the installation is completed, the following errors may occur, when the controller is launched: /etc/init.d/eucalyptus-cc start Starting Eucalyptus cluster controller: Enabling IP forwarding(13)permission denied: make_sock: could not bind to address [::]:8774 (13)Permission denied: make_sock: could not bind to address 0.0.0.0:8774 no listening sockets available, shutting down Unable to open logs Failed to start the CC! To solve this issue, Selinux should be disabled. 3) If you do not have sufficient experience with XEN, you may encounter some problems when using it. After the installation of XEN is completed, the value of the parameter default=1 should be changed to default=0 in this configuration file: /etc/grub/menu.lst to load XEN core. 4) It is also advisable to create a group called libvirt in CentOS and add the account used for running Eucalyptus to this group. 3.7 Conclusion: Though the open-source version of the product has a number of issues, there are simple workarounds. Furthermore, the commercial edition provides a broader functionality (VMware hypervisor tools, compatibility with Amazon AWS, AD and LDAP integration, etc.). Those who already have a virtual environment can enhance it with a Eucalyptus cloud instead of complete migration. Altoros 6

4. vcloud Director 1.5 vcloud Director is a platform for deploying clouds developed by VMware. The system enables building hybrid clouds and, if the entire infrastructure in your office is built using VMware products, you will have no difficulties with implementing vcloud Director. You can migrate your virtual machines between private and public clouds using VMware vcloud Connector. 4.1 Main features: Virtual data centers vshield security technologies Infrastructure service catalog Multi-tenant organizations Self-service portal VMware vcloud API, open virtualization format, and callouts 4.2 Price: Unfortunately, there are no free editions of the product. You have to contact a regional manager to find out the approximate cost of a package that would meet your requirements. 4.3 Community: VMware is one of the leaders in the market and has a very large community. There is also a rich knowledge base, which can be used as a free support service. The product comes with a support package and the company offers additional paid support on demand. 4.4 Documentation: Proprietary software usually comes with high quality documentation, and this platform is no exception. There will be no difficulties, if you carefully follow all the instructions provided in the guides. 4.5 Experience: We successfully installed and configured vcloud Director. It should be mentioned, that Red Hat is required in order to install this platform. Other things you will need for installation include vcenter (with clusters and DRS), and vshield. Obviously vcloud Director uses the vcenter API. This means a user of vcloud Director has access to the full functionality implemented in vsphere. 4.6 Conclusion: This is a commercial product and that is a big disadvantage for some users. However, if you already use VMware for virtualization, vcloud Director will be the most appropriate choice. Altoros 7

5. OpenStack 2011.3 OpenStack 2011.3 is an open-source platform for deploying clouds. This project includes three products: Nova (an analog to Amazon EC2), Swift (an analog to Amazon S3), and Glance (an API server that provides discovery, registration, and delivery services for virtual disk images). In our research, we only used Nova, but you should pay close attention to Swift, which offers scalable object storage for petabytes of accessible data. OpenStack 2011.3 is supported by many vendors, including CloudStack 3. Currently, Nova fully supports two hypervisors: KVM and XEN. The platform is being developed rapidly and soon will be provided with a broader functionality. The technology is popular among a large community of specialists and is backed by such companies as Cisco, Dell, NASA, Intel, AMD, Citrix, Rackspace, and RightScale. The core of this product is developed by NASA. 5.1 Main features: Ability to manage virtualized commodity server resources Ability to manage local area networks Virtual machine image management Security groups Role-based access control Projects & quotas VNC proxy through a Web browser 5.2 Price: OpenStack 2011.3 is open-source and can be downloaded for free. The project is developed by various contributors and exists mainly on user donations. 5.3 Community: In comparison to other products mentioned in this research, OpenStack seems to have the largest and the most active community. The community members are always willing to help others find solutions to any arising problems. 5.4 Documentation: However, OpenStack documentation is somewhat incomplete. Due to the rapid development of the product, the documentation fails to cover all the current issues and new features in time. Often you have to visit forums or use IRC to get the required information. 5.5 Experience: We have successfully installed and configured Nova, Keystone, and dashboard without any critical issues. 5.6 Conclusion: This open-source platform is free and is being developed very rapidly. It demonstrates a lot of progress, but still lots of development efforts are required before it can be used for production. OpenStack 2011.3 is already compatible with Amazon API and the dashboard project is currently under consideration. Altoros 8

6. Summary If you decide to move your business to the cloud, one of the first tasks you will encounter is choosing a platform that will better fit your company's requirements. Though it may be hard to understand what stands behind the vendor's promises in marketing descriptions, I hope this article will help a bit. This research is the result of working with all of the cloud products and is not aimed at promoting any of the systems. There is no silver bullet, and even the best cloud platform (if any exists) can hardly satisfy all of the demands and use cases. For a particular type of business, you need to investigate all the factors involved, define your typical tasks, calculate the risks, allocate a budget, and compare it against the platforms' capabilities and license costs. It will be a compromise, any way you look at it. The thing is to make sure you have made the best possible choice in the very beginning. Table: Detailed Cloud Computing Platforms Comparison (plus being a positive, minus being a negative, with footnotes adding detail) Features CloudStack 3.0.0 Eucalyptus 2.0.3 vcloud Director 1.5 OpenStack 2011.3 AD Integration +\- (1) - + - Management Console + - (2) + +\- (3) Web Access to the vm Console + - (4) + + API + + + + Multi-role Support + + + + VLANS + + + + Hypervisor Agnostic + (5) + (6) + (7) + (8) Easy Template Creation Process + - + - Snapshots + + + + Resource Over Provisioning and Limits + + + + Alerts and Notifications + - + - Volumes + + + + Guest OS Preferences (9) + - + + Host Maintenance with Live Migration + - + - Free + +\- (-10) - + Amazon API Compatibility + + - + RightScale + + - +\- (11) High Availability Cloud Component + + + - Implementation Complexity (12) + - + - Altoros 9

Notes: 1. CloudStack does not provide users with a GUI for setting up AD integration, but the API enables doing this. We wrote a script (http://cloudstack.org/forum/10-developer-and-apisupport/9521-script-sync-users-between-cloudstack-and-active-directory.html) to make AD integration easier. 2. The management console of Eucalyptus is implemented in the commercial version. 3. The management console of OpenStack has already been developed, but has not been included into the product s API yet. Supposedly, it will be added in the next release. 4. Web access to the vm console of Eucalyptus is only available when working with KVM. 5. CloudStack 3.0.0 supports KVM, XEN, ESXi, OVM, and BareMetal. 6. Eucalyptus 2.0.3 supports KVM, XEN, ESXi but hypervisor agnostic of Eucalyptus is only available in the commercial edition. 7. vcloud Director 1.5 only supports ESXi. 8. OpenStack 2011.3 supports XEN and KVM. 9. The type of guest OS for all the platforms is determined by hypervisors, particularly, Eucalyptus only supports Linux guests. 10. Eucalyptus has both commercial and free versions. 11. We had a possibility to test the platforms with a developer account of Rightscale. It is impossible to enable OpenStack from a client s account, but this can be done from a developer s account. The functionality works well, so it is unclear why this product is still not supported. 12. Complicated installation and configuration combined with a not-at-all-user-friendly interface can make implementation very challenging. In any case, it is rather complicated to conclude how difficult it is to install and configure a platform in the test mode. Cloudstack and vcloud are easier to install. 7. About Altoros Altoros provides consulting and managed services around Cloud Foundry PaaS, multi-cloud deployment automation, and complex Java/.NET/Ruby architectures that make heavy use of SQL/NoSQL/Hadoop clusters. Altoros employs 250+ senior- and mid-level engineers across 8 countries, including one of the largest pools of Cloud Foundry expertise on the market. For more, please visit www.altoros.com or follow @altoros. Altoros 10