The Next-Generation Cloud: A Practical Definition

Transcription

1

2

3 Want to read more? You can buy this book at oreilly.com in print and ebook format. Buy 2 books, get the 3rd FREE! Use discount code: OPC10 All orders over $29.95 qualify for free shipping within the US. It s also available at your favorite book retailer, including the ibookstore, the Android Marketplace, and Amazon.com. Spreading the knowledge of innovators oreilly.com

4 Programming for PaaS Lucas Carlson

5 Programming for PaaS by Lucas Carlson Copyright 2013 Lucas Carlson and Doug Baldwin. All rights reserved. Printed in the United States of America. Published by O Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA O Reilly books may be purchased for educational, business, or sales promotional use. Online editions are also available for most titles ( For more information, contact our corporate/ institutional sales department: or corporate@oreilly.com. Editors: Mike Loukides and Meghan Blanchette Production Editor: Kara Ebrahim Copyeditor: Jasmine Kwityn Proofreader: Rachel Head Indexer: Lucie Haskins Cover Designer: Randy Comer Interior Designer: David Futato Illustrator: Rebecca Demarest August 2013: First Edition Revision History for the First Edition: : First release See for release details. Nutshell Handbook, the Nutshell Handbook logo, and the O Reilly logo are registered trademarks of O Reilly Media, Inc. Programming for PaaS, the image of a common hare, and related trade dress are trademarks of O Reilly Media, Inc. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and O Reilly Media, Inc., was aware of a trademark claim, the designations have been printed in caps or initial caps. While every precaution has been taken in the preparation of this book, the publisher and author assume no responsibility for errors or omissions, or for damages resulting from the use of the information contained herein. ISBN: [LSI]

6 Table of Contents Preface xi 1. The Cloud for Developers The Developer s Plight 2 What the Cloud Has Done for Innovation 2 The Cloud: A Brief History for Programmers 4 Introducing APIs 4 Along Comes DevOps 4 The Arrival of Application Lifecycle Management 5 The Next-Generation Cloud with Platform-as-a-Service 7 The Core of the Cloud 8 Managed Platforms versus Productized Platforms 10 The Cloud s Promise (or Hype) 10 The Cloud in Five Years 11 The Promise Fulfilled What Is PaaS? Conjuring a Website 13 Early Options for Developers 14 Shared Web Hosting 14 Dedicated Hosting 15 PaaS: The Best of Both Worlds 18 The Developer s Holy Grail 19 Sharing the Load 19 Language Considerations 20 PaaS Pricing 20 Is PaaS Really New or Just IaaS++? 21 PaaS: A Vital Tool for Modern Apps 22 Moving Toward Higher-Level Languages 22 v

7 Managing the Backend 23 Conjuring Confidence Types of PaaS Non-Portable: Following a Template 25 Force.com 25 Google App Engine 26 Windows Azure 27 Non-Portable Conclusion 28 Portable: No Heavy Lifting Required 28 Heroku 29 Cloud Foundry 30 AppFog 31 dotcloud 32 CloudBees 32 Summary: Where Do You Want to Live? 33 Dealing with Legacy and Greenfield Apps 33 Tapping Into Services 34 Moving Toward Open Standards 35 The Allure of Open Source 35 Evaluating Your Legacy Moving Legacy Apps to PaaS Initial Considerations 37 Sidestepping Potential Problems 38 Common Questions to Ask Yourself 38 Even More Legacy Code Issues 39 Overview 39 Asset Hosting 40 All About Blob 40 PHP with Amazon S3 41 Node.js with Azure Blob Service 42 Generalized Asset Hosting Functions in Ruby for Rackspace Cloud Files 43 Uploading with Plug-ins 44 Session Management 44 PHP 46 Node.js 47 Ruby 47 Java 47 Caching 48 Filling In the Pieces 48 Caching with memcached in PHP 49 vi Table of Contents

8 Caching with MongoDB in Node.js 50 Generalized Caching Functions in Ruby for Redis 50 Asynchronous Processing 51 Serving Up Stored Data 51 How to Create Asynchronous Processes 52 More Advanced Scheduling of Background Tasks 52 SQL 53 The Dilemma of Stored Procedures 53 NoSQL 54 Miscellaneous Gotchas 54 The Optimization Trap 55 Starting from Scratch 55 A Final Note on Legacy Apps Writing New Apps for PaaS Breaking Down the Monolith 57 Independent Thinking 59 Leveraging APIs for Mobile Development 59 The Emergence of JSON and REST 60 A Look at JSON 60 A Look at REST 61 A Look at Metaservices 64 Consuming RESTful Metaservices 65 Application Clients 65 Mobile Clients 66 Thin Web Clients 66 Thick Web Clients 67 The Unique Contribution of PaaS 67 Four Important Benefits 68 A Solution for Enterprises and Governments 69 The Effect of Moore s Law Mobile Apps on PaaS A Brief History of Mobile App Development 71 The Apps of the Future 72 Data Structures 73 JSON and XML 73 Consuming Metaservices in Mobile Clients 74 ios 74 Android 76 How PaaS Makes Mobile Backend Development Easier 78 It s Fast to Build Mobile Backend Metaservices 78 Table of Contents vii

9 It s Easy to Scale Metaservices with PaaS 79 It s Easy to Pick the Right Underlying Core Services 79 Portable Interfaces Can Be Used on Many Devices 79 Serving a Large Audience A Look at Core Services Non-PaaS Core Services 81 Evaluating PaaS for Services 82 Saving Time with Managed Databases and PaaS 83 SQL 83 NoSQL 85 Caches and PaaS: Look for Redundancy 87 Solving the Challenges of 87 The Importance of Monitoring 88 Considering Your Options 89 Taking the Long View 90 Load Testing 90 Planning an Upgrade Path 91 Storage Options Why Not PaaS? Public Cloud versus Private Cloud 95 What Is Private Cloud? 95 How to Choose: Small- and Medium-Sized Businesses 96 Open and Closed 97 How to Choose: Enterprise Businesses 97 The Limitations of PaaS 98 Fitting Your App into the Mold 99 More Considerations 99 Avoiding Limitations 100 Encountering Resistance 102 Putting the Limitations in Perspective The Future of PaaS The Influence of OpenStack 105 Keeping Your Development Options Open 106 Outages: Your Biggest Problem 107 Regaining Control Through Open Source 108 Micro Magic 109 Limitations of Open Source PaaS Libraries 109 The Virtues of Versatility 110 viii Table of Contents

10 Final Thoughts Resources PaaS Providers 111 IaaS Providers 113 Managed Services 114 Data storage: MySQL 115 Data storage: PostgreSQL 115 Data storage: CouchDB 115 Data storage: MongoDB 115 Data storage: NoSQL 115 Data storage: Redis 115 Data storage: Caching 115 Mobile 116 Search 116 Logging Background Tasks 116 Analytics 117 Error Monitoring 117 Utilities 117 Payments 117 Migrating Legacy Apps to PaaS 117 WordPress Plug-ins 117 Drupal Modules 118 Joomla! Plug-ins 118 Greenfield PaaS App Development 118 Ruby 118 Python 118 Node.js 118 PHP 119 Java 119.NET 119 Perl 119 Index Table of Contents ix

11

12 CHAPTER 1 The Cloud for Developers One day, not long ago, Jason Gendron had an idea. What if he could create a community of Twitter friends, so that instead of just following each other, users might actually have bidirectional communication? Jason, a Chicagobased developer, wrote some code, registered the domain name twitclub.com, and deployed it on a dedicated server. Success was immediate. In a few months, over 80,000 people were using the service. But with success came challenges the kind of challenges you always say you will be glad to have if only you succeed. With 80,000 users, Jason was spending half his time handling operations and half his time doing development. He spent less time innovating and more time running the actual app. Before long, hackers compromised his self-configured servers. The hackers sent out terabytes of data, leaving him with an enormous bill. The net result: he was devoting most of his time to battling with servers and not enough to writing code. Only a few months later, Jason turned to Platform-as-a-Service (PaaS), which allowed him to outsource all the maintenance responsibilities, from software updates to security patches. The benefits were immediately clear. Suddenly he was able to stop thinking about the operations side of his idea, letting his PaaS provider deal with it. That enabled him to spend 100% of his time innovating. Soon he was able to actually quit his day job and devote all his time to his startup, bootstrapping it into a profitable company. PaaS changed Jason s life, and it can change your life too. It can let you spend more time coding and less time managing servers. Jason s plight is a familiar one, and its solution deploying services on PaaS is one that holds enormous promise, pointing the way toward a future in which cloud-based innovation is drastically easier and much less expensive. 1

13 The Developer s Plight Developers are everywhere. They work in small businesses, in agencies, in enterprises, in startups. All developers are facing the same challenge today: dealing with operations that are coupled with development. The problems may look different depending on your working environment, but the central issue is there nevertheless. As an example, let s look at the traditional waterfall development process. Typically, the developer works on code and gets it running in a dev/test environment. Then he throws it over the IT wall, at which point the operations people spend a few weeks to a month getting it quality assured and deployed, creating a huge delay in getting it into production mode. Timelines are delayed. Product testing is delayed. Ultimately, and perhaps most costly, innovation slows down. Velocity, or the lack thereof, becomes an issue especially with social and mobile applications. You might have a marketing campaign that needs to go up in a hurry and may only last for a few weeks. Going through the typical process of throwing it over the wall could delay you a critical amount of time, especially if there are troubles with the app and you need to make modifications, or if there is simply not enough velocity for today s social market campaigns. On the other side of the spectrum are developers in small businesses who are simply trying to get their jobs done, and individual developers innovators like Jason Gendron who are trying to come up with ideas for the next Instagram or Facebook. PaaS helps them solve the issue of velocity while at the same time providing significant savings by letting them focus on coding. Looking to the future, these savings promise to have a profound and very positive impact on the creation of startups. What the Cloud Has Done for Innovation The cloud has transformed how developers create software, speeding up the way developers work around the world, from venture-backed startups all the way to large Fortune 100 corporations. Modern developers are being asked to do more with less. They are given tight budgets and tighter deadlines to accomplish miraculous feats of development. Cost and convenience have led to widespread adoption of the cloud. The cloud has been the mechanism that lets enterprise developers bypass IT departments and allows entrepreneurs to have access to effectively unlimited-sized data centers without any up-front hardware purchases. Figure 1-1 tracks venture capital deals over a 10-year period beginning in It shows normalized data for the total number of deals versus total deal size. As the graph 2 Chapter 1: The Cloud for Developers

14 illustrates, the two sets of numbers tracked very closely for several years. Significantly, that changed in 2006, the year Infrastructure-as-a-Service (IaaS) went mainstream when Amazon introduced Amazon Web Services with EC2 and S3. At that point, the cloud decoupled the two trajectories, progressively driving down the deal size and driving up the number of deals. Figure 1-1. Total deal size vs. normalized total deals, What does this mean? What are the implications? For the first time in history, there is a decoupling of the total number of deals versus the deal size. By 2010, venture capitalists had to pay only half as much money to fund new companies as they used to. These high-tech companies no longer needed as much capital. They did not need to build out data centers anymore; they could rely on the cloud. That is a key benefit of cloud adoption in venture capital deals. Through cloud technology like IaaS and PaaS, the 50% cost savings are going to translate into all sorts of business: not just startups and VC-backed companies, but in the midmarket and enterprise worlds as well. Infrastructure-as-a-Service gets rid of half the problem the issue of buying and managing data centers. The second half of the problem is managing application operations. Decoupling operations from development is the second and true promise of the cloud, and it s one that Platform-as-a-Service is uniquely poised to deliver. What the Cloud Has Done for Innovation 3

15 The Cloud: A Brief History for Programmers What is the cloud? It is a loaded term and overly used. Is the cloud just Dropbox? Is it the iphone? Is it just Gmail? Maybe for some people these myriad examples are the cloud, but not for a developer. For a developer, the cloud is a set of foundational technologies built on top of each other to enable new ways of building and running technology. If you can t build a new kind of foundational technology on another foundational technology, it is not the cloud. Many apps and SaaS are built on foundational cloud technologies. Dropbox and Gmail are SaaS apps built on foundational cloud technology. But they themselves are not cloud technologies. The 1990s saw the rise of data centers. Third-party companies would put servers into a room and rent them out. This was less expensive than previous constraints, when companies had to buy their own servers and data centers. With the rise of centralized data servers came virtualization, which represented the first step into the cloud. With virtualization, data centers could consolidate into massive servers subdivided into smaller ( virtualized ) servers. VMware and Microsoft were among the early companies to create software that was critical to the development of virtualization. Introducing APIs In 2006, on top of virtualization came the next big step into the cloud: the application programming interface (API). APIs added a sophisticated layer of automation, enabling you to control, start, stop, and create new virtual machines through simple and realtime commands. First created by companies such as Amazon with Amazon Web Services, APIs paved the way for Infrastructure-as-a-Service, which heralded a lot of what we now consider cloud standards. At this point in the history of the cloud, it was so easy to spawn a multitude of virtual machines that managing servers became a headache. With unlimited servers at your fingertips, how do you take care of managing them all? That is where DevOps came into play. Along Comes DevOps DevOps became a mainstream force around It arose from the need of developers to do their jobs faster. They were tired of waiting for operations to deploy their code. They were tired of not having tools to easily manage services. They were tired of having to do it all manually. Out of these frustrations, programmers moved into the cloud and 4 Chapter 1: The Cloud for Developers

16 became DevOps gurus. They built systems to manage and maintain infrastructure and to interact with servers in a programmatic fashion. Important DevOps tools like Chef and Puppet were introduced, providing systems to manage thousands of servers, upgrade code, replace code, replace servers, deploy new servers into a template, and make modifications, all of which had been very labor intensive and difficult from a developer s point of view. We even saw the rise of automated DevOps tools like RightScale and ScaleXtreme. DevOps offers developers the most control out of all the cloud tools. The trade-off is that you still need to spend time building and managing operations; if things go wrong, you are still the go-to person. And so, DevOps is not the ultimate answer to the hopes of developers. Here s why. As a developer, you will most likely spend time writing code that works with Chef and Puppet, while your ultimate goal is probably to spend less time managing operations. If that is your goal, Platform-as-a-Service can handle operational tasks for you today, freeing up even more of your time. With PaaS, you do not have to write the Chef cookbooks or the Puppet scripts to manage servers. You can spend more of your time writing the code that interacts with your users. DevOps technologies were and remain essential for application lifecycle management tools, which we ll discuss in a moment. Application lifecycle management would not be possible without DevOps, so DevOps is not going to go away. DevOps is a core foundational technology, and there will always be a need for it in a cloud world. DevOps tools are also a big part of how any Platform-as-a-Service runs under the covers. For platforms such as Heroku, EngineYard, AppEngine, and AppFog, DevOps tools are essential behind-the-scenes tools. The Arrival of Application Lifecycle Management Thanks to DevOps, one can now manage thousands of machines easily, but one still sees the world through the glasses of infrastructure. Applications care more about services (e.g., MySQL and MongoDB) than the details (e.g., what version of libxml is installed across virtual machines). Managing services and applications remains outside the grasp of DevOps and even IaaS. The next layer of cloud technology is application lifecycle management. App lifecycle management tools are typified by technologies like Cloud Foundry, Open Shift, and Cloudify. They are not yet really PaaS (though they sometimes claim to be), because they still need an operator to run them (hence not really removing the big pain of running operations yourself). However, they do provide a cornerstone to PaaS technology. These tools know how to start, stop, and deploy applications. They often know how to run and manage some of your services, like MySQL, as well. The Cloud: A Brief History for Programmers 5

17 App lifecycle management tools handle applications holistically, managing applications across many different servers, so an application can run on hundreds or even thousands of them. Traditionally, IaaS and DevOps tools have had trouble thinking in terms of applications of the needs, resources, and services that span hundreds of servers. App lifecycle management understands applications, treats them from a services point of view, and knows how to manage, scale, and maintain them. In many cases, you can run app lifecycle management tools on your own laptop. Cloud Foundry has a Micro VM that can do a proof of concept very quickly. OpenShift and Cloudify have similar tools. Taking app lifecycle management to the next level and building out a production-ready version of the same tool can be daunting; it often takes teams of 5 10 operations people and involves managing dozens or hundreds of machines, even for small production installations. The benefits of app lifecycle management are great, though. Take, for example, a Drupal website that is going to be hit by massive traffic overnight. In this example, you ll need to go from a single server to 1,000 servers to handle this huge influx of new users. Before app lifecycle management, you would need to engage a team to manually figure out how to incorporate hundreds of new servers into the process. You would need to deploy the right code and take a very hands-on approach. It required significant human intervention and it needed to scale with human resources. Even with DevOps, this can be a daunting task. How do you ensure that the servers that Puppet created are all working the way you expect them to? How do you maintain these servers? How can you see in real time how the application loads are affecting each server? These are only some of the shortcomings of DevOps tools. An app lifecycle management tool such as Cloud Foundry changes all this. You can tell it that your application needs 1,000 more instances, and Cloud Foundry will do all the plumbing. It makes the changes necessary to run those applications across your servers. It greatly simplifies the process. But there s a hitch. You still need people watching and monitoring the app lifecycle tool itself. You don t get rid of operations; you are simply shifting your attention from an individual application to the running of your lifecycle tool. In our example, prior to the advent of app lifecycle management tools, when you needed to scale up the number of servers the development team would interact directly with the operations team to ensure success. Sometimes the same team, or even the same person, would be responsible for both, but the roles would be separate. The operations people would be in charge of manually figuring out how to hook all the servers together. Now an app lifecycle management tool can do all that for you. It knows about the application, it knows how to execute the code, it knows how to add the servers and instances to the application. But the app lifecycle management tool itself needs 6 Chapter 1: The Cloud for Developers

18 operations. People are required to operate the tool. The difference is that it is an abstract tool into which you can put anything, any application. As a developer, it does not matter if the operations people running the tool are in-house and sitting right next to you, or if they are hundreds of miles away in a place like Portland, Oregon. Thus we enter the realm of NoOps and Platform-as-a-Service. The Next-Generation Cloud with Platform-as-a-Service The cloud has been instrumental in moving us away from a paradigm that involved significant expenses, not only in terms of buying servers, but also of running those systems, with all the personnel involved. In the past, any startup would have had a similar experience. You would need to hire people to handle your core competency, and then spend millions of dollars to handle all of the data center and management pieces. The central concept and the main benefit of the cloud, beginning with Infrastructureas-a-Service, is to reduce the cost of buying data centers. You do not need to buy data centers anymore. But you still need operations people to run the servers that you are now renting. NoOps fully removes the need for operations and development people to work hand in hand. Operational needs are still being fulfilled, but they are being accomplished independently of any individual application. NoOps refers to the idea of outsourcing operations roles and providing a way for developers to get their jobs done faster. Developers don t have to wait for another team to deploy their code, and the systems that automate those processes for developers operate seamlessly. NoOps is a controversial term, because some people read it as No Ops, suggesting that operations are no longer relevant. On the contrary, however, operations are more relevant and important today than ever. The intent behind the term NoOps is to highlight that from the developer s perspective, you no longer interact as directly with the operating guts of running the application. It s the same as how NoSQL doesn t mean that SQL is no longer relevant, but rather that there is another way of approaching data storage and retrieval where a developer doesn t interact with SQL. Platform-as-a-Service outsources operations. It is not getting rid of operations, but decoupling them from development, so that you can get your job as a developer done easier and faster. The original iterations of managed Platform-as-a-Service, which included systems such as Force.com and the Google App Engine, were very constrained. They required you to develop your code against their APIs, so that they only worked within their contexts. Their Platform-as-a-Service features were accessed only when you tied them directly to The Cloud: A Brief History for Programmers 7

19 their systems. They promised that you could access special data and that you could take advantage of features like auto-scaling but doing so could be difficult. There were two downsides to early PaaS. The first was that you needed to learn a new set of APIs in order to program against them, so there was a learning curve just to get acclimated. The second downside involved portability. If you were to program against the Google App Engine, for example, it would be difficult to move your application and try it out on a different platform. There were upsides as well, though such as the extractive system data and the services that they provided. Then new players began to arrive on the scene, and with their arrival came a movement toward platforms like Heroku and EngineYard. They broke the mold of saying that you needed to code against APIs. They said, in effect, We are going to take your application as is. You don t have to make any changes that work against proprietary APIs. You can run this code just as easily on your own hardware as you could on our systems, and you aren t going to have to change your code to make that happen. For developers, this was a revolutionary moment in the history of the cloud. Initially, in order to provide their innovative services, these PaaS providers limited the language technology. Early users of Heroku and EngineYard, for example, could only pick Ruby. So while the upside was that you didn t have to program against APIs, the downside was a restriction on what languages you could pick. PaaS quickly evolved with the help of next-generation PaaS companies like AppFog and dotcloud, which were no longer tied to a single language. Today, many larger PaaS companies, and even older ones like Heroku and EngineYard, support many programming languages. This represents a significant transition from restrictive platforms to those that are more open. Some PaaS companies are still tied to single programming languages, however, claiming that there is more benefit in having deeper domain knowledge for a single language. A popular trend in PaaS with companies like AppFog is multi-infrastructure PaaS. This allows you to run apps in many different infrastructures at the same time, even operated by completely different companies. For the first time in history, you can easily run your app on Amazon Web Services and Rackspace at the same time. If Amazon Web Services goes down, Rackspace can act as a disaster recovery program that keeps applications up and running on a separate system. This has been a dream for most programmers that PaaS can uniquely fulfill. The Core of the Cloud For developers, the cloud can be a loaded term with many different interpretations. How does the cloud help the developer get her job done better and faster? It can be 8 Chapter 1: The Cloud for Developers

20 difficult to clearly determine what is simply an application and what will actually change your life. To some people, the cloud means Gmail, Dropbox, and similar services. But these are applications built on the cloud. They do not change a developer s life. What really changes a developer s life are the core fundamental cloud technologies, the essential technologies that form the backbone of the cloud. The foundational cloud technologies are virtualization, infrastructure APIs, DevOps, app lifecycle management tools, and NoOps. They all build on top of each other and combine to enable the next generation of technologies. Each one is necessary for the others. For example, you can t have infrastructure APIs for virtualization without virtualization itself. As a developer, you can interact with any one of these foundational technologies and extract great benefits. For example, you can interact with virtualization directly. Many DevOps technologies do so, managing KVM or Xen directly, usually to virtualize different operating systems and test applications in those systems. You can test an application to determine whether it is a software app, a web app, or a mobile app; with this foundational technology, you can virtualize all of these environments. Using APIs for virtualization, many developers build on Amazon Web Services and similar OpenStack APIs in order to get their jobs done better and faster. It enables them to spawn servers and manage processes and packages with great speed. But the problem is that you, Mr. or Ms. Developer, are still the one on call when the servers go down at 4 a.m. And the servers inevitably do go down at 4 a.m. Even with virtualization. Even with infrastructure APIs. Even with Amazon Web Services. Even with Cloud Foundry. As a developer, half of the problem is getting the resources you need; that is what Infrastructure-as-a-Service solves. The other half of the problem is running and managing your application; that is what Platform-as-a-Service solves. From a developer s point of view, you can utilize any of these core technologies successfully. The higher up the stack you move, the more time you can spend writing your own code. As a developer, you can spend time at the IaaS level: you ll have more control over some of the lower features, those closer to the infrastructure. The trade-off is that you ll need to spend more time in VMs and less time on the code that you are writing for your users. The higher up the stack you move in the cloud and the closer you get to PaaS, the more time you can spend innovating. You ll have the time to be like Jason Gendron and improve your product, to pivot and try different things with your users, to figure out how to build the next Google or Facebook, rather than worrying how to keep the servers up at 4 a.m. The Core of the Cloud 9

21 Managed Platforms versus Productized Platforms Our discussion of PaaS has centered on managed or public cloud PaaS, in which a developer or company outsources maintenance responsibilities to the PaaS provider. A productized or private cloud PaaS offers a different set of attributes. In a productized platform, you are utilizing app lifecycle management tools and Platform-as-a-Service tools on your own hardware with your own resources. The benefit is that your operations team is in control. They can incorporate the platform s tools in a way that works with many of your applications because they are familiar with how they work. Another advantage: your operations people can reuse much of the hardware in which you have invested and determine how to get all aspects of your system to work together well. A managed PaaS provider, like Heroku or AppEngine, is in charge of running and maintaining operations for you. As we saw earlier, one of the biggest benefits of Platform-as-a-Service is that it provides the ability to decouple development from operations. Once development is decoupled, the operations do not need to be in house anymore. And if they do not need to be in house, you have to ask yourself, Is it cheaper to run them in house or is there an economy of scale to be had with an outside provider? A managed platform takes PaaS technology and provides it as a service for your company in real time without you needing to worry about service level agreements. Uptime is guaranteed, so that when things go wrong at 4 a.m., it is the public provider s job to fix it, not yours. There are various productized platforms to choose from. There are open source app lifecycle management tools like Cloud Foundry or OpenShift that can be run onpremises, and there are more commercial tools like Cloudify and Stackato that can be licensed. Some companies, like AppFog, have both a public cloud PaaS offering and a private cloud, on-premises license of the same software. Running app lifecycle management tools like Cloud Foundry on your own can be very hard. Production-quality service for these tools requires dozens of individual components that interact with each other. It can be a complex matter making sure that these components interact well, that they are healthy and managed, and that if something goes wrong, they are replaced. Those are the kind of issues handled by a managed platform issues that will need to be dealt with manually if you are trying to incorporate those tools into your own processes. The Cloud s Promise (or Hype) From a developer s point of view, part of the challenge of thriving in this new landscape is determining whether or not the cloud is all hype. 10 Chapter 1: The Cloud for Developers

22 Is Gmail going to make a dramatic difference in the life of an individual developer, a corporation, or an agency? Probably not. It might make an incremental improvement, but not a drastic one. However, understanding how to best utilize foundational cloud tools like DevOps and PaaS within the operation of a modern business, whether you are starting one or running one, and figuring out how to leverage cloud technology to do your job faster and more cheaply than before is not hype at all. On the contrary, it is how high-tech companies are going to be built and operated in the future. It is reality. Without a doubt, we are rapidly headed en masse to the cloud. When technology is built on technology, it creates a feedback loop that grows exponentially. When you consider, for example, that the maturing process that led from Morse code to the advent of the telephone took more than 40 years, the current rate of technological maturation is nothing short of astounding. That s one of the lessons of Moore s law on transistors, which observes that the number of transistors on integrated circuits doubles approximately every two years. In high-tech companies and in the cloud, innovations are happening more rapidly than ever. The timeline for new foundational technologies being built, coming to market, and maturing is shortening quickly, with major overhauls on entire industries happening in timelines as short as a few years. In recent history, it took around a decade for virtualization to gain widespread adoption. IaaS has matured nearly as much in only five years. PaaS is likely to be adopted widely in a mere one to two years. As a developer, learning to adroitly adapt to these technologies is key for growing your career in this modern age. The Cloud in Five Years PaaS is maturing quickly, but it is still not perfect for every application. Will the next Twitter or the next Facebook be built on PaaS? The answer today is not yet, but most companies are at least starting to consider the advantages of moving to PaaS. As of 2013, PaaS has not been proven at scale yet, much like Ruby on Rails hadn t been in A few large companies have shown success with PaaS (e.g., Groupon using EngineYard). Once a few more large success stories have shown the potential of PaaS at large scale, we are likely to see a mass adoption shortly after. The other factor for mass adoption is the maturity of PaaS behind the firewalls for large corporations. Heroku and EngineYard are fantastic public cloud solutions, but large companies have already invested in large numbers of servers that are not likely to be retired very soon. Being able to run large applications in PaaS on existing hardware will go a long way to making mass adoption a reality. If you look ahead 5 to 10 years, PaaS will be a cornerstone technology. We are going to witness a new generation of high-tech companies being built on the tools of the cloud. We are going to see billion-dollar companies being built solely on PaaS technology. The Cloud in Five Years 11

23 The Promise Fulfilled As we saw at the beginning of this chapter, PaaS literally changed Jason Gendron s life situation. It enabled him to focus on his core talents, writing code and running his business, while it lowered his cost of innovation. It gave him the time and the server power to help turn TwitClub into a successful venture. By removing the need for an IaaS provider, by managing the nitty gritty of day-to-day operations, by handling glitches and crashes, PaaS is changing the lives of millions of other developers. Whether you are inside an agency dealing with hundreds of clients, inside an enterprise with thousands of users, or working on your own to develop the big idea, PaaS offers you the tools to realize your potential. It reduces the price of innovation for individual developers. It reduces the price of innovation for venture capitalists looking to invest in the next Google. And it is going to bring the same cost savings into enterprises as enterprise adoption of PaaS becomes ubiquitous. In the coming chapters, we ll look more closely at PaaS and managed services, examine how to write apps for PaaS, and explore a future in which PaaS becomes a major player in cloud technology. 12 Chapter 1: The Cloud for Developers

24 O Reilly Ebooks Your bookshelf on your devices! When you buy an ebook through oreilly.com you get lifetime access to the book, and whenever possible we provide it to you in five, DRM-free file formats PDF,.epub, Kindle-compatible.mobi, Android.apk, and DAISY that you can use on the devices of your choice. Our ebook files are fully searchable, and you can cut-and-paste and print them. We also alert you when we ve updated the files with corrections and additions. Learn more at ebooks.oreilly.com You can also purchase O Reilly ebooks through the ibookstore, the Android Marketplace, and Amazon.com. Spreading the knowledge of innovators oreilly.com