Contents I INTRODUCTION & CONCEPTS 17 1 Introduction to Cloud Computing 19 11 Introduction 111 Definition of Cloud Computing 20 12 Characteristics of Cloud Computing 20 13 Cloud Models 22 131 132 Service Models 22 Deployment Models 23 14 Cloud Services Examples 141 142 143 IaaS: Amazon EC2, Google Compute Engine, Azure VMs 25 PaaS: Google App Engine 27 SaaS: Salesforce 28 15 Cloud-based Services & Applications 151 152 153 154 155 156 157 Cloud Computing for Healthcare Cloud Computing for Energy Systems Cloud Computing for Transportation Systems Cloud Computing for Manufacturing Industry Cloud Computing for Government Cloud Computing for Education Cloud Computing for Mobile Communication 20 25 30 30 31 32 34 34 34 36
2 Cloud Concepts & Technologies 39 21 Virtualization 40 22 Load Balancing 41 23 Scalability & Elasticity 45 24 Deployment 46 25 Replication 47 26 Monitoring 49 27 Software Defined Networking 51 28 Network Function Virtualization 54 29 MapReduce 56 210 Identity and Access Management 57 211 Service Level Agreements 58 212 Billing 59 3 Cloud Services & Platforms 63 31 Compute Services 64 311 Amazon Elastic Compute Cloud 66 312 Google Compute Engine 66 313 Windows Azure Virtual Machines 67 32 Storage Services 67 321 Amazon Simple Storage Service 68 322 Google Cloud Storage 69 323 Windows Azure Storage 70 33 Database Services 70 331 Amazon Relational Data Store 71 332 Amazon DynamoDB 72 333 Google Cloud SQL 72 334 Google Cloud Datastore 74 335 Windows Azure SQL Database 74 336 Windows Azure Table Service 74 34 Application Services 74 341 Application Runtimes & Frameworks 75 342 Queuing Services 77 343 Email Services 78 344 Notification Services 78 345 Media Services 80
35 Content Delivery Services 80 351 Amazon CloudFront 81 352 Windows Azure Content Delivery Network 81 36 Analytics Services 81 361 Amazon Elastic MapReduce 81 362 Google MapReduce Service 82 363 Google BigQuery 83 364 Windows Azure HDInsight 83 37 Deployment & Management Services 83 371 Amazon Elastic Beanstalk 83 372 Amazon CloudFormation 83 38 Identity & Access Management Services 84 381 Amazon Identity & Access Management 85 382 Windows Azure Active Directory 85 39 Open Source Private Cloud Software 85 391 CloudStack 86 392 Eucalyptus 86 393 OpenStack 87 4 Hadoop & MapReduce 93 41 Apache Hadoop 94 42 Hadoop MapReduce Job Execution 95 421 NameNode 96 422 Secondary NameNode 96 423 JobTracker 96 424 TaskTracker 96 425 DataNode 96 426 MapReduce Job Execution Workflow 97 43 Hadoop Schedulers 102 431 FIFO 102 432 Fair Scheduler 102 433 Capacity Scheduler 103 44 Hadoop Cluster Setup 104 441 Install Java 105 442 Install Hadoop 105 443 Networking 106 444 Configure Hadoop 107 445 Starting and Stopping Hadoop Cluster 108
II DEVELOPING FOR CLOUD 115 5 Cloud Application Design 117 51 Introduction 118 52 Design Considerations for Cloud Applications 118 521 Scalability 118 522 Reliability & Availability 119 523 Security 119 524 Maintenance & Upgradation 120 525 Performance 120 53 Reference Architectures for Cloud Applications 120 54 Cloud Application Design Methodologies 124 541 Service Oriented Architecture 124 542 Cloud Component Model 127 543 IaaS, PaaS and SaaS services for cloud applications 129 544 Model View Controller 130 545 RESTful Web Services 132 55 Data Storage Approaches 134 551 Relational (SQL) Approach 134 552 Non-Relational (No-SQL) Approach 138 6 Python Basics 143 61 Introduction 144 62 Installing Python 145 63 Python Data Types & Data Structures 145 631 Numbers 145 632 Strings 147 633 Lists 148 634 Tuples 149 635 Dictionaries 150 636 Type Conversions 151 64 Control Flow 151 641 if 151 642 for 152 643 while 153 644 range 153 645 break/continue 153 646 pass 154 65 Functions 154 66 Modules 157 67 Packages 159
68 File Handling 160 69 Date/Time Operations 162 610 Classes 163 7 Python for Cloud 169 71 Python for Amazon Web Services 170 711 Amazon EC2 171 712 Amazon AutoScaling 173 713 Amazon S3 177 714 Amazon RDS 177 715 Amazon DynamoDB 180 716 Amazon SQS 182 717 Amazon EMR 185 72 Python for Google Cloud Platform 187 721 Google Compute Engine 187 722 Google Cloud Storage 190 723 Google Cloud SQL 193 724 Google BigQuery 196 725 Google Cloud Datastore 199 726 Google App Engine 202 73 Python for Windows Azure 204 731 Azure Cloud Service 204 732 Azure Virtual Machines 206 733 Azure Storage 207 74 Python for MapReduce 210 75 Python Packages of Interest 211 751 JSON 211 752 XML 213 753 HTTPLib & URLLib 214 754 SMTPLib 216 755 NumPy 219 756 Scikit-learn 222 76 Python Web Application Framework - Django 223 761 Django Architecture 223 762 Starting Development with Django 224 763 Django Case Study - Blogging App 233 77 Designing a RESTful Web API 237 8 Cloud Application Development in Python 247 81 Design Approaches 248 811 Design methodology for IaaS service model 248
812 Design methodology for PaaS service model 249 82 Image Processing App 250 83 Document Storage App 259 84 MapReduce App 272 85 Social Media Analytics App 284 III ADVANCED TOPICS 301 9 Big Data Analytics 303 91 Introduction 304 92 Clustering Big Data 304 921 k-means clustering 305 922 DBSCAN clustering 309 923 Parallelizing Clustering Algorithms using MapReduce 313 93 Classification of Big Data 316 931 Naive Bayes 317 932 Decision Trees 323 933 Random Forest 326 934 Support Vector Machine 331 94 Recommendation Systems 335 10 Multimedia Cloud 341 101 Introduction 342 102 Case Study: Live Video Streaming App 342 103 Streaming Protocols 352 1031 RTMP Streaming 353 1032 HTTP Live Streaming 353 1033 HTTP Dynamic Streaming 354 104 Case Study: Video Transcoding App 354 11 Cloud Application Benchmarking & Tuning 365 111 Introduction 366 1111 Trace Collection/Generation 367 1112 Workload Modeling 367 1113 Workload Specification 367 1114 Synthetic Workload Generation 367 1115 User Emulation vs Aggregate Workloads 368
112 Workload Characteristics 368 113 Application Performance Metrics 372 114 Design Considerations for a Benchmarking Methodology 372 115 Benchmarking Tools 373 1151 Types of Tests 374 116 Deployment Prototyping 375 117 Load Testing & Bottleneck Detection Case Study 376 118 Hadoop Benchmarking Case Study 379 12 Cloud Security 391 121 Introduction 392 122 CSA Cloud Security Architecture 393 123 Authentication 395 1231 Single Sign-on (SSO) 395 124 Authorization 398 125 Identity & Access Management 401 126 Data Security 402 1261 Securing Data at Rest 402 1262 Securing Data in Motion 406 127 Key Management 407 128 Auditing 409 13 Cloud for Industry, Healthcare & Education 411 131 Cloud Computing for Healthcare 412 132 Cloud Computing for Energy Systems 415 133 Cloud Computing for Transportation Systems 420 134 Cloud Computing for Manufacturing Industry 423 135 Cloud Computing for Education 424 Appendix-A - Setting up Ubuntu VM 431 Appendix-B - Setting up Django 444 Bibliography 450 Index 451