CSE-E5430 Scalable Cloud Computing Lecture 7

Transcription

1 CSE-E5430 Scalable Cloud Computing Lecture 7 Keijo Heljanko Department of Computer Science School of Science Aalto University keijo.heljanko@aalto.fi /34

2 Flash Storage Currently one of the trends is the introduction of Flash memory SSDs (solid state disks) are replacing hard disks in many applications Flash capacity per Euro is increasing faster than hard disk capacity per Euro Random SSD read (and often also write) IOPS are more than 100 those of high end hard disk read and write IOPS 2/34

3 Flash Storage (cnt.) Sequential read and write speeds are faster than those of the best hard disks As SSDs have no moving parts they are fail quite a bit less frequently than hard disks As such SSDs are a very good match for typical client laptop and desktop usage patterns 3/34

4 Flash Storage Flash has both strengths and limitations compared to hard disks, they are not a direct hard disk replacement for all server workloads Especially the write endurance of SSDs (the amount of data that the SSD is specified to write reliably during its lifetime) is quite often very small compared to hard disks For write intensive server workloads hard disks might still be the only economically viable option due to SSDs having to be replaced once write endurance is exhausted 4/34

5 Flash Organization A flash chip is organized in pages of some KBs in size (e.g., 2KB) A page read can load the data of a page into buffers that can be quickly randomly accessed A page write can only flip bits of the page from 0 to 1 In order to change the bits from 1 to 0 and erase operation operating on a large number of blocks needs to be performed An erase operation works on blocks that consist of several flash pages at the time (e.g., 128KB of data) If the blocks to be erased contain some data, that data must be written elsewhere before the block is erased 5/34

6 Flash Types Flash memory comes in several flavors, the main ones being: triple-level cell TLC (cheapest), multi-level cell MLC (cheap), and single-level cell SLC (expensive) Flash blocks can be erased: around 1000 times (TLC flash), times (MLC flash), or times (SLC flash) 6/34

7 Flash Wear Levelling Algorithms Highly sophisticated algorithms are used for wear leveling, where the goal is to write each flash cell as evenly as possible When flash disk becomes almost full, the free space can become fragmented which can result in performance loss on writes as the SSD moves blocks around to make space for the written data Flash disks often use spare capacity set aside to make the fragmentation problems less severe 7/34

8 Sustained Flash Write Performance Because of the write leveling algoritms, the sustained Flash memory write speeds can sometimes be compromised: http: // Intel_X25-E_G1_vs_Intel_X25-M_G2.htm 8/34

9 Sustained Flash Write Performance (cnt.) Thankfully performance consistency has improved on newer SSD designs but long benchmarking is needed: intel-ssd-dc-s3700-series-800gb/ 9/34

10 Sustained Flash Write Performance (cnt.) Benchmarking another set of SSDs from: 840_pro_review 10/34

11 Optimizing for Flash One should minimize the number of bytes written to Flash Less bytes written means less wear and longer lifetime expectancy of Flash Less bytes written means less frequent slow block erases, and this improves the overall Flash IOPS Heavy sequential write workloads (e.g., database logs) can be efficiently handled by arrays of hard disks without any problems with write endurance Operating systems support such as the TRIM command which tells to the SSD which data blocks can be safely discarded is very useful 11/34

12 Future of Storage Technologies A mantra from Jim Gray of Microsoft in his 2006 presentation gray/talks/flash_is_good.ppt: Tape is Dead Disk is Tape Flash is Disk RAM Locality is King 12/34

13 Jim Gray on Disks (in 2006) Disk are cheap per capacity Sequential access full disk reads of take hours Random access full disk reads take weeks Thus most of disk should be treated as a cold-storage archive 13/34

14 Jim Gray on Flash (in 2006) Lots of IOPS Expensive compared to disks (but improving) Limited write endurance Slow to write (compared to reading) 14/34

15 Jim Gray on RAM (2006 numbers) Flash/disk is cycles away from the CPU RAM is 100 cycles away from the CPU Thus Jim Gray concludes that main memory databases are going to be common Also opens possibilities for new memory technologies between RAM and Flash, see e.g., Intel and Micron 3D X-point: 15/34

16 Some Rule of Thumb Numbers for Flash For a single random access read, the following rules of thumb numbers apply: Main memory reference: 100 ns Flash drive access: ns (1000x slower than memory) Disk seek: ns ( x slower than memory) 16/34

17 Tape is Dead, Disk is Tape, RAM locality is King Trends of RAM, SSD, and HDD prices. From: H. Plattner and A. Zeier: In-Memory Data Management: An Inflection Point for Enterprise Applications 17/34

18 Tape is Dead, Disk is Tape, RAM locality is King RAM (and SSDs) are radically faster than HDDs: One should use RAM/SSDs whenever possible RAM is roughly the same price as HDDs were a decade earlier Workloads that were viable with hard disks a decade ago are now viable in RAM One should only use hard disk based storage for datasets that are not yet economically viable in RAM (or SSD) The Big Data applications (HDD based massive storage) should consist of applications that were not economically feasible a decade ago using HDDs 18/34

19 RAMCloud John K. Ousterhout, Parag Agrawal, David Erickson, Christos Kozyrakis, Jacob Leverich, David Mazires, Subhasish Mitra, Aravind Narayanan, Diego Ongaro, Guru M. Parulkar, Mendel Rosenblum, Stephen M. Rumble, Eric Stratmann, Ryan Stutsman: The case for RAMCloud. Commun. ACM 54(7): (2011). Facebook in 2009 has been running in 2009 with enough RAM to fit 75% of their dataset (not counting images or video) in RAM If they would use enough RAM cache to hit 99% of the dataset, the random disk seek latency would still kill their average latency performance: (99% 100 ns + 1% ns) = ns, which is way more that 100ns! 19/34

20 RAMCloud - Discussing the Numbers With Flash disks and 99% cache hit rate we get latencies: (99% 100 ns + 1% ns) = 1099 ns, which is still 10x more that 100ns. The above concerns only average latency, not throughput, but similar reasoning also applies to aggregate IOPS numbers of RAM, Flash, and Disk If a system can have enough memory to have 100% of the working set in RAM, instead of Flash / Hard disk, way more IOPS can be served with the same number of servers. 20/34

21 RAMCloud - Limiting Factors The main problem in RAMcloud style designs to guarantee data persistence in case of power failure + quick recovery in case of server crash / power outage The second problem is to have enough low latency networking hardware and OS to keep RAM busy 21/34

22 RAM vs Flash vs Disk The RAMCloud paper has the following diagram adapted from the paper: Andersen, D., Franklin, J., Kaminsky, M., et al., FAWN: A Fast Array of Wimpy Nodes, Proc. 22nd Symposium on Operating Systems Principles, 2009: 22/34

23 Cloud Computing - Definition by NIST (recap) The NIST Definition of Cloud Computing, SP , Sept /SP pdf Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. This cloud model is composed of five essential characteristics, three service models, and four deployment models. 23/34

24 Cloud Computing - Essential characteristics On-demand self-service Automated self-provisioning of services such as computing and storage Broad network access Wide variety of clients accessing the cloud services over standard networks Resource pooling Multi-tenancy of several customers on shared resources, allows high utilization ratios Rapid elasticity Computing capacity can be quickly scaled both up and down on customer demand Measured Service Pay-as-you-go billing: computing, storage, bandwidth, etc. 24/34

25 Cloud Computing - Service Models Software as a Service (SaaS) Examples: Salesforce.com, Google Apps for Business Platform as a Service (PaaS) Examples: Google App Engine, Heroku.com Infrastructure as a Service (IaaS) Examples: Amazon Web Services, Rackspace Cloud 25/34

26 Cloud Computing - Deployment Models Private cloud Cloud operated by a single organization for its internal use Community cloud Cloud provisioned for a community of users with shared concerns Public cloud Cloud for open use by anyone from the general public Hybrid cloud Composition of several of the above but still enabling data and application portability. Example: Cloud bursting 26/34

27 Cloud and Open Source What kinds of open source projects are supporting the cloud in addition to the usual suspects such as Linux? Quite often successful open source projects start as clones of existing proprietary systems, so it makes sense to take a look at the proprietary industry leaders, and figuring out the open source alternatives to their software stacks 27/34

28 What is Inside Amazon IaaS Stack? Amazon Web Services is currently the leading commercial IaaS provider Many successful open source projects have started as clones of proprietary software What kinds of components are inside the Amazon Web Services IaaS stack? 28/34

29 Amazon Web Services - Top Level Categories Compute Content Delivery Database Deployment & Management E-Commerce Industry-specific Clouds Messaging Monitoring Networking Payments & Billing Storage Support Web Traffic Workforce 29/34

30 Amazon Compute and Open Source Some categories will have open source replacements, and many are currently under heavy development: Compute, virtual machines/amazon EC2: OpenStack Compute ( Open Nebula ( Eucalyptus ( Currently OpenStack has the largest momentum, while Open Nebula is the most stable solution Compute, scalable batch processing, Elastic MapReduce (Google MapReduce clone): Based of Apache Hadoop ( Also Microsoft has integrated Hadoop with Windows Azure cloud platform as well as its SQL server in the HDInsight offering: services/hdinsight/ 30/34

31 Amazon Storage and Open Source Storage, local network block storage/amazon EBS: Sheepdog project ( Ceph Rados ( Storage, global network object storage/amazon S3: OpenStack Object Storage ( 31/34

32 Open Sourcing the Datacenter Open sourced datacenter design: Open Compute ( from Facebook Datacenter design based on heavy use of outside air cooling Custom server designs for Intel and AMD processors Designs of electrical systems and distributed UPSs All designs fully open sourced 32/34

33 Google s Infrastructure Google is the leading SaaS cloud provider, what new components do they use, and what are the open source replacements? Google Filesystem GFS (distributed filesystem) - Hadoop Distributed Filesystem HDFS Google MapReduce (distributed batch processing) - Hadoop MapReduce - Apache Spark Google Bigtable / Megastore / Dremel (distributed database) - Hadoop Database (HBase) / Apache Cassandra / Apache Hive / Cloudera Impala-Spark SQL-Facebook Presto Google Chubby (distributed coordination service) / Apache Zookeeper 33/34

34 Google s Infrastructure (cnt.) Many components have open source replacements developed by Google s competitors: Yahoo!, Facebook, Twitter,... Google s systems implement a massively distributed fault tolerant PaaS infrastructure for the SaaS solutions from Google Runs on hardware made from commodity components Major focus on automated fault tolerance an multi-tenancy to minimize the number of administrators/computer Google has the luxury of embarrassing parallelism : Running a single word processing application is inherently sequential but running a million word processing applications is embarrassingly parallel 34/34