Ceph Appliance: ETERNUS CD10000 S2

Transcription

1 Walter Graf Ceph Appliance: ETERNUS CD10000 S Fujitsu

2 Summary Upfront New Storage Application Areas How to address with Ceph Fully integrated and Easy To Use ETERNUS CD10000 S Fujitsu

3 New Storage Application Areas Cloud Infrastructures with OpenStack Unstructured Data Repositories using Amazon S3 / OpenStack Swift Fujitsu

4 The Infrastructure Challenge Agile Development Lengthy Deployment Fujitsu

5 The DevOps Way Deployment Automation Infrastructure as Code Speeds up Deployment Makes Q/A possible Fujitsu

6 ETERNUS CD10000 OpenStack use case DBCE Cloud Marketplace Competitive Advantage Nova Cinder Neutron DARZ OpenStack Cloud ETERNUS CD10000 Cloud Storage Time To Market Quicker Booking & Billing Agility Automation Flexibility Cost Reduction Fujitsu

7 Customer / Storage Profile Service Provider Large Private Cloud Operators Own Software Development Web Frontend Open Source Minded Following Cloud Programming Paradigms Self Managing & Self Healing Storage Immortal System Fujitsu

8 The scale of unstructured data is mind-boggling About 85% is unstructured data Data growth 18% p.a. structured data 41% p.a. unstructured data Fujitsu

9 The Unstructured Data Opportunity Create competitive advantages Big Data repositories Internet of Things Car Sensor Data Sync & Share Enterprise Dropbox owncloud, Seafile, ctera, Data Space Fujitsu

10 Object Storage Architecture Owncloud, irods, irods, Seafile, Ceph Object API RESTful API [S3,Swift] Rados Gateway Ceph Object API Ceph Object Store (ETERNUS CD10000) Fujitsu

11 University of Mainz Johannes Gutenberg University of Mainz ~ 36,500 students; > 500 professors > 150+ departments; > 5,500 employees; multiple institutes and clinics Central IT department - ZDV IT services and HPC center Fujitsu

12 Customer / Storage Profile Large repositories > 100 TB Seamless scalability up to multi PB range Cost efficient storage for less frequently accessed data Easy accessible (no tape) Immortal system No vendor lockin Viewing object storage as superior over file system storage Fujitsu

13 Ceph Scalable Disaster Resilient Self-managing Self-Healing Fujitsu

14 OpenStack.org User Survey May Fujitsu

15 Key Components Calculate instead of lookup Use objects instead of blocks or files Automatically place, replicate, balance, and migrate data Fujitsu

16 True Scalability, Disaster Resilience, Seamless Lifecycle RAID Ceph Access network Controller 1 Controller 2 Node 1 Node 2 Node 3 Node 4 Limited Scalability DR only with multiple systems and additional software Major migration efforts at EOSL Unlimited Scalability Built in DR Seamless migration to new nodes, no EOSL Fujitsu

17 Ceph Software Architecture Cluster Monitors <10 cluster membership authentication cluster state cluster map Meta Data Server* (MDS) 10s for POSIX only Namespace mgmt. Metadata ops (open, stat, rename, ) Object Storage Daemons (OSD) 10,000s stores all data / metadata organises all data in flexibly sized containers Topology Authentication POSIX meta data only bulk data traffic block file object Clients *) still experimental Fujitsu

18 From Object to OSD Object func(pool, obj_name) Placement Group #a Placement Group #b Placement Group #c CRUSH ruleset OSD#i (primary copy) OSD#k (2nd copy) OSD#l (3rd copy) Fujitsu

19 Crush Ruleset Example 3 replicas in 3 fire sections 1. In fire section 1 i. Using CRUSH select host ii. Using CRUSH select & remember 1 osd on this host 2. In fire section 2 i. Using CRUSH select 1 host ii. Using CRUSH select & remember 1 osd on this host 3. In fire section 3 i. Using CRUSH select 1 host ii. Using CRUSH select & remember 1 osd on this host Fujitsu

20 Recover Fujitsu

21 Why ETERNUS CD10000? Enterprise Class Architecture ETERNUS CD10000 S2 End to End Software plus Hardware Integration & Service Lifecycle Management Overcome Downsides of SDS Fujitsu

22 ETERNUS CD10000 > 50 PB > 200 nodes Fujitsu

23 ETERNUS CD10000 Architecture optional component Customer Network Mgmt Data Gateway Node Gateway Node Monitor Node Storage Node Storage Node Storage Node Storage Node Mgmt Node raw capacity > 50 PB Replica, Recovery, Balancing, Migration CD10k Backend Network CD10k Mgmt Network Fujitsu

24 ETERNUS CD10000 Flex Nodes optional Storage Node 44 TB Storage Node 92 TB Storage Node 140 TB Storage Node 188 TB PRIMERGY 2540-M1 (44 TB) PCIe SSD PRIMERGY 2540-M1 (44 TB) PCIe SSD PRIMERGY 2540-M1 (44 TB) PCIe SSD PRIMERGY 2540-M1 (44 TB) PCIe SSD ETERNUS JX40 S2 (48 TB) ETERNUS JX40 S2 (48 TB) ETERNUS JX40 S2 (48 TB) ETERNUS JX40 S2 (48 TB) ETERNUS JX40 S2 (48 TB) ETERNUS JX40 S2 (48 TB) Fujitsu

25 Density Node Advanced 1U integrated storage node Based on Intel Atom Processor, which reduces total power consumption by 50% with no reduction in performance Equipped with 12 drives, one node provides 60TB capacity Local SSD Cache option Innovative drive mounting design eliminates rotational vibration Ideally suited for use in Erasure Coded pools Fujitsu

26 ETERNUS CD10000 S2 Node optimizations PRIMERGY 2540-M1 (44 TB) ETERNUS JX40 S2 (48 TB) GB TB disks PCIe SSD becoming optional PCIe SSD ETERNUS JX40 S2 (48 TB) Modular Capacity Extensions ETERNUS JX40 S2 (48 TB) 1U Mgmt Node Optional Monitor Node Optional RADOS GW PRIMERGY 2530-M1 PRIMERGY 2530-M1 PRIMERGY 2530-M Fujitsu

27 Efficiency gains with ETERNUS CD10000 S2 Up to factor 6 less cost per GB with Flex Nodes Up to factor 10 less costs per GB with Density Nodes Up to 75% reduction in capacity investment for data redundancy with Erasure Coding Up to factor 10 higher storage density with Density Nodes Up to 50% less power consumption with Density Nodes Compared to ETERNUS CD10000 S Fujitsu

28 How To Connect Storage Nodes Storage Node 2 x 10 GbE 10 GbE Switch Storage Node connection in a non-redundant configuration 1 x 10 GbE Storage Node 10 GbE Switch 10 GbE Switch 8 x 10 GbE Storage Node connection in a redundant configuration 1 x 10 GbE Fujitsu

29 Switch Cascading 10 GbE Switch 10 GbE Switch 2 x 40 GbE 2 x 40 GbE Uplink connection in a non-redundant configuration 10 GbE Switch 10 GbE Switch 8 x 10 GbE 2 x 40 GbE 8 x 10 GbE 2 x 40 GbE 10 GbE Switch 2 x 40 GbE 10 GbE Switch 2 x 40 GbE Uplink connection in a redundant configuration Fujitsu

30 How To Connect Zones (1) 10 GbE Switch QSFP+ QSFP+ QSFP+ QSFP+ 10 GbE Switch 8 x 10 GbE (for redundancy) long distance optical cable* 8 x 10 GbE 10 GbE Switch QSFP+ QSFP+ QSFP+ QSFP+ 10 GbE Switch *) depending on cable length MMF or SMF cables / SFPs / QSFPs are needed required cables, SFPs, QSFPs not part of ETERNUS CD10000 portfolio Fujitsu

31 How To Connect Zones (2) 10 GbE Switch QSFP+ QSFP+ optical cable** Customer Network* optical cable** 10 GbE Switch 8 x 10 GbE (for redundancy) 8 x 10 GbE QSFP+ QSFP+ 10 GbE Switch QSFP+ QSFP+ optical cable** Customer Network* optical cable** QSFP+ QSFP+ 10 GbE Switch *) required components are project specific and are not part of ETERNUS CD10000 portfolio **) required cables, SFPs, QSFPs not part of ETERNUS CD10000 portfolio Fujitsu

32 Ceph is Open Source Stay compatible Contribute instead of fork Based on Ceph Enterprise Releases Offer solution maintenance instead of separate contracts for hardware and software All backed by Red Hat Fujitsu

33 Immortal System Concept Normal Storage initial configuration storage upgrade storage upgrade ETERNUS CD10000 storage nodes other components new storage nodes new storage nodes replacement of old storage nodes and other components initial purchase time normal EOSL prolonged EOSL prolonged EOSL prolonged EOSL Fujitsu

34 Ceph Challenge: Installation Manual Ceph Installation (Plain Ceph) Setting-up a Ceph cluster with 240+ OSDs admin days Adding an additional node from 3 admin hours up to half a day Automated installation (CD10000) Setting-up a Ceph cluster with 240+ OSDs 1 hour Adding an additional node 0.5 hour Fujitsu

35 Ceph Admin Challenge: Replacing an HDD Plain Ceph taking the failed disk offline in Ceph taking the failed disk offline on OS / Controller Level identify (right) hard drive in server exchanging hard drive partitioning hard drive on OS level Make and mount file system bring the disk up in Ceph again On ETERNUS CD10000 vsm_cli <cluster> replace-disk-out <node> <dev> exchange hard drive vsm_cli <cluster> replace-disk-in <node> <dev> Fujitsu

36 Ceph Admin Challenge: Adding a Node Plain Ceph Install hardware Install OS Configure OS Configure network Configure S/W repositories Configure ntp Configure sudo Configure ssh Partition disks (OSDs, Journals) Make filesystems Deploy monitor (optional) Deploy OSDs On ETERNUS CD10000 Install hardware hardware will automatically PXE boot and install the current cluster environment including current configuration Make node available to GUI Add node to cluster with mouse click on GUI Fujitsu

37 ETERNUS CD10000 = Ceph++ Cloud Storage + Immortal System + E2E Solution Contract + Automated Deployment + Automated Management + Hardware / Software Integration Fujitsu

38 ETERNUS CD10000 Addresses new storage application areas Avoids Vendor Lockin Addresses Key Storage Requirements scalability, DR, automation, immortal system, seamless migration Offers optimised price capacity ratio Stay tuned for further information: Corporate Partner Portal > Portfolio catalog > Products > Storage solutions > Hyperscale Storage WP RAID: End of Era?, Presentations, Product Insights, Sizing Tool On Youtube: Search for ETERNUS CD Fujitsu

39 Fujitsu

40 ETERNUS CD10000 Backup Rapid Infrastructure Provisioning with OpenStack Fujitsu

41 The backup principle - still relevant? Does the backup principle still rule? Have at least 3 copies of your data Keep these backups on 2 different media Store 1 backup offsite But, what about, amount of data, bandwith, backup window, cost? Fujitsu

42 Data protection strategies for petabyte storage What we see: Two camps of customers/ mindsets The traditional way Dominated by explicit requirements Legacy apps processes Insists on principle New concepts are demanded! Leverage Ceph functions Backup-in-the-box New cloud way Backup only what you need Move data as less as possible Ceph provides HW redundancy across sites Logical level protection based on Snapshots OpenStack / Sync & Share make use of the Ceph functions Fujitsu

43 New: backup-in-the-box Backup-in-the-box Pool based backup Full, incremental, synthetic full Pool or object-based recovery To the original pool or to another Pool A Pool B Backup Pool Ceph Cluster CD10000 storage nodes Fujitsu