Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000

Transcription

1 Business-centric Storage FUJITSU Hyperscale Storage System ETERNUS CD10000

2 Clear the way for new business opportunities. Unlock the power of data. Overcoming storage limitations Unpredictable data growth poses great challenges and has been a key issue among IT managers for many years now. And this is not expected to change in the near future. Developments such as cloud services, mobility, big data and analytics, social networking and specialized Internet offerings are already revolutionizing almost every aspect of business and daily life. When it comes to storage, an avalanche of data is rolling toward today s data centers and they must take steps now in order to cope with such huge masses of data. Data centers and experts must determine what kind of massively scalable infrastructure is capable of responding flexibly to data growth. Cloud services providers, for example, have already been facing this challenge for several years. Experience with such data-intensive environments shows that whenever huge data volumes are required in the petabyte range with linearly scalable performance, conventional storage architectures quickly reach their limitations. In such cases the following challenges must be overcome: Time-consuming, risky RAID rebuilds Exploding costs for high-availability Over- or under-provisioning due to unpredictable data growth Extremely time-consuming data migrations Major problems with (planned) downtime High costs per gigabyte Performance issues Setting the foundation for sustainable future business Today scale-out solutions are available based on clusters with RAID systems, and they are indeed capable of alleviating a number of problems but they are still not an adequate response to several challenges. RAID rebuilds represent one typical issue they are time-consuming and risky. Another problem is performance that is not scaled linearly it reaches a saturation limit through central data distribution mechanisms. Furthermore, the gain in capacity is associated with very high costs. Those are all good reasons why you should consider alternative storage strategies that will provide a solid foundation for your business well into the future. Data center platform technologies like cloud services, mobility, big data and analytics, social networking and specialized Internet offerings are driving data growth to unimagined heights and will continue to do so in the years ahead. The only way to cope with this development is through high-capacity storage infrastructures delivering performance that can be linearly scaled. 2

3 ETERNUS CD10000 Hyperscale storage system FUJITSU Storage ETERNUS CD10000 enables you to take care of extreme data growth yourself and with ease. This hyperscale, software-defined system is designed for all environments with huge online data volumes and offers almost unlimited scalability at consistently high levels of performance. ETERNUS CD10000 combines Ceph open source storage software, Fujitsu management enhancements and Fujitsu enterprise-class hardware with end-to-end maintenance services in a complete solution that is ready to use right out of the box. NEARLY UNLIMITED AND FLEXIBLE SCALABILITY OF CAPACITY AND PERFORMANCE Pay as you grow. No unnecessary upfront investments No forced migration due to scalability limits Extremely long lifecycle thanks to technology refreshes that also reduce maintenance and costs FAULT TOLERANCE AND SELF-HEALING BY DESIGN No extra costs for high availability Provides high service levels at lower cost levels Zero downtime BASED ON CEPH OPEN SOURCE STORAGE SOFTWARE No vendor lock-in Seamless integration in OpenStack environments SUPPORTS OBJECT, FILE AND BLOCK STORAGE Delivers great storage consolidation potential within one architecture SYSTEM PLATFORM WITH END-TO-END MAINTENANCE Use of open source storage without risks Fewer evaluation, implementation and maintenance tasks HIGH PERFORMANCE THROUGH HIGH PARALLELISM OF READ AND WRITE OPERATIONS High I/O performance is achieved at lower cost 3

4 ETERNUS CD10000 The storage architecture for the cloud era Technological developments like the cloud and big data are not only radically changing the way we work they are also changing data centers in dramatic ways. Infrastructures are converging so that the exponentially growing number of apps and cross-functional features can be provided to users. At the same time, an expanding group of users and systems are demanding more availability of data online. In light of these trends, IT managers must accept the fact that planning the development of performance and storage capacities in the future will become even more difficult than it is now. But with ETERNUS CD10000 you will still be on the safe side. Fujitsu has redefined storage scalability, reliability and manageability to help you easily cope with dynamic business change driven by the cloud, social media, big data, mobility, etc. ETERNUS CD10000 combines powerful technologies from the open source and OpenStack community with Fujitsu hardware and software in a turnkey scale-out storage system. Turnkey, universal end-to-end solution ETERNUS CD10000 is based on storage nodes with enterprise-class x86 servers. The system supports up to 200 storage nodes in a 19- inch standard rack to reach a capacity of up to 50 petabytes. Data storage is distributed across the storage nodes in the system. This is possible thanks to a solution based on Linux, Ceph storage software and functional enhancements from Fujitsu. Ceph is a freely available software governed by the Lesser General Public License (LGPL). Another important feature of the system is standardized management. ETERNUS CD10000 is equipped with a GUI that allows even relatively inexperienced administrators to centrally perform all management tasks, along with monitoring and reporting. All components are optimized and harmonized in terms of performance and reliability. The system still undergoes quality-assured development, and Fujitsu provides full service and lifecycle management support. Use case specific application scenarios (e.g. cloud services, analytics) Obeject Level Access Block Level Access File Level Access 10 GbE Frontend Network Central Management Ceph Storage Software Storage nodes with industry standard components ETERNUS CD10000 in brief Turnkey end-to-end solution based on Ceph and industrystandard technology Scalable up to 200 storage nodes to achieve a capacity of up to 50 petabytes within a small footprint Internal high-performance network Unified object, block and file storage Central, standardized management Complete service and support Quality-assured ongoing further development Optional support in the realization of customized interfaces Fast Interconnect Backend Network 4

5 Distributed scale-out platform The ETERNUS CD10000 architecture is fundamentally different from conventional storage system architectures. For example, the scalability of capacity and performance is achieved through the storage nodes, which are configured with cost-efficient, performance-optimized industry-standard servers and storage subsystems. The system offers a large number of these storage nodes and manages them as a storage pool. In addition, the data is evenly distributed across the storage nodes, where it is stored and written redundantly. This scale-out approach has many advantages: Linear scalability: The performance of the system is scaled linearly by adding new nodes. High performance: The distributed storage of data across several hard disks and storage nodes supports the high-performance of the system. Fault tolerance: The entire system is resilient due to the storage of data replicas, thus ensuring protection against hard disk and storage node faults or outages. Software-defined storage ETERNUS CD10000 features Ceph open source storage software, one of the leading software technologies for distributed storage. It is one of the cornerstones of the OpenStack Project, which involves IT vendors and developers worldwide who work on various components for open source cloud platforms. Fujitsu has refined Ceph software in terms of enterprise-class demands for availability and fault tolerance it has also enhanced the software with functions for easy system management. Ceph was developed to enable standardized object, block and file storage with a distributed x86 computer cluster. Ceph offers this with scalability into the exabyte range it is also extremely reliable and delivers very high performance. A central element in Ceph is the so-called CRUSH (Controlled Replication Under Scalable Hashing) algorithm, which is used for writing and reading data. The algorithm ensures that data is evenly distributed across the nodes and hard disks of the system, and that the data can be reproduced at any time. The current status of the cluster is also determined in other words, the software detects changes that have resulted from adding new storage nodes, or from hard disk or node failures. Advantages of this technology include: No hot spots due to distributed data storage System is self-managing and automatically adjusts to changes System is self-healing Node 1 Node 2 Node 3 Node N The capacity and performance of the ETERNUS CD10000 system can be scaled quickly and cost-effectively by adding storage nodes. Data is evenly distributed and stored across hard disks and storage nodes. The creation of additional copies means that data can be reproduced quickly, even during outages affecting hard disks or storage nodes. 5

6 Powerful hardware architecture Flexible configuration Consistently optimized building blocks The ETERNUS CD10000 hardware architecture is the basis for highavailability and the outstanding scalability of capacity and performance. For that reason, the entire hardware infrastructure features extremely powerful building blocks across the board, not to mention that all components are precisely harmonized with each other. For each storage node, including all data copies, the system delivers a data throughput rate of 1 GB/s. The storage nodes are integrated in a redundant internal network. The nodes are interconnected through a fast 40 Gb InfiniBand network in the backend, and in the frontend a 10 Gb Ethernet network ensures constant performance. Simple, with almost unlimited scalability Thanks to optimized building blocks, the scalability of ETERNUS CD10000 with storage nodes is practically unlimited. Configurations of up to 200 storage nodes are supported to reach a capacity of up to 50 petabytes. When it comes to the storage nodes, ETERNUS CD10000 offers four modules which make customized system configurations quite easy. The Management Node keeps a record of events during system operation. This compiled data is used for managing the infrastructure solution. If the Management Node should fail, this has no impact on the operation of the system. The Basic Node serves as the fundamental building block for the system with 12.6 terabytes of raw capacity. The Performance Node with PCI-e SSD for scaling provides a raw capacity of 34.2 terabytes. The Capacity Node ensures capacity scaling with high disk density. This storage node has a raw capacity of terabytes. By mixing the Basic Node, Performance Node and Capacity Node in a system, the ETERNUS CD10000 can support any customized application scenario with an optimal configuration. Basic Node Performance Node Capacity Node 12.6 TB 34.2 TB TB 6

7 Excellent performance and scalability Constant high performance, no bottlenecks The innovative, distributed Ceph file system ensures that the performance of the ETERNUS CD10000 hardware architecture is utilized optimally. This file system separates the metadata from the stored data. For metadata transactions, which normally account for half of the workload, the storage software has an innovative architecture that distributes the metadata management across many metadata server (MDS) systems. With support from the CRUSH algorithm, the clients directly access the data, without having to query a central entity. In practical terms, this means that even when a large number of clients access the system, data can be read and written without compromising performance. Metadata operations Metadata servers Clients Cluster monitors File, Block, Object I/O Object Storage Devices Metadata I/O Increasing performance, quickly and easily ETERNUS CD10000 is a self-managing system. It identifies new hard disks or storage nodes as they are added. New devices are automatically integrated in the complete system, and the data distribution is adjusted accordingly to prevent any hot spots. This means that the system performance is scalable at any time, whereby each new storage node increases system capacity and performance. Hardware refresh projects are just as easy. Old components can be replaced with new devices while the system is running, and there is no need to reconfigure the system. Automated Rebalancing Node 1 Node 2 Node 3 Node N 7

8 Fault-tolerant infrastructure for always-on business Resilient and self-healing The scale-out concept of the ETERNUS CD10000, with numerous storage nodes and distributed data storage, provides for a fault-tolerant architecture with complete redundancy of hardware, software and data. The impact of several hard disk or node failures can be counteracted. The system detects any such changes in system status and automatically takes measures to prevent outages. It heals itself by automatically restoring the data affected, and the distribution of the stored data and copies across the storage nodes is optimized so that just the right bandwidth is available. The off-loading of data to the functioning hard disks does not have any significant impact on system performance. Easy disaster recovery ETERNUS CD10000 also supports the realization of disaster recovery configurations. The system can be split and distributed across two sites. For example, the data can be stored redundantly at the primary site and at the secondary site. This ensures that data is always available if hard disks or storage nodes should fail, and each site serves as the recovery backup for the other if one location suffers a complete outage. Site A Redundant Client Network Site B Redundant Client Network Redundant Cluster Network Redundant Cluster Network DR Node at 3rd Site ETERNUS CD10000 automatically restores data should hard disks or nodes fail, and it heals itself through optimization measures. If ETERNUS CD10000 is split geographically across two sites, business continuity is ensured should disaster ever strike. Advantages: Uninterrupted operations No time consuming hard disk rebuilds No administration needed to ensure high availability Advantages: Disaster recovery Data always available, even in worst-case scenarios Fast continuation of business processes 8

9 Easy, central management Comprehensive support Time-saving system platform administration via GUI ETERNUS CD10000 is quite easy to manage. Fujitsu has integrated a GUI that is used to manage the entire system including the Ceph open source software, which normally involves command lines and in-depth management expertise. The management tool is the central entity for software deployment as well as for tasks like network and cluster management. In addition, enhanced functions have been integrated to make configuration and other tasks much simpler. Advantages: Easy, time-saving management even for relatively inexperienced administrators Reduced costs for administration and maintenance Simple lifecycle management ETERNUS CD10000 makes it easy for you to develop a storage strategy that is sustainable well into the future. This starts with the implementation itself. Since the system is delivered as a turnkey solution, you do not have to spend time choosing the best open source and industry-standard technologies, nor do you need to harmonize components or conduct tests. The system is under constant quality-assured further development, which means that you always have the very latest hardware and software components for example, whenever new application interfaces are made available. And that also applies to service because Fujitsu supports the system in every aspect. Our SolutionContract includes proactive and reactive maintenance and support services that cover all hardware and software components. The many service level options are very flexible so that diverse customer requirements can be satisfied. But that s not all: ETERNUS CD10000 also delivers long-term investment protection and simple lifecycle management because customers are not dependent on proprietary technologies. You can upgrade devices and storage nodes at any time, and thanks to the innovative scale-out concept behind ETERNUS CD10000, you don t have to worry about data migration. Advantages: Easy implementation Quality-assured ongoing further development High levels of flexibility for enhancements and technological innovations Comprehensive support for maintenance and support Low-cost operation 9

10 ETERNUS CD10000 Ideal solution for many applications Thanks to its innovative scale-out architecture, ETERNUS CD10000 is the ideal solution for all applications that demand effective management of massive online data in response to exploding data growth. Discover the benefits delivered by ETERNUS CD10000 in addressing your storage challenges. Area of application Requirement Benefits of ETERNUS CD10000 Cloud service providers Offering storage capacity with high flexibility, availability, performance and efficiency Zero downtime, high quality of service Maintenance and component replacement without interrupting operations Scalability on demand, without high up-front investments No migration costs, nearly unlimited expansion options Consistent high performance, even for large numbers of users Reduced costs Maximum capacity with a minimum footprint in the data center Enterprises with extensive research and development projects Immediate access to project data with documents, photos, graphics, videos, etc. Extreme capacity scalability High-performance data access No migration costs, nearly unlimited expansion options Maintenance and component replacement without interrupting operations Reduced costs Public administration, universities with vast online repositories Banks, insurance companies Media enterprises Immediate access to longterm archived data such as research findings or tax, registry and contract data Online high availability of customer and business data Fast and reliable availability of processed mass data Extreme capacity scalability Consistent high performance No migration costs, nearly unlimited expansion options Maintenance and component replacement without interrupting operations Reduced costs per gigabyte Always-on thanks to innovative scale-out architecture No (planned) downtime Low-cost realization of disaster recovery concepts Extremely scalable capacity and performance High I/O performance for video and audio streaming Excellent capacity scalability Low cost per gigabyte Constant data availability 10

11 Fujitsu ETERNUS Business-centric Storage FUJITSU Storage ETERNUS CD10000 combines innovative Ceph storage software, which is a cornerstone of the OpenStack Project, with high-performance hardware and software in a complete turnkey solution. This enables you to bolster your storage landscape so that it can cope with huge amounts of online data and dynamic data growth. At the same time, ETERNUS CD10000 provides you with extraordinary scalability, performance and reliability and low TCO (Total Cost of Ownership). Benefits of FUJITSU Storage ETERNUS CD10000 in brief: Minimum planning and implementation work: The system is configured in accordance with customer requirements and delivered as a turnkey solution Low investment: The system is based on open source and industrystandard technology Low-cost operation Easy migration projects: No data migration, virtually unlimited scalability, component replacement and technology refresh possible online Extreme scalability up to 50 petabytes High capacity with a small footprint in comparison to scale-up storage systems Consistent high performance, even for high loads and large numbers of users High performance, even with low-price high-capacity hard disks Always-on thanks to fault-tolerant design and easy-to-implement disaster recovery Easy, low-cost expansion options Simple, centralized management Complete lifecycle management When do you plan to realize a strategy for ensuring the future sustainability of your business? Be sure to contact us! storage-pm@ts.fujitsu.com Lower TCO per gigabyte than conventional high-capacity storage systems 11

12 Published by Fujitsu Limited Copyright: 2014 Fujitsu Limited Printed in Japan All rights reserved, including intellectual property rights. Technical data subject to modifications and delivery subject to availability. Any liability that the data and illustrations are complete, actual or correct is excluded. Designations may be trademarks and/or copyrights of the respective manufacturer, the use of which by third parties for their own purposes may infringe the rights of such owner.