FusionCube 2.0 Feature Description for Data Warehouse Infrastructure

Transcription

1 FusionCube 2.0 Feature for Data Warehouse Infrastructure Issue 01 Date HUAWEI TECHNOLOGIES CO., LTD.

2 Copyright Huawei Technologies Co., Ltd All rights reserved. No part of this document may be reproduced or transmitted in any form or by any means without prior written consent of Huawei Technologies Co., Ltd. Trademarks and Permissions and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd. All other trademarks and trade names mentioned in this document are the property of their respective holders. Notice The purchased products, services and features are stipulated by the contract made between Huawei and the customer. All or part of the products, services and features described in this document may not be within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and recommendations in this document are provided "AS IS" without warranties, guarantees or representations of any kind, either express or implied. The information in this document is subject to change without notice. Every effort has been made in the preparation of this document to ensure accuracy of the contents, but all statements, information, and recommendations in this document do not constitute a warranty of any kind, express or implied. Huawei Technologies Co., Ltd. Address: Website: Huawei Industrial Base Bantian, Longgang Shenzhen People's Republic of China i

3 Contents Contents WRFD Automatic Hardware Discovery and Capacity Expansion WRFD Integration of Computing and Storage WRFD High Performance WRFD High WRFD Unified Resource Management WRFD Thin Provisioning WRFD RBAC WRFD High-Speed InfiniBand Network WRFD High-Speed SSD... 9 ii

4 1.1 WRFD Automatic Hardware Discovery and Capacity Expansion The FusionCube automatically discovers all its attached hardware and scans the hardware specifications. You only need to select the discovered hardware when creating a resource pool. The FusionCube also automatically installs software for the selected hardware, configures the network, and adds the hardware to the resource pool. During capacity expansion, the FusionCube also automatically discovers newly added hardware and completes all configurations when you add the hardware to the resource pool. This feature simplifies system configuration and reduces manual configuration. Automatic hardware discovery: The FusionCube automatically discovers all initial hardware and specifications and identifies any newly added hardware. The FusionCube also automatically discovers and identifies servers and switch modules. Computing resource expansion: You can select a server from the discovered server list and add it to an existing or new cluster. The FusionCube also completes software installation, network configuration, and data configuration for the server. Storage expansion: The FusionCube automatically discovers information about all disks on the storage node. You can select disks from the disk list to create a storage pool. When a resource pool is added to a cluster, the FusionCube automatically configures services. 3

5 1.2 WRFD Integration of Computing and Storage This feature is introduced in FusionCube 2.0. The FusionCube provides shared storage by pooling the local disks on a server. This feature eliminates the need for an external shared storage device. Integration of Computing and Storage provides more I/O storage bandwidth and lower costs than shared storage. Automatic creation of a storage pool: FusionStorage automatically adds its server disks to the storage resource pool and expands storage nodes with the expansion of computing nodes. Data reliability: The storage system automatically stores data on two or more nodes thereby ensuring data reliability even if a node becomes faulty. 1.3 WRFD High Performance The FusionCube provides high performance using function-rich hardware and advanced technologies. 4

6 This feature improves user experience by providing high system performance. Hardware platform: Provides high-density computing nodes and intra-subrack high-speed switch modules. The outgoing bandwidth for a single subrack can reach 80 Gbit/s. Application optimization: Optimizes the performance of the database applications that have passed the compatibility test, ensuring high performance of application software on the FusionCube. High-speed data transmission: Exchanges data between computing nodes and between computing nodes and storage nodes. The FusionCube also exchanges data within the clusters of storage nodes over the 56 Gbit/s InfiniBand network and provides a10 GE network for the external service and management planes. Distributed storage: Improves system I/O throughput using built-in distributed storage. The I/O peak value reaches up to three times that of the IP SAN device on the same disk. High-performance solid-state drive (SSD) storage: Uses SSDs to provide high input/output operations per second (IOPS), 30 times higher than traditional mechanical hard disks. 1.4 WRFD High The High (HA) feature allows the system to provide high fault recovery capability using various mechanisms to ensure management node reliability, VM reliability, and storage reliability. This feature minimizes service interruption and improves user experience. 5

7 Computing reliability: Database applications are clustered; as a result, the fault of a single computing node does not interrupt services. Storage reliability: The built-in distributed storage system stores at least two copies of all data; as a result, data is always accessible regardless of any node fault. If data loss occurs on a server, the system automatically reconstructs the data using the backup, ensuring data reliability. In addition, FusionStorage provides protection against power failures. Network reliability: Both the external 10 GE network and internal InfiniBand network apply dual-plane redundancy and load balancing. 1.5 WRFD Unified Resource Management Unified Resource Management aggregates the resources of different systems and implements centralized resource management based on a unified resource management model. This feature simplifies O&M operations and increases management efficiency. Unified Resource Management collects all hardware objects, including servers and switches. The FusionCube thereby provides a unified topology view, alarm system, and resource tree, helping you identify and maintain all resources. On the web UI, you can combine computing, storage, and network resources based on service requirements. The system automatically establishes associations between resources. A wizard is provided to help complete operations such as creating the environment, configuring resources, and provisioning services. 6

8 1.6 WRFD Thin Provisioning Thin Provisioning provides greater virtual storage space than actual memory space. Thin Provisioning improves storage resource utilization and helps reduce initial investments in storage resources. The system allocates physical storage resources only when data is written onto a storage device. 1.7 WRFD RBAC Role-based Access Control (RBAC) applies to enterprise security management. RBAC assigns the rights to perform specified operations to specific roles. Once a role and a group of rights is defined for a user, the user can perform all authorized operations. The feature simplifies user management because roles change less frequently than rights. RBAC enables management over the rights of different users. 7

9 RBAC includes the following functions: User management and permission control: Includes centralized management over roles and users, password policy management, and user management in the third-party authentication system. Single sign-on: Users can visit all trusted application systems after a single login. 1.8 WRFD High-Speed InfiniBand Network This feature is introduced in FusionCube 2.0. The industry-leading InfiniBand network that is based on the cutting-edge remote direct memory access (RDMA) technology allows the FusionCube to provide the following functions: 56 Gbit/s data storage rates and service channels Communication delays within microseconds The InfiniBand network enhances database throughput, improves response time to requests, and improves user experience. The FusionCube for databases uses InfiniBand networking to communicate between storage and database nodes (computing nodes), implements dual-link redundancy, and ensures system reliability. The FusionCube delivers the following characteristics using a high-speed InfiniBand network: Provides a data rate of 56 Gbit/s and allows high-speed connection setup. Uses standard multilayer fat-tree networking and allows smooth capacity expansion. Provides a communication network where congestion hardly occurs and avoids data switching bottlenecks. 8

10 Provides minor communication delays within microseconds and transmits computing and storage information promptly. Provides lossless network QoS and ensures data integrity during transmission. Allows multi-path communication for active and standby ports and ensures communication path redundancy. 1.9 WRFD High-Speed SSD This feature is introduced in FusionCube 2.0. High-speed SSDs serve as the storage device in place of traditional SAS/SATA disks. If data processing takes several hours or reports need to be generated in real time, SSDs significantly shorten the wait time during decision-making analysis. The database applications with massive data analysis impose high requirements upon storage throughput. Huawei FusionCube supports a distributed SSD storage system for high-performance applications and provides higher I/O performance than traditional hard disks, such as SATA/SAS disks. The PCIe SSD on the FusionCube communicates directly with the CPU, thereby shortening the access path for data storage. By combining with the high-speed I/O performance of flash storage, the FusionCube can greatly improve storage performance and eliminate storage I/O bottlenecks. Huawei SSDs provide the following characteristics: High bandwidth: Uses PCIe 2.0 x 8 interfaces, providing 3 Gbit/s I/O bandwidth. High I/O: Supports 4 KB data blocks and 100% random I/O, and provides 600,000 continuous random read IOPS and 220,000 continuous write IOPS. The distributed SSD storage system takes the following measures to enhance system reliability: The built-in error checking and correcting (ECC) engine and the RAID5 engine checks and corrects data errors between data channels. The built-in data scrubbing engine periodically checks data that has been stored to 9

11 prevent data errors. A dynamic RAID algorithm is used to share resources among channels. This ensures that the system is functioning properly even if multiple chips fail. FusionStorage categorizes and manages frequently accessed and less frequently accessed data and uses an advanced SSD wear algorithm to maximize the space reclamation rate, minimize the write-wear rate, and extend the life of the SSD. This feature cooperates with Huawei FusionStorage to enhance optimal performance. 10