APACHE HADOOP PLATFORM HARDWARE INFRASTRUCTURE SOLUTIONS

Size: px

Start display at page:

Download "APACHE HADOOP PLATFORM HARDWARE INFRASTRUCTURE SOLUTIONS"

Patricia Hodge
7 years ago
Views:

1 APACHE HADOOP PLATFORM BIG DATA HARDWARE INFRASTRUCTURE SOLUTIONS 1

2 BIG DATA. BIG CHALLENGES. BIG OPPORTUNITY. How do you manage the VOLUME, VELOCITY & VARIABILITY of complex data streams in order to find VALUE? The nature of the data that enterprises capture, store and analyze is changing. Enterprises are challenged with managing the complexity and volume of their data. As technology and resources change, not all data fits neatly into rows and columns of a table. It comes from many sources in multiple formats. These large data streams are exceeding the capacity of conventional database systems. Enterprises are challenged with finding resources to tame the volume, velocity and variability of massive data in order to analyze and profit from this valuable resource. Enterprises must choose an alternative approach to current conventional methods in order to unlock the value of their Big Data. Implementing the right combination of IT hardware, software and analytical expertise is critical to effectively manage, manipulate and interpret Big Data. APACHE HADOOP an alternative approach to conventional database management. Apache Hadoop is a powerful open source data storage and processing platform designed for sophisticated analysis of both structured and unstructured complex data. This technology offers maximum flexibility, scalability and seamlessly integrates into an enterprise s operation, running on a cluster of commodity servers. With Apache Hadoop, enterprises can easily explore complex data using custom analyses tailored to their information, questions and needs. This technology can help reveal the value of Big Data. TURN-KEY SOLUTIONS designed to meet your needs for managing Big Data. Implementing the right combination of IT hardware, software and analytical expertise is critical to successfully manage Big Data. A-TRAC has partnered with Cloudera, the commercial leader for open-source Apache Hadoop to offer enterprises turn-key cluster platform solutions. Our turn-key solutions are built on Cloudera s Apache Hadoop platform and powered by Intel based servers. Each system is customizable and scalable to meet our clients needs and changing demands. A-TRAC s turn-key solutions provide enterprises with the hardware, software and professional services required to rapidly prove, deploy and scale a Hadoop based cluster platform. 2

As technology and resources change, not all data fits neatly into rows and columns of a table. It comes from many sources in multiple formats.

3 SAMPLE COMPONENTS USED TO MAKE CUSTOMIZED TURN-KEY SOLUTIONS. HIGH-PERFORMANCE ENTERPISE HADOOP INFRASTRUCTURE MODEL 815 Name Node 815 Data Node (4x 3.5" HDDs) 827 2U Twin Data Node (6x 3.5" HDDs per Node) Key Features -Optimized Hadoop Name Node - IPMI 2.0+ KVM with dedicated LAN for - Cost effective, high performance, power - Flexible UIO controller or I/O NIC cards - 4x3.5" hot swap drive bays - Redundant 700W Gold Level 93% -Optimized Hadoop Name Node - IPMI 2.0+ KVM with dedicated LAN for - Flexible UIO controller or I/O NIC cards - 4x3.5" hot swap drive bays - Redundant 700W Gold Level 93% -Optimized Hadoop Twin Data Node - IPMI KVM with dedicated LAN for - Two 6x HDD Nodes in 2U of rack space - 6x 3.5" hot swap drive bays per node - Redundant 920W Platinum Level 94% Processor Support Intel Xeon processor E Intel Xeon processor E Intel Xeon processor E family Chipset Intel C602 chipset ; QPI up to 8.0GT/s Intel C602 chipset ; QPI up to 8.0GT/s Intel C602 chipset; QPI up to 8.0GT/s System Memory (Max) Up to 256GB DDR3 1600MHz ECC Registered DIMM; 8x DIMM sockets Per Node (2 nodes per system) Expansion Slots 1 x PCI-E 3.0 (x32) left hand side riser card support 1 x PCI-E 3.0 (x32) left hand side riser card support 3x PCI-E 3.0 (x8) slots (1x low-profile and 2x full-height full-length) OnBoard & AOC HBA Controllers 2x SATA 3.0 ports (6Gbps) 8x SATA 2.0 ports (3Gbps) 2x SATA 3.0 ports (6Gbps) 8x SATA 2.0 ports (3Gbps) 6x SATA 3.0 ports (6Gbps) 1x SATA 2.0 ports (3Gbps) Networking/VG A/ Audio 1x Realtek RTL8211E PHY (dedicated I/O overhead 1x Realtek RTL8211E PHY (dedicated Manageability IPMI KVM with dedicated LAN IPMI KVM with dedicated LAN IPMI KVM with dedicated LAN Drive Bays 4x 3.5" SAS/SATA hot-swap HDD bays - 4x 300GB 15K HDD 4x 3.5" SAS/SATA hot-swap HDD bays - 4x 300GB 15K HDD 6x Hot-swap 3.5" SATA3 HDD Bays Power Supply Redundant (1+1) 700W Gold Level (93%) high- w/pmbus Redundant (1+1) 700W Gold Level (93%) high- w/pmbus 1280W Redundant High-efficiency Digital Power Supplies w/ PMBus Cooling System 4x 4cm heavy duty counter-rotating fans 4x 4cm heavy duty counter-rotating fans 4x 8cm heavy duty fans with PWM fan speed control Form Factor 1U rackmount chassis (25.6 depth) 17.2"W x 1.7"H x 25.6"D (437 x 43 x 650mm) 1U rackmount chassis (25.6 depth) 17.2"W x 1.7"H x 25.6"D (437 x 43 x 650mm) 2U rackmount chassis (28.5 depth) 17.2"W x 3.47"H x 28.5"D (438 x 88 x 724mm) 3

5" hot swap drive bays - Redundant 700W Gold Level 93% -Optimized Hadoop Name Node - IPMI 2.0+ KVM with dedicated LAN for - Flexible UIO controller or I/O NIC cards - 4x3.

4 SAMPLE COMPONENTS USED TO MAKE CUSTOMIZED TURN-KEY SOLUTIONS. HIGH-PERFORMANCE ENTERPISE HADOOP INFRASTRUCTURE SSE-G24-TG4 (24 1GbE Ports) XG0440DCR (40 1GbE Ports) xg2600 (26 10GbE Ports) MODEL 825 Data Node (8x 3.5" HDDS) 826 Data Node (12x 3.5" HDDs) 1GbE & 10GbE Ethernet Switches Key Features Processor Support -Optimized Hadoop Data Node - IPMI 2.0+ KVM with dedicated LAN for - Cost effective, high performance, power - Flexible UIO controller or I/O NIC cards - 8x3.5" hot swap drive bays - Redundant 740W Gold Level 93% -Optimized Hadoop Data Node - IPMI KVM with dedicated LAN for - Flexible UIO controller or I/O NIC cards - 12x 3.5" hot swap drive bays - Redundant 1200W Gold Level 93% Intel Xeon processor E Intel Xeon processor E Key Features: -Layer 2 / 3 Ethernet Switching - Link aggregation (LACP) - Jumbo frames - VLAN support Configuration Flexibility: SSE-G24-TG4-24 ports of RJ45 1Gbps Ethernet with 4 SFP Combo ports - 4 ports 10Gbps Ethernet (CX4, XFP, or SFP+) - Stacking Chipset Intel C602 chipset; QPI up to 8.0GT/s Intel C602 chipset; QPI up to 8.0GT/s XG0440DC - 40 ports of RJ45 1Gbps Ethernet with 4 SFP+ 10GbE ports4 ports System Memory (Max) Expansion Slots SATA / SAS Networking/VG A/ Audio 1 x PCI-E 3.0 x16 slot 6 x PCI-E 3.0 x8 slots Via Cable for SATA controller SATA 2.0 3Gbps with RAID 0, 1, 5, 10 SATA 3.0 6Gbps with RAID 0, 1, 5, 10 SAS2 from LSI 2208 HW RAID 0, 1, 5, 6, 10, 50, 60 support 2x PCI-E 3.0 x16 slots 4x PCI-E 3.0 x8 slots Via Cable for SATA controller SATA 2.0 3Gbps with RAID 0, 1, 5, 10 SATA 3.0 6Gbps with RAID 0, 1, 5, 10 SAS2 (6Gbps) via LSI 2308 SW RAID 0, 1, 10 support - Provides fan out capability for 1GbE server connectivity in compact 1RU high form factor - Data Center-grade switch with built-in dual hot swappable power supplies - Provides an easy upgrade path for environments transitioning to 10GbE GbE ports with 4 10GbE SFP+ ports - SFP Plus Form Factor XG ports 10Gbps Ethernet (SFP+) - Offers industry-leading low latency in 10GbE Switching (as low as 300ns latency) -Delivers up to 520Gbps -Available as 26-port SFP+ optical solution in compact 1RU high form factor -Flexible SFP+ interfaces (Copper Twinax, SR and LR) allow you to build the ideal network architecture for your requirements -Flexible airflow (front-to-rear and rear-tofront airflow) -Power consumption under 5 watts per port Manageability IPMI KVM with dedicated LAN IPMI KVM with dedicated LAN IPMI Server Management Drive Bays Power Supply 8x Hot-swap 3.5" HDD Bays; Support SAS2 HW RAID via LSI 2208 Redundant (1+1) 740W Gold Level (93%) high- w/pmbus 12x 3.5" SAS/SATA hot-swap HDD bays - 1/2TB HDD Redundant (1+1) 1200W Gold Level (93%) high- w/pmbus Cooling System 3x 8cm 7k RPM middle fans 3x 80mm 4-pin 6300 RPM PWM fans -HW fault alerts or SNMP - Redundant access for management - Support for open standards (SMASH 2.0, LDAP, WSMAN) - VLAN support - KVM and Virtual Media and SOL (no additional license needed) -Easy Maintenance (Command line flash tools for firmware update) Form Factor 2U rackmount chassis (25.5" depth) 17.2"W x 3.5"H x 25.5"D (437 x 89 x 648mm) 2U rackmount chassis (25.5 depth) 17.2 W x 3.5 H x 25.5 D (437 x 89 x 648mm) 4

5" HDDs) 1GbE & 10GbE Ethernet Switches Key Features Processor Support -Optimized Hadoop Data Node - IPMI 2.

5 ABOUT A-TRAC A-TRAC is a complete technology solutions provider. We provide leading IT products, comprehensive solutions, and innovative thinking to help solve the most challenging technology demands. Our expertise and keen understanding of industry-specific needs allow us to deliver the best IT solutions to our clients based on their unique requirements. A-TRAC is committed to our clients' success and we work with our clients as a trusted advisor. A-TRAC 332 Second Avenue Waltham, Massachusetts 02451

Up to 4 PCI-E SSDs Four or Two Hot-Pluggable Nodes in 2U

Twin Servers Up to 4 PCI-E SSDs Four or Two Hot-Pluggable Nodes in 2U New Generation TwinPro Systems SAS 3.0 (12Gbps) Up to 12 HDDs/Node FDR(56Gbps)/QDR InfiniBand 1TB DDR3 up to 1866 MHz in 16 DIMMs Redundant