CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John Fragalla Senior HPC Technical Specialist Global Systems Practice Sun Microsystems, Inc.
25 Years of Technical Computing Sun continues to transform the computing landscape Sun Technical Workstation 1982 Single HPC Thread Giving HPC to the individual user Sun Enterprise 10000 1997 64 HPC Threads Largest Single System Image for HPC Sun Constellation System 2007 62,976 HPC Threads Most Open Petascale Architecture 2
Continuing To Push The Limit Game Changing Portfolio Sun Constellation System Ultra-dense Blade Platform Ultra-dense Switching Solution Ultra-dense Storage Solution Software Previewing TODAY Eco-Efficient building blocks Developer Environment and Management Tools SunSMCustomer Ready Architected Systems HPC Cluster, including Sun Blade Scalable Unit Visualization System Scalable Storage Cluster Very large deployments Tokyo Tech TACC (under construction) Delivering Seamless Scalability 1TF 1.7PF Most Open Highest Performing Most Serviceable Fastest Deployment Most Robust Most Reliable Most Available 3
Introducing The Sun Constellation System An open systems super computer designed for petascale packaged as an integrated product Massive Scalability: Optimized compute, storage, networking and software technologies and services Dramatically Reduced Complexity: Integrated connectivity and management to reduce start-up, development and operational complexity Breakthrough Economics: Technical innovation resulting in fewer components and high efficiency systems in a tightly integrated solution 4
Sun Constellation System Open Petascale Architecture Delivering the Most Scalable Super Computer The Most Scalable Computing Cluster 700ns latency (DDR); Up to 1.7 PetaFLOPs; Up to 10 PB 20% Smaller Footprint than Competition Open Industry Standards Solaris, Linux, OpenMPI, Open InfiniBand interfaces and management X64 Computing Architecture InfiniBand DDR interconnect The Highest Density Compute Cluster Core switch supports 3456 nodes Custom rack supports 48 server modules Sun Fire X4500 storage cluster with 480TB per rack The Easiest to Deploy and Manage Provides a 6:1 reduction in physical ports and cables Eliminates 100s of discrete switching elements 5
Flexible Configurations Scale to Meet Computing Needs 1 Core Switch Servers: 3,456 PFLOPS: 0.4 3 Core Switches Servers: 10,368 PFLOPS: 1.3 2 Core Switches Servers: 6,912 PFLOPS: 0.9 4 Core Switches Servers: 13,824 PFLOPS: 1.7 6
Sun Constellation System Open Petascale Architecture Radical Simplicity: Building out a 3456 Node HPC Super Computer Sun Constellation ks c Ra System Cluster Competitors Compute cks a R Clusters S af Le s he re hes Co witc S tc wi Competitors Cabling Infrastructure C lin ab Alternative Open Standards Fabric 300 Switching Elements 6912 Cables 92 Racks g Reduced Cabling Ca in bl g Constellation System Open Super Computer 1 Switching Element 300:1 Reduction 1152 Cables 6:1 Reduction 74 Racks 20% Smaller footprint 7
Sun Constellation System Open Petascale Architecture Eco-Efficient Building Blocks Compute Networking Storage Software Developer Tools Grid Engine Provisioning Linux Ultra-dense Blade Platform Ultra-dense Switch Solution Ultra-dense Storage Solution Fastest Processors: SPARC, AMD Opteron, Intel Xeon Highest Compute Density Fastest Host Channel Adaptor 3456 port InfiniBand Switch Unrivaled cable simplification Most economical InfiniBand cost/port Most economical and scalable parallel file system building block Up to 48 TB in 4RU Direct Cabling to IB Switch Comprehensive Software Stack Integrated Developer Tools Integrated Grid Engine Infrastructure Provisioning, Monitoring, Patching Simplified Inventory Management 8
Ultra-Dense Blade Platform Delivering the Most Efficient and Eco-Friendly Node Architecture The first blade platform designed for extreme density and performance 6+ TFLOPS, 768 cores per chassis / 42U Unibody design accommodates more server modules than conventional rack/chassis combo while reducing 500 lbs in weight 4 InfiniBand Leaf Switch Network Express Modules Lowest cost per port with Ultra-Dense Switch Solution Pay as you grow platform ideal for fast growing businesses Choose among SPARC, AMD Opteron and Intel Xeon CPU technologies Runs General Purpose Software Custom compiles and tuning are not required Realize economies of scale savings in power and cooling 9
Ultra-Dense Switch Solution Delivering the Most Integrated and Open Switching Architecture Switch Performance 3456 ports SDR or DDR Bisection Bandwidth of 110 Tbps 5 Stage internal full Clos network 700ns latency (DDR) Line and Fabric Cards 24 Line Cards with 144 4X ports each Physically realized with 48 12X connectors per line card 18 Fabric Cards with no connectors Dual-Wide Rack Chassis Redundant Power and Cooling Host based Solaris 10 Subnet Manager 10
Sun Fire X4500 Ultra-Dense Storage Solution The Fastest, Densest and Most Scalable Storage Architecture The Fastest Lustre Object Storage Server 2 AMD Opteron CPUs and 16+ GB Memory 2 PCI Express 4x slots, driving 1GB/s IO Runs Solaris ZFS with Raid Z and Raid Z2 The Densest Lustre Object Storage Server Up to 48*TB of Storage in 4RU storage server 1PB in 2 racks Realize huge economies of scale savings in power and cooling Integrated system to reduce power and cooling Simplify the storage fabric with the server network into a single massive InfiniBand switch 1 Ultra-Dense Switch for both Ultra-Dense Blade Platform and Ultra-Dense Storage Solution * With 1TB disk drives 11
Sun Constellation System Storage Solutions Compute Engine Data Cache Super Computer IB Network Tier 2 Fixed Content Archive Load Archive SAN Data Movers Scalable Storage Cluster Long-Term Retention & Archive Tier 2 Near-Line Archive Automated Migration Tier 1 Archive & Home Directories 12
Why OpenSolaris? Minimize idea-to-production time Latest OS features and tools Blazing Performance, e.g. memory placement optimization, large page sizes, OpenMPI via Sun HPC ClusterTools Robustness via Predictive Self-Healing Dtrace to help identify and eliminate performance bottlenecks Performance libraries tuned for AMD, Intel, and SPARC ZFS file system Studio 12 compilers with new thread analyzer Open community built OS 50+ user groups, 60,000+ members, 100+ OpenSolaris projects 13
Sun Constellation System HPC Open Software Stack Sun CRS, Support, Architectural, Professional Services Open Petascale Computing from Sun Sun Studio 12 Developer Tools Sun HPC ClusterTools Management Workload Management Cluster Management Sun Grid Engine Software Sun Connection, ROCKS, Ganglia Sun Constellation System Ultra-Dense Switch Solution Open, Free Open Storage Server Open, Free ZFS, S-QFS Lustre, p-nfs Operating System Sun Constellation System Ultra-Dense Blade Platform Free 64 Bit IB Switch NEM for Blades 3456 Port Non-Blocking Switch Open Open 14
Factory Integrated Systems Arrive Ready to Run Your choice of Sun and 3rd party HW & SW Hardware racked and cabled Software installed and configured SunSM Customer Ready Program Deliver Ready-to-Deploy Systems Agile deployment Higher quality, lower risk Up to 90% faster Up to 80% less installation issues Tools to tailor to specific needs Integration and testing in the factory You concentrate on your core business Uses Sun's ISO9000 certified mfg processes 15
Sun Constellation System in HPC World s Largest Super Computer under construction based on Sun Constellation System Technology 16
TACC: The First Sun Constellation System Implementation Sun Partners with the HPC Community to Deliver Super Computer The World's Largest Super Computer Under Construction 500 TeraFLOPS 82 Sun Ultra-Dense Blade Platforms 2 Sun Ultra-Dense Switches 72 Sun X4500 ( Thumper ) Servers TACC selected for first NSF Track2 HPC system Sun is the sole HW supplier Opteron based Expandable configuration Solaris Fabric Management 17
HPC From Sun: Open Innovation Scalable Game Changing 18
Summary Sun Open Petascale Architecture Rich Portfolio in HPC Game Changing Products www.sun.com/hpc 19
CAS2K7 13 September, 2007 Sun Constellation System: The Open Petascale Computing Architecture John.Fragalla@Sun.COM Thank You