Grid Computing and Sun

Grid Computing and Sun Grid Computing Presentation William Lo Technical Consultant

Agenda Customer challenges Grid Computing overview Sun and Grid Computing Grid success stories 2

Customer Challenges Time-to-market pressures Multiple concurrent projects with different schedules & milestones Growing datasets larger, more complex designs Insufficient in-house IT expertise Not enough throughput more and faster compute resources required Heightened budget/roi focus 3

Industry Pressures The need for more compute power: Life Sciences: Genetic sequencing, database queries Automotive: Crash tests, stress tests, Aerodynamics Electronic Design: Simulations, verifications, regression tests Digital Content Creation: Frame rendering Oil and Gas: Visualization, data analysis Software Development: Code builds Scientific Research: Large compute needs, collaboration 4

The Productivity Challenge Improving Resource Access Problem: Not using Scientists/Engineering efficiently Solution: A Grid makes it easy for the engineers to submit jobs. They run more tests product design cycle improves. Benefits: Increase productivity which leads to shorter time to market, higher quality and lower costs 5

Grid Computing A New Computing Utility Model Problem-solving through resource pooling in virtual systems: Virtualization of Transparent scalability of Access that is... Resources into a dynamic, single compute resource from federated assets CPU cycles, storage Dependable, consistent, pervasive, inexpensive 6

Stages of Sun Grid Computing Cluster Grid Departmental Computing Simplest Grid deployment Maximum utilization of departmental resources Resources allocated based on priorities Campus Grid Enterprise Computing Resources shared within the enterprise Policies ensure computing on demand Gives multiple groups seamless access to enterprise resources Global Grid Internet Computing Resources shared over the Internet Global view of distributed datasets Growth path for enterprise Campus Grids 7

Grid Computing Model Cluster Grids Usage Simplest Grid deployment Single team: Project Department Single site firewall Benefit Optimal alignment of resources, tasks, and budgets Industry Examples Automotive More simulations for safer cars Entertainment Faster image-frame rendering Life Sciences Pattern matching against huge datasets EDA Increased design iterations create more powerful devices 8

Grid Computing Model Campus Grids Usage Multiple teams in organization share one or more Cluster Grids Single site to enterprisewide Benefit Maximum ROI and utility Industry Examples Manufacturing Collaborative engineering projects Oil and Gas Mining-distributed databases Finance More Monte Carlo simulations for uncovering new business 9

Grid Computing Model Global Grids Usage Linked Cluster and Campus Grid Models across many organizations Typically used for research Benefit N1 Creates large virtual system Facilitates collaboration between organizations Industry Examples Medicine Provides expert teams access to medical instruments and distributed computing resources Academia Facilitates collaboration between geographically dispersed groups Research Enables compute-intensive projects beyond the firewall 10

Grid Computing Adoption Trends Cluster Grids Single team Single organization Campus Grids Multiple teams Single organization Global Grids Multiple teams Multiple organizations 11

How it Works Grid Hardware and Software Components Resource management services above OS layer to integrate systems Hardware/OS systems are unchanged Minimal management software/tool costs Connecting people, departments,organizations, communities 12

Key Software Technologies for the Grid Cluster Grid: Sun Grid Engine Campus Grid: Sun Grid Engine, Enterprise Edition Global Grid: Globus, Avaki = Sun Grid Computing software 13

Cluster Grid Solution Sun Grid Engine Maximize resources for single projects, teams, departments Prioritize jobs Manage jobs from start to finish Free download for Solaris and Linux Operating Environments 14

Sun Grid Engine 5.3 Essential Feature and Benefits Feature Ongoing, resource balancing Benefits Easy access to computer resources High utilization (almost 100%) Increases project throughput 15

Sun Grid Engine Free Downloads First Year Fast becoming the most-used Distributed Resource Manager (DRM) tool 3016 unique sites 118,000 CPUs worldwide run Sun Grid Engine 1 new CPU every 5 minutes Over 90 countries 60% never used Grid software before 92% rated Sun Grid Engine as Good, Very Good, or Excellent 16

When to Select Sun Grid Engine 5.3 A small company with one product A single project within a larger organization One team with its own financing for a specific project 17

Campus Grid Solution: Sun Grid Engine, Enterprise Edition Consolidates departmental (Cluster) Grids across the enterprise Owners negotiate accumulated usage assignments over time (weeks, months, quarters) Policies enforced automatically Exceptions for specific needs/ events provide flexibility 18

Sun Grid Engine, Enterprise Edition 5.3 Essential Feature and Benefits Feature (additional to Sun Grid Engine 5.3) Policies module based on accumulated usage over time Benefits (additional to Sun Grid Engine 5.3) Align business needs to compute resources usage Sharing between projects Fosters collaboration 19

Options to Set Up a Grid Full solution Outsource required services to build and maintain a Grid Grid enabling services Outsource creation of a Grid with goal of becoming self-sufficient Reference implementation Give me the tools and I will do it myself 20

Customer Stories Synopsys University of Durham More Customer Stories of Grid Computing at Sun: http://www.sun.com/grid 21

Synopsys Company Overview Leader in complex integrated circuit design software and expert professional services Challenges Needed to reduce the time & expense of regression testing Lack of compute usage data made it difficult to plan for future growth and spending Solution Sun Grid Engine Cluster Grid 22

Results We ve dramatically increased the speed and depth of testing, received quicker results and significantly increased the utilization of our computing resources. Director of Engineering, Synopsys 23

University of Durham UK Company Overview The Virgo Consortium a global collaboration of cosmology researchers Challenges How to run simulations of huge datasets Solution Create a total throughput machine Solaris 8, Veritas, Sun Grid Engine, HPC ClusterTools, Forte tools Sun Fire 6800 servers/sun Blade 1000 workstations 24

Results: The Cosmology Machine University of Durham UK I m very happy with the decisions we made. Cosmology is one of the highest profile, most exciting and competitive fields of science. Four hundred fifty-six billion arithmetic operations per second sounds like a lot, but our performance demands are growing roughly in accordance with Moore s Law. That means Sun s scalability is crucial to us in maintaining our lead. The unique functionality that Sun architected will help us completely change the profile of cosmological research. Sun is a great company to be working with. Professor Carlos Frenk 25

Grid Information From Sun On the Web Grid Computing at Sun: sun.com/grid Success stories Web-based training and testing Grid Certification course information Grid Engine Open Source Project Partner information 26

Grid Computing Product and Support Partners Americas Asia Pacific Europe/Middle East Amdahl IT Services Applied Computer Solutions Avaki Avcom Technologies Blackstone Computing Cantiga CGI, Inc. Eakins Open Systems Grid Queuing Noemix Raytheon Areo Communications Canon CTC ECS Singapore Exson Technology Greenbell Systems Hitachi Ingram Micro Asia Itt Frontier Pericomp Systech Toshiba Trigem Computer Yugi Systems Access Computing Limited Amdahl IT Services Avaki Blackstone Computing Cantiga Cards Engineering GmbH & CO. Clarity Technology Distributor Systems International Limited EsEda Limited Esteem Systems Plc GNS Semcon Trollhattan UdiTiS SA 27

Services to Set Up a Grid Professional Services Consulting/integration of full solution Configuration support Ongoing tuning of compute environment Enterprise Services Product support, SGE and SGEEE 28

Getting Started Find a suitable pilot project Download Sun Grid Engine Take the Web-based training course Install on designated workstations and servers Learn how to configure for your environment, applications, and workload Roll out on a wider scale 29

Conclusion Sun Grid Computing delivers competitive advantage Sun has the products, services and partners to help you succeed. 30

William Lo william.lo@sun.com

Back-Up Slides 32

Computational Demand Pushing the Envelope The Net Effect: More bandwidth More systems/devices More powerful computing technologies To Meet: Time-to-market pressure Growing datasets Heightened budget/roi focus 33

Key Software Technologies for the Grid Grid Infrastructure Foundation software provides users access to the full power of connective resources Systems Management Application and systems management for IT professionals Application Development Tools Build and deploy performance-tuned Grid-ready applications Services-on-demand for Grids Powerful tools for intranet and extranet access and collaboration Security for Grids Solutions for demanding enterprise and government requirements Distributed Resource Management for Cluster Grids Distributed Resource Management for Campus Grids Distributed Resource Management for Global Grids Sun Management Center Solaris Management Console Sun HighGround Storage Resource Manager Solaris Web Start Flash Solaris Live Upgrade Solaris Resource Manager Forte Developer HPC ClusterTools / Prism Sun Management Center Developer Environment Sun ONE Portal Server/Technical Compute Portal Sun ONE Directory Server Sun ONE Messaging Server Solaris Firewall Sun Enterprise Authentication Mechanism Trusted Solaris iplanet Certificate Management System 34

Cognigen Company Overview Uses NONMEM to model drug variability within a patient and across a population Challenges Manual processes not scaling at the company grows Time wasted looking for resources Not enough throughput Solution Sun Grid Engine and a 23-node Sun Netra X1 Farm Cluster Grid 35

Results Dropped it (Sun Grid Engine) in the Grid and got it working the way I wanted within 6 8 hours. Darrin Perusich, Cognigen Each one of our scientists has one extra hour every day to work on other things. Duncan Ross, Director of IT We experienced a ten-to-one reduction in hardware costs and almost doubled the CPU power. Duncan Ross, Director of IT We can process twelve times the amount of NONMEM jobs, allowing us to do more complex and thorough analyses. Duncan Ross, Director of IT 36

Caprion Pharmaceuticals Company Overview Applies proteomics to accelerate diagnosis and treatment Internal drug discovery programs Challenges Protein analysis demands required a new approach Difficulty predicting the exact problems that will arise over time Insufficient in-house IT expertise to architect the right solution Solution Sun Cluster Grid: Sun Blade 100 workstations, Sun Fire 6800, 4800, 3800, and 280R servers, Sun Ray, Sun StorEdge 37

Results We re experts in biology, not computers. Paul Kearny, Director of Bioinformatics We were extremely fortunate that the company with the highest performance technology today is the same company that has the ability, willingness, and scalability to help us feel comfortable about tomorrow Sun Microsystems. Paul Kearny, Director of Bioinformatics 38

Customer Stories Cognigen Synopsys University of Durham Caprion Pharmaceuticals 39