The Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland
|
|
- Harry McCormick
- 8 years ago
- Views:
Transcription
1 The Lattice Project: A Multi-Model Grid Computing System Center for Bioinformatics and Computational Biology University of Maryland
2 Parallel Computing PARALLEL COMPUTING a form of computation in which many calculations are carried out simultaneously Parallelism is the dominant paradigm in computer architecture Bit-level parallelism Instruction-level parallelism Data parallelism Task parallelism
3 Parallel Computing Universe Multi-core GPU SMP Cluster MPP Grid Computing
4 Parallel Computing Universe Shared Memory Multi-core GPU SMP
5 Parallel Computing Universe Multi-core GPU SMP Cluster MPP Grid Computing
6 Parallel Computing Universe Distributed Memory Cluster MPP Grid Computing
7 Parallel Computing Universe Distributed Computing Cluster MPP Grid Computing
8 Parallel Computing Universe Multi-core GPU SMP Cluster MPP Grid Computing
9 Parallel Computing Universe GPU SMP Cluster MPP Multi-core Grid Computing
10 Grid Computing BOINC Pool Compute Cluster Condor Pool The Lattice Project
11 Condor Developed at the University of Wisconsin for over 20 years A middleware toolkit for distributed computing by means of cycle scavenging Jobs run when the computers are idle (e.g., no mouse or keyboard input) Typically runs on institutional desktop computers (which often includes computer labs, in the University setting) Freely available and runs on all common platforms Relatively easy to install, configure, and maintain
12 Grid Computing BOINC Pool Compute Cluster Condor Pool The Lattice Project
13 Compute Cluster Dedicated computing resource Often has a fast network interconnect (e.g., InfiniBand), and is thus well-suited for problems that require inter-process communication (IPC) May run queuing software to enable use of the resource (e.g., PBS, SGE, LSF) Vary greatly in size and capability Beowulf Cluster Supercomputer
14 Grid Computing BOINC Pool Compute Cluster Condor Pool The Lattice Project
15 BOINC BOINC - Berkeley Open Infrastructure for Network Computing A platform for volunteer computing (otherwise known as public computing) Generalization of the original SETI@home software A BOINC client pulls down work from a project server, crunches it, and returns the results Credit is allocated based on the amount of work completed BOINC is a potentially huge and valuable free resource
16 Grid Computing BOINC Pool Compute Cluster Condor Pool The Lattice Project
17 Distributed Computing Paradigms DISTRIBUTED COMPUTING the use of many computers, connected by a network, to solve computational problems HIGH PERFORMANCE COMPUTING (HPC) well suited for tightly-coupled problems, which require communication between processes on separate nodes HIGH THROUGHPUT COMPUTING (HTC) well suited for embarrassingly parallel problems, which are easily broken up into parts that can be run independently
18 High Performance Computing In HPC, problem instances run on separate nodes that pass messages between one another (e.g., MPI programming model) Commonly, scientific computing applications fit this model (e.g., climate modeling, N-body simulations, anything where space in a complex and dynamic system is partitioned by a grid) Message passing is necessary when, e.g., updating a value at the boundary of a grid cell depends on the values of neighbor cells that reside on other processors Traditional clusters and supercomputers with a fast network interconnect were designed for these type of problems
19 High Throughput Computing In HTC, problem instances are independent from one another Includes parameter sweeps, stochastic algorithms, and combinatorial optimization problems An example: phylogenetic tree reconstruction under a likelihood model Can take advantage of loosely federated, heterogeneous computational resources without fast interconnects, which include pools of computers managed by Condor and BOINC
20 Grid Computing BOINC Pool Compute Cluster Condor Pool The Lattice Project
21 Characterizing Computing Resources HTC resources Condor Pool BOINC Pool HPC resources Compute Cluster
22 Characterizing Computing Resources Shared Condor Pool BOINC Pool Dedicated Compute Cluster
23 Characterizing Computing Resources Institutional Condor Pool Compute Cluster Volunteer BOINC Pool
24 Grid Computing BOINC Pool Compute Cluster Condor Pool The Lattice Project
25 Grid Computing GRID COMPUTING a form of distributed computing that makes use of geographically and administratively disparate resources The Grid integrates multiple computing resources (e.g., Condor pools and clusters) that may reside in different institutional domains The user of Grid computing: Immediately gains access to a large number of computing resources, thus enabling them to perform analyses on a new, much larger scale Does not interface directly with any computational resource, and thus does not have to install any software or worry about where their job is running
26 Models of Grid Computing SERVICE MODEL a heavyweight, feature-rich model focused on providing access to institutional resources and robust job submission capabilities and security features Well known Service Grids include TeraGrid, Open Science Grid, and EGEE DESKTOP MODEL scavenges cycles from idle desktop computers, which are volunteered by the general public The combined power of hundreds of thousands of desktop computers represents a substantial, readily available resource The most widely used software for tapping this resource is BOINC
27 The Lattice Project The first Grid system to effectively combine a Service Grid (using Globus software) and a Desktop Grid (using BOINC software) Aimed at sharing computational resources between academic institutions, particularly those in the University System of Maryland Focused on enabling large-scale computation, especially for problems in the life sciences Development began in 2003 since then, many different researchers have used the system, racking up over 18,000 CPU years of computation (measured in wall clock time)
28 Grid Middleware Globus Toolkit (GT) software forms the backbone of the Grid system Provides basic mechanisms for job submission, file transfer, and authentication BOINC software adds a unique dimension to our Grid system, allowing us to use resources volunteered by the general public Queuing software such as Condor and PBS controls other Grid resources Our own code ties all of this together: makes available Grid-enabled applications through a user interface, handles file transfers, record keeping, data management, job scheduling, and more
29 Globus Current state of the art in Grid middleware The Lattice Project uses the following GT4 services: GSI (Grid Security Infrastructure) MDS (Monitoring and Discovery System) GRAM (Grid Resource Allocation and Management) GridFTP (Grid File Transfer Protocol) RFT (Reliable File Transfer) RLS (Replica Location Service) Globus operates on a push model: work is sent from a submitting node to a computational resource
30 BOINC BOINC was created to manage large, well-defined projects it does not provide many of the normal features of a queuing system However, BOINC does perform fairly sophisticated scheduling, accounting for a dynamic and heterogeneous host population In contrast to Globus, BOINC clients pull work from a server Clients are not trusted, so BOINC provides support for redundant computing and result validation BOINC provides features that make it easy for volunteers to participate, such as an easily installable client program, and interactive project web sites
31 The Lattice BOINC Project
32 Benefits of Combining Globus and BOINC Globus Service Grid users gain access to a much larger pool of potential resources than was previously possible BOINC Desktop Grid users gain a more fully-featured system (e.g., multiple users, multiple applications, authentication, authorization)
33 Grid Architecture
34 Grid Client Interface to the Grid where researchers are able to submit and monitor jobs - currently, our primary interface is command line based Researchers log in to a workstation, upload their input data, and submit jobs using command line tools Since most of the applications we Grid-enable were command line tools to begin with, we have tried to make using the Grid application feel similar to using the original application We have also implemented facilities for supporting batch submissions, since most Grid users have a lot of work to submit HOMOGENEOUS JOB BATCH vs. HETEROGENEOUS JOB BATCH
35 Command Line Interface
36 Command Line Interface
37 Command Line Interface
38 Web Monitoring Tools
39 Web Monitoring Tools
40 Grid, Public, and GPU Computing for Assembling the Tree of Life A multi-year NSF award to build an advanced computational system for phylogenetic analysis Leverages the existing Grid system Provides for improving the performance of popular phylogenetic analysis programs using GPGPU frameworks such as OpenCL and CUDA The BOINC pool is our greatest potential source of contemporary GPUs Provides for the construction of a web portal interface to facilitate easy and efficient job submission, monitoring, and post-processing
41 Web Portal
42 Grid Resources Quick facts about resources: We support three major platforms: Linux (both PowerPC and Intel-based), Windows, and Mac OS (both PowerPC and Intel-based) Three different institutions are currently tied in to the Grid: UMCP, Bowie State University, and Coppin State University Within UMCP, several groups have contributed resources: UMIACS, OIT, CLFS, PSLA, and ECE/ISR We currently have four Condor pools, three dedicated clusters, and a BOINC project with a steadily growing number of participants We currently have a total of CPUs
43 Grid Resources
44 Grid Resources
45 Grid Resources Why contribute resources to The Lattice Project? If a group contributes computing resources to the Grid, they are eligible to use all Grid resources A group would like to increase the utilization rate of a resource Compute resources in a Grid may be used more efficiently
46 Grid Services GRID SERVICE: a scientific application that has been Grid-enabled These applications are made available to run on Grid resources To date, we have created 25 Grid services, mostly life sciences applications Services are typically created on-demand We have developed software to create Grid services quickly and easily GSBL (Grid Services Base Library) and GSG (Grid Services Generator)
47 Grid Services
48 Research Projects Phylogenetic analysis GARLI Protein sequence comparison HMMPfam Conservation network design MARXAN
49 Conclusion The Lattice Project successfully integrates a feature-rich, Globus-based Service Grid with a BOINC-based Desktop Grid Provides an interface for job submission and monitoring Provides a meta-scheduler and a sophisticated data management scheme Provides a number of applications as Grid services, and tools for streamlining the process of Grid service creation Has been used to complete research for several years already
50 More Information The Lattice Project web site: The Lattice BOINC Project web site:
ABSTRACT GRID COMPUTING SYSTEM. Adam Bazinet, Master of Science, 2009
ABSTRACT Title of Document: THE LATTICE PROJECT: A MULTI-MODEL GRID COMPUTING SYSTEM Adam Bazinet, Master of Science, 2009 Directed By: Professor Michael Cummings Center for Bioinformatics and Computational
More informationGrid Scheduling Architectures with Globus GridWay and Sun Grid Engine
Grid Scheduling Architectures with and Sun Grid Engine Sun Grid Engine Workshop 2007 Regensburg, Germany September 11, 2007 Ignacio Martin Llorente Javier Fontán Muiños Distributed Systems Architecture
More informationCluster, Grid, Cloud Concepts
Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of
More informationScheduling and Resource Management in Computational Mini-Grids
Scheduling and Resource Management in Computational Mini-Grids July 1, 2002 Project Description The concept of grid computing is becoming a more and more important one in the high performance computing
More informationGrid Scheduling Dictionary of Terms and Keywords
Grid Scheduling Dictionary Working Group M. Roehrig, Sandia National Laboratories W. Ziegler, Fraunhofer-Institute for Algorithms and Scientific Computing Document: Category: Informational June 2002 Status
More informationGridWay: Open Source Meta-scheduling Technology for Grid Computing
: Open Source Meta-scheduling Technology for Grid Computing Ruben S. Montero dsa-research.org Open Source Grid & Cluster Oakland CA, May 2008 Contents Introduction What is? Architecture & Components Scheduling
More informationfor my computation? Stefano Cozzini Which infrastructure Which infrastructure Democrito and SISSA/eLAB - Trieste
Which infrastructure Which infrastructure for my computation? Stefano Cozzini Democrito and SISSA/eLAB - Trieste Agenda Introduction:! E-infrastructure and computing infrastructures! What is available
More informationPARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN
1 PARALLEL & CLUSTER COMPUTING CS 6260 PROFESSOR: ELISE DE DONCKER BY: LINA HUSSEIN Introduction What is cluster computing? Classification of Cluster Computing Technologies: Beowulf cluster Construction
More informationAn approach to grid scheduling by using Condor-G Matchmaking mechanism
An approach to grid scheduling by using Condor-G Matchmaking mechanism E. Imamagic, B. Radic, D. Dobrenic University Computing Centre, University of Zagreb, Croatia {emir.imamagic, branimir.radic, dobrisa.dobrenic}@srce.hr
More informationGrid Computing: A Ten Years Look Back. María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es
Grid Computing: A Ten Years Look Back María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es Outline Challenges not yet solved in computing The parents of grid Computing
More informationGrid Computing With FreeBSD
Grid Computing With FreeBSD USENIX ATC '04: UseBSD SIG Boston, MA, June 29 th 2004 Brooks Davis, Craig Lee The Aerospace Corporation El Segundo, CA {brooks,lee}aero.org http://people.freebsd.org/~brooks/papers/usebsd2004/
More informationHigh Performance Computing. Course Notes 2007-2008. HPC Fundamentals
High Performance Computing Course Notes 2007-2008 2008 HPC Fundamentals Introduction What is High Performance Computing (HPC)? Difficult to define - it s a moving target. Later 1980s, a supercomputer performs
More informationPrinciples and characteristics of distributed systems and environments
Principles and characteristics of distributed systems and environments Definition of a distributed system Distributed system is a collection of independent computers that appears to its users as a single
More informationHPC and Grid Concepts
HPC and Grid Concepts Divya MG (divyam@cdac.in) CDAC Knowledge Park, Bangalore 16 th Feb 2012 GBC@PRL Ahmedabad 1 Presentation Overview What is HPC Need for HPC HPC Tools Grid Concepts GARUDA Overview
More information159.735. Final Report. Cluster Scheduling. Submitted by: Priti Lohani 04244354
159.735 Final Report Cluster Scheduling Submitted by: Priti Lohani 04244354 1 Table of contents: 159.735... 1 Final Report... 1 Cluster Scheduling... 1 Table of contents:... 2 1. Introduction:... 3 1.1
More informationConcepts and Architecture of the Grid. Summary of Grid 2, Chapter 4
Concepts and Architecture of the Grid Summary of Grid 2, Chapter 4 Concepts of Grid Mantra: Coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations Allows
More informationA High Performance Computing Scheduling and Resource Management Primer
LLNL-TR-652476 A High Performance Computing Scheduling and Resource Management Primer D. H. Ahn, J. E. Garlick, M. A. Grondona, D. A. Lipari, R. R. Springmeyer March 31, 2014 Disclaimer This document was
More informationIBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand
PartnerWorld Developers IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand 2 Introducing the IBM Solutions Grid
More informationSystem Models for Distributed and Cloud Computing
System Models for Distributed and Cloud Computing Dr. Sanjay P. Ahuja, Ph.D. 2010-14 FIS Distinguished Professor of Computer Science School of Computing, UNF Classification of Distributed Computing Systems
More informationCluster Implementation and Management; Scheduling
Cluster Implementation and Management; Scheduling CPS343 Parallel and High Performance Computing Spring 2013 CPS343 (Parallel and HPC) Cluster Implementation and Management; Scheduling Spring 2013 1 /
More informationwww.xenon.com.au STORAGE HIGH SPEED INTERCONNECTS HIGH PERFORMANCE COMPUTING VISUALISATION GPU COMPUTING
www.xenon.com.au STORAGE HIGH SPEED INTERCONNECTS HIGH PERFORMANCE COMPUTING GPU COMPUTING VISUALISATION XENON Accelerating Exploration Mineral, oil and gas exploration is an expensive and challenging
More informationIII Level Course, 2011 Free Software. Dott. Bertoldo Silvano Ing. Terzo Olivier
III Level Course, 2011 Free Software Dott. Bertoldo Silvano Ing. Terzo Olivier 1 1. Introduction to Grid and Cloud Computing 2. Open Source Software in Grid and Cloud Computing 2.1 Hypervisor 2.2 Cloud
More informationWorking with HPC and HTC Apps. Abhinav Thota Research Technologies Indiana University
Working with HPC and HTC Apps Abhinav Thota Research Technologies Indiana University Outline What are HPC apps? Working with typical HPC apps Compilers - Optimizations and libraries Installation Modules
More informationOverview of HPC Resources at Vanderbilt
Overview of HPC Resources at Vanderbilt Will French Senior Application Developer and Research Computing Liaison Advanced Computing Center for Research and Education June 10, 2015 2 Computing Resources
More informationThe XSEDE Global Federated File System (GFFS) - Breaking Down Barriers to Secure Resource Sharing
December 19, 2013 The XSEDE Global Federated File System (GFFS) - Breaking Down Barriers to Secure Resource Sharing Andrew Grimshaw, University of Virginia Co-architect XSEDE The complexity of software
More informationRoberto Barbera. Centralized bookkeeping and monitoring in ALICE
Centralized bookkeeping and monitoring in ALICE CHEP INFN 2000, GRID 10.02.2000 WP6, 24.07.2001 Roberto 1 Barbera ALICE and the GRID Phase I: AliRoot production The GRID Powered by ROOT 2 How did we get
More informationBasic Scheduling in Grid environment &Grid Scheduling Ontology
Basic Scheduling in Grid environment &Grid Scheduling Ontology By: Shreyansh Vakil CSE714 Fall 2006 - Dr. Russ Miller. Department of Computer Science and Engineering, SUNY Buffalo What is Grid Computing??
More informationGPU System Architecture. Alan Gray EPCC The University of Edinburgh
GPU System Architecture EPCC The University of Edinburgh Outline Why do we want/need accelerators such as GPUs? GPU-CPU comparison Architectural reasons for GPU performance advantages GPU accelerated systems
More informationCloud Computing. Lecture 5 Grid Case Studies 2014-2015
Cloud Computing Lecture 5 Grid Case Studies 2014-2015 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit Summary Grid Case Studies: Monitoring: TeraGRID
More informationSimplest Scalable Architecture
Simplest Scalable Architecture NOW Network Of Workstations Many types of Clusters (form HP s Dr. Bruce J. Walker) High Performance Clusters Beowulf; 1000 nodes; parallel programs; MPI Load-leveling Clusters
More informationClouds vs Grids KHALID ELGAZZAR GOODWIN 531 ELGAZZAR@CS.QUEENSU.CA
Clouds vs Grids KHALID ELGAZZAR GOODWIN 531 ELGAZZAR@CS.QUEENSU.CA [REF] I Foster, Y Zhao, I Raicu, S Lu, Cloud computing and grid computing 360-degree compared Grid Computing Environments Workshop, 2008.
More informationGrid Computing vs Cloud
Chapter 3 Grid Computing vs Cloud Computing 3.1 Grid Computing Grid computing [8, 23, 25] is based on the philosophy of sharing information and power, which gives us access to another type of heterogeneous
More informationUsing WestGrid. Patrick Mann, Manager, Technical Operations Jan.15, 2014
Using WestGrid Patrick Mann, Manager, Technical Operations Jan.15, 2014 Winter 2014 Seminar Series Date Speaker Topic 5 February Gino DiLabio Molecular Modelling Using HPC and Gaussian 26 February Jonathan
More informationA Taxonomy and Survey of Grid Resource Planning and Reservation Systems for Grid Enabled Analysis Environment
A Taxonomy and Survey of Grid Resource Planning and Reservation Systems for Grid Enabled Analysis Environment Arshad Ali 3, Ashiq Anjum 3, Atif Mehmood 3, Richard McClatchey 2, Ian Willers 2, Julian Bunn
More informationSpeeding up MATLAB and Simulink Applications
Speeding up MATLAB and Simulink Applications 2009 The MathWorks, Inc. Customer Tour 2009 Today s Schedule Introduction to Parallel Computing with MATLAB and Simulink Break Master Class on Speeding Up MATLAB
More informationClusters: Mainstream Technology for CAE
Clusters: Mainstream Technology for CAE Alanna Dwyer HPC Division, HP Linux and Clusters Sparked a Revolution in High Performance Computing! Supercomputing performance now affordable and accessible Linux
More informationCloud Computing with Red Hat Solutions. Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd. sivaram@redhat.com
Cloud Computing with Red Hat Solutions Sivaram Shunmugam Red Hat Asia Pacific Pte Ltd sivaram@redhat.com Linux Automation Details Red Hat's Linux Automation strategy for next-generation IT infrastructure
More informationCMS Tier-3 cluster at NISER. Dr. Tania Moulik
CMS Tier-3 cluster at NISER Dr. Tania Moulik What and why? Grid computing is a term referring to the combination of computer resources from multiple administrative domains to reach common goal. Grids tend
More informationCollaborative Project in Cloud Computing
Collaborative Project in Cloud Computing Project Title: Virtual Cloud Laboratory (VCL) Services for Education Transfer of Results: from North Carolina State University (NCSU) to IBM Technical Description:
More informationBatch Scheduling and Resource Management
Batch Scheduling and Resource Management Luke Tierney Department of Statistics & Actuarial Science University of Iowa October 18, 2007 Luke Tierney (U. of Iowa) Batch Scheduling and Resource Management
More informationIntroduction to High Performance Cluster Computing. Cluster Training for UCL Part 1
Introduction to High Performance Cluster Computing Cluster Training for UCL Part 1 What is HPC HPC = High Performance Computing Includes Supercomputing HPCC = High Performance Cluster Computing Note: these
More informationDeveloping a Computer Based Grid infrastructure
Computational Grids: Current Trends in Performance-oriented Distributed Computing Rich Wolski Computer Science Department University of California, Santa Barbara Introduction While the rapid evolution
More informationHPC Cluster Decisions and ANSYS Configuration Best Practices. Diana Collier Lead Systems Support Specialist Houston UGM May 2014
HPC Cluster Decisions and ANSYS Configuration Best Practices Diana Collier Lead Systems Support Specialist Houston UGM May 2014 1 Agenda Introduction Lead Systems Support Specialist Cluster Decisions Job
More informationVolunteer Computing and Cloud Computing: Opportunities for Synergy
Volunteer Computing and Cloud Computing: Opportunities for Synergy Derrick Kondo INRIA, France Performance vs. Reliability vs. Costs high Cost Reliability high low low low Performance high Performance
More informationISPASS-2009 Tutorial Proposal Archer: Zero-configuration Virtual Appliances for Architecture Simulation
ISPASS-2009 Tutorial Proposal Archer: Zero-configuration Virtual Appliances for Architecture Simulation Tutorial audience and goals: This tutorial targets computer architecture researchers and students
More informationGrid Activities in Poland
Grid Activities in Poland Jarek Nabrzyski Poznan Supercomputing and Networking Center naber@man.poznan.pl Outline PSNC National Program PIONIER Sample projects: Progress and Clusterix R&D Center PSNC was
More informationProgram Grid and HPC5+ workshop
Program Grid and HPC5+ workshop 24-30, Bahman 1391 Tuesday Wednesday 9.00-9.45 9.45-10.30 Break 11.00-11.45 11.45-12.30 Lunch 14.00-17.00 Workshop Rouhani Karimi MosalmanTabar Karimi G+MMT+K Opening IPM_Grid
More informationHigh Performance Computing in CST STUDIO SUITE
High Performance Computing in CST STUDIO SUITE Felix Wolfheimer GPU Computing Performance Speedup 18 16 14 12 10 8 6 4 2 0 Promo offer for EUC participants: 25% discount for K40 cards Speedup of Solver
More informationSilviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania)
Silviu Panica, Marian Neagul, Daniela Zaharie and Dana Petcu (Romania) Outline Introduction EO challenges; EO and classical/cloud computing; EO Services The computing platform Cluster -> Grid -> Cloud
More informationHigh Performance. CAEA elearning Series. Jonathan G. Dudley, Ph.D. 06/09/2015. 2015 CAE Associates
High Performance Computing (HPC) CAEA elearning Series Jonathan G. Dudley, Ph.D. 06/09/2015 2015 CAE Associates Agenda Introduction HPC Background Why HPC SMP vs. DMP Licensing HPC Terminology Types of
More informationlocuz.com HPC App Portal V2.0 DATASHEET
locuz.com HPC App Portal V2.0 DATASHEET Ganana HPC App Portal makes it easier for users to run HPC applications without programming and for administrators to better manage their clusters. The web-based
More informationXSEDE Service Provider Software and Services Baseline. September 24, 2015 Version 1.2
XSEDE Service Provider Software and Services Baseline September 24, 2015 Version 1.2 i TABLE OF CONTENTS XSEDE Production Baseline: Service Provider Software and Services... i A. Document History... A-
More informationLiving in a mixed world -Interoperability in Windows HPC Server 2008. Steven Newhouse stevenn@microsoft.com
Living in a mixed world -Interoperability in Windows HPC Server 2008 Steven Newhouse stevenn@microsoft.com Overview Scenarios: Mixed Environments Authentication & Authorization File Systems Application
More informationHPC Software Requirements to Support an HPC Cluster Supercomputer
HPC Software Requirements to Support an HPC Cluster Supercomputer Susan Kraus, Cray Cluster Solutions Software Product Manager Maria McLaughlin, Cray Cluster Solutions Product Marketing Cray Inc. WP-CCS-Software01-0417
More informationCloud Computing Architecture with OpenNebula HPC Cloud Use Cases
NASA Ames NASA Advanced Supercomputing (NAS) Division California, May 24th, 2012 Cloud Computing Architecture with OpenNebula HPC Cloud Use Cases Ignacio M. Llorente Project Director OpenNebula Project.
More informationIT service for life science
anterio performs research in the field of molecular modelling including computer-aided drug design. With our experience in these fields we help customers to implement an IT infrastructure to aid these
More informationSimulation Platform Overview
Simulation Platform Overview Build, compute, and analyze simulations on demand www.rescale.com CASE STUDIES Companies in the aerospace and automotive industries use Rescale to run faster simulations Aerospace
More informationAn Evaluation of Economy-based Resource Trading and Scheduling on Computational Power Grids for Parameter Sweep Applications
An Evaluation of Economy-based Resource Trading and Scheduling on Computational Power Grids for Parameter Sweep Applications Rajkumar Buyya, Jonathan Giddy, and David Abramson School of Computer Science
More informationSurvey and Taxonomy of Grid Resource Management Systems
Survey and Taxonomy of Grid Resource Management Systems Chaitanya Kandagatla University of Texas, Austin Abstract The resource management system is the central component of a grid system. This paper describes
More informationLSKA 2010 Survey Report Job Scheduler
LSKA 2010 Survey Report Job Scheduler Graduate Institute of Communication Engineering {r98942067, r98942112}@ntu.edu.tw March 31, 2010 1. Motivation Recently, the computing becomes much more complex. However,
More information- Behind The Cloud -
- Behind The Cloud - Infrastructure and Technologies used for Cloud Computing Alexander Huemer, 0025380 Johann Taferl, 0320039 Florian Landolt, 0420673 Seminar aus Informatik, University of Salzburg Overview
More informationCyberinfrastructure Education and Hands-on Training Using the CH3D-GTM Virtual Appliance on SURAGrid
Cyberinfrastructure Education and Hands-on Training Using the CH3D-GTM Virtual Appliance on SURAGrid Renato Figueiredo http://grid-appliance.org J. Davis, J. Fortes, P. Sheng, V. Paramygin, B. Tutak, D.
More informationAudio networking. François Déchelle (dechelle@ircam.fr) Patrice Tisserand (tisserand@ircam.fr) Simon Schampijer (schampij@ircam.
Audio networking François Déchelle (dechelle@ircam.fr) Patrice Tisserand (tisserand@ircam.fr) Simon Schampijer (schampij@ircam.fr) IRCAM Distributed virtual concert project and issues network protocols
More informationChapter 18: Database System Architectures. Centralized Systems
Chapter 18: Database System Architectures! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Network Types 18.1 Centralized Systems! Run on a single computer system and
More informationOutline. High Performance Computing (HPC) Big Data meets HPC. Case Studies: Some facts about Big Data Technologies HPC and Big Data converging
Outline High Performance Computing (HPC) Towards exascale computing: a brief history Challenges in the exascale era Big Data meets HPC Some facts about Big Data Technologies HPC and Big Data converging
More informationSimple Introduction to Clusters
Simple Introduction to Clusters Cluster Concepts Cluster is a widely used term meaning independent computers combined into a unified system through software and networking. At the most fundamental level,
More informationClient/Server and Distributed Computing
Adapted from:operating Systems: Internals and Design Principles, 6/E William Stallings CS571 Fall 2010 Client/Server and Distributed Computing Dave Bremer Otago Polytechnic, N.Z. 2008, Prentice Hall Traditional
More informationAnalytical Study of Various High Performance Computing Paradigms
Analytical Study of Various High Performance Computing Paradigms Rashmi Gupta M. Tech Scholar Banasthali Vidyapeeth Jaipur, India Omesh Kumar M. Tech Scholar A. K. G Engineering college Ghaziabad, India
More informationRoadmap for Applying Hadoop Distributed File System in Scientific Grid Computing
Roadmap for Applying Hadoop Distributed File System in Scientific Grid Computing Garhan Attebury 1, Andrew Baranovski 2, Ken Bloom 1, Brian Bockelman 1, Dorian Kcira 3, James Letts 4, Tanya Levshina 2,
More informationWhite Paper The Numascale Solution: Extreme BIG DATA Computing
White Paper The Numascale Solution: Extreme BIG DATA Computing By: Einar Rustad ABOUT THE AUTHOR Einar Rustad is CTO of Numascale and has a background as CPU, Computer Systems and HPC Systems De-signer
More informationComputational infrastructure for NGS data analysis. José Carbonell Caballero Pablo Escobar
Computational infrastructure for NGS data analysis José Carbonell Caballero Pablo Escobar Computational infrastructure for NGS Cluster definition: A computer cluster is a group of linked computers, working
More informationOn-Demand Supercomputing Multiplies the Possibilities
Microsoft Windows Compute Cluster Server 2003 Partner Solution Brief Image courtesy of Wolfram Research, Inc. On-Demand Supercomputing Multiplies the Possibilities Microsoft Windows Compute Cluster Server
More informationVarious Grid productions and Comparison of ORACLE and IBM grid
Beyond Limits... Volume: 2 Issue: 3 International Journal Of Advance Innovations, Thoughts & Ideas Various Grid productions and Comparison of ORACLE and IBM grid Saurabh Srivastava* iam100rabh@gmail.com
More informationHPC Growing Pains. Lessons learned from building a Top500 supercomputer
HPC Growing Pains Lessons learned from building a Top500 supercomputer John L. Wofford Center for Computational Biology & Bioinformatics Columbia University I. What is C2B2? Outline Lessons learned from
More informationMitglied der Helmholtz-Gemeinschaft. System monitoring with LLview and the Parallel Tools Platform
Mitglied der Helmholtz-Gemeinschaft System monitoring with LLview and the Parallel Tools Platform November 25, 2014 Carsten Karbach Content 1 LLview 2 Parallel Tools Platform (PTP) 3 Latest features 4
More informationnumascale White Paper The Numascale Solution: Extreme BIG DATA Computing Hardware Accellerated Data Intensive Computing By: Einar Rustad ABSTRACT
numascale Hardware Accellerated Data Intensive Computing White Paper The Numascale Solution: Extreme BIG DATA Computing By: Einar Rustad www.numascale.com Supemicro delivers 108 node system with Numascale
More informationThe EDGeS project receives Community research funding
Desktop Grids EDGeS project Delegation for access to trusted resources The EDGeS project receives Community research funding 1 DG = Desktop Grid = Loose grid scavenging idle resources Unit of Work = Application
More informationUniversity of Huddersfield Repository
University of Huddersfield Repository Gubb, David, Holmes, Violeta, Kureshi, Ibad, Liang, Shuo and James, Yvonne Implementing a Condor pool using a Green-IT policy Original Citation Gubb, David, Holmes,
More informationGRID COMPUTING Techniques and Applications BARRY WILKINSON
GRID COMPUTING Techniques and Applications BARRY WILKINSON Contents Preface About the Author CHAPTER 1 INTRODUCTION TO GRID COMPUTING 1 1.1 Grid Computing Concept 1 1.2 History of Distributed Computing
More informationDavid Rioja Redondo Telecommunication Engineer Englobe Technologies and Systems
David Rioja Redondo Telecommunication Engineer Englobe Technologies and Systems About me David Rioja Redondo Telecommunication Engineer - Universidad de Alcalá >2 years building and managing clusters UPM
More informationDistributed Systems LEEC (2005/06 2º Sem.)
Distributed Systems LEEC (2005/06 2º Sem.) Introduction João Paulo Carvalho Universidade Técnica de Lisboa / Instituto Superior Técnico Outline Definition of a Distributed System Goals Connecting Users
More informationEsqu Science Experiments For Computer Network
Vangelis Floros, GRNET S.A. 3 rd Open Source Software Conference March 22, 2008 NTUA, Athens Greece Introduction What is a Grid? What is escience? Large Scientific Grids The example of EGEE Building Grid
More informationWindows HPC Server 2008 R2 Service Pack 3 (V3 SP3)
Windows HPC Server 2008 R2 Service Pack 3 (V3 SP3) Greg Burgess, Principal Development Manager Windows Azure High Performance Computing Microsoft Corporation HPC Server Components Job Scheduler Distributed
More informationHPC-related R&D in 863 Program
HPC-related R&D in 863 Program Depei Qian Sino-German Joint Software Institute (JSI) Beihang University Aug. 27, 2010 Outline The 863 key project on HPC and Grid Status and Next 5 years 863 efforts on
More informationHPC Wales Skills Academy Course Catalogue 2015
HPC Wales Skills Academy Course Catalogue 2015 Overview The HPC Wales Skills Academy provides a variety of courses and workshops aimed at building skills in High Performance Computing (HPC). Our courses
More informationSoftware. Enabling Technologies for the 3D Clouds. Paolo Maggi (paolo.maggi@nice-software.com) R&D Manager
Software Enabling Technologies for the 3D Clouds Paolo Maggi (paolo.maggi@nice-software.com) R&D Manager What is a 3D Cloud? "Cloud computing is a model for enabling convenient, on-demand network access
More informationCloud Computing for HPC
Cloud Computing for HPC Extending Clusters to Clouds Solution Briefing TORONTO 10/25/2011 Company Background 2 Platform Computing, Inc. Platform Clusters, Grids, Clouds Computing The leader in cluster,
More informationThe Managed computation Factory and Its Application to EGEE
The Managed Computation and its Application to EGEE and OSG Requirements Ian Foster, Kate Keahey, Carl Kesselman, Stuart Martin, Mats Rynge, Gurmeet Singh DRAFT of June 19, 2005 Abstract An important model
More informationA GPU COMPUTING PLATFORM (SAGA) AND A CFD CODE ON GPU FOR AEROSPACE APPLICATIONS
A GPU COMPUTING PLATFORM (SAGA) AND A CFD CODE ON GPU FOR AEROSPACE APPLICATIONS SUDHAKARAN.G APCF, AERO, VSSC, ISRO 914712564742 g_suhakaran@vssc.gov.in THOMAS.C.BABU APCF, AERO, VSSC, ISRO 914712565833
More informationMicrosoft Technical Computing The Advancement of Parallelism. Tom Quinn, Technical Computing Partner Manager
Presented at the COMSOL Conference 2010 Boston Microsoft Technical Computing The Advancement of Parallelism Tom Quinn, Technical Computing Partner Manager 21 1.2 x 10 New Bytes of Information in 2010 Source:
More informationPRIMERGY server-based High Performance Computing solutions
PRIMERGY server-based High Performance Computing solutions PreSales - May 2010 - HPC Revenue OS & Processor Type Increasing standardization with shift in HPC to x86 with 70% in 2008.. HPC revenue by operating
More informationIntroduction to parallel computing and UPPMAX
Introduction to parallel computing and UPPMAX Intro part of course in Parallel Image Analysis Elias Rudberg elias.rudberg@it.uu.se March 22, 2011 Parallel computing Parallel computing is becoming increasingly
More informationDenis Caromel, CEO Ac.veEon. Orchestrate and Accelerate Applica.ons. Open Source Cloud Solu.ons Hybrid Cloud: Private with Burst Capacity
Cloud computing et Virtualisation : applications au domaine de la Finance Denis Caromel, CEO Ac.veEon Orchestrate and Accelerate Applica.ons Open Source Cloud Solu.ons Hybrid Cloud: Private with Burst
More informationGrid Computing Vs. Cloud Computing
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 6 (2013), pp. 577-582 International Research Publications House http://www. irphouse.com /ijict.htm Grid
More informationThe Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets
The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets!! Large data collections appear in many scientific domains like climate studies.!! Users and
More informationAn Architecture for Dynamic Allocation of Compute Cluster Bandwidth
1 An Architecture for Dynamic Allocation of Compute Cluster Bandwidth John Bresnahan 1,2,3, Ian Foster 1,2,3 1 Math and Computer Science Division, Argonne National Laboratory, Argonne, IL 60439 2 Computation
More informationIntroduction to grid technologies, parallel and cloud computing. Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber
Introduction to grid technologies, parallel and cloud computing Alaa Osama Allam Saida Saad Mohamed Mohamed Ibrahim Gaber OUTLINES Grid Computing Parallel programming technologies (MPI- Open MP-Cuda )
More informationChapter 1: Introduction. What is an Operating System?
Chapter 1: Introduction What is an Operating System? Mainframe Systems Desktop Systems Multiprocessor Systems Distributed Systems Clustered System Real -Time Systems Handheld Systems Computing Environments
More informationScaling from Workstation to Cluster for Compute-Intensive Applications
Cluster Transition Guide: Scaling from Workstation to Cluster for Compute-Intensive Applications IN THIS GUIDE: The Why: Proven Performance Gains On Cluster Vs. Workstation The What: Recommended Reference
More informationBioinformatics Grid - Enabled Tools For Biologists.
Bioinformatics Grid - Enabled Tools For Biologists. What is Grid-Enabled Tools (GET)? As number of data from the genomics and proteomics experiment increases. Problems arise for the current sequence analysis
More information