Cloud Computing. Lecture 5 Grid Case Studies
|
|
- Kellie May
- 7 years ago
- Views:
Transcription
1 Cloud Computing Lecture 5 Grid Case Studies
2 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit
3 Summary Grid Case Studies: Monitoring: TeraGRID IS Data Transfer: LIGO Task Distribution: GEO600
4 TeraGrid Information Systems
5 TeraGrid (National Science Foundation) TeraGrid DEEP: Integrates NSF s 60 largest computers (+ than 60 TF): more than 2 PB of online storage. National data visualization infrastructure. Most powerful world computing network. TeraGrid WIDE Science Portals: Integration of scientific communities. More than 90 community data collections. Cooperation with other grid projects in Europe and Asia/Pacífic.
6 The Challenge Provide a mechanism that allows all participants to publish and discover information about available capabilities: What are TeraGrid s computing resources? Which features are provided by each resource? Where are the login services? Where can I access a particular data collection? Who has a weather forecast service? Provide a mechanism adapted to the TeraGrid open community: Editors record information (instead of submitting to a centralized database). A central index allows for aggregation and discovery. Multiple access interfaces (WS/SOAP, WS/ReST, browser).
7 Technical Issues Information is stored in legacy systems: Databases (different types, restricted access). Static and dynamic web interfaces. Multiple and varied database schemas: It s very complex to design an integrate database which supports all data types and relations. Many types of clients (browsers, SOAP, ReST). Service availability is critical: Both TeraGrid management (testing, documentation and planning) and its users and partners depend on this service. Therefore it has a 99.5% availability goal.
8 TeraGrid Central Services TeraGrid Information Service Architecture Apache 2.0 WS/REST HTTP GET Clients Cache Tomcat WebMDS WS/SOAP Clients WS MDS4 Resources WS MDS4 WS/SOAP Clients
9 Registry Editors record available content: The local service maintains a registry at the central registry. Entries expire automatically so are refreshed periodically. Editors maintain ownership of their information systems (they can even participate in other grids). Indexing services pull content: Registry entries have access control. Registry entries have a link to the source. Cache supports service faults, etc
10 High Availabilty Architecture TG Central Servers info.teragrid.org Clients Resources and Partners info.dyn.teragrid.org TeraGrid Dynamic Direct Numerical Simulation
11 TGUP Batch Load & Queue Data IIS provides queue & batch load information from all RP sites for TGUP to use in system monitor <LoadRP xmlns=""> <ComputeResourceLoad xmlns=""> <ResourceID>pople.psc.teragrid.org</ResourceID> <SiteID>psc.teragrid.org</SiteID> <LoadInfo hostname="tg-login1.pople.psc.teragrid.org" timestamp=" t13:46:19z"> <Load> <Type>queue</Type> <Value>98</Value> </Load>
12 TeraGrid Results Does not require deep modification or loss of ownership of legacy systems. Simple and consistent access mechanism. Integrates: Description of computing services and queue state. Registry of service and software availability. Centralized documentation. Test, validation and verification service: INCA, testing and execution portal.
13 GT4: Base Globus Toolkit Java Runtime GSI- OpenSSH MyProxy Data Rep C Runtime Delegation GRAM GridFTP Replica Location Python Runtime CAS GridWay Reliable File Transfer MDS4 Base Segurança Execução Dados Monit.
14 LIGO
15 LIGO: Laser Interferometry Gravitational Wave Observatory Goal: observe gravitational waves. Three physical detectors in two locations (plus the GEO detector in Germany). More than 10 centres for data analysis. Collaborators in more than 40 institutions.
16 LIGO: Laser Interferometry Gravitational Wave Observatory LIGO records thousands of data channels generating 1TB/day of data during test periods: The result data are published and data centres subscribe to the parts that local users want for analysis or storage. The data analysis results in more derived data: About 30% of LIGOs total data. They are also published and replicated. More than 35 million files on the grid: More than 6 million unique files More than 30 million files (copies of the originals)
17 The Challenge Replicate more than 1 TB/day of data to more than 10 locations. Solution: A publish/subscribe model. Let scientist specify and discover data using applicational criteria (metadata). Let scientists locate copies of the data.
18 Technical Constraints Efficiency Avoid bandwidth sub-use during transfer specially on broadband (10 Gbps) links. Avoid downtime between data transfers.
19 Lightweight Data Replicator Joins three basic Globus services: 1. Metadata service (MDS): What files are available? Information about files such as size, md5, date, Metadata propagation. 2. Globus Replica Location Service (RLS): Where are the files? Catalog service translates filenames into URLs. Maps files to locations. 3. GridFTP Service: How can we copy files? Server+adapted client. Used to replicate data between locations.
20 LIGO Data Replicator Architecture Each participant has a machine dedicated to transferring files requested by local clients. The scheduler requests metadata and catalogs replicas to identify missing files which are added to a priority list. The transfer daemon checks the list, transfer files and updates the LRC. If a transfer fails it remains on the transfer list.
21 LIGO Results Complete LIGO/GEO experiment: Replicated 30 TB in 30 days. (~700 MB/minute) MTBF: 1 month. More than 35 million files on the LDR network. Performance limited by chosen programming language (Python). Partnership with Globus Alliance to include a version of the LDR in Globus Toolkit.
22 Data Replication Service Data Replication Service (DRS) Reimplementation of LDR publish/subscribe capabilities. Uses Java based WS-RF services. Uses the RLS e RFT services from GT4. Included in GT4.
23 GT4: Base Globus Toolkit Java Runtime GSI- OpenSSH MyProxy Data Rep C Runtime Delegation GRAM GridFTP Replica Location Python Runtime CAS GridWay Reliable File Transfer MDS4 Base Segurança Execução Dados Monit.
24 GEO600
25 GEO600 Observatory Goal: observe gravitational waves. 600m laser interferometer close to Hannover. Members of LIGO as well.
26 The Challenge Sweep the packets of data produced by GEO600 looking for gravitational waves: Very complex signal processing. Very large amounts of data to process. D-GRID (state owned German Grid) and Open Science Grid available.
27 Two Pronged Approach Shared with the LIGO community. Runs on voluntary PCs. Uses the BOINC network. Runs since mid >70,000 computers/week ~19000 units/day AstroGrid-D Same application as Using D-Grid and OSG. Runs since Oct/2007. Distributes tasks using GRAM. Averages 4000 units/day.
28 Traditional Approach to Resource Management Accessing multiple sites: Accounts, permissions, etc... Use a metascheduler to decide on resource selection: GridWay Metascheduler uses GRAM to contact different job submission sites.
29 GEO600 Approach Submission node has a list of all the GEO 600 resources with min. and max. job capacities for each. Hourly the list are reviewed and jobs are dispatched. Every time a node has less than min. Jobs, more jobs are transferred upto max. jobs and the corresponding input files are transferred asynchronously. The status of each job is maintained in the submission machine. Job output files are sent back to the submission system asynchronously. GEO600 processes 4000 jobs/day this way.
30 D-GRID Approach Other GRAM4 tasks GEO600 jobs Other GRAM4 tasks Local jobs Local jobs GRAM4 Service Scheduler (e.g. Condor) GRAM4 Service Scheduler (e.g. SGE) Computing Nodes Computing Nodes Resource A Resource B
31 Next time Cycle Sharing Edge Computing Scheduling Algorithms
Cloud Computing. Up until now
Cloud Computing Lecture 6 Grid Case Studies 2010-2011 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers GlobusToolkit 1 Grid Case Studies: Summary Monitoring: TeraGRID
More informationGrid Computing With FreeBSD
Grid Computing With FreeBSD USENIX ATC '04: UseBSD SIG Boston, MA, June 29 th 2004 Brooks Davis, Craig Lee The Aerospace Corporation El Segundo, CA {brooks,lee}aero.org http://people.freebsd.org/~brooks/papers/usebsd2004/
More informationThe GridWay Meta-Scheduler
The GridWay Meta-Scheduler Committers Ignacio M. Llorente Ruben S. Montero Eduardo Huedo Contributors Tino Vazquez Jose Luis Vazquez Javier Fontan Jose Herrera 1 Goals of the Project Goals of the Project
More informationLIGO Authentication and Authorization 2.0
LIGO Authentication and Authorization 2.0 CILogon Fall 2009 Workshop Urbana, IL Sep 29, 2009 Scott Koranda & Warren Anderson University of Wisconsin Milwaukee LIGO G0900910 Who we are LIGO Laboratory»
More informationXSEDE Service Provider Software and Services Baseline. September 24, 2015 Version 1.2
XSEDE Service Provider Software and Services Baseline September 24, 2015 Version 1.2 i TABLE OF CONTENTS XSEDE Production Baseline: Service Provider Software and Services... i A. Document History... A-
More informationThe Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland
The Lattice Project: A Multi-Model Grid Computing System Center for Bioinformatics and Computational Biology University of Maryland Parallel Computing PARALLEL COMPUTING a form of computation in which
More informationA Survey Study on Monitoring Service for Grid
A Survey Study on Monitoring Service for Grid Erkang You erkyou@indiana.edu ABSTRACT Grid is a distributed system that integrates heterogeneous systems into a single transparent computer, aiming to provide
More informationClassic Grid Architecture
Peer-to to-peer Grids Classic Grid Architecture Resources Database Database Netsolve Collaboration Composition Content Access Computing Security Middle Tier Brokers Service Providers Middle Tier becomes
More informationInca User-level Grid Monitoring
Inca User-level Grid Monitoring Shava Smallen ssmallen@sdsc.edu SC 09 November 17, 2009 Goal: reliable grid software and services for users Over 750 TF Over 30 PB of online and archival data storage Connected
More informationAn approach to grid scheduling by using Condor-G Matchmaking mechanism
An approach to grid scheduling by using Condor-G Matchmaking mechanism E. Imamagic, B. Radic, D. Dobrenic University Computing Centre, University of Zagreb, Croatia {emir.imamagic, branimir.radic, dobrisa.dobrenic}@srce.hr
More informationGridWay: Open Source Meta-scheduling Technology for Grid Computing
: Open Source Meta-scheduling Technology for Grid Computing Ruben S. Montero dsa-research.org Open Source Grid & Cluster Oakland CA, May 2008 Contents Introduction What is? Architecture & Components Scheduling
More informationGrid Computing vs Cloud
Chapter 3 Grid Computing vs Cloud Computing 3.1 Grid Computing Grid computing [8, 23, 25] is based on the philosophy of sharing information and power, which gives us access to another type of heterogeneous
More informationThe Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets
The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets!! Large data collections appear in many scientific domains like climate studies.!! Users and
More informationMonitoring Clusters and Grids
JENNIFER M. SCHOPF AND BEN CLIFFORD Monitoring Clusters and Grids One of the first questions anyone asks when setting up a cluster or a Grid is, How is it running? is inquiry is usually followed by the
More informationGrid Scheduling Architectures with Globus GridWay and Sun Grid Engine
Grid Scheduling Architectures with and Sun Grid Engine Sun Grid Engine Workshop 2007 Regensburg, Germany September 11, 2007 Ignacio Martin Llorente Javier Fontán Muiños Distributed Systems Architecture
More informationTHE CCLRC DATA PORTAL
THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: g.j.drinkwater@dl.ac.uk, s.a.sufi@dl.ac.uk Abstract: The project aims
More informationTeraGrid: A National Cyberinfrastructure Facility
TeraGrid: A National Cyberinfrastructure Facility Charlie Catlett, TeraGrid Director University of Chicago and Argonne National Laboratory cec@uchicago.edu January 2006 TeraGrid Objectives DEEP Science:
More informationConcepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen
Concepts and Architecture of Grid Computing Advanced Topics Spring 2008 Prof. Robert van Engelen Overview Grid users: who are they? Concept of the Grid Challenges for the Grid Evolution of Grid systems
More informationInca User-level Grid Monitoring
Inca User-level Grid Monitoring Shava Smallen ssmallen@sdsc.edu SC 08 November 19, 2008 Goal: reliable grid software and services for users Over 750 TF Over 30 PB of online and archival data storage Connected
More informationData Management Challenges of Data-Intensive Scientific Workflows
Data Management Challenges of Data-Intensive Scientific Workflows Ewa Deelman, Ann Chervenak USC Information Sciences Institute, Marina Del Rey, CA 90292 deelman@isi.edu, annc@isi.edu Abstract Scientific
More informationWeb Services and Service Oriented Architectures. Thomas Soddemann, RZG
Web Services and Service Oriented Architectures, RZG Delaman Workshop 2004 Overview The Garching Supercomputing Center - RZG Diving into the world of Web Services Service Oriented Architectures And beyond
More informationEDG Project: Database Management Services
EDG Project: Database Management Services Leanne Guy for the EDG Data Management Work Package EDG::WP2 Leanne.Guy@cern.ch http://cern.ch/leanne 17 April 2002 DAI Workshop Presentation 1 Information in
More informationUsing Globus Toolkit
Using Globus Toolkit G. Poghosyan & D. Nilsen GridKa School 11-15 September 2006 Basic Grid Services in GT Security Services GSI (Grid Security Infrastructure) Data Services GridFTP RFT (Reliable File
More informationGrid Computing @ Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions
Grid Computing @ Sun Carlo Nardone Technical Systems Ambassador GSO Client Solutions Phases of Grid Computing Cluster Grids Single user community Single organization Campus Grids Multiple user communities
More informationGrid Data Management. Raj Kettimuthu
Grid Data Management Raj Kettimuthu Data Management Distributed community of users need to access and analyze large amounts of data Fusion community s International ITER project Requirement arises in both
More informationA Web Services Data Analysis Grid *
A Web Services Data Analysis Grid * William A. Watson III, Ian Bird, Jie Chen, Bryan Hess, Andy Kowalski, Ying Chen Thomas Jefferson National Accelerator Facility 12000 Jefferson Av, Newport News, VA 23606,
More informationPRACE WP4 Distributed Systems Management. Riccardo Murri, CSCS Swiss National Supercomputing Centre
PRACE WP4 Distributed Systems Management Riccardo Murri, CSCS Swiss National Supercomputing Centre PRACE WP4 WP4 is the Distributed Systems Management activity User administration and accounting Distributed
More informationCloud Computing. Lecture 5 Grid Security 2014-2015
Cloud Computing Lecture 5 Grid Security 2014-2015 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit Summary Grid Security TLS WS-Security Proxy certificates
More informationSecure Federated Light-weight Web Portals for FusionGrid
Secure Federated Light-weight Web Portals for FusionGrid By: D. Aswath, M. Thompson, M. Goode, X. Lee, N. Y. Kim Presented by: Dipti Aswath GCE Workshop 2006 Second International Workshop on Grid Computing
More informationCondor for the Grid. 3) http://www.cs.wisc.edu/condor/
Condor for the Grid 1) Condor and the Grid. Douglas Thain, Todd Tannenbaum, and Miron Livny. In Grid Computing: Making The Global Infrastructure a Reality, Fran Berman, Anthony J.G. Hey, Geoffrey Fox,
More informationA Service for Data-Intensive Computations on Virtual Clusters
A Service for Data-Intensive Computations on Virtual Clusters Executing Preservation Strategies at Scale Rainer Schmidt, Christian Sadilek, and Ross King rainer.schmidt@arcs.ac.at Planets Project Permanent
More informationA QoS-aware Method for Web Services Discovery
Journal of Geographic Information System, 2010, 2, 40-44 doi:10.4236/jgis.2010.21008 Published Online January 2010 (http://www.scirp.org/journal/jgis) A QoS-aware Method for Web Services Discovery Bian
More informationTHE US NATIONAL VIRTUAL OBSERVATORY. IVOA WebServices. William O Mullane The Johns Hopkins University
THE US NATIONAL VIRTUAL OBSERVATORY IVOA WebServices William O Mullane The Johns Hopkins University 1 What exactly is a WS? FROM http://dev.w3.org/cvsweb/~checkout~/2002/ws/arch/wsa/wd-wsaarch.html#whatisws
More informationWorkload Characterization and Analysis of Storage and Bandwidth Needs of LEAD Workspace
Workload Characterization and Analysis of Storage and Bandwidth Needs of LEAD Workspace Beth Plale Indiana University plale@cs.indiana.edu LEAD TR 001, V3.0 V3.0 dated January 24, 2007 V2.0 dated August
More informationDFSgc. Distributed File System for Multipurpose Grid Applications and Cloud Computing
DFSgc Distributed File System for Multipurpose Grid Applications and Cloud Computing Introduction to DFSgc. Motivation: Grid Computing currently needs support for managing huge quantities of storage. Lacks
More informationExecution Management: Key Concepts
Execution Management: Key Concepts Execution Management: Key Concepts Overview The Globus Toolkit provides a service to submit, monitor, and cancel jobs on Grid computing resources called GRAM. In GRAM,
More informationIntegration strategy
C3-INAD and ESGF: Integration strategy C3-INAD Middleware Team: Stephan Kindermann, Carsten Ehbrecht [DKRZ] Bernadette Fritzsch [AWI] Maik Jorra, Florian Schintke, Stefan Plantikov [ZUSE Institute] Markus
More informationIdentity and Access Management for LIGO: International Challenges
Identity and Access Management for LIGO: International Challenges Scott Koranda for LIGO and CTSC University of Wisconsin-Milwaukee November 14, 2012 LIGO-XXXXXXXX-v1 1 / 26 LIGO Science Mission LIGO,
More informationScience Gateway Services for NERSC Users
Science Gateway Services for NERSC Users Shreyas Cholia NERSC User Group Meeting October 7, 2009 Science Gateways at NERSC Web access methods to NERSC resources Much is possible beyond yesterday s ssh+pbs
More informationOn Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments
On Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments 18. June 2013 Morris Reidel, Shahbaz Memon, et al. Outline Background Ultrascan Application Ultrascan Software Components
More informationDeploying Business Virtual Appliances on Open Source Cloud Computing
International Journal of Computer Science and Telecommunications [Volume 3, Issue 4, April 2012] 26 ISSN 2047-3338 Deploying Business Virtual Appliances on Open Source Cloud Computing Tran Van Lang 1 and
More informationCONDOR And The GRID. By Karthik Ram Venkataramani Department of Computer Science University at Buffalo kv8@cse.buffalo.edu
CONDOR And The GRID By Karthik Ram Venkataramani Department of Computer Science University at Buffalo kv8@cse.buffalo.edu Abstract Origination of the Condor Project Condor as Grid Middleware Condor working
More informationAdvanced Data Management and Analytics for Automated Demand Response (ADR) based on NoSQL
Advanced Data Management and Analytics for Automated Demand Response (ADR) based on NoSQL Bert Taube btaube@versant.com Versant Corporation www.versant.com Rolf Bienert Rolf@openadr.org OpenADR Alliance
More informationCluster, Grid, Cloud Concepts
Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of
More informationReal Time Analysis of Advanced Photon Source Data
Real Time Analysis of Advanced Photon Source Data Dan Fraser (ANL) Director, Community Driven Improvement of Globus Software Brian Tieman (APS) And a host of others. ESRFUP WP11 Workshop Exploiting the
More informationP ERFORMANCE M ONITORING AND A NALYSIS S ERVICES - S TABLE S OFTWARE
P ERFORMANCE M ONITORING AND A NALYSIS S ERVICES - S TABLE S OFTWARE WP3 Document Filename: Work package: Partner(s): Lead Partner: v1.0-.doc WP3 UIBK, CYFRONET, FIRST UIBK Document classification: PUBLIC
More informationRecommendations for Static Firewall Configuration in D-Grid
D-Grid Integrationsprojekt (DGI-2) Fachgebiet 3-3 Firewalls Recommendations for Static Firewall Configuration in D-Grid Version 1.5, 21. Mai 2008 D-Grid Integrationsprojekt (DGI-2) Autoren: Gian Luca Volpato
More informationCEMON installation and configuration procedure
CEMON installation and configuration procedure Introduction Tanya Levshina, Rohit Mathur, Steve Timm Draft This document is intended for administrators responsible for installing and configuring ITB Compute
More informationEnabling LIGO Applications on Scientific Grids
Enabling LIGO Applications on Scientific Grids Junwei Cao, MIT/LIGO jcao@ligo.mit.edu For the LIGO Scientific Collaboration OSG Consortium Meeting Milwaukee, Wisconsin July 20-22 2005 Data Monitoring Toolkit
More informationThe Globus Replica Location Service: Design and Experience
TPDS-2008-05-0201 1 The Globus Replica Location Service: Design and Experience Ann L. CHERVENAK, Robert SCHULER, Matei RIPEANU, Muhammad Ali AMER, Shishir BHARATHI, Ian FOSTER, Adriana IAMNITCHI, Carl
More informationSWIFT. Page:1. Openstack Swift. Object Store Cloud built from the grounds up. David Hadas Swift ATC. HRL davidh@il.ibm.com 2012 IBM Corporation
Page:1 Openstack Swift Object Store Cloud built from the grounds up David Hadas Swift ATC HRL davidh@il.ibm.com Page:2 Object Store Cloud Services Expectations: PUT/GET/DELETE Huge Capacity (Scale) Always
More informationGRID COMPUTING Techniques and Applications BARRY WILKINSON
GRID COMPUTING Techniques and Applications BARRY WILKINSON Contents Preface About the Author CHAPTER 1 INTRODUCTION TO GRID COMPUTING 1 1.1 Grid Computing Concept 1 1.2 History of Distributed Computing
More informationHPC-related R&D in 863 Program
HPC-related R&D in 863 Program Depei Qian Sino-German Joint Software Institute (JSI) Beihang University Aug. 27, 2010 Outline The 863 key project on HPC and Grid Status and Next 5 years 863 efforts on
More informationCHAPTER 4 PROPOSED GRID NETWORK MONITORING ARCHITECTURE AND SYSTEM DESIGN
39 CHAPTER 4 PROPOSED GRID NETWORK MONITORING ARCHITECTURE AND SYSTEM DESIGN This chapter discusses about the proposed Grid network monitoring architecture and details of the layered architecture. This
More informationAHE Server Deployment and Hosting Applications. Stefan Zasada University College London
AHE Server Deployment and Hosting Applications Stefan Zasada University College London 1 AHE Server Implementation WSRF::Lite => services developed in Perl WebDAV server GridSAM => Globus grid => Sun Grid
More informationIntroduction. MCSN N. Tonellotto Complements of Distributed Enabling Platforms
Introduction 1 Distributed relating to a computer network in which at least some of the processing is done by the individual computers and information is shared by and often stored at the computers Enabling
More informationBuilding Web Services with XML Service Utility Library (XSUL)
Building Web Services with XML Service Utility Library (XSUL) Aleksander Slominski IU Extreme! Lab August 2005 Linked Environments for Atmospheric Discovery Outline Goals and Features Creating Web Services
More informationTowards an E-Governance Grid for India (E-GGI): An Architectural Framework for Citizen Services Delivery
Towards an E-Governance Grid for India (E-GGI): An Architectural Framework for Citizen Services Delivery C. S. R. Prabhu 1 ABSTRACT The National e-governance Plan (NeGP) proposes citizen service delivery
More informationFuture Developments in UniGrids and NextGRID
Future Developments in UniGrids and NextGRID Dr. David Snelling Fujitsu Laboratories of Europe Unicore Summit Nice, France - October 2005 Overview Status Report New Gateway Architecture Parallel HTTP based
More informationThe EDGeS project receives Community research funding
Desktop Grids EDGeS project Delegation for access to trusted resources The EDGeS project receives Community research funding 1 DG = Desktop Grid = Loose grid scavenging idle resources Unit of Work = Application
More informationTanya Levshina, Steve Timm
Introduction Tanya Levshina, Steve Timm This document is intended for administrators responsible for supporting ITB Compute Element (CE) version 0.4.1 onto OSG Integration Resources. We assume that an
More informationEsqu Science Experiments For Computer Network
Vangelis Floros, GRNET S.A. 3 rd Open Source Software Conference March 22, 2008 NTUA, Athens Greece Introduction What is a Grid? What is escience? Large Scientific Grids The example of EGEE Building Grid
More informationRemoving Failure Points and Increasing Scalability for the Engine that Drives webmd.com
Removing Failure Points and Increasing Scalability for the Engine that Drives webmd.com Matt Wilson Director, Consumer Web Operations, WebMD @mattwilsoninc 9/12/2013 About this talk Go over original site
More informationSecure Data Transfer and Replication Mechanisms in Grid Environments p. 1
Secure Data Transfer and Replication Mechanisms in Grid Environments Konrad Karczewski, Lukasz Kuczynski and Roman Wyrzykowski Institute of Computer and Information Sciences, Czestochowa University of
More informationAn Architecture for Dynamic Allocation of Compute Cluster Bandwidth
1 An Architecture for Dynamic Allocation of Compute Cluster Bandwidth John Bresnahan 1,2,3, Ian Foster 1,2,3 1 Math and Computer Science Division, Argonne National Laboratory, Argonne, IL 60439 2 Computation
More informationBUILDING APPLICATIONS FROM A WEB SERVICE BASED COMPONENT ARCHITECTURE. D. Gannon, S. Krishnan, L. Fang, G. Kandaswamy, Y. Simmhan, A.
BUILDING APPLICATIONS FROM A WEB SERVICE BASED COMPONENT ARCHITECTURE D. Gannon, S. Krishnan, L. Fang, G. Kandaswamy, Y. Simmhan, A. Slominski What this talk is about How to build secure, reliable applications
More informationIntroduction to Grid computing
Introduction to Grid computing The INFNGrid Project Team Introduction This tutorial has been implemented considering as starting point the DataGrid (EDG) tutorial Many thanks to the EDG tutorials team!
More informationRoberto Barbera. Centralized bookkeeping and monitoring in ALICE
Centralized bookkeeping and monitoring in ALICE CHEP INFN 2000, GRID 10.02.2000 WP6, 24.07.2001 Roberto 1 Barbera ALICE and the GRID Phase I: AliRoot production The GRID Powered by ROOT 2 How did we get
More informationAdding IaaS Clouds to the ATLAS Computing Grid
Adding IaaS Clouds to the ATLAS Computing Grid Ashok Agarwal, Frank Berghaus, Andre Charbonneau, Mike Chester, Asoka de Silva, Ian Gable, Joanna Huang, Colin Leavett-Brown, Michael Paterson, Randall Sobie,
More informationStreamServe Persuasion SP5 StreamStudio
StreamServe Persuasion SP5 StreamStudio Administrator s Guide Rev B StreamServe Persuasion SP5 StreamStudio Administrator s Guide Rev B OPEN TEXT CORPORATION ALL RIGHTS RESERVED United States and other
More informationStreamServe Persuasion SP5 Control Center
StreamServe Persuasion SP5 Control Center User Guide Rev C StreamServe Persuasion SP5 Control Center User Guide Rev C OPEN TEXT CORPORATION ALL RIGHTS RESERVED United States and other international patents
More informationGlobus Auth. Steve Tuecke. The University of Chicago
Globus Auth Enabling an extensible, integrated ecosystem of services and applications for the research and education community. Steve Tuecke The University of Chicago Cloud has transformed how platforms
More informationGT 6.0 GRAM5 Key Concepts
GT 6.0 GRAM5 Key Concepts GT 6.0 GRAM5 Key Concepts Overview The Globus Toolkit provides GRAM5: a service to submit, monitor, and cancel jobs on Grid computing resources. In GRAM, a job consists of a computation
More informationTechnical Guide to ULGrid
Technical Guide to ULGrid Ian C. Smith Computing Services Department September 4, 2007 1 Introduction This document follows on from the User s Guide to Running Jobs on ULGrid using Condor-G [1] and gives
More information16th International Conference on Control Systems and Computer Science (CSCS16 07)
16th International Conference on Control Systems and Computer Science (CSCS16 07) TOWARDS AN IO INTENSIVE GRID APPLICATION INSTRUMENTATION IN MEDIOGRID Dacian Tudor 1, Florin Pop 2, Valentin Cristea 2,
More informationScheduling and Resource Management in Grids and Clouds
Scheduling and Resource Management in Grids and Clouds Dick Epema Parallel and Distributed Systems Group Delft University of Technology Delft, the Netherlands may 10, 2011 1 Outline Resource Management
More informationLarge Scale Coastal Modeling on the Grid
Large Scale Coastal Modeling on the Grid Lavanya Ramakrishnan lavanya@renci.org Renaissance Computing Institute Duke University North Carolina State University University of North Carolina - Chapel Hill
More informationGrid Computing: A Ten Years Look Back. María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es
Grid Computing: A Ten Years Look Back María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es Outline Challenges not yet solved in computing The parents of grid Computing
More informationManaging Credentials with
Managing Credentials with MyProxy Jim Basney National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu http://myproxy.ncsa.uiuc.edu/ What is MyProxy? A service for managing
More informationHEP Data-Intensive Distributed Cloud Computing System Requirements Specification Document
HEP Data-Intensive Distributed Cloud Computing System Requirements Specification Document CANARIE NEP-101 Project University of Victoria HEP Computing Group December 18, 2013 Version 1.0 1 Revision History
More informationADAM 5.5. System Requirements
ADAM 5.5 System Requirements 1 1. Overview The schema below shows an overview of the ADAM components that will be installed and set up. ADAM Server: hosts the ADAM core components. You must install the
More informationBuilding Grids with Jini and JavaSpaces
Building Grids with Jini and JavaSpaces Carlo Nardone Grid Program Driver Sun Microsystems Italy 1 Agenda SOA Jini JGrid Jini Rio JavaSpaces (JXTA, JxGrid...) thanks to Z. Juhasz, Univ. of Veszprem (Hungary)
More informationGrids Computing and Collaboration
Grids Computing and Collaboration Arto Teräs CSC, the Finnish IT center for science University of Pune, India, March 12 th 2007 Grids Computing and Collaboration / Arto Teräs 2007-03-12 Slide
More informationStatus and Evolution of ATLAS Workload Management System PanDA
Status and Evolution of ATLAS Workload Management System PanDA Univ. of Texas at Arlington GRID 2012, Dubna Outline Overview PanDA design PanDA performance Recent Improvements Future Plans Why PanDA The
More informationSoftware Engineering II
Software Engineering II Dr. Rami Bahsoon School of Computer Science University of Birmingham r.bahsoon@cs.bham.ac.uk Software Engineering II - Dr R Bahsoon Introduction to Cloud and SOA 1 Service-oriented
More informationFor large geographically dispersed companies, data grids offer an ingenious new model to economically share computing power and storage resources
Data grids for storage http://storagemagazine.techtarget.com/magitem/0,291266,sid35_gci1132545,00.html by: Ray Lucchesi Storage Magazine Issue: Oct 2005 For large geographically dispersed companies, data
More informationWeb Service Based Data Management for Grid Applications
Web Service Based Data Management for Grid Applications T. Boehm Zuse-Institute Berlin (ZIB), Berlin, Germany Abstract Web Services play an important role in providing an interface between end user applications
More informationInternational Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop
ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com
More informationJitterbit Technical Overview : Salesforce
Jitterbit allows you to easily integrate Salesforce with any cloud, mobile or on premise application. Jitterbit s intuitive Studio delivers the easiest way of designing and running modern integrations
More informationA Metadata Catalog Service for Data Intensive Applications
A Metadata Catalog Service for Data Intensive Applications Gurmeet Singh, Shishir Bharathi, Ann Chervenak, Ewa Deelman, Carl Kesselman, Mary Manohar, Sonal Patil, Laura Pearlman Information Sciences Institute,
More informationIVOA Single Sign-On security
IVOA Single Sign-On security Guy Rixon Presentation to ACCIS meeting Caltech, February 2007 Grid of secured services VOSpace App-server Restricted archive IVOA SSO, ACCIS meeting, February 2007 2 Client-server
More informationChapter 4 Cloud Computing Applications and Paradigms. Cloud Computing: Theory and Practice. 1
Chapter 4 Cloud Computing Applications and Paradigms Chapter 4 1 Contents Challenges for cloud computing. Existing cloud applications and new opportunities. Architectural styles for cloud applications.
More informationPlateforme de Calcul pour les Sciences du Vivant. SRB & glite. V. Breton. http://clrpcsv.in2p3.fr
SRB & glite V. Breton http://clrpcsv.in2p3.fr Introduction Goal: evaluation of existing technologies for data and tools integration and deployment Data and tools integration should be addressed using web
More informationHow To Monitor A Grid System
1. Issues of Grid monitoring Monitoring Grid Services 1.1 What the goals of Grid monitoring Propagate errors to users/management Performance monitoring to - tune the application - use the Grid more efficiently
More informationGrid monitoring system survey
Grid monitoring system survey by Tian Xu txu@indiana.edu Abstract The process of monitoring refers to systematically collect information regarding to current or past status of all resources of interest.
More informationCode and Process Migration! Motivation!
Code and Process Migration! Motivation How does migration occur? Resource migration Agent-based system Details of process migration Lecture 6, page 1 Motivation! Key reasons: performance and flexibility
More informationSCI-BUS gateways for grid and cloud infrastructures
SCI-BUS gateways for grid and cloud infrastructures Tamas Kiss University of Westminster Peter Kacsuk, Zoltan Farkas MTA SZTAKI VERCE project meeting 1 st February 2013, Edinburgh SCI-BUS is supported
More informationMIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper
Migrating Desktop and Roaming Access Whitepaper Poznan Supercomputing and Networking Center Noskowskiego 12/14 61-704 Poznan, POLAND 2004, April white-paper-md-ras.doc 1/11 1 Product overview In this whitepaper
More informationEnhanced Research Data Management and Publication with Globus
Enhanced Research Data Management and Publication with Globus Vas Vasiliadis Jim Pruyne Presented at OR2015 June 8, 2015 Presentations and other useful information available at globus.org/events/or2015/tutorial
More information