Portals and Resource Scheduling at Imperial College

Size: px
Start display at page:

Download "Portals and Resource Scheduling at Imperial College"

Transcription

1 Portals and Scheduling at Imperial College Dr Steven Newhouse Technical Director, London e-science Centre Department of Computing, Imperial College Background UK Regional e-science Centre Sun Centre of Excellence in e-science Concentrating on Grid Middleware: Portal Infrastructure Maximising Utilisation Policy for Sharing Construction of Imperial College Grid Development of higher-level scheduling & optimisation of resource utilisation 2 1

2 Contents ICENI Imperial College e-science Networked Infrastructure Imperial College Grid OGSA to Jini gateway -WS Interface E-Science Portal at Imperial College (EPIC) 3 ICENI The Iceni, under Queen Boudicca, united the tribes of South-East England in a revolt against the occupying Roman forces in AD60 IC e-science Networked Infrastructure Developed by LeSC Grid Middleware Group Collect and provide relevant Grid meta-data Use to define and develop higher-level services Prototype web service protocols 4 2

3 ICENI Architecture Computational JavaCoG Globus Storage Network Private Administrative Domain CR SR Identity Manager Domain Manager CR SR Public Computational Community CR SR Public Computational Community SR Browser Web Services Gateway Application Portal Software PolicyManager Application Mapper Broker Manager CR SR Component Design Tools Application Design Tools Private Gateway between private and public regions Public 5 Centre 24TB PIONEER Athlon Cluster 22 processor 100Mb Storage 1.2TB ATLAS Compaq / Quadrics Cluster 32 processor MPI: ~5.7us & >200 MB/s AP Sparc Ultra II APNet Storage 6TB CONDOR POOL ~ 150 PIII processors SATURN Sun E6800 SMP 24 processors Backplane: 9.6GB/s VIKING 1 P4/Linux Cluster 66 dual node Myrinet VOYAGER Microsoft/Dell Intel Cluster 32 processor Giganet VIKING 2 P4/Linux Cluster 68 dual node 100Mb 6 3

4 Imperial College Grid EPIC SGEEE SGE LeSC HEP HEP PBS PBS UCL SGE 7 Open Grid Services Architecture (OGSA) Initiated by the Globus team with IBM Leverage e-commerce software within e-science Utilise web service protocols and tool base: UDDI: Universal, Discovery, Device & Integration WSDL: Web Services Definition Language SOAP: Simple Object Access Protocol Refactor Globus toolkit to use web services 8 4

5 Grid Service Contracts User:A Client User:A Duration:10m Browser Jini Lookup Service Client User:B User:A+B Duration:1hr 9 OGSA & Jini Integration WSDL Interface GSI + SOAP Connection Gateway Manager GSI enabled Web Service Hosting Environment SOAP->Java User Info Jini Lookup Service Jini Client Interface User:A Duration:10m User: A+B Duration:1hr 10 5

6 -WS Standardise low-level remote access to DRM Build on current interface and track developments Provide web services access to through Jini Evolve to provide XML Schema language: Job definition ML ML Policy ML GRAM 2.0 / RSL (Direct OGSA service?) 11 Motivation WS SGEEE / Solaris Client Meta- Scheduler WS WS WS SGE / Linux SGE / Solaris PBS / Linux 12 6

7 Layered Architecture Other infrastructures GRAM RSL (SOAP & XML?) e.g. XSLT transformation (current mechanism: globus-script-pbs-submit) GSI GSI WS Adv Res WS Adv Res API Native DRM GSI Enabled Web Hosting Environment 13 EPIC: e-science Portal at Imperial College Collaborative LeSC industrial project with Sun Microsystems Develop a secure portal infrastructure to: Access your own personal environment Applications to support day-to-day e-science Interaction with other Grid infrastructures Allow role based access to resources Anonymous: public web pages Students: internal pages, , compute resources Staff: restricted pages 14 7

8 Accessing e-science applications Submarine Design Dr Ian Mathews, Imperial College Parameter exploration to find optimal design Mesoscale Materials Analysis Professor Peter Coveney, QMUL, London Remote access to Lattice Boltzman simulation (LB3D) Technical Compute Portal Wolfgang Gentzsch & Dan Fraser (Sun Microsystems) Web based access to Sun s Grid Engine 15 uportal 1.x (Replaced 2.x) 16 8

9 Where next -WS Integrate with as it develops Link to higher-level schedulers Portal Integration of GSI within uportal Integrate TCP with web services 17 Acknowledgements Nathalie Furmento Jini & Asif Saleem uportal & TCP William Lee OGSA Further Information: mail: 18 9

10 The Grid Middleware Group Acknowledgements: John Darlington, Tony Field Nathalie Furmento, Stephen McGough Anthony Mayer, James Stanton Yong Xie, William Lee Marko Krznaric, Murtaza Gulamali Asif Saleem, Laurie Young Contact:

Using the VOM portal to manage policy within Globus Toolkit, Community Authorisation Service & ICENI resources

Using the VOM portal to manage policy within Globus Toolkit, Community Authorisation Service & ICENI resources Using the VOM portal to manage policy within Globus Toolkit, Community Authorisation Service & ICENI resources Asif Saleem Marko Krznarić Jeremy Cohen Steven Newhouse John Darlington London e-science Centre,

More information

Grid Computing Case Studies

Grid Computing Case Studies Grid Computing Case Studies The White Rose Grid in England GridLab & Progress at PSNC Poznan Imperial College LeSC in London Wolfgang Gentzsch, Director Grid Computing Sun Microsystems Sun's Evolutionary

More information

Using ICENI to run parameter sweep applications across multiple Grid resources

Using ICENI to run parameter sweep applications across multiple Grid resources Using ICENI to run parameter sweep applications across multiple Grid resources M. Y. Gulamali, A. S. McGough, S. J. Newhouse, and J. Darlington London e-science Centre, Imperial College London, London,

More information

Sun's Vision and Strategy for Grid Computing

Sun's Vision and Strategy for Grid Computing Sun's Vision and Strategy for Grid Computing John Barr Grid Computing Specialist 01252 421157 john.barr@sun.com Sun's Vision and Strategy for Grid Computing What does Grid mean? Sun in escience & Grid

More information

Trading Grid Services Within the UK e-science Grid

Trading Grid Services Within the UK e-science Grid Trading Grid s Within the UK e-science Grid Steven Newhouse, John Darlington, Miqdad Asaria, Anthony Mayer & William Lee London e-science Centre, Imperial College London, London, UK. email: sjn5,jd,ma299,aem3,wwhl@doc.imperial.ac.uk

More information

Technical Guide to ULGrid

Technical Guide to ULGrid Technical Guide to ULGrid Ian C. Smith Computing Services Department September 4, 2007 1 Introduction This document follows on from the User s Guide to Running Jobs on ULGrid using Condor-G [1] and gives

More information

THE CCLRC DATA PORTAL

THE CCLRC DATA PORTAL THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: g.j.drinkwater@dl.ac.uk, s.a.sufi@dl.ac.uk Abstract: The project aims

More information

e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography)

e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography) Macromolecular Research, Vol. 14, No. 2, pp 140-145 (2006) e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography)

More information

Grid Computing @ Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions

Grid Computing @ Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions Grid Computing @ Sun Carlo Nardone Technical Systems Ambassador GSO Client Solutions Phases of Grid Computing Cluster Grids Single user community Single organization Campus Grids Multiple user communities

More information

Grid Computing With FreeBSD

Grid Computing With FreeBSD Grid Computing With FreeBSD USENIX ATC '04: UseBSD SIG Boston, MA, June 29 th 2004 Brooks Davis, Craig Lee The Aerospace Corporation El Segundo, CA {brooks,lee}aero.org http://people.freebsd.org/~brooks/papers/usebsd2004/

More information

The Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland

The Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland The Lattice Project: A Multi-Model Grid Computing System Center for Bioinformatics and Computational Biology University of Maryland Parallel Computing PARALLEL COMPUTING a form of computation in which

More information

GRID COMPUTING Techniques and Applications BARRY WILKINSON

GRID COMPUTING Techniques and Applications BARRY WILKINSON GRID COMPUTING Techniques and Applications BARRY WILKINSON Contents Preface About the Author CHAPTER 1 INTRODUCTION TO GRID COMPUTING 1 1.1 Grid Computing Concept 1 1.2 History of Distributed Computing

More information

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4 Concepts and Architecture of the Grid Summary of Grid 2, Chapter 4 Concepts of Grid Mantra: Coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations Allows

More information

Living in a mixed world -Interoperability in Windows HPC Server 2008. Steven Newhouse stevenn@microsoft.com

Living in a mixed world -Interoperability in Windows HPC Server 2008. Steven Newhouse stevenn@microsoft.com Living in a mixed world -Interoperability in Windows HPC Server 2008 Steven Newhouse stevenn@microsoft.com Overview Scenarios: Mixed Environments Authentication & Authorization File Systems Application

More information

Grid Scheduling Architectures with Globus GridWay and Sun Grid Engine

Grid Scheduling Architectures with Globus GridWay and Sun Grid Engine Grid Scheduling Architectures with and Sun Grid Engine Sun Grid Engine Workshop 2007 Regensburg, Germany September 11, 2007 Ignacio Martin Llorente Javier Fontán Muiños Distributed Systems Architecture

More information

The Grid and the Network

The Grid and the Network The Grid and the Network The UK Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 1 The Grid and the Network The UK Network Infrastructure

More information

A Market-Oriented Grid Directory Service for Publication and Discovery of Grid Service Providers and their Services

A Market-Oriented Grid Directory Service for Publication and Discovery of Grid Service Providers and their Services The Journal of Supercomputing, 36, 17 31, 2006 C 2006 Springer Science + Business Media, Inc. Manufactured in The Netherlands. A Market-Oriented Grid Directory Service for Publication and Discovery of

More information

Introduction. MCSN N. Tonellotto Complements of Distributed Enabling Platforms

Introduction. MCSN N. Tonellotto Complements of Distributed Enabling Platforms Introduction 1 Distributed relating to a computer network in which at least some of the processing is done by the individual computers and information is shared by and often stored at the computers Enabling

More information

A Web Services Data Analysis Grid *

A Web Services Data Analysis Grid * A Web Services Data Analysis Grid * William A. Watson III, Ian Bird, Jie Chen, Bryan Hess, Andy Kowalski, Ying Chen Thomas Jefferson National Accelerator Facility 12000 Jefferson Av, Newport News, VA 23606,

More information

Building Grids with Jini and JavaSpaces

Building Grids with Jini and JavaSpaces Building Grids with Jini and JavaSpaces Carlo Nardone Grid Program Driver Sun Microsystems Italy 1 Agenda SOA Jini JGrid Jini Rio JavaSpaces (JXTA, JxGrid...) thanks to Z. Juhasz, Univ. of Veszprem (Hungary)

More information

Introduction to Grid Computing

Introduction to Grid Computing Introduction to Grid Computing What is the GRID? Grid Computing Technology Grid computing enables the virtualization of distributed computing and data resources such as processing, network bandwidth and

More information

Grids, e-business and e-utilities. Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk

Grids, e-business and e-utilities. Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk Grids, e-business and e-utilities Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk The Grid as an Enabler for Virtual Organisations Ian Foster, Carl Kesselman and

More information

Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware

Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware R. Goranova University of Sofia St. Kliment Ohridski,

More information

Introduction into Web Services (WS)

Introduction into Web Services (WS) (WS) Adomas Svirskas Agenda Background and the need for WS SOAP the first Internet-ready RPC Basic Web Services Advanced Web Services Case Studies The ebxml framework How do I use/develop Web Services?

More information

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen Concepts and Architecture of Grid Computing Advanced Topics Spring 2008 Prof. Robert van Engelen Overview Grid users: who are they? Concept of the Grid Challenges for the Grid Evolution of Grid systems

More information

Introduction. The Evolution of the Grid. Introduction (cont.) Grid Computing Fall 2004 Paul A. Farrell 9/2/2004

Introduction. The Evolution of the Grid. Introduction (cont.) Grid Computing Fall 2004 Paul A. Farrell 9/2/2004 The Evolution of the Grid The situation has changed Introduction David De Roure, Mark A. Baker, Nicholas R. Jennings, Nigel R. Shadbolt Grid Computing Making the Global Infrastructure a Reality Fran Berman,

More information

GEDDM - Commercial Data Mining Using Distributed Resources

GEDDM - Commercial Data Mining Using Distributed Resources GEDDM - Commercial Data Mining Using Distributed Resources Mark Prentice 1 st December 2004 Introduction Industrial partner Overview of GEDDM project Application areas Grid enabled implementation Current

More information

GRID @ Sun. Richard Croucher, Technology Director/Chief Architect Sun Microsystems Inc

GRID @ Sun. Richard Croucher, Technology Director/Chief Architect Sun Microsystems Inc GRID @ Sun Richard Croucher, Technology Director/Chief Architect Sun Microsystems Inc Agenda Why Grid Grid Computing in Sun Sun Grid Utility Evolution of Grid Computing for the Enterprise Sun Microsystems

More information

IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand

IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand PartnerWorld Developers IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand 2 Introducing the IBM Solutions Grid

More information

SUN GRID ENGINE & SGE/EE: A CLOSER LOOK

SUN GRID ENGINE & SGE/EE: A CLOSER LOOK SUN GRID ENGINE & SGE/EE: A CLOSER LOOK Carlo Nardone HPC Consultant Sun Microsystems, GSO SUN GRID ENGINE & SGE/EE: A CLOSER LOOK Agenda Sun and Grid Computing Sun Grid Engine: Architecture Campus Grid

More information

Deploying a distributed data storage system on the UK National Grid Service using federated SRB

Deploying a distributed data storage system on the UK National Grid Service using federated SRB Deploying a distributed data storage system on the UK National Grid Service using federated SRB Manandhar A.S., Kleese K., Berrisford P., Brown G.D. CCLRC e-science Center Abstract As Grid enabled applications

More information

Instruments in Grid: the New Instrument Element

Instruments in Grid: the New Instrument Element Instruments in Grid: the New Instrument Element C. Vuerli (1,2), G. Taffoni (1,2), I. Coretti (1), F. Pasian (1,2), P. Santin (1), M. Pucillo (1) (1) INAF Astronomical Observatory of Trieste (2) INAF Informative

More information

HPC and Grid Concepts

HPC and Grid Concepts HPC and Grid Concepts Divya MG (divyam@cdac.in) CDAC Knowledge Park, Bangalore 16 th Feb 2012 GBC@PRL Ahmedabad 1 Presentation Overview What is HPC Need for HPC HPC Tools Grid Concepts GARUDA Overview

More information

Classic Grid Architecture

Classic Grid Architecture Peer-to to-peer Grids Classic Grid Architecture Resources Database Database Netsolve Collaboration Composition Content Access Computing Security Middle Tier Brokers Service Providers Middle Tier becomes

More information

Cluster Grid Interconects. Tony Kay Chief Architect Enterprise Grid and Networking

Cluster Grid Interconects. Tony Kay Chief Architect Enterprise Grid and Networking Cluster Grid Interconects Tony Kay Chief Architect Enterprise Grid and Networking Agenda Cluster Grid Interconnects The Upstart - Infiniband The Empire Strikes Back - Myricom Return of the King 10G Gigabit

More information

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft. Global Grid User Support - GGUS - within the LCG & EGEE environment

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft. Global Grid User Support - GGUS - within the LCG & EGEE environment Global Grid User Support - GGUS - within the LCG & EGEE environment Abstract: For very large projects like the LHC Computing Grid Project (LCG) involving some 8,000 scientists from universities and laboratories

More information

AHE Server Deployment and Hosting Applications. Stefan Zasada University College London

AHE Server Deployment and Hosting Applications. Stefan Zasada University College London AHE Server Deployment and Hosting Applications Stefan Zasada University College London 1 AHE Server Implementation WSRF::Lite => services developed in Perl WebDAV server GridSAM => Globus grid => Sun Grid

More information

Sensor Grid: Integration of Wireless Sensor Networks and the Grid

Sensor Grid: Integration of Wireless Sensor Networks and the Grid Sensor Grid: Integration of Wireless Sensor Networks and the Grid Hock Beng Lim 1, Yong Meng Teo 1,2, Protik Mukherjee 1, Vinh The Lam 1, Weng Fai Wong 1,2, Simon See 3 1 Singapore-MIT Alliance, National

More information

Web Service Based Data Management for Grid Applications

Web Service Based Data Management for Grid Applications Web Service Based Data Management for Grid Applications T. Boehm Zuse-Institute Berlin (ZIB), Berlin, Germany Abstract Web Services play an important role in providing an interface between end user applications

More information

Rapid Prototyping of Usable Middleware

Rapid Prototyping of Usable Middleware Best Practice Project Rapid Prototyping of Usable Middleware Peter Coveney Centre for Computational Science University College London Paris, 31 March 2003 EPSRC Annual e-science Meeting, 21 April, 2005

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

CSF4:A WSRF Compliant Meta-Scheduler

CSF4:A WSRF Compliant Meta-Scheduler CSF4:A WSRF Compliant Meta-Scheduler Wei Xiaohui 1, Ding Zhaohui 1, Yuan Shutao 2, Hou Chang 1, LI Huizhen 1 (1: The College of Computer Science & Technology, Jilin University, China 2:Platform Computing,

More information

GridWay: Open Source Meta-scheduling Technology for Grid Computing

GridWay: Open Source Meta-scheduling Technology for Grid Computing : Open Source Meta-scheduling Technology for Grid Computing Ruben S. Montero dsa-research.org Open Source Grid & Cluster Oakland CA, May 2008 Contents Introduction What is? Architecture & Components Scheduling

More information

Grid Technology in Civil Engineering

Grid Technology in Civil Engineering University of Ljubljana Faculty of Civil and Geodetic Engineering, Institute of Civil Enegineering, Earthquake Engineering and Construction IT, Chair of Construction Informatics Grid Technology in Civil

More information

Grid Computing: A Ten Years Look Back. María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es

Grid Computing: A Ten Years Look Back. María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es Grid Computing: A Ten Years Look Back María S. Pérez Facultad de Informática Universidad Politécnica de Madrid mperez@fi.upm.es Outline Challenges not yet solved in computing The parents of grid Computing

More information

Resource Management and Scheduling. Mechanisms in Grid Computing

Resource Management and Scheduling. Mechanisms in Grid Computing Resource Management and Scheduling Mechanisms in Grid Computing Edgar Magaña Perdomo Universitat Politècnica de Catalunya Network Management Group Barcelona, Spain emagana@nmg.upc.edu http://nmg.upc.es/~emagana/

More information

IBM WebSphere Enterprise Service Bus, Version 6.0.1

IBM WebSphere Enterprise Service Bus, Version 6.0.1 Powering your service oriented architecture IBM WebSphere Enterprise Service Bus, Version 6.0.1 Highlights Supports a variety of messaging Requires minimal standards including JMS, Version 1.1 programming

More information

Building a Global Compute Grid Two Examples Using the Sun ONE Grid Engine and the Globus Toolkit

Building a Global Compute Grid Two Examples Using the Sun ONE Grid Engine and the Globus Toolkit Building a Global Compute Grid Two Examples Using the Sun ONE Grid Engine and the Globus Toolkit Charu Chaubal, Grid Computing Engineering Radoslaw Rafinski, Sun Microsystems, Poland Sun BluePrints OnLine

More information

An IDL for Web Services

An IDL for Web Services An IDL for Web Services Interface definitions are needed to allow clients to communicate with web services Interface definitions need to be provided as part of a more general web service description Web

More information

Solution for private cloud computing

Solution for private cloud computing The CC1 system Solution for private cloud computing 1 Outline What is CC1? Features Technical details Use cases By scientist By HEP experiment System requirements and installation How to get it? 2 What

More information

GRIP:Creating Interoperability between Grids

GRIP:Creating Interoperability between Grids GRIP:Creating Interoperability between Grids Philipp Wieder, Dietmar Erwin, Roger Menday Research Centre Jülich EuroGrid Workshop Cracow, October 29, 2003 Contents Motivation Software Base at a Glance

More information

SIMPLIFYING GRID APPLICATION PROGRAMMING USING WEB-ENABLED CODE TRANSFER TOOLS

SIMPLIFYING GRID APPLICATION PROGRAMMING USING WEB-ENABLED CODE TRANSFER TOOLS SIMPLIFYING GRID APPLICATION PROGRAMMING USING WEB-ENABLED CODE TRANSFER TOOLS Cǎtǎlin L. Dumitrescu, Jan Dünnweber, Philipp Lüdeking, Sergei Gorlatch Department of Mathematics and Computer Science, University

More information

Open DMIX - Data Integration and Exploration Services for Data Grids, Data Web and Knowledge Grid Applications

Open DMIX - Data Integration and Exploration Services for Data Grids, Data Web and Knowledge Grid Applications Open DMIX - Data Integration and Exploration Services for Data Grids, Data Web and Knowledge Grid Applications Robert L. Grossman, Yunhong Gu, Dave Hanley, Xinwei Hong and Gokulnath Rao Laboratory for

More information

Web Services and Service Oriented Architectures. Thomas Soddemann, RZG

Web Services and Service Oriented Architectures. Thomas Soddemann, RZG Web Services and Service Oriented Architectures, RZG Delaman Workshop 2004 Overview The Garching Supercomputing Center - RZG Diving into the world of Web Services Service Oriented Architectures And beyond

More information

Principles and Experiences: Building a Hybrid Metadata Service for Service Oriented Architecture based Grid Applications

Principles and Experiences: Building a Hybrid Metadata Service for Service Oriented Architecture based Grid Applications Principles and Experiences: Building a Hybrid Metadata Service for Service Oriented Architecture based Grid Applications Mehmet S. Aktas, Geoffrey C. Fox, and Marlon Pierce Abstract To link multiple varying

More information

Federated Service Oriented Architecture for Effects-Based Operations

Federated Service Oriented Architecture for Effects-Based Operations Federated Service Oriented Architecture for Effects-Based Operations Intelligence and Information Systems Matt Brown (720) 88-4014 mebrown@raytheon.com Customer Success Is Our Mission is a trademark of

More information

Developing a Computer Based Grid infrastructure

Developing a Computer Based Grid infrastructure Computational Grids: Current Trends in Performance-oriented Distributed Computing Rich Wolski Computer Science Department University of California, Santa Barbara Introduction While the rapid evolution

More information

Interacting the Edutella/JXTA Peer-to-Peer Network with Web Services

Interacting the Edutella/JXTA Peer-to-Peer Network with Web Services Interacting the Edutella/JXTA Peer-to-Peer Network with Web Services Changtao Qu Learning Lab Lower Saxony University of Hannover Expo Plaza 1, D-30539, Hannover, Germany qu @learninglab.de Wolfgang Nejdl

More information

CHAPTER 4 PROPOSED GRID NETWORK MONITORING ARCHITECTURE AND SYSTEM DESIGN

CHAPTER 4 PROPOSED GRID NETWORK MONITORING ARCHITECTURE AND SYSTEM DESIGN 39 CHAPTER 4 PROPOSED GRID NETWORK MONITORING ARCHITECTURE AND SYSTEM DESIGN This chapter discusses about the proposed Grid network monitoring architecture and details of the layered architecture. This

More information

A Web Services Data Analysis Grid *

A Web Services Data Analysis Grid * A Web Services Data Analysis Grid * William A. Watson III, Ian Bird, Jie Chen, Bryan Hess, Andy Kowalski, Ying Chen Thomas Jefferson National Accelerator Facility 12000 Jefferson Av, Newport News, VA 23606,

More information

THE EXPAND PARALLEL FILE SYSTEM A FILE SYSTEM FOR CLUSTER AND GRID COMPUTING. José Daniel García Sánchez ARCOS Group University Carlos III of Madrid

THE EXPAND PARALLEL FILE SYSTEM A FILE SYSTEM FOR CLUSTER AND GRID COMPUTING. José Daniel García Sánchez ARCOS Group University Carlos III of Madrid THE EXPAND PARALLEL FILE SYSTEM A FILE SYSTEM FOR CLUSTER AND GRID COMPUTING José Daniel García Sánchez ARCOS Group University Carlos III of Madrid Contents 2 The ARCOS Group. Expand motivation. Expand

More information

Siena Web Services. A Solution To Personal Computing With Established Desktop Programs Exploiting Web Technologies

Siena Web Services. A Solution To Personal Computing With Established Desktop Programs Exploiting Web Technologies A Solution To Personal Computing With Established Desktop Programs Exploiting Web Technologies (c) 2002 Siena Technology Ltd. UK, info@siena-tech.com : Overview Reference Potential for YOU? Requirements

More information

The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets

The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets!! Large data collections appear in many scientific domains like climate studies.!! Users and

More information

A Service for Data-Intensive Computations on Virtual Clusters

A Service for Data-Intensive Computations on Virtual Clusters A Service for Data-Intensive Computations on Virtual Clusters Executing Preservation Strategies at Scale Rainer Schmidt, Christian Sadilek, and Ross King rainer.schmidt@arcs.ac.at Planets Project Permanent

More information

A Service Platform for On-Line Games

A Service Platform for On-Line Games A Service Platform for On-Line Games Debanjan Saha Sambit Sahu Anees Shaikh Network Services and Software IBM TJ Watson Research Center Hawthorne, NY 10598 {dsaha,sambits}@us.ibm.com, aashaikh@watson.ibm.com

More information

Grid Computing & the Open Grid Services Architecture. Ian Foster Argonne National Laboratory University of Chicago Globus Project

Grid Computing & the Open Grid Services Architecture. Ian Foster Argonne National Laboratory University of Chicago Globus Project Grid Computing & the Open Grid Services Architecture Ian Foster Argonne National Laboratory University of Chicago Globus Project Open Group Grid Conference, Boston, July 21, 2003 2 Is the Grid a) A collaboration

More information

An approach to grid scheduling by using Condor-G Matchmaking mechanism

An approach to grid scheduling by using Condor-G Matchmaking mechanism An approach to grid scheduling by using Condor-G Matchmaking mechanism E. Imamagic, B. Radic, D. Dobrenic University Computing Centre, University of Zagreb, Croatia {emir.imamagic, branimir.radic, dobrisa.dobrenic}@srce.hr

More information

OGSA - A Guide to Data Access and Integration in UK

OGSA - A Guide to Data Access and Integration in UK The OGSA-DAI Project Databases and the Grid Neil Chue Hong Principal Consultant EPCC, Edinburgh N.ChueHong@epcc.ed.ac.uk What is OGSA-DAI? 4It is a project: OGSA Data Access and Integration: funded by

More information

Analisi di un servizio SRM: StoRM

Analisi di un servizio SRM: StoRM 27 November 2007 General Parallel File System (GPFS) The StoRM service Deployment configuration Authorization and ACLs Conclusions. Definition of terms Definition of terms 1/2 Distributed File System The

More information

Roberto Barbera. Centralized bookkeeping and monitoring in ALICE

Roberto Barbera. Centralized bookkeeping and monitoring in ALICE Centralized bookkeeping and monitoring in ALICE CHEP INFN 2000, GRID 10.02.2000 WP6, 24.07.2001 Roberto 1 Barbera ALICE and the GRID Phase I: AliRoot production The GRID Powered by ROOT 2 How did we get

More information

Additional Information: Alternative Locations provides a link to the National Centre for e-social Science (NCeSS)home page

Additional Information: Alternative Locations provides a link to the National Centre for e-social Science (NCeSS)home page Citation: Lloyd, Ashley and Sloan, T.M.. 2005. : Extending the INWA Grid, in.,. (ed), First International Conference on e-social Science, Jun 22 2005. Manchester, UK: ESRC National Centre for e-social

More information

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC

Agenda. HPC Software Stack. HPC Post-Processing Visualization. Case Study National Scientific Center. European HPC Benchmark Center Montpellier PSSC HPC Architecture End to End Alexandre Chauvin Agenda HPC Software Stack Visualization National Scientific Center 2 Agenda HPC Software Stack Alexandre Chauvin Typical HPC Software Stack Externes LAN Typical

More information

MPI / ClusterTools Update and Plans

MPI / ClusterTools Update and Plans HPC Technical Training Seminar July 7, 2008 October 26, 2007 2 nd HLRS Parallel Tools Workshop Sun HPC ClusterTools 7+: A Binary Distribution of Open MPI MPI / ClusterTools Update and Plans Len Wisniewski

More information

Using Resource Virtualization Techniques to Grid-enable Coupled Coastal Ocean Models

Using Resource Virtualization Techniques to Grid-enable Coupled Coastal Ocean Models Using Resource Virtualization Techniques to Grid-enable Coupled Coastal Ocean Models Renato Figueiredo Arijit Ganguly Advanced Computing and Information Systems Lab Peter Sheng, Justin Davis, Vladimir

More information

Globus Toolkit: Authentication and Credential Translation

Globus Toolkit: Authentication and Credential Translation Globus Toolkit: Authentication and Credential Translation JET Workshop, April 14, 2004 Frank Siebenlist franks@mcs.anl.gov http://www.globus.org/ Copyright (c) 2002 University of Chicago and The University

More information

Redbook Overview Patterns: SOA Design with WebSphere Message Broker and WebSphere ESB

Redbook Overview Patterns: SOA Design with WebSphere Message Broker and WebSphere ESB IBM Software for WebSphere Redbook Overview Patterns: SOA Design with WebSphere Message Broker and WebSphere ESB Presenter: Kim Clark Email: kim.clark@uk.ibm.com Date: 27/02/2007 SOA Design with WebSphere

More information

On Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments

On Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments On Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments 18. June 2013 Morris Reidel, Shahbaz Memon, et al. Outline Background Ultrascan Application Ultrascan Software Components

More information

GRID COMPUTING: A NEW DIMENSION OF THE INTERNET

GRID COMPUTING: A NEW DIMENSION OF THE INTERNET GRID COMPUTING: A NEW DIMENSION OF THE INTERNET Wolfgang Gentzsch, Director Grid Computing, Sun Microsystems, Palo Alto, USA Abstract: The Grid is a distributed computing architecture for accessing Computing,

More information

Cloud Computing. Lecture 5 Grid Case Studies 2014-2015

Cloud Computing. Lecture 5 Grid Case Studies 2014-2015 Cloud Computing Lecture 5 Grid Case Studies 2014-2015 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit Summary Grid Case Studies: Monitoring: TeraGRID

More information

Using an End-To-End Demonstration in an Undergraduate Grid Computing Course

Using an End-To-End Demonstration in an Undergraduate Grid Computing Course Using an End-To-End Demonstration in an Undergraduate Grid Computing Course Mark A. Holliday Dept. of Mathematics and Computer Science Western Carolina University Cullowhee, NC 28723 01-828-227-3951 holliday@cs.wcu.edu

More information

Using Linux Clusters as VoD Servers

Using Linux Clusters as VoD Servers HAC LUCE Using Linux Clusters as VoD Servers Víctor M. Guĺıas Fernández gulias@lfcia.org Computer Science Department University of A Corunha funded by: Outline Background: The Borg Cluster Video on Demand.

More information

Esqu Science Experiments For Computer Network

Esqu Science Experiments For Computer Network Vangelis Floros, GRNET S.A. 3 rd Open Source Software Conference March 22, 2008 NTUA, Athens Greece Introduction What is a Grid? What is escience? Large Scientific Grids The example of EGEE Building Grid

More information

Architectural Overview

Architectural Overview Architectural Overview Version 7 Part Number 817-2167-10 March 2003 A Sun ONE Application Server 7 deployment consists of a number of application server instances, an administrative server and, optionally,

More information

TUTORIAL. Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler, b.tweddell}@fz-juelich.

TUTORIAL. Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler, b.tweddell}@fz-juelich. TUTORIAL Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler, b.tweddell}@fz-juelich.de September 2006 Outline Motivation & History Production UNICORE

More information

The UK e-science Programme and the Grid. Tony Hey Director of UK e-science Core Programme Tony.Hey@epsrc.ac.uk

The UK e-science Programme and the Grid. Tony Hey Director of UK e-science Core Programme Tony.Hey@epsrc.ac.uk The UK e-science Programme and the Grid Tony Hey Director of UK e-science Core Programme Tony.Hey@epsrc.ac.uk e-science and the Grid e-science is about global collaboration in key areas of science, and

More information

GridForce: A Comprehensive Model for Improving Technical Preparedness of our Workforce for the Grid

GridForce: A Comprehensive Model for Improving Technical Preparedness of our Workforce for the Grid GridForce: A Comprehensive Model for Improving Technical Preparedness of our Workforce for the Grid Bina Ramamurthy Bina Ramamurthy CSE Department University at Buffalo (SUNY) bina@cse.buffalo.edu http://www.cse.buffalo.edu/gridforce

More information

GENERIC DATA ACCESS AND INTEGRATION SERVICE FOR DISTRIBUTED COMPUTING ENVIRONMENT

GENERIC DATA ACCESS AND INTEGRATION SERVICE FOR DISTRIBUTED COMPUTING ENVIRONMENT GENERIC DATA ACCESS AND INTEGRATION SERVICE FOR DISTRIBUTED COMPUTING ENVIRONMENT Hemant Mehta 1, Priyesh Kanungo 2 and Manohar Chandwani 3 1 School of Computer Science, Devi Ahilya University, Indore,

More information

Oracle WebLogic Foundation of Oracle Fusion Middleware. Lawrence Manickam Toyork Systems Inc www.toyork.com http://ca.linkedin.

Oracle WebLogic Foundation of Oracle Fusion Middleware. Lawrence Manickam Toyork Systems Inc www.toyork.com http://ca.linkedin. Oracle WebLogic Foundation of Oracle Fusion Middleware Lawrence Manickam Toyork Systems Inc www.toyork.com http://ca.linkedin.com/in/lawrence143 History of WebLogic WebLogic Inc started in 1995 was a company

More information

Monitoring Clusters and Grids

Monitoring Clusters and Grids JENNIFER M. SCHOPF AND BEN CLIFFORD Monitoring Clusters and Grids One of the first questions anyone asks when setting up a cluster or a Grid is, How is it running? is inquiry is usually followed by the

More information

The Managed computation Factory and Its Application to EGEE

The Managed computation Factory and Its Application to EGEE The Managed Computation and its Application to EGEE and OSG Requirements Ian Foster, Kate Keahey, Carl Kesselman, Stuart Martin, Mats Rynge, Gurmeet Singh DRAFT of June 19, 2005 Abstract An important model

More information

Cloud and Virtualization to Support Grid Infrastructures

Cloud and Virtualization to Support Grid Infrastructures ESAC GRID Workshop '08 ESAC, Villafranca del Castillo, Spain 11-12 December 2008 Cloud and Virtualization to Support Grid Infrastructures Distributed Systems Architecture Research Group Universidad Complutense

More information

Real Time Analysis of Advanced Photon Source Data

Real Time Analysis of Advanced Photon Source Data Real Time Analysis of Advanced Photon Source Data Dan Fraser (ANL) Director, Community Driven Improvement of Globus Software Brian Tieman (APS) And a host of others. ESRFUP WP11 Workshop Exploiting the

More information

Global Grid User Support - GGUS - in the LCG & EGEE environment

Global Grid User Support - GGUS - in the LCG & EGEE environment Global Grid User Support - GGUS - in the LCG & EGEE environment Torsten Antoni (torsten.antoni@iwr.fzk.de) Why Support? New support groups Network layer Resource centers CIC / GOC / etc. more to come New

More information

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing New Paradigms: Clouds, Virtualization and Co. EGEE08, Istanbul, September 25, 2008 An Introduction to Virtualization and Cloud Technologies to Support Grid Computing Distributed Systems Architecture Research

More information

Sun Grid Engine, a new scheduler for EGEE middleware

Sun Grid Engine, a new scheduler for EGEE middleware Sun Grid Engine, a new scheduler for EGEE middleware G. Borges 1, M. David 1, J. Gomes 1, J. Lopez 2, P. Rey 2, A. Simon 2, C. Fernandez 2, D. Kant 3, K. M. Sephton 4 1 Laboratório de Instrumentação em

More information

Grid, Web Services, Software Component Architectures

Grid, Web Services, Software Component Architectures BUILDING APPLICATIONS FROM A WEB SERVICE BASED COMPONENT ARCHITECTURE D. Gannon, S. Krishnan, A. Slominski, G. Kandaswamy, L. Fang Department of Computer Science Indiana University Bloomington, IN 47401

More information

Interoperability between Sun Grid Engine and the Windows Compute Cluster

Interoperability between Sun Grid Engine and the Windows Compute Cluster Interoperability between Sun Grid Engine and the Windows Compute Cluster Steven Newhouse Program Manager, Windows HPC Team steven.newhouse@microsoft.com 1 Computer Cluster Roadmap Mainstream HPC Mainstream

More information

The Current Status of the EUMETNET Programme UNIDART

The Current Status of the EUMETNET Programme UNIDART The Current Status of the EUMETNET Programme UNIDART Jürgen Seib Deutscher Wetterdienst Database Management Department e-mail: juergen.seib@dwd.de The main goal Development of a Web-based information system

More information

Using the Grid for the interactive workflow management in biomedicine. Andrea Schenone BIOLAB DIST University of Genova

Using the Grid for the interactive workflow management in biomedicine. Andrea Schenone BIOLAB DIST University of Genova Using the Grid for the interactive workflow management in biomedicine Andrea Schenone BIOLAB DIST University of Genova overview background requirements solution case study results background A multilevel

More information

Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence

Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence Emerging Technologies Shaping the Future of Data Warehouses & Business Intelligence Service Oriented Architecture SOA and Web Services John O Brien President and Executive Architect Zukeran Technologies

More information