PRACE WP4 Distributed Systems Management. Riccardo Murri, CSCS Swiss National Supercomputing Centre

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "PRACE WP4 Distributed Systems Management. Riccardo Murri, CSCS Swiss National Supercomputing Centre"

Transcription

1 PRACE WP4 Distributed Systems Management Riccardo Murri, CSCS Swiss National Supercomputing Centre

2 PRACE WP4 WP4 is the Distributed Systems Management activity User administration and accounting Distributed data management Trust between sites and security Monitoring of distributed resources Resource management and allocation Grid access Provides tools for: Consistent management of the Tier-0 systems Smooth interoperation of the PRACE infrastructure with the national, regional or institutional HPC services Seamless access for users to the PRACE infrastructure 2

3 WP4 defines the PRACE Middleware Stack To connect all PRACE systems in a coherent whole e.g., uniform interfaces for job submission and data transfer Yet allow users to take advantage of the diversity of PRACE systems Do not make all machines look equal, as they have different characteristics which can be successfully exploited by computational jobs Iterative process to define the middleware stack Second release in June, currently being deployed Work towards final release starts now! 3

4 Middleware selection HPC ecosystem integration Wide range of tools to adapt to the manifold needs of users Standards compliance a must Client software must be readily available at end-user sites Leverage DEISA experience DEISA has been running a distributed supercomputing infrastructure since several years Strong cooperation between the two projects User-centric view Assessments also based on survey and user feedback 4

5 The PRACE Infrastructure, today Six prototype systems In BSC (Spain), CEA (France), CSC (Finland), FZJ (Germany), HLRS (Germany), SARA (The Netherlands) Diversity of computational architectures Private high-speed interconnect 10Gb/s dedicated links Shared with the DEISA supercomputing federation Leverage DEISA experience and tools in running it Star topology, with hub in Frankfurt a.m. Public Internet access Through the European GÉANT R&E network 5

6 Two-tiered structure All PRACE services exposed to both the private network and the Internet Flexibility in service setup Cater for diversity in systems capabilities and site policies Inner circle on the private network Geared towards high-speed transfers and strong integration of PRACE services Outer circle on the public Internet Secures access to the PRACE services Door nodes : bastion hosts that act as a gateway to the PRACE private network 6

7 A vision for access to PRACE systems X.509-based authentication and authorization Uniform authentication for all PRACE services UNICORE, SSH, GridFTP/RFT, Provides encryption and confidentiality of all network communications Widely-adopted standard EUGridPMA/IGTF provides trust anchor Globus GSI support Single Sign-On: seamlessly mix several Grid services The Grid standard 7

8 Data movement GridFTP supported at all sites Standard for Grid high-speed data transfers Supported by all major Grid infrastructures: DEISA, EGEE, TeraGrid, OSG, GridAustralia,... Door nodes act as gateway between private and public network Command-line and graphical clients available for all major OSes Globus RFT for automated file transfer Unattended and reliable transfer of large files One server serves both the private and the public network 8

9 Job submission and control: command-line Command-line access fully supported Still the most popular way of accessing HPC systems Direct access to local batch execution and scheduling systems Exploit system-specific features SSH provides command-line access Well-known secure protocol X.509- and GSI- authentication supported Door node provides gateway between private and public network 9

10 Job submission and control: UNICORE 6 UNICORE 6 UNIform interface to COmputing REsources Both command-line and Eclipse-based rich graphical client Extensible: use the API or embed GridBeans into the rich client to create submission interfaces tailored to specific needs X.509-authentication Workflow engine Can coordinate data transfer with job execution, and stage files to the target system Several data transfer protocols supported Can be used as an alternative data transfer system, Does much more than just this! See for reference 10

11 Resource monitoring User-level testing with INCA Executes tests as an unprivileged user and reports status e.g., to verify that a certain application is available Aggregates results and reports in a color-coded web page Different views with X.509-authorization Network performance testing Iperf data Shared with DEISA Monitoring features still actively discussed and developed 11

12 User management and Accounting Centralized user management One account to access all PRACE services Compatible with the DEISA system Might merge into a single database in the future Web client for accounting/reporting X.509-authorization with different authorization levels: user, project manager, site manager Developed by DEISA and in daily production use since years 12

13 Thank you! WP4 will start working on the new release of the middleware stack shortly What features would you like to see added? What other use cases do you think should be supported on PRACE Tier-0 systems? What modifications would best support your use of the PRACE Tier-0 systems? We value your input! 13

14 References: WP4 deliverables so far D4.1.1 Requirement analysis for Tier-0 systems management D4.1.2 Report on existing Tier-0 systems management solutions D4.1.3 Deployment of initial software stack to selected sites D4.2.2 Deployment of enhanced solutions 14

Software Engineering for Distributed Data Processing Infrastructures (DCIs)

Software Engineering for Distributed Data Processing Infrastructures (DCIs) Etienne URBAH urbah@lal.in2p3.fr Oleg LODYGENSKY lodygens@lal.in2p3.fr LAL, Univ Paris-Sud, IN2P3/CNRS, Orsay, France The EDGI project receives Community research funding under grant agreement 261556 1

More information

XSEDE Service Provider Software and Services Baseline. September 24, 2015 Version 1.2

XSEDE Service Provider Software and Services Baseline. September 24, 2015 Version 1.2 XSEDE Service Provider Software and Services Baseline September 24, 2015 Version 1.2 i TABLE OF CONTENTS XSEDE Production Baseline: Service Provider Software and Services... i A. Document History... A-

More information

PRACE in building the HPC Ecosystem Kimmo Koski, CSC

PRACE in building the HPC Ecosystem Kimmo Koski, CSC PRACE in building the HPC Ecosystem Kimmo Koski, CSC 1 Petaflop computing First Steps and Achievements Production of the HPC part of the ESFRI Roadmap; Creation of a vision, involving 15 European countries

More information

PRACE hardware, software and services. David Henty, EPCC, d.henty@epcc.ed.ac.uk

PRACE hardware, software and services. David Henty, EPCC, d.henty@epcc.ed.ac.uk PRACE hardware, software and services David Henty, EPCC, d.henty@epcc.ed.ac.uk Why? Weather, Climatology, Earth Science degree of warming, scenarios for our future climate. understand and predict ocean

More information

Plateforme de Calcul pour les Sciences du Vivant. SRB & glite. V. Breton. http://clrpcsv.in2p3.fr

Plateforme de Calcul pour les Sciences du Vivant. SRB & glite. V. Breton. http://clrpcsv.in2p3.fr SRB & glite V. Breton http://clrpcsv.in2p3.fr Introduction Goal: evaluation of existing technologies for data and tools integration and deployment Data and tools integration should be addressed using web

More information

PRACE An Introduction Tim Stitt PhD. CSCS, Switzerland

PRACE An Introduction Tim Stitt PhD. CSCS, Switzerland PRACE An Introduction Tim Stitt PhD. CSCS, Switzerland High Performance Computing A Key Technology 1. Supercomputing is the tool for solving the most challenging problems through simulations; 2. Access

More information

Mitglied der Helmholtz-Gemeinschaft UNICORE. Uniform Access to JSC Resources. Michael Rambadt, unicore-info@fz-juelich.de. 20.

Mitglied der Helmholtz-Gemeinschaft UNICORE. Uniform Access to JSC Resources. Michael Rambadt, unicore-info@fz-juelich.de. 20. Mitglied der Helmholtz-Gemeinschaft UNICORE Uniform Access to JSC Resources 20. Mai 2014 Michael Rambadt, unicore-info@fz-juelich.de Outline Introduction Features UNICORE Portal UNICORE Rich Client UNICORE

More information

Anwendungsintegration und Workflows mit UNICORE 6

Anwendungsintegration und Workflows mit UNICORE 6 Mitglied der Helmholtz-Gemeinschaft Anwendungsintegration und Workflows mit UNICORE 6 Bernd Schuller und UNICORE-Team Jülich Supercomputing Centre, Forschungszentrum Jülich GmbH 26. November 2009 D-Grid

More information

The GridWay Meta-Scheduler

The GridWay Meta-Scheduler The GridWay Meta-Scheduler Committers Ignacio M. Llorente Ruben S. Montero Eduardo Huedo Contributors Tino Vazquez Jose Luis Vazquez Javier Fontan Jose Herrera 1 Goals of the Project Goals of the Project

More information

HPC Cloud Computing with OpenNebula

HPC Cloud Computing with OpenNebula High Performance Cloud Computing Day BiG Grid - SARA Amsterdam, The Netherland, October 4th, 2011 HPC Cloud Computing with OpenNebula Ignacio M. Llorente Project Director Acknowledgments The research leading

More information

supercomputing. simplified.

supercomputing. simplified. supercomputing. simplified. INTRODUCING WINDOWS HPC SERVER 2008 R2 SUITE Windows HPC Server 2008 R2, Microsoft s third-generation HPC solution, provides a comprehensive and costeffective solution for harnessing

More information

The Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland

The Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland The Lattice Project: A Multi-Model Grid Computing System Center for Bioinformatics and Computational Biology University of Maryland Parallel Computing PARALLEL COMPUTING a form of computation in which

More information

EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling

EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling EUFORIA: Grid and High Performance Computing at the Service of Fusion Modelling Miguel Cárdenas-Montes on behalf of Euforia collaboration Ibergrid 2008 May 12 th 2008 Porto Outline Project Objectives Members

More information

A Data Management System for UNICORE 6. Tobias Schlauch, German Aerospace Center UNICORE Summit 2009, August 25th, 2009, Delft, The Netherlands

A Data Management System for UNICORE 6. Tobias Schlauch, German Aerospace Center UNICORE Summit 2009, August 25th, 2009, Delft, The Netherlands A Data Management System for UNICORE 6 Tobias Schlauch, German Aerospace Center UNICORE Summit 2009, August 25th, 2009, Delft, The Netherlands Outline Objectives Concept Implementation Overview Test Scenario

More information

Big Data and Cloud Computing for GHRSST

Big Data and Cloud Computing for GHRSST Big Data and Cloud Computing for GHRSST Jean-Francois Piollé (jfpiolle@ifremer.fr) Frédéric Paul, Olivier Archer CERSAT / Institut Français de Recherche pour l Exploitation de la Mer Facing data deluge

More information

Cloud Computing. Lecture 5 Grid Case Studies 2014-2015

Cloud Computing. Lecture 5 Grid Case Studies 2014-2015 Cloud Computing Lecture 5 Grid Case Studies 2014-2015 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit Summary Grid Case Studies: Monitoring: TeraGRID

More information

Cluster, Grid, Cloud Concepts

Cluster, Grid, Cloud Concepts Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of

More information

TUTORIAL. Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler, b.tweddell}@fz-juelich.

TUTORIAL. Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler, b.tweddell}@fz-juelich. TUTORIAL Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler, b.tweddell}@fz-juelich.de September 2006 Outline Motivation & History Production UNICORE

More information

Alternative Deployment Models for Cloud Computing in HPC Applications. Society of HPC Professionals November 9, 2011 Steve Hebert, Nimbix

Alternative Deployment Models for Cloud Computing in HPC Applications. Society of HPC Professionals November 9, 2011 Steve Hebert, Nimbix Alternative Deployment Models for Cloud Computing in HPC Applications Society of HPC Professionals November 9, 2011 Steve Hebert, Nimbix The case for Cloud in HPC Build it in house Assemble in the cloud?

More information

LSKA 2010 Survey Report Job Scheduler

LSKA 2010 Survey Report Job Scheduler LSKA 2010 Survey Report Job Scheduler Graduate Institute of Communication Engineering {r98942067, r98942112}@ntu.edu.tw March 31, 2010 1. Motivation Recently, the computing becomes much more complex. However,

More information

On-Demand Supercomputing Multiplies the Possibilities

On-Demand Supercomputing Multiplies the Possibilities Microsoft Windows Compute Cluster Server 2003 Partner Solution Brief Image courtesy of Wolfram Research, Inc. On-Demand Supercomputing Multiplies the Possibilities Microsoft Windows Compute Cluster Server

More information

Manjrasoft Market Oriented Cloud Computing Platform

Manjrasoft Market Oriented Cloud Computing Platform Manjrasoft Market Oriented Cloud Computing Platform Aneka Aneka is a market oriented Cloud development and management platform with rapid application development and workload distribution capabilities.

More information

Grids Computing and Collaboration

Grids Computing and Collaboration Grids Computing and Collaboration Arto Teräs CSC, the Finnish IT center for science University of Pune, India, March 12 th 2007 Grids Computing and Collaboration / Arto Teräs 2007-03-12 Slide

More information

Oracle E-Business Suite Adapter. Integration Methodology

Oracle E-Business Suite Adapter. Integration Methodology Oracle E-Business Suite Adapter Integration Methodology Author Neeraj Chauhan (Manager Product Management, Oracle E-Business Suite, ATG) Page 1 of 13 Table of Content Introduction... 3 Overview... 4 Why

More information

Manjrasoft Market Oriented Cloud Computing Platform

Manjrasoft Market Oriented Cloud Computing Platform Manjrasoft Market Oriented Cloud Computing Platform Innovative Solutions for 3D Rendering Aneka is a market oriented Cloud development and management platform with rapid application development and workload

More information

Inca User-level Grid Monitoring

Inca User-level Grid Monitoring Inca User-level Grid Monitoring Shava Smallen ssmallen@sdsc.edu SC 09 November 17, 2009 Goal: reliable grid software and services for users Over 750 TF Over 30 PB of online and archival data storage Connected

More information

SCI-BUS gateways for grid and cloud infrastructures

SCI-BUS gateways for grid and cloud infrastructures SCI-BUS gateways for grid and cloud infrastructures Tamas Kiss University of Westminster Peter Kacsuk, Zoltan Farkas MTA SZTAKI VERCE project meeting 1 st February 2013, Edinburgh SCI-BUS is supported

More information

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed

Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Enabling Large-Scale Testing of IaaS Cloud Platforms on the Grid 5000 Testbed Sébastien Badia, Alexandra Carpen-Amarie, Adrien Lèbre, Lucas Nussbaum Grid 5000 S. Badia, A. Carpen-Amarie, A. Lèbre, L. Nussbaum

More information

Sage Integration Cloud Technology Whitepaper

Sage Integration Cloud Technology Whitepaper Sage Integration Cloud Technology Whitepaper Sage Christian Rubach July 21, 2016 Abstract Sage is committed to providing businesses around the world the information, insight and tools they need to succeed.

More information

Orbiter Series Service Oriented Architecture Applications

Orbiter Series Service Oriented Architecture Applications Workshop on Science Agency Uses of Clouds and Grids Orbiter Series Service Oriented Architecture Applications Orbiter Project Overview Mark L. Green mlgreen@txcorp.com Tech-X Corporation, Buffalo Office

More information

GRID COMPUTING Techniques and Applications BARRY WILKINSON

GRID COMPUTING Techniques and Applications BARRY WILKINSON GRID COMPUTING Techniques and Applications BARRY WILKINSON Contents Preface About the Author CHAPTER 1 INTRODUCTION TO GRID COMPUTING 1 1.1 Grid Computing Concept 1 1.2 History of Distributed Computing

More information

Windows Compute Cluster Server 2003. Miron Krokhmal CTO

Windows Compute Cluster Server 2003. Miron Krokhmal CTO Windows Compute Cluster Server 2003 Miron Krokhmal CTO Agenda The Windows compute cluster architecture o Hardware and software requirements o Supported network topologies o Deployment strategies, including

More information

E U F O R I A D S A 3. 1

E U F O R I A D S A 3. 1 aidentifier: Date: Activity: Authors: Status: Link: 01-12-2009 SA3 Adrian Jackson Deliverable No link E U F O R I A D S A 3. 1 M A I N T E N A N C E, R U N N I N G, A N D Q U E R Y A N S W E R I N G F

More information

Inca User-level Grid Monitoring

Inca User-level Grid Monitoring Inca User-level Grid Monitoring Shava Smallen ssmallen@sdsc.edu SC 08 November 19, 2008 Goal: reliable grid software and services for users Over 750 TF Over 30 PB of online and archival data storage Connected

More information

WHITE PAPER The Evolution of Job Scheduling: CA's Approach to Workload Automation

WHITE PAPER The Evolution of Job Scheduling: CA's Approach to Workload Automation WHITE PAPER The Evolution of Job Scheduling: CA's Approach to Workload Automation Sponsored by: CA Tim Grieser November 2007 IN THIS WHITE PAPER Global Headquarters: 5 Speen Street Framingham, MA 01701

More information

Real Time Analysis of Advanced Photon Source Data

Real Time Analysis of Advanced Photon Source Data Real Time Analysis of Advanced Photon Source Data Dan Fraser (ANL) Director, Community Driven Improvement of Globus Software Brian Tieman (APS) And a host of others. ESRFUP WP11 Workshop Exploiting the

More information

Service Oriented Distributed Manager for Grid System

Service Oriented Distributed Manager for Grid System Service Oriented Distributed Manager for Grid System Entisar S. Alkayal Faculty of Computing and Information Technology King Abdul Aziz University Jeddah, Saudi Arabia entisar_alkayal@hotmail.com Abstract

More information

OPEN DATA CENTER ALLIANCE Usage Model: Guide to Interoperability Across Clouds

OPEN DATA CENTER ALLIANCE Usage Model: Guide to Interoperability Across Clouds sm OPEN DATA CENTER ALLIANCE Usage Model: Guide to Interoperability Across Clouds SM Table of Contents Legal Notice... 3 Executive Summary... 4 Purpose... 5 Overview... 5 Interoperability... 6 Service

More information

A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources

A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources Davide Salomoni 1, Daniele Andreotti 1, Luca Cestari 2, Guido Potena 2, Peter Solagna 3 1 INFN-CNAF, Bologna, Italy 2 University

More information

Deploying Multiscale Applications on European e-infrastructures

Deploying Multiscale Applications on European e-infrastructures Deploying Multiscale Applications on European e-infrastructures 04/06/2013 Ilya Saverchenko The MAPPER project receives funding from the EC's Seventh Framework Programme (FP7/2007-2013) under grant agreement

More information

Sustainable Grid User Support

Sustainable Grid User Support Sustainable Grid User Support Dr. Torsten Antoni torsten.antoni@kit.edu www.eu-egee.org EGEE and glite are registered trademarks User education User support is Simple access to a broad range of information

More information

INDIGO DataCloud. Technical Overview RIA-653549. Giacinto.Donvito@ba.infn.it. INFN-Bari

INDIGO DataCloud. Technical Overview RIA-653549. Giacinto.Donvito@ba.infn.it. INFN-Bari INDIGO DataCloud Technical Overview RIA-653549 Giacinto.Donvito@ba.infn.it INFN-Bari Agenda Gap analysis Goals Architecture WPs activities Conclusions 2 Gap Analysis Support federated identities and provide

More information

GRMS - The resource management system for Clusterix computational environment

GRMS - The resource management system for Clusterix computational environment GRMS - The resource management system for Clusterix computational environment Bogdan Ludwiczak bogdanl@man.poznan.pl Poznań Supercomputing and Networking Center Outline: GRMS - what it is? GRMS features

More information

Experiences with the GLUE information schema in the LCG/EGEE production Grid

Experiences with the GLUE information schema in the LCG/EGEE production Grid Experiences with the GLUE information schema in the LCG/EGEE production Grid Stephen Burke, Sergio Andreozzi and Laurence Field CHEP07, Victoria, Canada www.eu-egee.org EGEE and glite are registered trademarks

More information

Xgrid. The simple solution for distributed computing. Features

Xgrid. The simple solution for distributed computing. Features Xgrid The simple solution for distributed computing. Features Comes built into both Mac OS X and Mac OS X Server Lets you harness the underutilized power of your own workgroup s Mac computers or volunteered

More information

The Virtual Grid Application Development Software (VGrADS) Project

The Virtual Grid Application Development Software (VGrADS) Project The Virtual Grid Application Development Software (VGrADS) Project VGrADS: Enabling e-science Workflows on Grids and Clouds with Fault Tolerance http://vgrads.rice.edu/ VGrADS Goal: Distributed Problem

More information

The Current Status of the EUMETNET Programme UNIDART

The Current Status of the EUMETNET Programme UNIDART The Current Status of the EUMETNET Programme UNIDART Jürgen Seib Deutscher Wetterdienst Database Management Department e-mail: juergen.seib@dwd.de The main goal Development of a Web-based information system

More information

Deploying Business Virtual Appliances on Open Source Cloud Computing

Deploying Business Virtual Appliances on Open Source Cloud Computing International Journal of Computer Science and Telecommunications [Volume 3, Issue 4, April 2012] 26 ISSN 2047-3338 Deploying Business Virtual Appliances on Open Source Cloud Computing Tran Van Lang 1 and

More information

SEERA-EI. Introduction to Cloud Computing. www.seera-ei.eu. SEERA-EI training, 13 April 2011. Aneta Karaivanova, IICT-BAS, Bulgaria

SEERA-EI. Introduction to Cloud Computing. www.seera-ei.eu. SEERA-EI training, 13 April 2011. Aneta Karaivanova, IICT-BAS, Bulgaria SEERA-EI Introduction to Cloud Computing www.seera-ei.eu SEERA-EI training, 13 April 2011 Aneta Karaivanova, IICT-BAS, Bulgaria The pan-eu e-infrastructures vision The Research Network infrastructure provides

More information

The GRID and the Linux Farm at the RCF

The GRID and the Linux Farm at the RCF The GRID and the Linux Farm at the RCF A. Chan, R. Hogue, C. Hollowell, O. Rind, J. Smith, T. Throwe, T. Wlodek, D. Yu Brookhaven National Laboratory, NY 11973, USA The emergence of the GRID architecture

More information

Helping Customers Move Workloads into the Cloud. A Guide for Providers of vcloud Powered Services

Helping Customers Move Workloads into the Cloud. A Guide for Providers of vcloud Powered Services Helping Customers Move Workloads into the Cloud A Guide for Providers of vcloud Powered Services Technical WHITE PAPER Table of Contents Introduction.... 3 About VMware vcloud Connector.... 3 Use Cases....

More information

Seed4C: A Cloud Security Infrastructure validated on Grid 5000

Seed4C: A Cloud Security Infrastructure validated on Grid 5000 Seed4C: A Cloud Security Infrastructure validated on Grid 5000 E. Caron 1, A. Lefray 1, B. Marquet 2, and J. Rouzaud-Cornabas 1 1 Université de Lyon. LIP Laboratory. UMR CNRS - ENS Lyon - INRIA - UCBL

More information

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4 Concepts and Architecture of the Grid Summary of Grid 2, Chapter 4 Concepts of Grid Mantra: Coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations Allows

More information

Future Developments in UniGrids and NextGRID

Future Developments in UniGrids and NextGRID Future Developments in UniGrids and NextGRID Dr. David Snelling Fujitsu Laboratories of Europe Unicore Summit Nice, France - October 2005 Overview Status Report New Gateway Architecture Parallel HTTP based

More information

WIND RIVER INTELLIGENT DEVICE PLATFORM XT

WIND RIVER INTELLIGENT DEVICE PLATFORM XT WIND RIVER INTELLIGENT DEVICE PLATFORM XT The Foundation for Building Devices That Connect to the Internet of Things The opportunities presented by the burgeoning Internet of Things (IoT) may be new, but

More information

Overview of the EU Data Grid Project

Overview of the EU Data Grid Project DataGrid is a project funded by the European Union Grid Tutorial 8/10/2003 n 1 Overview of the EU Data Grid Project The European DataGrid Project Team http://www.eu-datagrid.org The EU DataGrid (EDG) Project

More information

Managing Complexity in Distributed Data Life Cycles Enhancing Scientific Discovery

Managing Complexity in Distributed Data Life Cycles Enhancing Scientific Discovery Center for Information Services and High Performance Computing (ZIH) Managing Complexity in Distributed Data Life Cycles Enhancing Scientific Discovery Richard Grunzke*, Jens Krüger, Sandra Gesing, Sonja

More information

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing New Paradigms: Clouds, Virtualization and Co. EGEE08, Istanbul, September 25, 2008 An Introduction to Virtualization and Cloud Technologies to Support Grid Computing Distributed Systems Architecture Research

More information

Windows IB. Introduction to Windows 2003 Compute Cluster Edition. Eric Lantz Microsoft elantz@microsoft.com

Windows IB. Introduction to Windows 2003 Compute Cluster Edition. Eric Lantz Microsoft elantz@microsoft.com Datacenter Fabric Workshop Windows IB Introduction to Windows 2003 Compute Cluster Edition Eric Lantz Microsoft elantz@microsoft.com August 22, 2005 What this talk is not about High Availability, Fail-over

More information

Seed4C: A High-security project for Cloud Infrastructure

Seed4C: A High-security project for Cloud Infrastructure Seed4C: A High-security project for Cloud Infrastructure J. Rouzaud-Cornabas (LIP/CC-IN2P3 CNRS) & E. Caron (LIP ENS-Lyon) November 30, 2012 J. Rouzaud-Cornabas (LIP/CC-IN2P3 CNRS) & E. Seed4C: Caron (LIP

More information

THE EUCALYPTUS OPEN-SOURCE PRIVATE CLOUD

THE EUCALYPTUS OPEN-SOURCE PRIVATE CLOUD THE EUCALYPTUS OPEN-SOURCE PRIVATE CLOUD By Yohan Wadia ucalyptus is a Linux-based opensource software architecture that implements efficiencyenhancing private and hybrid clouds within an enterprise s

More information

CAREER TRACKS PHASE 1 UCSD Information Technology Family Function and Job Function Summary

CAREER TRACKS PHASE 1 UCSD Information Technology Family Function and Job Function Summary UCSD Applications Programming Involved in the development of server / OS / desktop / mobile applications and services including researching, designing, developing specifications for designing, writing,

More information

PanDA. A New Paradigm for Computing in HEP. Through the Lens of ATLAS and Other Experiments. Kaushik De

PanDA. A New Paradigm for Computing in HEP. Through the Lens of ATLAS and Other Experiments. Kaushik De PanDA A New Paradigm for Computing in HEP Through the Lens of ATLAS and Other Experiments Univ. of Texas at Arlington On behalf of the ATLAS Collaboration ICHEP 2014, Valencia Computing Challenges at the

More information

CMS Dashboard of Grid Activity

CMS Dashboard of Grid Activity Enabling Grids for E-sciencE CMS Dashboard of Grid Activity Julia Andreeva, Juha Herrala, CERN LCG ARDA Project, EGEE NA4 EGEE User Forum Geneva, Switzerland March 1-3, 2006 http://arda.cern.ch ARDA and

More information

Data Lab Operations Concepts

Data Lab Operations Concepts Data Lab Operations Concepts 1 Introduction This talk will provide an overview of Data Lab components to be implemented Core infrastructure User applications Science Capabilities User Interfaces The scope

More information

AN IMPLEMENTATION OF E- LEARNING SYSTEM IN PRIVATE CLOUD

AN IMPLEMENTATION OF E- LEARNING SYSTEM IN PRIVATE CLOUD AN IMPLEMENTATION OF E- LEARNING SYSTEM IN PRIVATE CLOUD M. Lawanya Shri 1, Dr. S. Subha 2 1 Assistant Professor,School of Information Technology and Engineering, Vellore Institute of Technology, Vellore-632014

More information

FIWARE Lab Solution for Managing Resources & Services in a Cloud Federation

FIWARE Lab Solution for Managing Resources & Services in a Cloud Federation FIWARE Lab Solution for Managing Resources & Services in a Cloud Federation Yahya Al-Hazmi Technische Universität Berlin yahya.al-hazmi@tu-berlin.de XIFI Webinar GoToWebinar February 23, 2015, 11-12 AM

More information

Testing Intelligent Device Communications in a Distributed System

Testing Intelligent Device Communications in a Distributed System Testing Intelligent Device Communications in a Distributed System David Goughnour (Triangle MicroWorks), Joe Stevens (Triangle MicroWorks) dgoughnour@trianglemicroworks.com United States Smart Grid systems

More information

Corporate Bill Analyzer

Corporate Bill Analyzer Corporate Bill Analyzer Product Description V 3.1 Contents Contents Introduction Platform Overview Core features Bill/Invoice presentment Corporate hierarchy support Billing Account hierarchy support Call

More information

Biorepository and Biobanking

Biorepository and Biobanking Biorepository and Biobanking LabWare s solution for biorepositories and biobanks combines powerful specimen tracking and logistics capabilities with specimen processing and workflow management features.

More information

A Cloud-Based Collaborative Virtual Environment

A Cloud-Based Collaborative Virtual Environment A Cloud-Based Collaborative Virtual Environment 1 Problem statement Recent years have witnessed a huge spread of information, with an increased expectation to stay connected at all times. This is also

More information

- from Clusters and Grids to Cloud computing

- from Clusters and Grids to Cloud computing Lecture - 1 Moving Ahead - from Clusters and Grids to Cloud computing Salman Toor salman.toor@it.uu.se Basic questions Why Cloud computing? What are the previous technologies? What was missing in the previous

More information

GRID Computing and Networks

GRID Computing and Networks A Member of the ExperTeam Group GRID Computing and Networks Karl Solchenbach Global IPv6 Summit Madrid, May 14, 2003 Pallas GmbH Hermülheimer Straße 10 D-50321 Brühl, Germany info@pallas.de http://www.pallas.com

More information

An Implementation of Active Data Technology

An Implementation of Active Data Technology White Paper by: Mario Morfin, PhD Terri Chu, MEng Stephen Chen, PhD Robby Burko, PhD Riad Hartani, PhD An Implementation of Active Data Technology October 2015 In this paper, we build the rationale for

More information

SuccessFactors Employee Central: Cloud Core HR Introduction, Overview, and Roadmap Update Joachim Foerderer, SAP AG

SuccessFactors Employee Central: Cloud Core HR Introduction, Overview, and Roadmap Update Joachim Foerderer, SAP AG Orange County Convention Center Orlando, Florida June 3-5, 2014 SuccessFactors Employee Central: Cloud Core HR Introduction, Overview, and Roadmap Update Joachim Foerderer, SAP AG SESSION CODE: 1812 Cloud

More information

Solutions for Quality Management in a Agile and Mobile World

Solutions for Quality Management in a Agile and Mobile World Solutions for Quality Management in a Agile and Mobile World with IBM Rational Quality Management Solutions Realities can stall software-driven innovation Complexities in software delivery compounded by

More information

Sistemi Operativi e Reti. Cloud Computing

Sistemi Operativi e Reti. Cloud Computing 1 Sistemi Operativi e Reti Cloud Computing Facoltà di Scienze Matematiche Fisiche e Naturali Corso di Laurea Magistrale in Informatica Osvaldo Gervasi ogervasi@computer.org 2 Introduction Technologies

More information

Using DeployR to Solve the R Integration Problem

Using DeployR to Solve the R Integration Problem DEPLOYR WHITE PAPER Using DeployR to olve the R Integration Problem By the Revolution Analytics DeployR Team March 2015 Introduction Organizations use analytics to empower decision making, often in real

More information

Session: What to do with the data?

Session: What to do with the data? Session: What to do with the data? Proceedings Paper Prepared for: Business s Management Association 2006 Symposium Presented By Microsoft & Avanade Session 43 Proceedings Paper 2 Introduction For several

More information

Monitoring, Managing and Supporting Enterprise Clouds with Oracle Enterprise Manager 12c Name, Title Oracle

Monitoring, Managing and Supporting Enterprise Clouds with Oracle Enterprise Manager 12c Name, Title Oracle Monitoring, Managing and Supporting Enterprise Clouds with Oracle Enterprise Manager 12c Name, Title Oracle Complete Cloud Lifecycle Management Optimize Plan Meter & Charge Manage Applications and Business

More information

File transfer in UNICORE State of the art

File transfer in UNICORE State of the art Mitglied der Helmholtz-Gemeinschaft File transfer in UNICORE State of the art Bernd Schuller, Björn Hagemeier, Michael Rambadt Federated Systems and Data division Jülich Supercomputer Centre Forschungszentrum

More information

EXECUTIVE SUMMARY. - Where is it? - Is it here? - What is its condition? - What is its status? - Where in my network is it?

EXECUTIVE SUMMARY. - Where is it? - Is it here? - What is its condition? - What is its status? - Where in my network is it? EXECUTIVE SUMMARY Integrating the Cisco Context Aware Mobility solution with unified communication applications such as presence and instant messaging can greatly enhance the level of business productivity

More information

System Development and Life-Cycle Management (SDLCM) Methodology

System Development and Life-Cycle Management (SDLCM) Methodology System Development and Life-Cycle Management (SDLCM) Methodology Subject Type Standard Approval CISSCO Program Director A. PURPOSE This standard specifies the format and conventions to be used in developing

More information

Automated deployment of virtualization-based research models of distributed computer systems

Automated deployment of virtualization-based research models of distributed computer systems Automated deployment of virtualization-based research models of distributed computer systems Andrey Zenzinov Mechanics and mathematics department, Moscow State University Institute of mechanics, Moscow

More information

University of Messina, Italy

University of Messina, Italy University of Messina, Italy IEEE MoCS 2011 Kerkyra - Greece June 28, 2011 Dr. Massimo Villari mvillari@unime.it Cross Cloud Federation Federated Cloud Scenario Cloud Middleware Model: the Stack The CLEVER

More information

Pragmatic Integration of Cloud and Grid Computing Infrastructures

Pragmatic Integration of Cloud and Grid Computing Infrastructures 2012 IEEE Fifth International Conference on Cloud Computing Pragmatic Integration of Cloud and Grid Computing Infrastructures Thomas Rings, Jens Grabowski Institute of Computer Science, University of Göttingen

More information

Grid Scheduling Dictionary of Terms and Keywords

Grid Scheduling Dictionary of Terms and Keywords Grid Scheduling Dictionary Working Group M. Roehrig, Sandia National Laboratories W. Ziegler, Fraunhofer-Institute for Algorithms and Scientific Computing Document: Category: Informational June 2002 Status

More information

Data Management. Network transfers

Data Management. Network transfers Data Management Network transfers Network data transfers Not everyone needs to transfer large amounts of data on and off a HPC service Sometimes data is created and consumed on the same service. If you

More information

SEVENTH FRAMEWORK PROGRAMME

SEVENTH FRAMEWORK PROGRAMME Publishable summary The 4CaaSt research project is creating an advanced Platform as a Service (PaaS). This cloud platform supports the optimized and elastic hosting of internet-scale multi-tier applications.

More information

A Uniform Job Monitoring Service in Multiple Job Universes

A Uniform Job Monitoring Service in Multiple Job Universes A Uniform Job Monitoring Service in Multiple Job Universes Aleš Křenek, Miroslav Ruda CESNET, EGEE JRA1 www.eu-egee.org Information Society Grid Monitoring Workshop, June 25, 2007 1 Outline Logging and

More information

Grid Computing With FreeBSD

Grid Computing With FreeBSD Grid Computing With FreeBSD USENIX ATC '04: UseBSD SIG Boston, MA, June 29 th 2004 Brooks Davis, Craig Lee The Aerospace Corporation El Segundo, CA {brooks,lee}aero.org http://people.freebsd.org/~brooks/papers/usebsd2004/

More information

Scyld Cloud Manager User Guide

Scyld Cloud Manager User Guide Scyld Cloud Manager User Guide Preface This guide describes how to use the Scyld Cloud Manager (SCM) web portal application. Contacting Penguin Computing 45800 Northport Loop West Fremont, CA 94538 1-888-PENGUIN

More information

Alexander Papaspyrou Technische Universität Dortmund (TUDO) Dortmund, Germany IGE Dissemination Manager

Alexander Papaspyrou Technische Universität Dortmund (TUDO) Dortmund, Germany IGE Dissemination Manager Alexander Papaspyrou Technische Universität Dortmund (TUDO) Dortmund, Germany IGE Dissemination Manager Geneva, April 8 th, 2010 1 Overview The European Grid Ecosystem Initiative for Globus in Europe (IGE)

More information

Aneka: A Software Platform for.net-based Cloud Computing

Aneka: A Software Platform for.net-based Cloud Computing Aneka: A Software Platform for.net-based Cloud Computing Christian VECCHIOLA a, Xingchen CHU a,b, and Rajkumar BUYYA a,b,1 a Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer

More information

Cloudy Middleware MARK LITTLE <MLITTLE@REDHAT.COM> TOBIAS KUNZE <TKUNZE@REDHAT.COM>

Cloudy Middleware MARK LITTLE <MLITTLE@REDHAT.COM> TOBIAS KUNZE <TKUNZE@REDHAT.COM> Cloudy Middleware MARK LITTLE TOBIAS KUNZE About Mark Little Sr Director of Engineering, Red Hat Tobias Kunze PaaS Architect, Red Hat CTO/Co-founder of Makara 2

More information

Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems

Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems Building the Internet of Things Jim Green - CTO, Data & Analytics Business Group, Cisco Systems Brian McCarson Sr. Principal Engineer & Sr. System Architect, Internet of Things Group, Intel Corp Mac Devine

More information

The Lattice Project. A Computational Grid System. Presented by Adam Bazinet

The Lattice Project. A Computational Grid System. Presented by Adam Bazinet The Lattice Project A Computational Grid System Presented by Adam Bazinet What It Is The Lattice Project is an attempt to effectively share computational resources among departments and institutions, starting

More information

Deliverables and Milestones Tables

Deliverables and Milestones Tables Deliverables and Milestones Tables The following tables list the deliverables and milestones for the project as originally listed in the DoW. The deliverables are split into two sections: completed and

More information

VMware vsphere Data Protection 6.1

VMware vsphere Data Protection 6.1 VMware vsphere Data Protection 6.1 Technical Overview Revised August 10, 2015 Contents Introduction... 3 Architecture... 3 Deployment and Configuration... 5 Backup... 6 Application Backup... 6 Backup Data

More information

Grid Computing Perspectives for IBM

Grid Computing Perspectives for IBM Grid Computing Perspectives for IBM Atelier Internet et Grilles de Calcul en Afrique Jean-Pierre Prost IBM France jpprost@fr.ibm.com Agenda Grid Computing Initiatives within IBM World Community Grid Decrypthon

More information