Interoperability in Grid Computing



Similar documents
Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware

THE CCLRC DATA PORTAL

An approach to grid scheduling by using Condor-G Matchmaking mechanism

Direct Issuance of Proxy Certificate on P-GRADE Grid Portal Without Using MyProxy

IGI Portal architecture and interaction with a CA- online

Esqu Science Experiments For Computer Network

Grid Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions

Grid Computing With FreeBSD

P ERFORMANCE M ONITORING AND A NALYSIS S ERVICES - S TABLE S OFTWARE

Using the Grid for the interactive workflow management in biomedicine. Andrea Schenone BIOLAB DIST University of Genova

SCI-BUS gateways for grid and cloud infrastructures

GRID COMPUTING Techniques and Applications BARRY WILKINSON

GRIP:Creating Interoperability between Grids

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4

Status and Integration of AP2 Monitoring and Online Steering

Science Days Stefan Freitag. 03. November Robotics Research Institute Dortmund University of Technology. Cloud Computing in D-Grid

Grid Scheduling Architectures with Globus GridWay and Sun Grid Engine

Towards a Comprehensive Accounting Solution in the Multi-Middleware Environment of the D-Grid Initiative

GridICE: monitoring the user/application activities on the grid

AAA for IMOS: Australian Access Federation & related components

The GISELA Science Gateway

GridWay: Open Source Meta-scheduling Technology for Grid Computing

Connecting Communities on the Meta-Scheduling Level: The DGSI Approach!

Grid Computing vs Cloud

SEE-GRID-SCI. SEE-GRID-SCI USER FORUM 2009 Turkey, Istanbul December, 2009

e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography)

Grid Engine. The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How)

XSEDE Service Provider Software and Services Baseline. September 24, 2015 Version 1.2

HPC and Grid Concepts

TUTORIAL. Rebecca Breu, Bastian Demuth, André Giesler, Bastian Tweddell (FZ Jülich) {r.breu, b.demuth, a.giesler,

Plateforme de Calcul pour les Sciences du Vivant. SRB & glite. V. Breton.

Cloud Computing. Lecture 5 Grid Case Studies

Experiences with the GLUE information schema in the LCG/EGEE production Grid

Bibliography. University of Applied Sciences Fulda, Prof. Dr. S. Groß

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen

Architectural Overview of the SmartLM Innovative License Management System. SmartLM Whitepaper

Authorization Strategies for Virtualized Environments in Grid Computing Systems

The EDGeS project receives Community research funding

Grids Computing and Collaboration

PROGRESS Portal Access Whitepaper

Globus Toolkit: Authentication and Credential Translation

A Federated Authorization and Authentication Infrastructure for Unified Single Sign On

Cluster, Grid, Cloud Concepts

A Market-based Framework for Trading Grid Resources

Applications des grilles aux sciences du vivant

The GENIUS Grid Portal

Fighting Cancer with the (help of) Grid. Jarek Nabrzyski, PSNC

Core Feature Comparison between. XML / SOA Gateways. and. Web Application Firewalls. Jason Macy jmacy@forumsys.com CTO, Forum Systems

Telematikplattform für Medizinische Forschungsnetze (TMF) e.v. Berlin / GERMANY

multiple geographically apart resource aggregation collaboration between remote working groups and developing teams

Annette Pollex-Krüger, Johannes Drepper, Sebastian C. Semler. Telematikplattform für Medizinische Forschungsnetze (TMF) e.v.

Managing the Data Center Using the JBoss Enterprise SOA Platform

The ENEA-EGEE site: Access to non-standard platforms

Grids, e-business and e-utilities. Tony Hey Director of the UK e-science Core Programme EPSRC and DTI

Internet of Things. Reply Platform

The glite File Transfer Service

See-GRID Project and Business Model

For large geographically dispersed companies, data grids offer an ingenious new model to economically share computing power and storage resources

Title: A Client Middleware for Token-Based Unified Single Sign On to edugain

The Italian Grid Infrastructure (IGI) CGW08 Cracow. Mirco Mazzucato Italian Grid Infrastructure Coordinator INFN CNAF Director

Enabling Collaboration Using the Biomedical Informatics Research Network (BIRN):

Abstract. 1. Introduction. Ohio State University Columbus, OH

Digital libraries of the future and the role of libraries

Data Grids. Lidan Wang April 5, 2007

The ENEA gateway approach providing EGEE/gLite access to unsupported platforms and operating systems

AN APPROACH TO DEVELOPING BUSINESS PROCESSES WITH WEB SERVICES IN GRID

Integraion und Steuerung von verteilten Sensorsystemen. Grid-Package for a Robotic Telescope Network (RTN)

Shibboleth Federation. Manabu Higashida

An Experience in Accessing Grid Computing Power from Mobile Device with GridLab Mobile Services

A Survey Study on Monitoring Service for Grid

The glite File Transfer Service

ARTEMIS: Towards a Secure Interoperability Infrastructure for Healthcare Information Systems

DATA MODEL FOR DESCRIBING GRID RESOURCE BROKER CAPABILITIES

Information Technology Services

Future Developments in UniGrids and NextGRID

Grid Scheduling Dictionary of Terms and Keywords

MIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper

Sustainability in Grid-Computing Christian Baun. Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH)

Business applications:

On Enabling Hydrodynamics Data Analysis of Analytical Ultracentrifugation Experiments

The Current Status of the EUMETNET Programme UNIDART

TRUST RELATIONSHIPS AND SINGLE SIGN-ON IN GRID BASED DATA WAREHOUSES

Dynamism and Data Management in Distributed, Collaborative Working Environments

Virtualization Infrastructure at Karlsruhe

Test of cloud federation in CHAIN-REDS project

IVOA Single Sign-On security

The OMII Software Distribution

Trading Grid Services Within the UK e-science Grid

Engineering an End-to-End GSI-based Security Infrastructure

A Web-based Portal to Access and Manage WNoDeS Virtualized Cloud Resources

Retrieval on the Grid Results from the European Project GRACE (Grid Search and Categorization Engine)

Defining Generic Architecture for Cloud Infrastructure as a Service Model

Fedora Distributed data management (SI1)

AstroGrid-D WG 5: Resource Management for Grid Jobs

Monitoring Clusters and Grids

Anwendungsintegration und Workflows mit UNICORE 6

The Lattice Project: A Multi-Model Grid Computing System. Center for Bioinformatics and Computational Biology University of Maryland

File Transfer Software and Service SC3

WebGReIC: Towards ubiquitous grid data management services

HETEROGENEOUS DATA INTEGRATION FOR CLINICAL DECISION SUPPORT SYSTEM. Aniket Bochare - aniketb1@umbc.edu. CMSC Presentation

Transcription:

Anette Weisbecker, Fraunhofer IAO, Stuttgart 18 th April 2007 Special Interest Session III Outline: Interoperability in Grid Computing Grid Computing for Medicine and Life Science Interoperability Architecture and Middleware Data Access Portal Application Classes and Applications Service oriented Grids Seite 2 05_Weisbecker_eHealthWeek_070418.pdf 1 / 11 1

Evolution of Grid Computing Evolutiuon short term medium term long term Inter Grids: Wide Area Service Grids Globale Grid Service Infrastructure international, global Grids SemanticGrids Service Oriented Knowledge Utilities (SOKU) Extra Grids: Distributed Partner Grids Distributed Enterprise and Campus Environments Integration of Partners, inter organisational Collaboration, VirtualOrganisation Security, inter organisational load balancing Intra Grids: Enterprise Grids process management across departments Authentification, Authorisation, Security, Accouting additional options e.g. load balancing Time Seite 3 Grid Projects (selection) I2B2 BIR N cabig TeraGrid OSG NGSEmbrace BalticGRID @neurist DEISA MediGRID Health EGEE e-child D-GRIDACGT SEE-GRID HealthGrid EUChinaGRID NAREGI WISDOMTWGrid EUIndiaGRID EELA apac Infrastructure Health Seite 4 05_Weisbecker_eHealthWeek_070418.pdf 2 / 11 2

MediGRID - Grid Computing for Medicine and Life Sciences Enhance interdisciplinary and widely location-independent collaboration within medical and biomedical research by use of GRID technologies GRID-services in a controlled e- Science platform which is continually available, economically calculable and secured by policies as well as their implementation offer a promising opportunity for the support of future collaborative research with efficient, modern IT tools. Transparent access to distributed resources through virtualisation enabled by a GRID. Coordination Data Metadata Classic Bioinformatics Data... Data Metadata Metadata Access Control Ontology Resource Fusion Different applications in application classes Biomedical Medical Clinical Informatics Image Research Processing Middleware D-GRID Integration Project Others, e.g. forestry or humanities escience, Security, Interationalisation Seite 5 Specific Requirements in MedGRID Highest requirements on data protection and privacy (patient data, data from biosamples, genome data) The data basis is relatively inhomogenious as the standardization of data formats (e.g. in medical imaging or clinical studies) is so far not very advanced. Lack of semantic interoperability. Heterogenouse User Community. MediGRID users and their main tasks: Doctor (looking for data, providing data, processing data) Assistant Medical Technician (providing data) Researcher doing bioinformatics (processing data) Researcher doing clinical studies (processing data) Radiologist (providing and processing data e.g. mammograms -> medical image processing) etc. Seite 6 05_Weisbecker_eHealthWeek_070418.pdf 3 / 11 3

Interoperability Interoperability is the collaboration of different systems, techniques and organisations. IEEE Definition: Interoperability is the ability of two or more systems or components to exchange information and to use the information that has been exchanged. Necessary Requirements: User Interface Standards Semantical interoperability: speaking the same»language«services Source: Institute of Electrical and Electronics Engineers. IEEE Standard Computer Dictionary: A Compilation of IEEE Standard Computer Glossaries. New York, NY: 1990. Semantic Data Infrastructure Trust & Security Seite 7 Grid Technologies Overview Open Source Products: Globus Toolkit Unicore glite Condor Phast Grid GRIA BOINC Storage Resource Broker (SRB) OGSA-DAI (Data Access and Integration) XEN VMWare exegrid Commercial Products: Univa: Globus Toolkits Sun N1 Grid Engine Nirvana SRB Oracle 10g Suite Data Synapse GridServer United Devices GX Synergy Grid Systems Nitya Extended Suite Platform Computing Platform Globus Toolkit Enterprise Grid Orchestrator LSF Sybase: AVAKI Enterprise Information Integration (EII) Seite 8 05_Weisbecker_eHealthWeek_070418.pdf 4 / 11 4

Standardisation Organisations (selection) Internet Engineering Task Force (IETF) Internet Protocol (Version 1: RFC 791, Version 6: RFC 2460 Transmission Control Protocol (RFC 793) W3C World Wide Web Consortium HTML, XML, XSLT, etc. Organization for the Advancement of Structured Information Standards (OASIS) Web Services Resource Framework (WSRF) / WSRF.net, SAML, XACML, Open Grid Forum (OGF) Open Grid Services Architecture (OGSA)»GIN - Grid-Interoperability-Now«group within the Open Grid Forum works on interoperability between e-infrastructures in order to provide services to global user communities GIN Seite 9 Open Grid Services Architecture Framework 1.5 Quelle: The Open Grid Services Architecture, Version 1.5, https://forge.gridforum.org/sf/docman/do/downloaddocument/projects.ogsa-wg/docman.root.published_documents.ogsa_1_5/doc13553 Seite 10 05_Weisbecker_eHealthWeek_070418.pdf 5 / 11 5

Software Architecture User/ Application Developer Portal CLI Unicore Client Grid-API (GAT) VOMRS VOMRS MediGrid Applications Bioinformatics Medical Image Processing Biomedical Ontologies Clinical Research MediGrid Spezific Services Workflow Management (GWES) Resource Management (D-GRDL) Data Management SRB OGSA-DAI Security Grid Services Integration Layer GLOBUS 4 Resource Monitoring Resource Accounting UNICORE Job Management Data Access Metadata Mgmt. Dataflow Monitoring Resources & local Services open Database CPU Storage + Archives protected Database CPU Storage+Archives MediGRID Middleware MediGRID Applications optional Seite 11 MediGRID Resources and Grid Services MediGRID User MediGRID Developer Databases via OGSA-DAI MediGRID Administrator Grid Certificate MediGRID Applications Disk Storage MediGRID Portal Storage via SRB User and VO Management via VOMRS Archive Storage Firewall Management Grid Workflow Execution Service central MediGRID Services Sensors and technical Devices Computing Nodes Metadata- Generation via GRDBD Monitoring Daemons Fluoroscope Tomographs Computers via Globus and Unicore (glite) Seite 12 05_Weisbecker_eHealthWeek_070418.pdf 6 / 11 6

Portal based Access to MediGRID MediGRID User MediGRID Developer Genome Sequence Analysis MediGRID Administrator Grid Certificate Statistical Analysis of Functional Brain Images SNP Selection Bioinformatics MediGRID Certificate Medical Image Processing 3D Prostate Biopsy Ontologies Ontology Access Virtual Vascular Surgery Standard Grid Portlets Developer Support Administration Credential Management Resource Monitoring File Browser Workflow Management D-GRDL Metadata Creation D-GRDL Metadata Management Resource Management Seite 13 Grid Workflows and Virtualisation Result Requirements: D-GRDL Resource Metadata Management (D-Grid) D-GRDL Management (D-Grid) GRDB Daemon (InstantGrid) Monitoring Data (Globus MDS + Ganglia) Input Parameter for Applications MediGRID Job-Initialisation Portal MediGRID Resources GWES Automatic Resource Selection Workflow Initialisation Job Submission GWES Grid Workflow Execution Service Seite 14 05_Weisbecker_eHealthWeek_070418.pdf 7 / 11 7

Data Virtualisation with Storage Resource Broker (SRB) Data Management and Data Virtualisation with in the Grid Abstraction Layer in Grid Filemanager move file logical no changes on logical view Physical Layer on Storage Resources Storage Resource A Storage Resource. B Storage Resource C Storage Resource D move file physical no changes of physical storing Requirements: Global IDs for Data in the Grid, Metadata Management, Solution: Storage Resource Broker Seite 15 Certificate based Usage via MediGRID Portal User PC Grid Certificate MediGRID D-Grid D-Grid Grid CA CA CA Zertifikate Zertifikate Certificate MyProxy Upload Tool 1. Portal Portal Credential 4. Grid Application Portlets Lifetime: 2 years 2. 3. Lifetime : 2 hours Advantage: Grid User do not need a Grid Comupter / no Middleware Installation Proxy Certificate MyProxy Server Lifetime : 7 days Grid Resources and Applications 1. Login at the portal and download the MPU tools via java webstart 2. Creation of a proxy certificate and Upload on the MyProxy Server 3. Creation of Credentials via the MediGRID portal 4. Usage of portal applictions, which need credentials Seite 16 05_Weisbecker_eHealthWeek_070418.pdf 8 / 11 8

MediGRID Portal MediGRID Portal is the central, easy to use, world wide access to the applications for the user GridSphere GridPortlets Certificates for secure access Integration of medical applications Applications are callable as web services (Wrapper) Global identifier for transparent data access OGSA-DAI for connection of distributed databases Petri net based workflows for application processes Seite 17 MediGRID Application Classes with their Applications Bioinformatics Genome Sequence Analysis SNPSelection: Single nucleotide polymorphisms selection RNAi: ribonucleic acid interference screening Sequorr: Sequence correlation Medical Image Processing 3D Prostate Biopsy Statistical Analysis of Functional Brain Images Virtual Vascular Surgery Clinical Research Analysis of clinical studies in neurology Ontologies Integration of different ontologies with heterogeneous formats Seite 18 05_Weisbecker_eHealthWeek_070418.pdf 9 / 11 9

From Business Processes to Grid Services Systematic Systematic Process Process Analysis Analysis Modularisation Modularisation & iterative iterative Refinement Refinement Identifikation Identifikation of of idenitical idenitical / / similar similar process process moduls moduls M1 M2 M3 M3 M4 M5 M6 M6 M8 IterativeRefinement IterativeRefinement Identification Identification of of Service Service Candidates Candidates Seite 19 Global Service Grids Providing services for global user communities by interoperability between different grids. Simplification Abstraction Virtualisation End-User Vision End-user empowerment Life-support to business processes Software Vision Continuously changing requirements Grid services development environments Architectural Vision Pervasive virtual organisations Computational semantics, ontologies, meta-descriptions Self-organising resources according to Next Generation Grid (NGG) Vision Picture source: www.cordis.europa.eu/ist/grids/what_is_a_grid.htm Seite 20 05_Weisbecker_eHealthWeek_070418.pdf 10 / 11 10

Contact Thank you for your attention! Questions? Priv.-Doz. Dr.-Ing. habil. Anette Weisbecker Fraunhofer Institute for Industrial Engineering Nobelstraße 12 70569 Stuttgart, Germany http://www.iao.fraunhofer.de Phone: +497119702400 E-Mail: Anette.Weisbecker@iao.fraunhofer.de http://www.sw-management.iao.fraunhofer.de http://www.enterprisegrids.fraunhofer.de www.medigrid.de Seite 21 05_Weisbecker_eHealthWeek_070418.pdf 11 / 11 11