The OGSA-DAI Project Databases and the Grid. Neil Chue Hong. Principal Consultant EPCC, Edinburgh

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "The OGSA-DAI Project Databases and the Grid. Neil Chue Hong. Principal Consultant EPCC, Edinburgh N.ChueHong@epcc.ed.ac.uk"

Transcription

1 The OGSA-DAI Project Databases and the Grid Neil Chue Hong Principal Consultant EPCC, Edinburgh

2 What is OGSA-DAI? 4It is a project: OGSA Data Access and Integration: funded by the UK escience Grid Core Programme 4It is a vision: From simple database access to truly virtualised data resources 4It is a standard: The GridDataService Specification from the Data Access and Integration Working Group (DAIS-WG) of the Global Grid Forum (GGF) 4It is software that you can use: Core services now in Release 2

3 OGSA-DAI Objective 4To define: open standards and open source based uniform service interfaces for accessing heterogeneous data sources within the Open Grid Services Architecture (OGSA) framework 4Why? Because we are increasingly wanting to integrate different data sources from different organisations together The Grid, and OGSA, appears to provide a framework for producing software to do this

4 Who are we? Contributing to the global grid computing community IBM USA Belfast Glasgow EPCC & NeSC Newcastle Daresbury Lab Manchester EPCC & NeSC IBM UK IBM USA Manchester e-sc Newcastle e-sc Oracle 373 man months Oxford Oracle RAL Cardiff London IBM Hursley Southampton 3 million, 18 months, started February 2002 Funded by the Grid Core Programme Cambridge Hinxton

5 What are we doing? Monitoring Diagnosis Logging Data Intensive Applications Scientific Data Mining & Integration Technology Scheduling Accounting Grid Plumbing & Security Infrastructure Data & Storage Resources Distributed

6 What are we doing? Data Intensive Applications Scientific Data Mining & Integration Technology Monitoring Diagnosis Logging Data Integration Scheduling Accounting Authorisation Data Access Grid Plumbing & Security Infrastructure Data & Storage Resources Structured Data Distributed

7 What are we doing? Data Intensive Applications App. Developers Scientific Data Mining & Integration Technology Monitoring Diagnosis Logging Data Integration Scheduling Accounting Authorisation Data Access Owners Grid Plumbing & Security Infrastructure Data & Storage Resources Structured Data Operations Team Distributed

8 Data Intensive Application Scientists What are we doing? Monitoring Diagnosis Logging Data Intensive Applications App. Developers Scientific Data Mining & Integration Technology Tech. Developers Data Integration Scheduling Accounting Authorisation Data Access Owners Grid Plumbing & Security Infrastructure Data & Storage Resources Distributed Operations Team Structured Data Data Providers Data Curators

9 Data Intensive Application Scientists What are we doing? Monitoring Diagnosis Logging Scheduling Owners Accounting Data Intensive Applications Scientific Data Mining & Integration Technology Tech. Developers Data Integration Keep all the groups happy Authorisation Grid Plumbing & Security Infrastructure Data & Storage Resources Distributed App. Developers Data Access Operations Team Structured Data Data Providers Data Curators

10 Project Requirements 4Derived from project requirements survey see DAIS WG 4Driven by Technical Authority and Early Adopters AstroGrid MyGrid 4Close relationship with many other projects

11 DAIS WG 4GridDatabaseService Specification DAIS WG of the GGF Will enter documentation track after GGF8 Defines an interface for a GridDatabaseService Primary contributors are OGSA-DAI Project and EuropeanDataGrid OGSA-DAI (the software) seeks to be a reference implementation of this standard But does not necessarily track it exactly just now Requirements and Overview Informational documents also published

12 The OGSA-DAI Approach 4Reuse existing technologies and standards OGSA, Query languages, Java, transport 4Three key new services: GridDataService GridDataServiceFactory GridDataServiceRegistry 4Benefits: Location independence Hides heterogeneity Scalable Flexible Dynamic

13 OGSA-DAI Positioning - Today OGSA-DAI Distributed Query OGSA-DAI Basic Services Delivery Data Format Drivers Query (Create Retrieve Update Delete) Meta Data F OGSA R Notification Lifetime Location Database, Communication, OS Technology

14 OGSA-DAI in one slide Distributed Query Processor Common Infrastructure Lifetime Service Types and Service Implementations st Fst Rst GDTSst GDTDst Context porttypes GS F R NSrc NSnk NSub HR GDT Configuration Logging Exceptions Interface Data GSH GSR GDR -MD -CS F-MD -S -SR F-S GDT-S GDT-SR D Versioning Security Policy XML Utilities File Utilities Audit Accounting porttype Functions SDE (From GS) XML Fragment Repositor y XPath Factory (From F) Repository (From R) Engine (From ) Execute Parameter Log Notify Transaction Cache Translation XSLT Hardcode Statement SQL Xpath XQuery XUpdate Delivery Mechanism: Bulk Stream Mode : Full Block Protocol :- FTP GridFTP SOAP/HTTP Other Management Notification Unique Naming Database Access Management Connection Role Map Internationalization Database Access Implementation JDBC XMLDB OGSA-DAI Grid Data Service Training Course File

15 OGSA-DAI To Date 4Assuming that OGSA becomes the standard framework Have adopted the OGSA approach 4Have first concentrated on data access Released software has only data access so far Distributed query processor prototype due in July 4Implementation provides focus on basic functionality first But architecturally we have tried to answer many pertinent questions Functionality will increase over subsequent releases

16 OGSA-DAI Core Services 4OGSA-DAI Release 2 April 15 th Java, Tomcat, Globus Toolkit 3 Alpha3 Supports MySQL, DB2, Xindice; SQL92, XPath, Xupdate 4Continue to track Globus Toolkit 3 releases Experimental, then production, GT3 grids will help 4Changes expected in next release ServiceGroups, DataResources,

17 a. Request to egistry for ources of data bout x Analyst 3c. Results of query returned to client as XML 1b. Registry responds 2a. Request to Factory for access to with database Factory handle OR 3d. Results of query delivered to consumer as XML Consumer Registry R 2c. Factory returns handle of to client 3a. Client queries with SQL, XPath, XQuery etc in action 2b. Factory creates GridDataService to manage access Grid Data Service 3b. interacts with database Factory F SOAP/HTTP service creation API interactions Database (Xindice MySQL Oracle DB2)

18 Data Resource Implementation Mapping Configuration DataResource ImplementationMap gdsf_config.xml Data Resource Data location Resource location DBMS dataresource Name dataresource Name scheme path path DB DB connection DataResourceImplementaitonMap connection DataResourceImple menation F connection DataResourceImple mentation

19 Activity Mapping gdsf_config.xml Data Resource Data location Resource location DBMS scheme path path DB DB grid_data_service.wsdl F Data resource SDE Data resource SDE grid_data_service_bindings.wsdl grid_data_service_port_type.wsdl activitymap.xml grid_data_service_faults.xml grid_data_service_types.xsd Activity schema SDE Activity schema SDE Activity schema SDE sql_query_statement.xsd sql_update_statement.xsd xpath_statement.xsd xupdate_statement.xsd ActivityMap + config ActivityMap + config ActivityMap + config ActivityMap + config SQLQueryStatement.class SQLUpdateStatement.class XPathStatement.class XUpdateStatement.class

20 4Asynchronous delivery Pull Asynchronous Delivery Client Q 1 R s Instance 2 GSH/R + data id Consumer D + GDH 3 DT R a GDT DB 4Asynchronous delivery Push Client Q + D + GSH/R 1 R s Instance GDT Consumer DT 3 R a 2 GSH/R DB

21 Composition Client Operation DB Operation Operation 4 Client Operation DB Client Operation DB Operation Operation Operation Client Operation 5 Client Operation DB Operation DB Operation Operation

22 4A higher level service: Distributed Query Service Extension of Polar* query processor, partitions and schedules queries Sits on top of OGSA and OGSA-DAI 4Defines new porttypes and services GridDistributedQuery(GDQ) PortType GridDistributedQueryService(GDQS) wraps Polar* GridQueryEvaluatorService(GQES) perform subqueries 4Currently based on OGSA-DAI Release 1.5

23 DQS Architecture

24 DQP in action

25 DQS: the future 4The GridDistributedQueryService is an example of a higher level data integration service which utilises OGSA-DAI core services Assumes that F, GDQS Factory and client live in different containers Really requires a well-defined meta-model for the physical schema of a database Being partially addressed in DAIS WG Shows how a can be both client and service Service hierarchy and composition 4DAIT (proposed follow-on to OGSA-DAI) would produce a robust reference implementation of the DQP components

26 Projects using OGSA-DAI 4Industry: FirstDIG: business process analysis (with First Transport Group) OGSA-DAI with datamining 4Collaborative Bridges: database integration over six geographically distributed genomics research sites (with IBM UK) OGSA-DAI with DiscoveryLink edikt: porting OGSA-DAI to other platforms OGSA-DAI with performance DEISA: linking Europe s HPC centres OGSA-DAI with distributed accounting MS.Net Grid: porting OGSA-DAI to the.net framework (with Microsoft Research UK) OGSA-DAI with.net

27 WS + GSI UK support ( > 100 downloads) XML + OGSA Prototypes for Early Adopters Design Documents & Demos for DAIS GGF5 XML + OGSA Prototype Available RDB + GT2 / OGSA Prototypes Available Project Timeline today GGF6 WG Papers & Prototypes Early Adopters NeSC Ship Release 1 (Jan 15 th 2003) OGSADAI NeSC Release 1.5 (Feb 28 th 2003) GGF7 Release 2 NeSC Release 2.5 Release 3 Feb 02 May 02 Jul 02 Sep 02 Dec 02 Feb 03 May 03 Sep 03 TP4 TP5 GT3 A1 GT3 A3 GT3 Beta Phase 1 Starts Phase 2 Starts GT3 A2 GT3 A4 GT3 Final

28 Further information 4The OGSA-DAI Project Site: 4The DAIS-WG site: 4OGSA-DAI Users Mailing list General discussion on grid data access and integration 4Formal support for OGSA-DAI releases + 4OGSA-DAI training courses

Experiences of Designing and Implementing Grid Database Services in the OGSA-DAI project

Experiences of Designing and Implementing Grid Database Services in the OGSA-DAI project Experiences of Designing and Implementing Grid Database Services in the OGSA-DAI project Mario Antonioletti 1, Neil Chue Hong 1, Ally Hume 1, Mike Jackson 1, Amy Krause 1, Jeremy Nowell 2, Charaka Palansuriya

More information

International Summer School on Grid Computing. Naples, Italy. Introduction to OGSA-DAI

International Summer School on Grid Computing. Naples, Italy. Introduction to OGSA-DAI International Summer School on Grid Computing Naples, Italy Introduction to OGSA-DAI Prof. Malcolm Atkinson Director www.nesc.ac.uk 21 st July 2003 1 Workshop Overview OGSA-DAI Workshop 08:30 Information

More information

Data Grids. Lidan Wang April 5, 2007

Data Grids. Lidan Wang April 5, 2007 Data Grids Lidan Wang April 5, 2007 Outline Data-intensive applications Challenges in data access, integration and management in Grid setting Grid services for these data-intensive application Architectural

More information

THE CCLRC DATA PORTAL

THE CCLRC DATA PORTAL THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: g.j.drinkwater@dl.ac.uk, s.a.sufi@dl.ac.uk Abstract: The project aims

More information

Robust service-based semantic querying to distributed heterogeneous databases

Robust service-based semantic querying to distributed heterogeneous databases Robust service-based semantic querying to distributed heterogeneous databases Carlos Buil-Aranda*, Oscar Corcho* and Amy Krause** *Ontology Engineering Group, Departamento de Inteligencia Artificial Universidad

More information

GENERIC DATA ACCESS AND INTEGRATION SERVICE FOR DISTRIBUTED COMPUTING ENVIRONMENT

GENERIC DATA ACCESS AND INTEGRATION SERVICE FOR DISTRIBUTED COMPUTING ENVIRONMENT GENERIC DATA ACCESS AND INTEGRATION SERVICE FOR DISTRIBUTED COMPUTING ENVIRONMENT Hemant Mehta 1, Priyesh Kanungo 2 and Manohar Chandwani 3 1 School of Computer Science, Devi Ahilya University, Indore,

More information

Grid Data Services Relational Database Management Systems Version 1.0 05Jul2002

Grid Data Services Relational Database Management Systems Version 1.0 05Jul2002 Grid Data Services Relational Database Management Systems Version 1.0 05Jul2002 Authors Brian Collins collinsb@uk.ibm.com (1) Andrew Borley borley@uk.ibm.com (1) Neil Hardman nhardman@uk.ibm.com (1) Alan

More information

Grids, e-business and e-utilities. Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk

Grids, e-business and e-utilities. Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk Grids, e-business and e-utilities Tony Hey Director of the UK e-science Core Programme EPSRC and DTI Tony.Hey@epsrc.ac.uk The Grid as an Enabler for Virtual Organisations Ian Foster, Carl Kesselman and

More information

Grid Database Service Specification

Grid Database Service Specification Grid Database Service Specification Document Identifier: GDSS-0.2 Date: 4 th October 2002 Authors: Amy Krause (EPCC, University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh EH9

More information

The UK e-science Programme and the Grid. Tony Hey Director of UK e-science Core Programme Tony.Hey@epsrc.ac.uk

The UK e-science Programme and the Grid. Tony Hey Director of UK e-science Core Programme Tony.Hey@epsrc.ac.uk The UK e-science Programme and the Grid Tony Hey Director of UK e-science Core Programme Tony.Hey@epsrc.ac.uk e-science and the Grid e-science is about global collaboration in key areas of science, and

More information

Towards Heterogeneous Grid Database Replication. Kemian Dang

Towards Heterogeneous Grid Database Replication. Kemian Dang Towards Heterogeneous Grid Database Replication Kemian Dang Master of Science Computer Science School of Informatics University of Edinburgh 2008 Abstract Heterogeneous database replication in the Grid

More information

e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography)

e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography) Macromolecular Research, Vol. 14, No. 2, pp 140-145 (2006) e-science Technologies in Synchrotron Radiation Beamline - Remote Access and Automation (A Case Study for High Throughput Protein Crystallography)

More information

Database Access and Integration Services on the Grid

Database Access and Integration Services on the Grid UK e-science Technical Report Series ISSN 1751-5971 Database Access and Integration Services on the Grid Norman W Paton Department of Computer Science, University of Manchester, Manchester, M13 9PL, UK.

More information

TOG & JOSH: Grid scheduling with Grid Engine & Globus

TOG & JOSH: Grid scheduling with Grid Engine & Globus TOG & JOSH: Grid scheduling with Grid Engine & Globus G. Cawood, T. Seed, R. Abrol, T. Sloan EPCC, The University of Edinburgh, James Clerk Maxwell Building, Mayfield Road, Edinburgh, EH9 3JZ, UK Abstract

More information

tibbr Now, the Information Finds You.

tibbr Now, the Information Finds You. tibbr Now, the Information Finds You. - tibbr Integration 1 tibbr Integration: Get More from Your Existing Enterprise Systems and Improve Business Process tibbr empowers IT to integrate the enterprise

More information

Evaluating Metadata access

Evaluating Metadata access Evaluating Metadata access strategies with the GOME test suite André Gemünd Fraunhofer SCAI www.eu-egee.org EGEE-II INFSO-RI-031688 EGEE and glite are registered trademarks Motivation Testing the test

More information

Writing Grid Service Using GT3 Core. Dec, 2003. Abstract

Writing Grid Service Using GT3 Core. Dec, 2003. Abstract Writing Grid Service Using GT3 Core Dec, 2003 Long Wang wangling@mail.utexas.edu Department of Electrical & Computer Engineering The University of Texas at Austin James C. Browne browne@cs.utexas.edu Department

More information

Grid Data Integration based on Schema-mapping

Grid Data Integration based on Schema-mapping Grid Data Integration based on Schema-mapping Carmela Comito and Domenico Talia DEIS, University of Calabria, Via P. Bucci 41 c, 87036 Rende, Italy {ccomito, talia}@deis.unical.it http://www.deis.unical.it/

More information

Deploying a distributed data storage system on the UK National Grid Service using federated SRB

Deploying a distributed data storage system on the UK National Grid Service using federated SRB Deploying a distributed data storage system on the UK National Grid Service using federated SRB Manandhar A.S., Kleese K., Berrisford P., Brown G.D. CCLRC e-science Center Abstract As Grid enabled applications

More information

Additional Information: Alternative Locations provides a link to the National Centre for e-social Science (NCeSS)home page

Additional Information: Alternative Locations provides a link to the National Centre for e-social Science (NCeSS)home page Citation: Lloyd, Ashley and Sloan, T.M.. 2005. : Extending the INWA Grid, in.,. (ed), First International Conference on e-social Science, Jun 22 2005. Manchester, UK: ESRC National Centre for e-social

More information

2. Create (if required) 3. Register. 4.Get policy files for policy enforced by the container or middleware eg: Gridmap file

2. Create (if required) 3. Register. 4.Get policy files for policy enforced by the container or middleware eg: Gridmap file Policy Management for OGSA Applications as Grid Services (Work in Progress) Lavanya Ramakrishnan MCNC-RDI Research and Development Institute 3021 Cornwallis Road, P.O. Box 13910, Research Triangle Park,

More information

2015, André Melancia (Andy.PT) 1

2015, André Melancia (Andy.PT) 1 2015, (Andy.PT) 1 "" 1. Requirements For this session you will need a computer with: Windows 7 Professional or higher Office 2007 Professional or higher (Outlook and Access installed) Some of the drivers

More information

DATABASES AND THE GRID

DATABASES AND THE GRID DATABASES AND THE GRID Paul Watson Department of Computing Science, University of Newcastle, Newcastle-upon-Tyne, NE1 7RU, UK e-mail: Paul.Watson@newcastle.ac.uk Telephone: +44 191 222 7653 Fax: +44 191

More information

A Survey Study on Monitoring Service for Grid

A Survey Study on Monitoring Service for Grid A Survey Study on Monitoring Service for Grid Erkang You erkyou@indiana.edu ABSTRACT Grid is a distributed system that integrates heterogeneous systems into a single transparent computer, aiming to provide

More information

INFRASTRUCTURE PROGRAMME

INFRASTRUCTURE PROGRAMME INFRASTRUCTURE PROGRAMME programme remit Infrastructure s remit is to provide researchers in the Engineering and Physical sciences with access to the world class facilities necessary to enable internationally

More information

Equipment Room Database and Web-Based Inventory Management

Equipment Room Database and Web-Based Inventory Management Equipment Room Database and Web-Based Inventory Management Project Proposal Sean M. DonCarlos Ryan Learned Advisors: Dr. James H. Irwin Dr. Aleksander Malinowski December 12, 2002 TABLE OF CONTENTS Project

More information

The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets

The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets!! Large data collections appear in many scientific domains like climate studies.!! Users and

More information

IBM DB2 XML support. How to Configure the IBM DB2 Support in oxygen

IBM DB2 XML support. How to Configure the IBM DB2 Support in oxygen Table of Contents IBM DB2 XML support About this Tutorial... 1 How to Configure the IBM DB2 Support in oxygen... 1 Database Explorer View... 3 Table Explorer View... 5 Editing XML Content of the XMLType

More information

EDG Project: Database Management Services

EDG Project: Database Management Services EDG Project: Database Management Services Leanne Guy for the EDG Data Management Work Package EDG::WP2 Leanne.Guy@cern.ch http://cern.ch/leanne 17 April 2002 DAI Workshop Presentation 1 Information in

More information

Service Oriented Architectures

Service Oriented Architectures 8 Service Oriented Architectures Gustavo Alonso Computer Science Department Swiss Federal Institute of Technology (ETHZ) alonso@inf.ethz.ch http://www.iks.inf.ethz.ch/ The context for SOA A bit of history

More information

A Grid Data Integration Service (OGSA-DQP)

A Grid Data Integration Service (OGSA-DQP) A Grid Data Integration Service (OGSA-DQP) Paul Watson, University of Newcastle-upon-Tyne based on the work of Norman Paton, Tasos Gounaris, Alvaro Fernandes, Rizos Sakellariou University of Manchester

More information

GridFTP: A Data Transfer Protocol for the Grid

GridFTP: A Data Transfer Protocol for the Grid GridFTP: A Data Transfer Protocol for the Grid Grid Forum Data Working Group on GridFTP Bill Allcock, Lee Liming, Steven Tuecke ANL Ann Chervenak USC/ISI Introduction In Grid environments,

More information

Development of Open Source RESTful WHOIS. Haikuo Zhang

Development of Open Source RESTful WHOIS. Haikuo Zhang Development of Open Source RESTful WHOIS Haikuo Zhang Why We Need a New WHOIS Protocol WHOIS Protocol (RFC 3912) has problems WHOIS has never been internationalized WHOIS was defined for ASCII only WHOIS

More information

Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware

Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware Analyses on functional capabilities of BizTalk Server, Oracle BPEL Process Manger and WebSphere Process Server for applications in Grid middleware R. Goranova University of Sofia St. Kliment Ohridski,

More information

Apache Sentry. Prasad Mujumdar prasadm@apache.org prasadm@cloudera.com

Apache Sentry. Prasad Mujumdar prasadm@apache.org prasadm@cloudera.com Apache Sentry Prasad Mujumdar prasadm@apache.org prasadm@cloudera.com Agenda Various aspects of data security Apache Sentry for authorization Key concepts of Apache Sentry Sentry features Sentry architecture

More information

An Introduction to Globus Toolkit 3

An Introduction to Globus Toolkit 3 An Introduction to Globus Toolkit 3 -Developing Interoperable Grid services 1 Outline Cornerstones New Concepts Software Stack Core Higher Level Services Developing and Using Grid Services Development

More information

IBM Rational Asset Manager

IBM Rational Asset Manager Providing business intelligence for your software assets IBM Rational Asset Manager Highlights A collaborative software development asset management solution, IBM Enabling effective asset management Rational

More information

Grid Technology and Information Management for Command and Control

Grid Technology and Information Management for Command and Control Grid Technology and Information Management for Command and Control Dr. Scott E. Spetka Dr. George O. Ramseyer* Dr. Richard W. Linderman* ITT Industries Advanced Engineering and Sciences SUNY Institute

More information

IBM Campaign Version-independent Integration with IBM Engage Version 1 Release 3 April 8, 2016. Integration Guide IBM

IBM Campaign Version-independent Integration with IBM Engage Version 1 Release 3 April 8, 2016. Integration Guide IBM IBM Campaign Version-independent Integration with IBM Engage Version 1 Release 3 April 8, 2016 Integration Guide IBM Note Before using this information and the product it supports, read the information

More information

Populating Your Domino Directory (Or ANY Domino Database) With Tivoli Directory Integrator. Marie Scott Thomas Duffbert Duff

Populating Your Domino Directory (Or ANY Domino Database) With Tivoli Directory Integrator. Marie Scott Thomas Duffbert Duff Populating Your Domino Directory (Or ANY Domino Database) With Tivoli Directory Integrator Marie Scott Thomas Duffbert Duff Agenda Introduction to TDI architecture/concepts Discuss TDI entitlement Examples

More information

PROGRESS Portal Access Whitepaper

PROGRESS Portal Access Whitepaper PROGRESS Portal Access Whitepaper Maciej Bogdanski, Michał Kosiedowski, Cezary Mazurek, Marzena Rabiega, Malgorzata Wolniewicz Poznan Supercomputing and Networking Center April 15, 2004 1 Introduction

More information

2. Requirements for Metadata Management on the Grid

2. Requirements for Metadata Management on the Grid Grid-Based Metadata Services Ewa Deelman 1, Gurmeet Singh 1, Malcolm P. Atkinson 2, Ann Chervenak 1, Neil P Chue Hong 3, Carl Kesselman 1, Sonal Patil 1, Laura Pearlman 1, Mei-Hui Su 1 1 Information Sciences

More information

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4

Concepts and Architecture of the Grid. Summary of Grid 2, Chapter 4 Concepts and Architecture of the Grid Summary of Grid 2, Chapter 4 Concepts of Grid Mantra: Coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations Allows

More information

The Grid and the Network

The Grid and the Network The Grid and the Network The UK Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 1 The Grid and the Network The UK Network Infrastructure

More information

SQL SERVER 2008 DATABASE MANAGEMENT. PART I: Writing Queries using MS Server 2008 Transact-SQL

SQL SERVER 2008 DATABASE MANAGEMENT. PART I: Writing Queries using MS Server 2008 Transact-SQL SQL SERVER 2008 DATABASE MANAGEMENT PART I: Writing Queries using MS Server 2008 Transact-SQL Module 1: Querying and Filtering Data Using the SELECT Statement Filtering Data Working with NULL Values Formatting

More information

IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand

IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand PartnerWorld Developers IBM Solutions Grid for Business Partners Helping IBM Business Partners to Grid-enable applications for the next phase of e-business on demand 2 Introducing the IBM Solutions Grid

More information

Edinburgh Glasgow DL. Newcastle. Belfast. Manchester. Cambridge. Oxford RL. Hinxton. Cardiff. London. Soton. GridCast UK-Japan N+N October 2003 1

Edinburgh Glasgow DL. Newcastle. Belfast. Manchester. Cambridge. Oxford RL. Hinxton. Cardiff. London. Soton. GridCast UK-Japan N+N October 2003 1 Edinburgh Glasgow DL Newcastle Belfast Manchester Cardiff Oxford RL Soton London Cambridge Hinxton GridCast UK-Japan N+N October 2003 1 GridCast Using the Grid in Broadcast Infrastructures Ron Perrott

More information

MIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper

MIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper Migrating Desktop and Roaming Access Whitepaper Poznan Supercomputing and Networking Center Noskowskiego 12/14 61-704 Poznan, POLAND 2004, April white-paper-md-ras.doc 1/11 1 Product overview In this whitepaper

More information

inforouter V8.0 Server & Client Requirements

inforouter V8.0 Server & Client Requirements inforouter V8.0 Server & Client Requirements Please review this document thoroughly before proceeding with the installation of inforouter Version 8. This document describes the minimum and recommended

More information

Data Services @neurist and beyond

Data Services @neurist and beyond s @neurist and beyond Siegfried Benkner Department of Scientific Computing Faculty of Computer Science University of Vienna http://www.par.univie.ac.at Department of Scientific Computing Parallel Computing

More information

Securing your business

Securing your business Securing your business Anders Askåsen Product Manager for OpenIDM * World Wide Coverage ForgeRock.com Enterprise Open Source Software ForgeRock Norway ForgeRock USA ForgeRock UK ForgeRock France Consulting

More information

Database Technology Training

Database Technology Training Database Technology Training July December 2013 UNITED KINGDOM ORACLE United Kingdom Telephone: +44 11 89 249 066 www.oracle.com/uk/education Database Technology Training: July December 2013 Additional

More information

Leveraging Service Oriented Architecture (SOA) to integrate Oracle Applications with SalesForce.com

Leveraging Service Oriented Architecture (SOA) to integrate Oracle Applications with SalesForce.com Leveraging Service Oriented Architecture (SOA) to integrate Oracle Applications with SalesForce.com Presented by: Shashi Mamidibathula, CPIM, PMP Principal Pramaan Systems shashi.mamidi@pramaan.com www.pramaan.com

More information

Using Object And Object-Oriented Technologies for XML-native Database Systems

Using Object And Object-Oriented Technologies for XML-native Database Systems Using Object And Object-Oriented Technologies for XML-native Database Systems David Toth and Michal Valenta David Toth and Michal Valenta Dept. of Computer Science and Engineering Dept. FEE, of Computer

More information

ActiveVOS Server Architecture. March 2009

ActiveVOS Server Architecture. March 2009 ActiveVOS Server Architecture March 2009 Topics ActiveVOS Server Architecture Core Engine, Managers, Expression Languages BPEL4People People Activity WS HT Human Tasks Other Services JMS, REST, POJO,...

More information

Grid Security : Authentication and Authorization

Grid Security : Authentication and Authorization Grid Security : Authentication and Authorization IFIP Workshop 2/7/05 Jong Kim Dept. of Computer Sci. and Eng. Pohang Univ. of Sci. and Tech. (POSTECH) Contents Grid Security Grid Security Challenges Grid

More information

Grid Computing @ Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions

Grid Computing @ Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions Grid Computing @ Sun Carlo Nardone Technical Systems Ambassador GSO Client Solutions Phases of Grid Computing Cluster Grids Single user community Single organization Campus Grids Multiple user communities

More information

Web Service Based Data Management for Grid Applications

Web Service Based Data Management for Grid Applications Web Service Based Data Management for Grid Applications T. Boehm Zuse-Institute Berlin (ZIB), Berlin, Germany Abstract Web Services play an important role in providing an interface between end user applications

More information

Two new DB2 Web Query options expand Microsoft integration As printed in the September 2009 edition of the IBM Systems Magazine

Two new DB2 Web Query options expand Microsoft integration As printed in the September 2009 edition of the IBM Systems Magazine Answering the Call Two new DB2 Web Query options expand Microsoft integration As printed in the September 2009 edition of the IBM Systems Magazine Written by Robert Andrews robert.andrews@us.ibm.com End-user

More information

Gradient An EII Solution From Infosys

Gradient An EII Solution From Infosys Gradient An EII Solution From Infosys Keywords: Grid, Enterprise Integration, EII Introduction New arrays of business are emerging that require cross-functional data in near real-time. Examples of such

More information

Early Experiences with the GRelC Library

Early Experiences with the GRelC Library Early Experiences with the GRelC Library Giovanni Aloisio, Massimo Cafaro, Sandro Fiore, Maria Mirto Center for Advanced Computational Technologies/ISUFI, University of Lecce, Italy {giovanni.aloisio,

More information

Agents and Web Services

Agents and Web Services Agents and Web Services ------SENG609.22 Tutorial 1 Dong Liu Abstract: The basics of web services are reviewed in this tutorial. Agents are compared to web services in many aspects, and the impacts of

More information

<Insert Picture Here> Introducing Data Modeling and Design with Oracle SQL Developer Data Modeler

<Insert Picture Here> Introducing Data Modeling and Design with Oracle SQL Developer Data Modeler Introducing Data Modeling and Design with Oracle SQL Developer Data Modeler Sue Harper Senior Principle Product Manager 1 The following is intended to outline our general product

More information

T-110.5140 Network Application Frameworks and XML Web Services and WSDL 15.2.2010 Tancred Lindholm

T-110.5140 Network Application Frameworks and XML Web Services and WSDL 15.2.2010 Tancred Lindholm T-110.5140 Network Application Frameworks and XML Web Services and WSDL 15.2.2010 Tancred Lindholm Based on slides by Sasu Tarkoma and Pekka Nikander 1 of 20 Contents Short review of XML & related specs

More information

Infosys GRADIENT. Enabling Enterprise Data Virtualization. Keywords. Grid, Enterprise Data Integration, EII Introduction

Infosys GRADIENT. Enabling Enterprise Data Virtualization. Keywords. Grid, Enterprise Data Integration, EII Introduction Infosys GRADIENT Enabling Enterprise Data Virtualization Keywords Grid, Enterprise Data Integration, EII Introduction A new generation of business applications is emerging to support customer service,

More information

Oracle PharmaGRID Response. Dave Pearson Oracle Corporation UK

Oracle PharmaGRID Response. Dave Pearson Oracle Corporation UK Oracle PharmaGRID Response Dave Pearson Oracle Corporation UK Grid Concepts and Vision! Everything is a service! Resource virtualisation and sharing Hardware, storage, network, data, function, instruments

More information

FileMaker 11. ODBC and JDBC Guide

FileMaker 11. ODBC and JDBC Guide FileMaker 11 ODBC and JDBC Guide 2004 2010 FileMaker, Inc. All Rights Reserved. FileMaker, Inc. 5201 Patrick Henry Drive Santa Clara, California 95054 FileMaker is a trademark of FileMaker, Inc. registered

More information

GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION

GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION Syed Rasheed Solution Manager Red Hat Corp. Kenny Peeples Technical Manager Red Hat Corp. Kimberly Palko Product Manager Red Hat Corp.

More information

Web Services in Oracle Fusion Middleware. Raghu Kodali Consulting Product Manager & SOA Evangelist Oracle Fusion Middleware Oracle USA

Web Services in Oracle Fusion Middleware. Raghu Kodali Consulting Product Manager & SOA Evangelist Oracle Fusion Middleware Oracle USA Web Services in Oracle Fusion Middleware Raghu Kodali Consulting Product Manager & SOA Evangelist Oracle Fusion Middleware Oracle USA Agenda Oracle Fusion Middleware Enterprise Web Services Services to

More information

Enabling Collaboration Using the Biomedical Informatics Research Network (BIRN):

Enabling Collaboration Using the Biomedical Informatics Research Network (BIRN): Enabling Collaboration Using the Biomedical Informatics Research Network (BIRN): Karl Helmer Ph.D. Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital June 4, 2010 BIRN

More information

DISTRIBUTED AND PARALLELL DATABASE

DISTRIBUTED AND PARALLELL DATABASE DISTRIBUTED AND PARALLELL DATABASE SYSTEMS Tore Risch Uppsala Database Laboratory Department of Information Technology Uppsala University Sweden http://user.it.uu.se/~torer PAGE 1 What is a Distributed

More information

XML Data Integration in OGSA Grids

XML Data Integration in OGSA Grids XML Data Integration in OGSA Grids Carmela Comito and Domenico Talia University of Calabria Italy comito@si.deis.unical.it Outline Introduction Data Integration and Grids The XMAP Data Integration Framework

More information

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen

Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen Concepts and Architecture of Grid Computing Advanced Topics Spring 2008 Prof. Robert van Engelen Overview Grid users: who are they? Concept of the Grid Challenges for the Grid Evolution of Grid systems

More information

Trading Grid Services Within the UK e-science Grid

Trading Grid Services Within the UK e-science Grid Trading Grid s Within the UK e-science Grid Steven Newhouse, John Darlington, Miqdad Asaria, Anthony Mayer & William Lee London e-science Centre, Imperial College London, London, UK. email: sjn5,jd,ma299,aem3,wwhl@doc.imperial.ac.uk

More information

Salesforce integration with Enterprise Open Source. Mischa de Vries László van den Hoek SFDC Consultant OS Consultant

Salesforce integration with Enterprise Open Source. Mischa de Vries László van den Hoek SFDC Consultant OS Consultant Salesforce integration with Enterprise Open Source Mischa de Vries László van den Hoek SFDC Consultant OS Consultant Agenda An Introduction to Salesforce Integration: On-Premise vs Cloud Salesforce Integration

More information

Auditing Data Access Without Bringing Your Database To Its Knees

Auditing Data Access Without Bringing Your Database To Its Knees Auditing Data Access Without Bringing Your Database To Its Knees Black Hat USA 2006 August 1-3 Kimber Spradlin, CISA, CISSP, CPA Sr. Manager Security Solutions Dale Brocklehurst Sr. Sales Consultant Agenda

More information

Bioinformatics and escience. Abstract

Bioinformatics and escience. Abstract Bioinformatics and escience W.A. Gray 1 and C. Thompson 2 1 Cardiff University, School of Computer Science, PO Box 916, Cardiff CF24 3XF, 2 BBSRC, Polaris House, North Star Avenue, Swindon SN2 1UH Abstract

More information

Methods and tools for data and software integration Enterprise Service Bus

Methods and tools for data and software integration Enterprise Service Bus Methods and tools for data and software integration Enterprise Service Bus Roman Hauptvogl Cleverlance Enterprise Solutions a.s Czech Republic hauptvogl@gmail.com Abstract Enterprise Service Bus (ESB)

More information

Web Services Data Access and Integration The Core (WS-DAI) Specification, Version 1.0

Web Services Data Access and Integration The Core (WS-DAI) Specification, Version 1.0 GFD-R.74 DAIS Working Group Mario Antonioletti, University of Edinburgh Malcolm Atkinson, NESC Mike Jackson, University of Edinburgh Amy Krause, University of Edinburgh Simon Laws, IBM Steven Lynden, AIST

More information

BIRT Document Transform

BIRT Document Transform BIRT Document Transform BIRT Document Transform is the industry leader in enterprise-class, high-volume document transformation. It transforms and repurposes high-volume documents and print streams such

More information

DBX. SQL database extension for Splunk. Siegfried Puchbauer

DBX. SQL database extension for Splunk. Siegfried Puchbauer DBX SQL database extension for Splunk Siegfried Puchbauer Agenda Features Architecture Supported platforms Supported databases Roadmap Features Database connection management SQL database input (content

More information

Querying Databases Using the DB Query and JDBC Query Nodes

Querying Databases Using the DB Query and JDBC Query Nodes Querying Databases Using the DB Query and JDBC Query Nodes Lavastorm Desktop Professional supports acquiring data from a variety of databases including SQL Server, Oracle, Teradata, MS Access and MySQL.

More information

LSC @ LDAPCON. 2011. Sébastien Bahloul

LSC @ LDAPCON. 2011. Sébastien Bahloul LSC @ LDAPCON. 2011 Sébastien Bahloul About me Developer and software architect 10 years experience in IAM Recently hired as product manager by a French security editor, Dictao, providing : personal and

More information

Automated Data Ingestion. Bernhard Disselhoff Enterprise Sales Engineer

Automated Data Ingestion. Bernhard Disselhoff Enterprise Sales Engineer Automated Data Ingestion Bernhard Disselhoff Enterprise Sales Engineer Agenda Pentaho Overview Templated dynamic ETL workflows Pentaho Data Integration (PDI) Use Cases Pentaho Overview Overview What we

More information

THE US NATIONAL VIRTUAL OBSERVATORY. IVOA WebServices. William O Mullane The Johns Hopkins University

THE US NATIONAL VIRTUAL OBSERVATORY. IVOA WebServices. William O Mullane The Johns Hopkins University THE US NATIONAL VIRTUAL OBSERVATORY IVOA WebServices William O Mullane The Johns Hopkins University 1 What exactly is a WS? FROM http://dev.w3.org/cvsweb/~checkout~/2002/ws/arch/wsa/wd-wsaarch.html#whatisws

More information

Consolidate by Migrating Your Databases to Oracle Database 11g. Fred Louis Enterprise Architect

Consolidate by Migrating Your Databases to Oracle Database 11g. Fred Louis Enterprise Architect Consolidate by Migrating Your Databases to Oracle Database 11g Fred Louis Enterprise Architect Agenda Why migrate to Oracle What is migration? What can you migrate to Oracle? SQL Developer Migration Workbench

More information

Cloud Computing with Windows Azure using your Preferred Technology

Cloud Computing with Windows Azure using your Preferred Technology Cloud Computing with Windows Azure using your Preferred Technology Sumit Chawla Program Manager Architect Interoperability Technical Strategy Microsoft Corporation Agenda Windows Azure Platform - Windows

More information

a division of Technical Overview Xenos Enterprise Server 2.0

a division of Technical Overview Xenos Enterprise Server 2.0 Technical Overview Enterprise Server 2.0 Enterprise Server Architecture The Enterprise Server (ES) platform addresses the HVTO business challenges facing today s enterprise. It provides robust, flexible

More information

Instruments in Grid: the New Instrument Element

Instruments in Grid: the New Instrument Element Instruments in Grid: the New Instrument Element C. Vuerli (1,2), G. Taffoni (1,2), I. Coretti (1), F. Pasian (1,2), P. Santin (1), M. Pucillo (1) (1) INAF Astronomical Observatory of Trieste (2) INAF Informative

More information

IT Exam Training online / Bootcamp

IT Exam Training online / Bootcamp DumpCollection IT Exam Training online / Bootcamp http://www.dumpcollection.com PDF and Testing Engine, study and practice Exam : 70-534 Title : Architecting Microsoft Azure Solutions Vendor : Microsoft

More information

Bringing Compute to the Data Alternatives to Moving Data. Part of EUDAT s Training in the Fundamentals of Data Infrastructures

Bringing Compute to the Data Alternatives to Moving Data. Part of EUDAT s Training in the Fundamentals of Data Infrastructures Bringing Compute to the Data Alternatives to Moving Data Part of EUDAT s Training in the Fundamentals of Data Infrastructures Introduction Why consider alternatives? The traditional approach Alternative

More information

Cancer Biomedical Informatics Grid (cabig)

Cancer Biomedical Informatics Grid (cabig) Cancer Biomedical Informatics Grid (cabig) V. Juggy Jagannathan Adjunct Professor of Computer Science West Virginia University VP of Research, MedQuist cabig Initiative by the National Cancer Institute

More information

<Insert Picture Here> Extending Hyperion BI with the Oracle BI Server

<Insert Picture Here> Extending Hyperion BI with the Oracle BI Server Extending Hyperion BI with the Oracle BI Server Mark Ostroff Sr. BI Solutions Consultant Agenda Hyperion BI versus Hyperion BI with OBI Server Benefits of using Hyperion BI with the

More information

Grid based Integration of Real-Time Value-at-Risk (VaR) Services. Abstract

Grid based Integration of Real-Time Value-at-Risk (VaR) Services. Abstract Grid based Integration of Real-Time Value-at-Risk (VaR) s Paul Donachy Daniel Stødle Terrence J harmer Ron H Perrott Belfast e-science Centre www.qub.ac.uk/escience Brian Conlon Gavan Corr First Derivatives

More information

Cross-domain Identity Management System for Cloud Environment

Cross-domain Identity Management System for Cloud Environment Cross-domain Identity Management System for Cloud Environment P R E S E N T E D B Y: N A Z I A A K H TA R A I S H A S A J I D M. S O H A I B FA R O O Q I T E A M L E A D : U M M E - H A B I B A T H E S

More information

Real Time Integrator 2.0 Technical Overview

Real Time Integrator 2.0 Technical Overview Real Time Integrator 2.0 Technical Overview An overview of Real Time Integrator 2.0 solutions, architecture and features www.sysrepublic.com Introducing Real Time Integrator 2.0 Real Time Integrator ()

More information

BIRN Update. Carl Kesselman

BIRN Update. Carl Kesselman BIRN Update Carl Kesselman Professor of Industrial and Systems Engineering Information Sciences Institute Fellow Viterbi School of Engineering University of Southern California Biomedical Informatics Research

More information

Contents. T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander

Contents. T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander T-110.5140 Network Application Frameworks and Web Services and 1.4.2008 Sasu Tarkoma Based on slides by Pekka Nikander Contents Short review of & related specs Web Services Driving forces Architecture

More information

CSE 132A. Database Systems Principles

CSE 132A. Database Systems Principles CSE 132A Database Systems Principles Prof. Victor Vianu 1 Data Management An evolving, expanding field: Classical stand-alone databases (Oracle, DB2, SQL Server) Computer science is becoming data-centric:

More information

QCDgrid Software Release Plan

QCDgrid Software Release Plan QCDgrid Software Release Plan Project Title: QCDgrid Document Title: QCDgrid Software Release Plan Document Identifier: QCDGRID2_RELEASE_PLAN_1.0 Document Filename: qcdgrid_release_plan.doc Distribution

More information