Future Developments in UniGrids and NextGRID

Transcription

1 Future Developments in UniGrids and NextGRID Dr. David Snelling Fujitsu Laboratories of Europe Unicore Summit Nice, France - October 2005

2 Overview Status Report New Gateway Architecture Parallel HTTP based File Transfer ETD based Virtual Organizations Update on Standards in Unicore Discussion

3 Quick Status Report UniGrids Highlights Unicore/GS V1.0 and V1.1 Released Explicit Trust Delegation Implemented Caused a small explosion in portal work Grid Programming Environment Released NextGRID Highlights Architecture White Paper Published Service Level Agreement Dynamics Semantically Enabled Workflow What Next?

4 Existing Gateway Architecture Firewall Unicore Client Unicore Gateway Network Job Supervisor WS Client Web Services Other Job Services Other Client Other Services Limitations ETD required to support the WS Web Server visiable outside the firewall Complex management Many open ports on the firewall Uincore Protocol Layer Authenticated HTTPS SSH, HTTP, GridFTP,...

5 New Gateway Architecture Unicore Client WS Client Unicore Gateway Firewall Other Web Services Web Service Enabled NJS Other Client Other Services Multi-Protocol Support UPL, HTTPS, SSH, Custom,... WS-Addressing Support Authentication and Authorization When available in the protocol Uincore Protocol Layer Authenticated HTTPS SSH, HTTP, GridFTP,...

6 Parallel HTTP File Transfer Status Quo Unicore UPL Web Services: In message body or attachments GridFTP Open Ports Requirements High performance on busy networks Parallel transfer valuable Same level of security as Unicore

7 Basic Idea UUDB Client Unicore Gateway Unicore GS Source UUDB Unicore Gateway Unicore GS Target Using Web W Service Protocols Advertise available protocols Define source and destination Monitor progress Available for use by Client or Server Extensive Testing on the NAREGI Network Simulator UPL or Web Service Authenticated HTTPS

8 Performance Comparison transferred data [MByte] GridFTP (5 streams) HTTPS (5 streams) HTTP (15 streams) Number of streams is the optimal for each protocol. HTTPS is bandwidth limited by Java based encryption. These results are for bad conditions. 100

9 Explicit Trust Delegation Unicore V4: Multi-site Job Unicore Client Job Server A Job Sub-job Dave Dave Dave Sub-job Dave Dave Server A Key: Authenticated SSL by X X Server B Sub-job Dave Job Y Job to run for and endorsed by X. Quill indicates where the Job is signed, e.g. private key available.

10 Explicit Trust Delegation Unicore V5: Portal Based Multi-site Job Web Service Client Dave Portal Job U: Dave Sub-job U: Dave Po. Po. Portal Key: Authenticated SSL by X X Server A Job U: Dave Sub-job U: Dave Po. Po. Job U:X Y Job to run for X endorsed by Y. If U:X is missing it is the same as Y. Server A Quill indicates where the Job is signed, e.g. private key available. Server B Sub-Job U: Dave Po.

11 EDT Based Virtual Organizations Aim Provide Support for Virtual Organizations Strategy Unicore User Database (UUDB) interacts with a VO Manager. ETD is needed to support sub-jobs and remote file transfer. Schedule Prototype in the next 8 months Call for requirements now! Standards needed to provide cross Grid VOs.

12 Typical VO AuthZ Process 2- ConsignJob (ID-887) 3- CheckUser (ID-887) Client ID-887 NJS UUDB: VO-554 -> uuid Run Job (VO-554): - SubJobs endorsed by the NJS 4- CheckVO(ID-887) 1- Register (ID-887) VO Manager: VO-554: ID-887, ID-675,... VO-542: ID-764, ID-675,...

13 Unicore and Standards Standards Priority Use the latest standard,... At the cost of early interoperation. Research has a role in standards development. Unicore Commits to: Infrastructure: WSRF, WSN, WS-Addressing Jobs: JSDL, BES IO: Data Transport And Supports: Btye-IO, DAI, CCDLM, ACS, SAGA, WSDM,...

14 Don t Mix Message and Content FEMA Logo: Questions?