The Grid and the Network

Transcription

1 The Grid and the Network The UK Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 1

2 The Grid and the Network The UK Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 2

3 SuperJANET 4 UK National Network Managed by UKERNA 10 Gbit/s core Regional Distribution IP Production Service Multicast enabled IPv6 rollout QoS Rollout MPLS Capable in core North Wales MAN TVN External Links NNW MidMAN Northern Ireland C&NL MAN South Wales MAN Clydenet UHI Network Reading Glasgow Warrington Bristol SWERN FaTMAN AbMAN Edinburgh Portsmouth LeNSE Leeds London EaStMAN External Links LMN NorMAN YHMAN EMMAN EastNet Kentish MAN 3

4 SuperJANET R&D Network Parallel R&D Network Ethernet infrastructure 1 10 Gbit/s Can connect any UK institute in principle Currently connects 3 sites RAL North Wales MAN MidMAN TVN External Links NNW Northern Ireland UHI Network Reading Glasgow Warrington Bristol AbMAN Clydenet FaTMAN EaStMAN C&NL MAN Edinburgh Portsmouth Leeds London External Links LMN NorMAN YHMAN EMMAN EastNet Kentish MAN South Wales MAN SWERN LeNSE 4

5 UKLIGHT is. UK Joining Global optical testbed R&D links to NL and USA 10 Gbit/s Available for leading edge network projects Designed to pilot new ways of networking Motivated on lightpath switching below IP layer 5

6 UKLight showing connections to selected International peer facilities CA*net StarLight Chicago 10Gb/s UKLight London SuperJANET R&D Network UK Researchers 2.5Gb/s 10Gb/s Abilene 10Gb/s CERN 10Gb/s 10Gb/s Local Research Equipment NetherLight Amsterdam CzechLight International Point-of-Access GEANT 6

7 UKLIGHT Projects already suggested Particle Physics Radio Astronomy HPC interconnection and computational steering Medical Diagnostic Imaging UKLIGHT Open Meeting What is the International Light infrastructure How projects might use it 3rd November Will publicise through UKERNA & NeSC web sites If anyone wants to go let me know!!!!!!!! 7

8 SuperJANET 5.. The Next Generation UK Network.. May look like this.. Multi service Routed IP Layer 2??? Layer 1 Start 2005 Router Router 8

9 The Grid and the Network The UK National Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 9

10 GRID Networking Projects EU DataGRID Network information systems and transport optimisation GRS: GRID resource management FutureGRID P2P architecture EU DataTAG TCP & QoS Network GridMcast, Multicast data distribution EU 6NET Network Services GRID Middleware MB-NG TCP & QoS GRIDprobe monitoring at 10Gbps 10

11 A Leading Edge QoS enabled Development network MANCHESTER SuperJANET GE-WAN OC-48 POS Wcom: Gbit/s 1.0 Gbit/s Wcom: UCL-LONDON RAL -OXFORD GE-WAN OC-48 POS OC-48 POS GE-WAN Wcom: ULCC: x GE 1 x GE 11

12 Objectives To demonstrate > Gbit/s Data Transport To demonstrate the use of QoS for e-science To pilot Managed Bandwidth using MPLS To pilot resource reservation middleware Partners UCL, Manchester, CCLRC Daresbury & RAL, CISCO, Spirent, [Lancaster, Cambridge, Southampton] 12

13 GRID Resource Scheduling (GRS) Objectives Integrate QoS into GRID resource model. QoS allocation and reservation Micro-management of QoS at edge sites. Partners UCL, Cambridge 13

14 GridProbe Objectives: Architecture for modular network monitoring at 10 Gbps. Analysis tools Extrapolation to 40 Gbps and beyond, Partners: Cambridge, Intel, Waikato DAG, Broadcom, Xilinx, NTL, Thus 14

15 GridMcast Objective: Multicast for data and software replication Partners: Cambridge e-science Centre, GridPP(EU), ATLAS (CERN) 15

16 FutureGRID Objectives: Deploy Xenoservers Active nodes at Access Grid sites (all e- Science Centres) Port the Pastry message routing and the Scribe event notification frameworks to Xenoserver with accounting and resource management of network usage (multicast congestion control) Design suitable API based on GRID GGF models WSDL/OGSA Refinement and implementation of application set (vic, rat, fcast, powerpoint) to new infrastructure, including gateways to legacy native multicast versions. Partners: Cambridge (CLab, Microsoft Research). 16

17 The Grid and the Network The UK National Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 17

18 IPv6 and the Grid IPv6 testbed exists in UK (6Net) connects: Southampton UCL - Lancaster SuperJANET-4 is being IPv6 enabled The GGF has an IPv6 working Group : UCL is involved in this (one Chair) Southampton &UCL porting Globus-3 to IPv6 18

19 High PerformanceTransport Protocols Deployment and Testing (UCL, Manchester) CS groups (Southampton, UCL, Lancaster, Cambridge.) Includes Modified TCP Non TCP New Long term protocols Throughput Mbits/s Background Mbits/s 19

20 The Grid and the Network The UK National Network Infrastructure A summary of E-Science supported Network projects in the UK Protocols Middleware for network services 20

21 Network Performance information measurement and publication 21

22 Diagnostic Tools for Users Grid Resource Information System Services for NOCs Globally Agreed interface Web Services XML Schemas Domain Specific NREN Geant Inet-2 22

23 Existing developments: DANTE / TERENA Internet-2 GGF Network Monitoring WG Global schema work [PERT Will be taken forward in EGEE Geant 2 23

24 Network Resource Allocation and Reservation Application Resource Provider AAA AAA AAA AAA AAA Configure Configure Configure Configure Configure Site Site NREN NREN -A -A Geant Geant NREN NREN Site -B Site -B 24

25 Existing work: GARA /Globus DataTAG work UvA AAA work UCL GRS and Cardiff G-QoS Canarie OGSA lightpath service work Would like to know of other work 25

26 Summary Activities in the UK are ensuring that the network is ready to serve the Grid at all levels Infrastructure Current 10 Gbit/s network - Future multi layer hybrid network UKLIGHT optical networking node Protocols IPv6 community and network infrastructure Advanced TCP and non-tcp transport protocol work QoS Services & Middleware Performance measurement and publication to Grid Information services Diagnostics for Grid operations Resource allocation and reservation Middleware EGEE Responsibility Many opportunities for UK Japan Joint Network Activities using research network infrastructure 26

27 27

28 GridPP Testbed All HEP experiment sites are part of Gavin s green dot map. At least a Globus gatekeeper was running at some point. In almost all cases this is actually an EDG gatekeeper - ie with extra functionality. 28

29 GridPP Testbed Uses Resource Broker at IC, MDS at RAL and VO at Manchester. Yesterday s snapshot: Result of: Birmingham 2 cpus Bristol 3 Cambridge 16 IC 16 (+ 80 BaBar) Liverpool 2 Manchester 8 (+ 60 DZero/Atlas) Oxford 1 RAL 6 (+Tier1/A) UCL 2 Core team in UK working within EDG Bi-weekly operational phone call 29

30 EDG testbed Application testbed: More than 1000 CPUs 5 Terabyte of storage EDG sw installed at more than 40 sites 30

31 EDG Testbed Snapshot for EU review: CERN nl: Nikhef 140 fr: CC Lyon 22? + 74? + 409? fr: Polytechnique/LLR 6 it: CNAF Bologna 48 it: Padova 11 it: Legnaro 48 uk: IC uk: Liverpool 2 uk: Manchester uk: Oxford 1 uk: RAL 6 (so we re doing ok internationally) 31

32 Comparison of UK L2 grid and PP Grid Application PP Applications L2 Grid Value added components EDG 2.0 Value added Components Data Man. RB VOMS EDG Info??? Simple User management UK MDS GT2 escience CA GT2 Network monitoring 32

33 E.g. CMS use of the EDG TB 250,000 Event Production within EDG as part of the Official CMS production Nb. of evts time SEs CEs 33