INTEGRATED SDN. Application driven Network Virtualization. Slide 1

Transcription

1 INTEGRATED SDN Application driven Network Virtualization Slide 1

2 The Team Reinhard Budich, Max-Planck-Institute for Meteorology, Hamburg Andy Georgi, Technische Universität Dresden Eduard Beier Hubert Hérenger Rolf Sperber Slide 2

3 Our Target (Application Driven) Provide Applications with required Networking Resources Infrastructure Resources Bandwidth Latency Latency Variation Limited Loss Functional Resources Firewall PKI Compression Encryption Negotiation Solution Slide 3

4 Our Target (Carrier modelled Services as a Product) Provide a Carrier modelled Service with the required Networking Resources Infrastructure Resources Bandwidth Latency Latency Variation Limited Loss Functional Resources Firewall PKI Compression Encryption Negotiation Solution Slide 4

5 Branching Integrated SDN Application Oriented Carrier Service Oriented Requirements Integrated SDN continued Requirements Slide 5

6 The Challenge (Applications) Applications 1 - n Network Functions 1 k Multiple Applications Competing for E2E Connectivity Requesting Network Functions F 1 F 2 Network Domains 1 m F 3 Slide 6

7 The Challenge (New Service) One of Multiple Services Network Functions 1 k New Service Requesting Network Connectivity Requesting Network Functions F 1 F 2 Network Domains 1 m F 3 Slide 7

8 What is Available Application Requirements irods GPFS Infrastructure only Network Functions 1 k OpenFlow Netconf NSI Framework Controller Nothing here F 1 F 2 Network Domains 1 m F 3 Slide 8

9 What is Available NSI : Network Service Interface Service Requirements Architecture Network Functions 1 k OpenFlow Netconf NSI Framework Controller Nothing here F 1 F 2 Network Domains 1 m F 3 Slide 9

10 Consolidated Building Block Applications 1 - n Services Network Functions 1 k Set of Network Service Agents (NSA) Set of NSA, NSI Framework Set of NSA Infrastructure Set of NSA Function F 1 F 2 Network Domains 1 m F 3 Slide 10

11 Set of Tools API between Application / Modelled Service and Resource Requesters Network Service Agents Requesting Agent Ultimate Requesting Agent Aggregating Requesting Agent Providing Agent Ultimate Providing Agent Aggregating Providing Agent API between Ultimate Providing Agent and Resource Slide 11

12 Generalisation and Simplification Start with one Application / Service Define Exchange Format Parsing the Request Infrastructure related Request Network Function related Request Build Application specific Exchange Hierarchy Infrastructure Related Requests Other Requests Number of Requests Bandwidth Latency Number of Requests Acceleration Encryption Start Duration Slide 12

13 Application / Service Requests Final Graph Application / Service Requirements ura ansa gobal PA e.g. irods model output All requests concerning this specific application Consolidation of provided services RA ansa Network Resources PA Network resources only e.g. bandwidth, time, latency... RA ansa other Resources PA Other resources, e.g. Encryption, PKI, Compression Slide 13

14 NSA Graph Application / Service NSA NSA NRS NSA NFV NSA NRS 1 NSA NRS 2 NSA NRS m NSA NFV 1 NSA NFV 2 NSA NFV n Slide 14

15 Assigning Network Resources The Problem Revisited Multiple Domains Different Carriers Different Technologies Unification Consolidated View Consoilidated Configuration Access Network Operating System Slide 15

16 Assigning Network Infrastructure Resources Domain Topologies NOS RA ansa Network Resources PA Aggregating Network Service Agent. End to End Topology view RA NSA Domain e4 Resources upa RA NSA Domain e3 Resources upa RA NSA Home Domain Resources upa RA NSA Domain e1 Resources upa RA NSA Domain e2 Resources upa Slide 16

17 Assigning Virtual Network Functions The Problem Revisited Multiple Functions Different Impact Different Role in the Course Integration Right Place in the Course Priority with Regard to overall Functionality Global Network Service Agent Slide 17

18 Network Function Virtualization Building Blocks RA ansa Other Resources PA Aggregating Network Service Agent. Building Blocks other than infrastructure Building Block Repository RA RA RA RA RA NSA PKI NSA Comp. NSA Encr. NSA Acc. NSA Firew. upa upa upa upa upa Slide 18

19 Set of Building Blocks available for the Application / Services Co ura ansa gobal PA BW Lat. Lat. Var. Enc. Acc Slide 19

20 MULTIPLE APPLICATIONS / SERVICES Competing for Bandwidth Slide 20

21 Multiple, Competing Applications Application / Service Applications 1 - n Slide 21

22 Vector of Requirements for a single Application / Service X= x 1 x 2 x 3 x 4 x 5 Precise Requirements, i.e. per element one value possible Variable Requirements, i.e. for at least one element an interval of values possible Negotiable Requirements, i.e.for at least one element runtime negotiations possible Slide 22

23 Requiring Resources Application / Service Request Acknowledged Denied yes no Check Feasible Slide 23

24 Requirements and Game Theory All Resources assigned New Application / Service starting Resources will have to be taken away from other applications First check, if minimum requirements will still be met If yes start negotiating for requirements If no deny Negotiate assignment of network resources between applications Slide 24

25 USE CASE CLIMATE RESEARCH Distributed, very large datasets Slide 25

26 Slide 26

27 Resolution Slide 27

28 Climate is a world-wide business Coupled Model Inter-Comparison Project Part of the preparations for the 5th Assessment Report of the International Panel on Climate Change (IPCC) due late 2014 Today: PBs of data are prepared, computed, federated and compared in a co-ordinated way 38 models ~ 15 countries (4 continents) ~ 50 PB of data ~ 1.5 PB replicated to PCMDI, BADC, DKRZ AR6 is on it s way, eta 2017/18 time frame Growth rates (orders of magnitude) 1 for the models 2 for data volume Slide 28

29 ... needs inter-comparison Every development work in climate modelling comprises comparison of realisations I introduced this small change... what happened to my model? Does it work? Does it work in the expected way? Are there consquences I did not expect?... A similar approach holds for teams, national, and international efforts: The Introduction and sophistication of scientific model inter-comparison is a unique property of this science community Slide 29

30 Multinational Research: The Challenge Climate Research Worldwide. MPI DKRZ 10/40 G 100/400 G 10 G Slide 30

31 TURBINE COMPUTATION Distributed Computation Slide 31

32 Typical Flutter Simulation Calculation Flutter simulation based application scenario Context: Aeroelastics (Involves fluid + structural mechanics) Code/Tools: Calculix (CSM, GPL) TRACE (CFD, DLR ) PREP (Preprocessor, DLR ) POST (Postprocessor, DLR ) Workflow: Calculix: Compute n Eigenmodes PREP: Mesh Displacement for m phase angles and n Eigenmodes TRACE: Run n x m jobs for a specified iteration count TRACE: Evaluate convergence criteria and rerun jobs POST: Do some postprocessing Slide 32

33 GPFS for Datamangement Details Data volume: ~ 1TB Overall Workflow: Multitude of independent simulation runs (HTC). Simulations running on HPC resources at different sites. Every simulation produces input data for subsequent simulations. Subsequent simulations again run at different sites. Thus to avoid knock-on delays in workflow execution data instantly should be available at different sites! GPFS: Adopted feature: Active File Management (AFM) and Stretched Cluster Cross site data replication allows running simulations without prior copying Implicit data consistent backup via AFM data replication Slide 33

34 Turbine Computing: Network Layout 3. Flutter Simulation (Solver 2) Chemnitz 1. Preprocessing at DSI Flutter Simulation (Solver 1) 4. Postprocessing at DSI 4. Storage Slide 34 34

35 USE CASE ENERGY DISTRIBUTION Enabling Atomized Energy Production Slide 35

36 Voltage Levels (simplified) High Voltage Medium Voltage Medium Volatge Low Voltage Low Voltage Low Voltage Low Voltage Backbone (Überregional) Metro Metro Local Area Local Area Local Area Local Area

37 Energy Distribution NH = Neighborhood NH NH NH NH NH NH Metro Metro Metro Backbone Metro Metro Metro NH NH NH NH NH NH

38 Local Area Interface P 1 C 1 Producer Consumer C 2 SL IC IC Interconnect to Metro C 1 P 2 C 5 P 3 P 5 TRSPON C 7 TRSTL Local Transformer and Storage P 1 C 3 C 6 P 6 SL Local Distribution Server C 4 P 4 C 8

39 Metro Interface P 1 L 1 Producer Industrial Consumption L 2 SM IC IC Interconnect to next voltage level P 2 TRSTM P 3 TRSTM Transformer and Storage in Metro L 1 P 1 L 3 SM Server in Metro IC SL SL SL

40 Backbone Interface P 1 Producer IC Interconnect into next voltge level P 2 SB TRSTB P 3 TRSTB Transformer and Storage in Backbone SB Backbone Server P 1 IC SM SM IC

41 Any Questions? HPC Network Consulting Rolf Sperber Slide 41

42 References (institutional) IETF: RFC 6241 Network Configuration Protocol ITU-T: G.805: Generic Functional Architecture of Transport Networks NSI WG (Network Service Interface Workgroup in OGF Network Service Framework Network Topology Descriptions in Hybrid Networks NSI Connection Service Protocol NSI Topology Representation NSI Topology Service Distribution Mechanisms ONF: OpenFlow Switch Specification Slide 42

43 References (individual papers) Roscoe, Timothy: The End of Internet Architecture / Sidney, Berkeley, Zurich / 2006 Schwerdel, Guenther, Rahamatulla, Khondoker, Reuther, Mueller: A Buildiung Block Model for Flexible Future Internet Architectures / Kaislerslautern 2013 Intrilligator: Mathematical Optimization and Economic Theory / Englewood Cliffs1971 Slide 43