FEDERICA. Federated E-infrastructure Dedicated to European Researchers Innovating in Computing network Architectures. Mauro Campanella GARR

Transcription

1 W W W.FP7-F ED ER IC A.EU FEDERICA Fdratd E-infrastructur Ddicatd to Europan Rsarchrs Innovating in Computing ntwork Architcturs Mauro Campanlla GARR Mauro.campanlla@garr.it CPqD Workshop on Nw Architctur for Futur Intrnt Sptmbr 22-23, Campinas, Brasil

2 Agnda FEDERICA introduction and usr rquirmnts Framwork and architctur Infrastructur status Fdrating FEDERICA From ntworks to Infrastructurs Considration on Futur Intrnt Conclusions 2

3 FEDERICA at a glanc What: Europan Community co-fundd projct in its 7th Framwork Program in th ara Capacitis - Rsarch Infrastructurs, 3.7 MEuro EC contribution, 461 PMs Whn: 1st January Jun 2010 (30 months) Who: 20 partnrs, basd on stakholdrs on ntwork rsarch and managmnt: 11 National Rsarch and Education Ntworks, DANTE (GÉANT2), TERENA, 4 Univrsitis, Junipr Ntworks, 1 small ntrpris (MARTEL), 1 rsarch cntr (i2cat) - Coordinator: GARR (Italian NREN) Whr: Europ-wid -Infrastructur, opn to xtrnal connctions 3

4 FEDERICA Vision An -Infrastructur basd on virtualization in both computrs and ntwork is a fundamntal tool for rsarchrs on Futur (and currnt) Intrnt. Th facility should allow rsarchrs a complt control of thir st of rsourcs in a slic, nabling disruptiv xprimnts at all communication layrs. Particular car should b placd in rproducibility of th xprimnts and in th avoidanc of complxity. Such -Infrastructur can b built on xisting infrastructurs using a practical approach and should b abl to fdrat with othr facilitis. 4

5 FEDERICA: an -Infrastructur on NRENS -Infrastructurs Routr/Switch Host for Virtual nods Raw Ethrnt 1Gbps (Fibr latr) 5

6 Projct Timlin Jun 2009 Jun 2010 Slics Jan 2008 Month 11 6

7 FEDERICA Infrastructur Rquirmnts B tchnology agnostic and nutral (transparnt) to allow disruptiv and novl tsting, as to not impos constraints to rsarchrs. Th rquirmnt is valid for all layrs, not just th application layr and xtnds to th oprating systm usd. Ensur rproducibility of th xprimnts, i.. givn th sam initial conditions, th rsults of an xprimnt ar th sam. This rquirmnt is considrd of particular importanc. Provid to th usr complt control and configuration capabilitis within th assignd rsourcs Allow mor than on usr group to run xprimnts at th sam tim, without intrfrnc. Opn to intrconnct / fdrat with othr -Infrastructurs and Intrnt. This last rquirmnt plans for introprability and migration tsting. 7

8 Agnda FEDERICA introduction and usr rquirmnts Framwork and architctur Infrastructur status Fdrating FEDERICA From ntworks to Infrastructurs Considration on Futur Intrnt Conclusions 8

9 FEDERICA Framwork Th vision (rquirmnts) suggsts two ky framwork choics for th infrastructur, which ar at th cor of dsign: Th simultanous prsnc of computing and ntwork physical rsourcs. Ths rsourcs form th substrat of th infrastructur. Th us of virtualization tchnologis applid both to computing and ntwork rsourcs. Virtualization will allow crating virtual, un-configurd rsourcs. 9

10 Virtualization - a dfinition Virtualization is dfind hr as th capability to crat a virtual vrsion of a physical rsourc, both in th computing and ntwork nvironmnt. Th virtual rsourc should b functionally quivalnt to th physical on. Th virtual rsourcs (.g. a virtual circuit, a disk partition, a virtual computr) ar usually cratd by sgmnting a physical rsourc. Virtualization may crat un-configurd (clan) virtual rsourcs,.g. an imag of th hardwar of a computing lmnt on which (almost) any oprating systm can b installd. Rcursivity is not prcludd! 10

11 FEDERICA - Architctur Two lvls: 2. Th virtualization substrat. Th physical infrastructur which contains all th hardwar and softwar capabl to crat th virtual rsourcs; 3. Th lvl containing all virtual infrastructurs. Each containing th virtual rsourcs and th initial ntwork topology conncting thm. Two lmntary rsourc ntitis: 1. Connctivity. In form of a bit pip (point to point circuit) with or without capacity guarants and with or without a data link protocol. 2. A computing lmnt and its attributs, offring th quivalnt of a computr hardwar containing at last RAM, CPU and on ntwork intrfac, mass storag is optional. Th computing lmnt is capabl of hosting various oprating systms and prform also functionalitis (.g. routing) 11

12 Architctural layrs (pictorial) Th Rsourcs Routr/Switch Host for Virtual nods Raw Ethrnt 1Gbps (Fibr latr) Th first ordr slics ar vrtical to indicat that thr is no hirarchy btwn thm. Virtual rsourcs in diffrnt slics may b drivd from th sam physical rsourc. 12

13 Agnda FEDERICA introduction and usr rquirmnts Framwork and architctur Infrastructur status Fdrating FEDERICA From ntworks to Infrastructurs Considration on Futur Intrnt Conclusions 13

14 Infrastructur Status KTH SE SUNET NORDUN ET HEAnt IE SWITCH CH DFN DE PSNC PL GARR IT CESNET CZ Rd.s ES FCCN PT i2cat ES GRNET ICCS GR Hungarnt HU All links ar 1 Gbps Ethrnt Each PoP hosts on or mor larg PC and a ntwork switch/routr 14

15 Th Cor Substrat - HW Switch: Junipr MX480, Dual CPU, 1 lin card with 32 ports at 1Gb Ethrnt. Virtual and logical routing, MPLS, VLANs, IPv4, IPv6, 2 of th 4 lin cards hav hardwar packt QoS capabilitis) V-Nods: ach is a 2 x Quad cor 2GHz, 32GB RAM, 7+1 ntwork intrfacs, 2x500GB disks, VMwar ESXi 3.51 FEDERICA substrat 15

16 Th Cor Substrat - IP Managmnt plan dfind as an IP Autonomous Systm: AS : (public, no transit, all 4 cor nods pr with local NRENs which announc th AS to GN2 and Global Intrnt) activ IP v4 : /23 (public addrsss) activ IP v6 : 2001:760:3801::/48 (public) (to b configurd) NRENs and Global Intrnt FEDERICA substrat 16

17 Virtual Intrnt From physical to virtual 17

18 Pictorial of cration of a Slic Th usr rqusts an Infrastructur mad of L2 circuits, un-configurd virtual nods, to tst a nw BGP vrsion. Cration of: 1. usr crdntials and authntication and a Slic 2. Virtual Gatway (in rd) to bridg th usr from outsid into th slic 3. Crat rsourcs and connct thm as spcifid by th usr NRENs and Global Intrnt FEDERICA substrat (only CORE is shown) 18

19 Offring Slics for any Rsarch Using Virtualization tchnologis th FEDERICA -Infrastructur crats slics composd by virtual rsourcs (circuits, nods, routrs) Th slics ar configurd according to usrs rqusts Possibl us cass: - nw routing protocols - bhavior on th ntwork of distributd applications Global Intrnt - Intr-domain srvics FEDERICA substrat (only cor is shown) 19

20 Virtualizing th optical layr: A ral challng To virtualiz th optical layr th challng is to introduc th tchnology in th quipmnt and th optical pips: - optical quipmnt which can b slicd in virtual quipmnt compltly managd by th usr. Each usr may b capabl of configuring a diffrnt data link, a capacity, a multiplxing schma - ach optical pips may b slicd. Th issu: laving th digital domain for th analogu domain An xtnsion of FEDERICA to th optical layr is undrway. Virtualzation is availabl in som optical quipmnt (using.g. NtFPGA, advancd rprogrammabl hardwar). 20

21 FEDERICA - Rproducibility - - To nginr th infrastructur to hav th capability to offr rproducibl bhaviour on a subst of its rsourcs, som principls hav bn followd: hav a high physical circuit mshing whn hardwar assistd virtualization was not availabl, physical rsourcs wr addd (th cas of ntwork intrfacs in th VNods) nvr ovrbook a rsourc. As an xampl w assign a cor to a singl virtual machin and rsrv adquat mmory and disk to it. Th QoS capabl lin cards in th Junipr prmit TDM-lik slicing of th connctd circuits (a local QoS is guarantd in a small scal) Manually mapping of th virtual rsourcs to th physical rsourcs Not all th slics nd this lvl of assurancs, it is availabl for rsarchrs who rqust it. 21

22 FEDERICA charactristics Oprating Systm on V-Nods Chosn by t h us r. It can a lso b a ta ilord syst m Typ of app licat ion Any Usr Cont rol of nt working la yrs Fu ll cont rol do wn to Ethrnt in a s lic. IP Not mand atd in th usrõs slic Connct ion to Intrnt Usr nd to b phys ica lly on on of infrastru ctur s its Availab l No Currnt ly VMwa r is us d for syst m virtua lizat ion If th a pplicat ion rqu ir s spc ific hard wa r, it can b co nnctd or ho std in a PoP It is poss ibl to tst/tr ia l mod ificat ion of xist ing pro toco ls an d n w ons Extns ion to dark f ibr is b ing va luatd ac cord ing to usrõs rqusts It is usd to connct to th s lic from Intrn t and to initia lly ma nag th s lic Can b a d irct co nnct ion us ing a pub lic IP addrss or through a gat wa y (NAT) If no spc ia l hard war ha s to b man agd dirct ly, a ll tst ing can b do n r mot ly us ing Int rnt 22

23 FEDERICA charactristics Rproducibility guarants Ys, accord ing to usrõs rqust Connct ion to xtrna l labs or infrastru cturs Poss ibl Sca lab ility Low to mdium rsourc multiplicity on cur rnt infrastru ctur Usr cost Ra l cost non o r limitd (2/3 fundd by EC) md ium-high Scur ity of - th sub strat - th s lics Md ium Md ium-high Th phys ica l subst rat of th projct ha s bn ng in rd to nsur a high qua lity of th pr formanc of th virtua l rsourc s A virtua l tunn l can vratd on product ion Int rnt or a phys ica l connct ion can b s t up (cost to b df ind in this cas) Th g ogra phica l cov rag is larg. Th nu mb r of V-Nod s and nt work sys t m currnt ly limits th a va ilab l tota l nu mb r of virtua l rs ourc to hu ndr dth If th us rs has s pc ific r quir mnts, lik host ing hardwa r, phys ica l connct ion, thr might b a co st to b va luatd ca s by cas. Each usr is idntifid by crd ntia ls and th prf rr d pro toco l to connct to rsourc s is ssh, Th sub strat AS is protct d by fir wa lls at th pr ing points. S lics ar cannot commun icat. 23

24 Th Usr Policy Board tasks - - First contact point for usrs: - adviss and clarifis initial qustions and points to / clarifis issus in th compilation of th rqustd documnts (Usr Information kit) Rcivs th official rqusts from usrs and valuats tchnically (not scintifically!) th proposals (with th support of tchnical xprts) A u t h n t ic f o r s li c a t a a c U c s s r s F E D E R I C R A M U s c a c n a s s g V m ir t u n a l t S S l ic r v A A D A I U u t h S S n t ic r v a t io n r r r U - - Follows a usr with a ddicatd FEDERICA prson through th usr projct liftim Rcivs usr fdback V M a n a g m ir tu n a l S t S lic r v V r ( v ir tu a l s r ir t u a l i c M a n a 1 U s r S r v r 1 ( v ir tu a l g 0 m n t. 1 N / 2 t w o r R o u t r 1 ( lo g a lic c A lo g h is c o D in I U S t o a t h n o t s r k V s S n / h r d 4 ) U l a ) R S c ia l i r tu a l S r v r ) 24 2 ( v i r tu a l ) n f ig u r d t h

25 Usrs W hav th currnt usrs / projcts activ/in approval phas: Harmony scalability tst ovr FEDERICA - Monitoring and Routing tsts (ELTE / Onlab2) - HARMONY scalability (PHOSPHORUS projct) - Optical IP routr - Facilitis introprability (Univ.Dublin) - FEDERICA monitoring (CESNET Intrnal) - Virtualization Prformanc (KTH, Swdn) 25

26 Summary of Infrastructur Offr Th infrastructur is nginrd for : - Almost clan slat - achiving rproducibility of tsts - fast provisioning - control of lowr ntwork layrs - full control of virtual rsourcs by th usr - Accss from vrywhr in Intrnt to slics - May host usr s quipmnt - Fr-of-charg us of standard offr - Accss rqust modratd by a usr policy board - Simultanous us by rsarchrs groups ICCS 26

27 Rsarch aras (Challngs) Thr ar a som ky challngs for th volution of th projct and tightly connctd to virtualization : - Ral vrsus Virtual - VIrtualization srvic dfinition and automation of procdurs - Fdration - Complxity Ths aras ar coupld through.g. dfinition and standardization of rsourcs, control, managmnt and monitoring, scurity and policis for rsilincy. 27

28 Rsarch aras: Ral v.s. Virtual Th rproducibility and th stability of th bhaviour of th virtual rsourcs is a fundamntal rquirmnt for quantitativ valuations of nw idas. As an xampl, a virtual circuit may not b capabl of offring a constant, fixd amount of bit pr scond, and a virtual computr imag may not provid a constant CPU usag. Th quality of a virtual rsourc can thn b dfind as a function of th diffrnc btwn th bhaviour of th virtual and th physical rsourc. Th diffrnc is du to two main indpndnt causs: 5. Sharing of th physical rsourc with othr virtual rsourcs 7. Th virtualization tchnology itslf, usually a layr placd btwn th physical rsourcs and th virtual ons 28

29 Agnda FEDERICA introduction and usr rquirmnts Framwork and architctur Infrastructur status Fdrating FEDERICA From ntworks to Infrastructurs Considration on Futur Intrnt Conclusions 29

30 Why Fdrating FEDERICA Through Fdration FEDERICA may : - achiv bttr scaling capabilitis - accss diffrnt rsourc typs (.g. wirlss, snsors) - contribut to a richr nvironmnt offring to th usr - facilitat (nw) standards dfinition,.g. rsourc dscription, protocols, monitoring - (human) ntworking xprts Fdration should not mak accss mor complx to th usr, nithr xclud unforsn uss of th facilitis. 30

31 Fdrating FEDERICA Proposal to diffrntiat btwn various forms of fdration: intgratd ( th facilitis can b usd as on with a intr-domain common control plan) partially intgratd (only part of th control is xchangd,.g. calndar, AAA information) ovrlay (ach facility just uss th srvics of th othr without a common control plan, just a data plan. hr Exchang of information rlatd to monitoring, faults, and so on is possibl) All ths typs prsnt challngs. 31

32 FEDERICA Data and Control Plan Accss protocol : initially human-basd du to nd for schduling, scurity and tchnical agrmnts (no first com, first srv policy). Nxt stp may b partially automatizd using SOA (but it s ndd a standard rprsntation of rsourcs) Control plan is not fully automatd and it is a st of tools and manual configuration (du to th combind ntwork and systm rsourcs) IPv4, IPv6: snmp, BGP, OSPF, (G)MPLS Ntwork Layr substrat NRENs and Global Intrnt Data Link layr substrat Ethrnt P,Q Spanning tr, 802.1AX (Trunking) (G)MPLS Physical Layr substrat Fibr and Coppr - Static 32

33 Slic Data and Control Plan SLICE Application Layr SLICE Ntwork Layr May host any control plan Basic Data Plan is IP SLICE Data Link layr Ethrnt SLICE Physical Layr Fibr and Coppr Ntwork Layr substrat NRENs and Global Intrnt Data Link layr substrat Physical Layr substrat 33

34 Fdrating FEDERICA (cont) Issus for fdrations: Having a common control plan in a multidomain nvironmnt is vry difficult, as it placs many constraints to ach facility (in tim, tchnology and dvlopmnts). Nd to dvlop standard rsourcs rprsntation schmas for virtual rsourcs and virtual rsourc sts to xchang srvics. Th intr-facility xchang of information and synchronization btwn facilitis has to scal gracfully. Th Intra-facility control plan is complx, du to rsourc schduling and rsourcs mapping from virtual topology (slic) to physical topology, spcially if rproducibility or guarants ar mandatd. 34

35 FEDERICA - Onlab2 pr-fdration OnLab nods can b hostd in a slic. Thos nod hav full control of thir ntwork intrfac and circuits up to th grss from FEDERICA into Gnral Intrnt. Onlab Slic NRENs and Global Intrnt FEDERICA substrat 35

36 Fdrating slics FEDERICA can crat a slic containing fully mshd routrs. Th tst topology btwn thm can b chosn by th usr nabling or disabling intrfacs on th routrs. Virtual routrs slic Usr s managmnt slic (VLAN) NRENs and Global Intrnt FEDERICA substrat (only CORE is shown) 36

37 Fdrating FEDERICA plans - continu to fdrat at th slic lvl in th ovrlay modl - considr brokring slics (nd to undrstand SLA) and xtnd collaboration to othr projcts - valuat challngs of fdrating at th substrat lvl. Th main issu is th virtual rsourcs mapping to th physical substrat - agr and dvlop fdratd monitoring and rsourc rprsntation - discuss usr's rquirmnts for physical intrconnction including th optical layr - and kp things simpl 37

38 FEDERICA Infrastructur: Conclusions An infrastructur basd on virtualization, ntwork and computing rsourcs can offr a vry usful platform for innovation and rsarch at many (if not all) communication layrs and can b ralizd on xisting facilitis. FEDERICA can b considrd a toolbox to tst how policis for social an human Futur Intrnt may prform and b implmntd in infrastructur/ntwork functionalitis. Th physical rsourcs functionalitis and infrastructur nginring should nsur th functionality to guarant th quality of th virtualization for rproducibility. Fdration is of ky importanc but has many facts and complxitis. A practical approach through a supportiv or prfdration is advisd. 38

39 Agnda FEDERICA introduction and usr rquirmnts Framwork and architctur Infrastructur status Fdrating FEDERICA From ntworks to Infrastructurs Considration on Futur Intrnt Conclusions 39

40 Ntwork or Infrastructur? What ar now GÉANT/NRENs? GÉANT is no longr (only) a ntwork, it has volvd to an Infrastructur. Actually it can considrd as an infrastructur factory. Th GÉANT IP ntwork is just on of th infrastructurs it can crat. Th IP ntwork works in paralll with.g. LHCnt, th VLBI, FEDERICA, point to point circuits on th sam physical substrat. Th volution has bn (conomically and tchnically) possibl whn w got accss to th dark fibr rsourc crating hybrid ntworks. Th sam is tru for th NRENs 40

41 Th infrastructur: just bits? Bits ar th raw rsourc, which is also bcoming in most countris an affordabl commodity. Th handling of thos bits (for srvics) is rquiring mor and mor protocols and applications which may run typically insid a ntwork nod (a routr, a switch).g. routing outsid a ntwork nod, in computr,.g. th bandwidth on dmand controllrs (AutoBAHN) in both, collaborativly,.g. monitoring (prfsonar), AAI What mattrs ar th functionalitis and thir prformanc, hinting that w nd in th infrastructurs both gnral purpos,flxibl, computing lmnts and ddicatd ASICs / NtFPGAs for prformanc. => Dcoupling th location and HW from th functionality yilds intrsting possibilitis. 41

42 Th OpnFlow cas from In a classical routr or switch, th fast packt forwarding (data path) and th high lvl routing dcisions (control path) occur on th sam dvic. An OpnFlow Switch sparats ths two functions. Th data path portion still rsids on th switch, whil high-lvl routing dcisions ar movd to a sparat controllr, typically a standard srvr. A singl srvr may command mor than on forwarding ngin and can implmnt on thos ngins non-standard protocols. This is diffrnt from a virtual routr, which still rquirs th data to flow whr th dcision procss taks plac. 42

43 Adding Virtualization to th infrastructur Th infrastructur is composd by (optical) pips (bit flows) and by computrs (with or without ddicatd HW) that prform functions. For both, virtualization is an availabl, rapidly dvloping tchnology that crats from physical rsourcs, virtual rsourcs which bhav (almost) lik th ral ons : - virtual circuits (with or without QoS) - virtual computrs (including virtual routrs, switchs.) Th quality (rproducibility) of th virtual rsourcs bhaviour is th ky charactristic to valuat th virtual rsourcs. Th infrastructur is now capabl of additional innovation, at th pric of an incrasing complxity (.g. virtualization is in principl rcursiv). 43

44 Summary Th infrastructurs ar composd by pips (bit flows) and computrs (PCs, routrs, Optical Switchs). Functionalitis and prformanc may not b locatd in th sam HW and topologis do not follow th physical nvironmnt. Th plannd functionalitis and th softwar layr ar plannd to incras in siz and numbrs. Each infrastructur (substrat) will crat and hav to (partially) manag (control, monitor) stacks of othr infrastructurs it crats. 44

45 GARR IP Traffic (Sp 30th, 2008) Two days, 5 avrag GEANT2 (Rsarch) 2 days - 5 avrag 1/3 of pring with Gnral Intrnt Two days, 5 avrag Two yars, day avrag + pak 45

46 GARR IP Traffic (April 1st, 2009) Daily, 5m avrag + pak GEANT2 (rsarch) Two yars, day avrag + pak Daily, 5m avrag + pak Two days, 5 avrag Two yars, day avrag + pak 1/3 of Gnral Intrnt pring 46

47 GARR prings (1 wk) Rsarch Traffic Gnral Intrnt (1 out of 3 prs) 47

48 Dirctions to pondr (F.I. architctur) A high capacity bst ffort srvic (for both IPv4 and IPv6) rmains a must. It s th most flxibl tools to fast adapt to nw rquirmnts and th most conomical and simplr to manag. In othr words statistical multiplxing of packts (or frams) is a vry valid tchnology. It is also th asist intrfac to allow a simpl ubiquitous usr accss. Larg information storag sits will bcom mor and mor important, spcially whn tightly coupld with computing powr. E.g. Googl books, Europana, Earth and Astronomical maps, Biological data (if th copyright associations will prmit it ). Samlss multidomain opration is a ky, involving standardizd rsourc information xchang, and authntication and authorization Undrstand how to intrconnct with th radio clouds Dfnd transparncy and nutrality of th infrastructur W nd to kp things simpl and managabl 48

49 THE issu: Complxity Intrnt as Circuits Intrnt as BGP Prings (CAIDA) Softwar Virus SobigF ( F-scur) Th major risk is to crat a st of distributd systms which is too complx 49

50 Agnda FEDERICA introduction and usr rquirmnts Framwork and architctur Infrastructur status Fdrating FEDERICA From ntworks to Infrastructurs Considration on Futur Intrnt Conclusions 50

51 Conclusions For Futur (and prsnt) Intrnt rsarch and volution, FEDERICAlik infrastructurs nabl innovativ paths, xploiting virtualization. Virtualization may hlp in optimizing th hardwar (lss physical boxs in a PoP.g.), rducing maintnanc ovrhad and disclos nw capabilitis: - dcoupling functionalitis (routing, policis, ) from physical topology - mor rliabl srvic, thanks to virtual computing rsourc automatic failovr - simultanous production and tsting It also provids a simplr accss to usrs, from Univrsitis, to Privat Entrpriss, schools, in a way similar to cloud computing. Virtualization draws also a smoothr path to fdration. 51

52 Rfrncs FEDERICA : NRENs GÉANT : : GARR :

53 FEDERICA v.s. othr projcts Projct: Onlab2/ Plantlab Emulab FEDERICA fixd fixd Usr choic (almost any) No mulation control down to raw Ethrnt Mandatory usd to connct thn mulation Usd to connct, thn not ndd Physical dlay and capacity choic No mulation Ys (up to 1 Gb) guarants of rproducibility No mulation Ys Almost non, at any tim Almost non, at any tim rgulatd by a Usr Policy Board limitd non non mdium/larg larg limitd Oprating systm Control of lowr layrs IP Usr accss limits Cost Scalability 53