|
|
|
- Gerald Jennings
- 10 years ago
- Views:
Transcription
1 Data Center N etw o rk i ng A rc h i tec tu re and Des i g n G u i d el i nes 1
2 Agenda Data Center Infrastructure Co re l ay er d esi g n A g g reg ati o n l ay er d esi g n A ccess l ay er d esi g n Densi ty and scal ab i l i ty i m S cal i ng b and w i d th and d ensi ty Increasi ng H A i n th e DC p l i cati o ns 2
3 w D at a C ent er Ar c h i t ec t u r e O L ay ers o f th e Data Center M ul ti -T i er M o d el v er v i ew Layer 2 and layer 3 access t o p o lo g i es D u al and si ng le at t ach ed 1 RU and b lade serv ers M u lt i p le ag g reg at i o n m o du les W eb / ap p / dat ab ase m u lt i -t i er env i ro nm ent s L2 adj acency req u i rem M i x o f o v er-su b scri p t i o n req u i rem ent s ent s E nv i ro nm ent al i m p li cat i o ns S t at ef u l serv i ces f o r secu ri t y and lo ad b alanci ng L 2 w / Clu st er in g an d N I C T eam in g Blade Chassis w / P ass T hr u Network Blade Chassis / I n t eg r at ed S w it c h D C C ore D C A g g reg a ti on M ain f r am e w / O S A D C A c c es s L 3 A c c ess 3
4 Co re L ay er Des i g n 4
5 P C o r e L ay er D es i gn R eq ui rem ents Is a separate DC Core L ay er req u i red? Con si d er: 10GigE port density A dm inistra tiv e dom a ins A ntic ipa te f u tu re req u irem K ey c ore c h arac teri sti c s D istrib u ted f orw a rding a rc h itec tu re L ow l a tenc y sw itc h ing 10GE sc a l a b il ity A dv a nc ed EC M A dv a nc ed h a sh ing a l gorith m S c a l a b l e I P m ents u l tic a st su pport s S c alin g Cam p u s A c c ess L ay er Cam p u s D ist r ib u t io n Cam p u s Co r e D C Co r e A g g r eg at io n S er v er F ar m A c c ess L ay er S c alin g 5
6 W C o r e L ay er D es i gn L 2 / L 3 Ch aracteri sti cs L ay er 2 / 3 b ou n d ari es: A l l L a yer 3 l ink s a t c ore, L 2 c onta ined a t/ b el ow a ggrega tion m odu l e L 2 ex tension th rou gh c ore is not rec om m ended CE F h ash i n g al g ori th m D ef a u l t h a sh is on L 3 I P a ddresses onl y L 3 + L 4 port is optiona l a nd m a y im prov e l oa d distrib u tion CORE1(config)#m l oad f u l l si m pl e l s i p c ef L e v e r a ge s a u t om a t ic s ou r ce p or t r a nd om iz a t ion in cl ie nt T CP s t a ck L 3 L 2 D C Co r e A g g r eg at io n A c c ess eb S er v er s Cam p u s Co r e A p p lic at io n S er v er s D at ab ase S er v er s CE F H ash A p p lied t o P ac k et s o n E q u al Co st R o u t es 6
7 W C o r e L ay er D es i gn R o uti ng P ro to co l Desi g n: O S P F N S S A h el ps to l im it L S A propa ga tion, b u t perm its rou te redistrib u tion ( R H I ) A dv ertise def a u l t into N S S A, su m m a riz e rou tes ou t O S P F def a u l t ref erenc e b / w is 100M, u se a u to-c ost ref erenc e-b a ndw idth set to 10G v a l u e V L A N s on 10GE tru nk s h a v e O S P F c ost = 1G ( c ost 1000), a dj u st b a ndw idth v a l u e to ref l ec t 10GE f or intersw itc h L 3 v l a n L oopb a c k interf a c es sim pl if y trou b l esh ooting ( neigh b or I D ) U se pa ssiv e-netw ork def a u l t: open u p onl y l ink s to a l l ow U se a u th entic a tion: m ore sec u re a nd a v oids u ndesired a dj a c enc ies T im ers spf 1/ 1, interf a c e h el l o-dea d = 1/ 3 A rea 0 NS S A eb S er v er s Cam p u s Co r e A p p lic at io n S er v er s D at ab ase S er v er s D C Co r e L0 = L0 = Default Default DC Subnets ( Sum m a r i z ed ) L3 v l a n -o s p f A g g r eg at io n L0 = L0 = A c c ess 7
8 W C o r e L ay er D es i gn R o uti ng P ro to co l Desi g n: E IG R P A d v erti se d ef au l t i n to DC w i th i n terf ac e c om m an d on c ore: ip s u m m a r y -a d d r e s s e ig r p Cam p u s Co r e C o s t o f r e q u ir e d t o b e pr e f e r r e d r o u t e o v e r t h e N U L L 0 r o u t e in s t a l l e d b y E I G R P If oth er d ef au l t rou tes ex i st ( f rom i n tern et ed g e f or ex am pl e), m ay n eed to u se d i stri b u te l i sts to f i l ter ou t U se passi v e-n etw ork d ef au l t DC Subnets ( Sum m a r i z ed ) Default Default L3 v l a n -e i g r p D C Co r e A g g r eg at io n S u m m z b n c w i i n c m d g : ari e DC su ets to ore th terf ac e om an on ag A c c ess ip s u m m a r y -a d d r e s s e ig r p eb S er v er s A p p lic at io n S er v er s D at ab ase S er v er s 8
9 A g g reg ati o n L ay er Des i g n 9
10 M Aggr egat i o n L ay er D es i gn S p anni ng T ree Desi g n Rap i d-p V S T + ( w ) o r M S T ( s) C h o i ce o f. 1 w /. 1 s b ased o n scale o f lo g i cal+v i rt u al p o rt s req u i red R-P V S T + i s reco m m ended and b est rep lacem ent f o r d R o o t P r i m a r y H SR P P r i m a r y A c ti v e Co ntex t Co r e R o o t Sec o nd a r y H SR P Sec o nd a r y Sta nd by Co ntex t Fast converging: inherits proprietary enhancem ents ( U pl ink -f ast, B ack b one-f ast) A ccess l ayer u pl ink f ail u res: ~ m s 2 sec ost f l ex ib l e d esign options C om b ined w ith R ootg u ard, B P D U G u ard, L oopg u ard, and U D L D achieves m ost stab l e S T P environm ent U D L D gl ob al onl y enab l es on f ib er ports, m u st enab l e m anu al l y on copper ports R o o tg ua r d L o o p G ua r d B P DU G ua r d U DL D G l o ba l 10
11 Aggr egat i o n L ay er D es i gn Integ rated S erv i ces S erv i ces: F i rew al l, L o ad B al anci ng, S S L E ncry p ti o n/ Decry p ti o n + L4 -L7 serv i ces i nt eg rat ed i n C i sco C at alyst S erv er lo ad b alanci ng, f i rew all and S S L serv i ces m dep lo yed i n: A ctive-stand b y pairs ( A C E, FW S M 2. X ) A ctive-active pairs ( A C E, FW S M 3. 1 ) ay b e I nt eg rat ed b lades o p t i m i z e rack sp ace, cab li ng, m g m t, p ro v i di ng f lex i b i li t y and eco no m i es o f scale I nf lu ences m any asp ect s o f o v erall desi g n 11
12 Aggr egat i o n L ay er D es i gn A cti v e-s tand b y S erv i ce Desi g n A c ti v e-stan d b y serv i c es A ppl ic a tion c ontrol engine F irew a l l serv ic e m odu l e ( 3. x ) S S L m odu l e U n d er u ti l i z es ac c ess l ay er u pl i n k s U n d er u ti l i z es serv i c e m an d sw i tc h f ab ri c s od u l es M u l ti pl e serv i c e m od u l e pai rs d oes perm i t ac ti v e-ac ti v e d esi g n. R o o t P r y H S R P P r y A c t n t t im ar im ar iv e Co ex Co r e R o o t S ec o n dar y H S R P S ec o n dar y S t an db y Co n t ex t 12
13 Aggr egat i o n L ay er D es i gn A cti v e-a cti v e S erv i ce Desi g n A c ti v e-ac ti v e S erv i c e Desi g n A ppl ic a tion c ontrol engine S L B + S S L + F W 4 G/ 8 G/ 16 G sw itc h f a b ric options A c tiv e-sta ndb y distrib u tion per c ontex t F irew a l l serv ic e m odu l e ( 3. x ) T w o a c tiv e-sta ndb y grou ps perm it distrib u tion of c ontex ts a c ross tw o F W S M s ( not per c ontex t) P erm i ts u pl i n k l oad b al an c i n g w h i l e h av i n g serv i c es appl i ed In c reases ov eral l serv i c e perf orm an c e V L A N 5 : R o o t P r i m a r y H SR P P r i m a r y A c ti v e Co ntex t V L A N 6 : R o o t Sec o nd a r y H SR P Sec o nd a r y Sta nd by Co ntex t Co r e v lan 6 v lan 6 v lan 5 v lan 6 v lan 6 v lan 5 V L A N 6 : R o o t P r i m a r y H SR P P r i m a r y A c ti v e Co ntex t V L A N 5 : R o o t Sec o nd a r y H SR P Sec o nd a r y Sta nd by Co ntex t 13
14 M O Aggr egat i o n L ay er D es i gn E stab l i sh i ng P ath P reference E stab l i sh R o ute P reference fo r S erv i ce E nab l ed A p p l i cati o ns U se rou te h eal th i n j ec ti on f eatu re of A CE In trod u c e rou te-m ap to R H I i n j ec ted rou te to set d esi red m etri c A l i g n s ad v erti sed rou te of V IP w i th ac ti v e c on tex t on A CE, F W S M an d S S L serv i c e m od u l es A v oi d s u n n ec essary u se of i n ter-sw i tc h l i n k an d asy m m etri c al f l ow s 3. R o ute M ap o n H o s t R o ute S ets P r efer r ed etr i c o f R o ute r o u t e -m a p R H I p e r m i t 10 m a t c h i p a d d r e s s 44 s e t m e t r i c -t y p e t y p e I f H ealth y, I n s talls H o s t R o ute to V I P o n L o c al M S F C Co r e v lan 6 v lan 6 4. I f C o n tex t F ai lo v er c c ur s, R H I an d R o ute P r efer en c e F o llo w 1. A C E P r o b es to R eal S er v er s i n V I P to Deter m i n e H ealth v lan 5 v lan 6 v lan 6 v lan 5 14
15 Core and Aggregation Layer Design S T P, H S R P and S erv i ce Co ntex t A l i g nm ent A l i g n serv er ac c ess to pri m ary c om pon en ts i n ag g reg ati on l ay er: V l a n root P rim a ry H S R P insta nc e R o o t P r i m a r y H SR P P r i m a r y A c ti v e Co ntex t Co r e R o o t Sec o nd a r y H SR P Sec o nd a r y Sta nd by Co ntex t A c tiv e serv ic e c ontex t P rov i d es m ore pred i c tab l e d esi g n S im pl if ies trou b l esh ooting M ore ef f i c i en t traf f i c f l ow D ec rea ses c h a nc e of f l ow pingpong a c ross inter-sw itc h l ink 15
16 Aggr egat i o n L ay er D es i gn S cal i ng th e A g g reg ati o n L ay er A g g reg ati on m od u l es prov i d e: S pa nning tree sc a l ing H S R P S c a l ing A c c ess l a yer density 10GE/ GEC u pl ink s A ppl ic a tion serv ic es sc a l ing S L B / f irew a l l F a u l t dom a in siz ing Core l ay er prov i d es i n ter-ag g m od u l e tran sport: L ow l a tenc y distrib u ted f orw a rding a rc h itec tu re ( u se D F C s) 100, 000s P P S f orw a rding ra te P rov ides inter-a gg m odu l e tra nsport m ediu m in m u l ti-tier m odel A g g r eg at io n M o du le 1 A g g r eg at io n M o du le 2 Cam S er v er F ar m A c c ess L ay er S c alin g D C Co r e p u s Co r e A g g r eg at io n M o du le 3 16
17 O M Aggr egat i o n L ay er D es i gn U si ng V R F s i n th e DC ( 1 ) E nab les v i rt u ali z at i o n/ p art i t i o ni ng o f net w o rk reso u rces ( M S F C, A C E, F W S M ) P erm i t s u se o f ap p li cat i o n serv i ces w i t h m u lt i p le access t o p o lo g i es M ap s w ell t o p at h i so lat i o n M A N / W A N desi g ns su ch as w i t h M P LS V R F -G r een V R F -B l ue V R F -R ed F i r ew a l l a nd SL B Co ntex ts f o r G r een, B l ue, a nd R ed A g g 1 V L A N s I so l a te Co ntex ts o n A c c ess P L S o r th er Co r e Q T r unk s D C Co r e A g g 2 A l ter na te P r i m a r y Co ntex ts o n A g g 1 a nd 2 to A c h i ev e A c ti v e- A c ti v e Desi g n S ecu ri t y p o li cy m anag em ent and dep lo ym ent b y u ser g ro u p / v rf 17
18 G W Aggr egat i o n L ay er D es i gn U si ng V R F s i n th e DC ( 2 ) M aps th e v i rtu al i z ed DC to th e M P L S M A N / W A N c l ou d R ed V R F R ed V R F G r een V R F r een V R F B lue V R F Cam B lue V R F p u s Co r e: P -N o des A N / Br an c h A g g M o du le 1 D C Co r e PE PE A g g M o du le Q T r un k s Q T r un k s 18
19 A c c es s L ay er Des i g n 19
20 Ac c es s L ay er D es i gn Defi ni ng L ay er 2 A ccess L 3 rou ti n g i s f i rst perf orm i n th e ag g reg ati on l ay er L 2 topol og i es c on si st of l ooped an d l oop-f ree m od el s S tatef u l serv i c es at A g g c an b e prov i d ed ac ross th e L 2 ac c ess ( F W, S L B, S S L, etc. ) ed L 3 A g g 1 L 2 P r i m a r y R o o t P r i m a r y H SR P A c ti v e Ser v i c es I nter -Sw D C Co r e i tc h L i nk A g g 2 Sec o nd a r y R o o t Sec o nd a r y H SR P Sta nd by Ser v i c es V L A N s are ex ten d ed ac ross i n ter-sw i tc h l i n k tru n k f or l ooped ac c ess V L A N s are n ot ex ten d ed ac ross i n ter-sw i tc h l i n k tru n k f or l oop-f ree ac c ess 20
21 m Ac c es s L ay er D es i gn E stab l i sh a Determ i ni sti c M o d el A l i g n ac ti v e c om pon en ts i n traf f i c path on c om m on A g g sw i tc h : P rim a ry S T P root A g g reg a ti on - 1( c on f i g ) # s p a n n i n g -tree v l a n 1-10 root p ri m a ry P rim a ry H S R P ( ou tb ou nd) sta ndb y 1 priority X A c tiv e serv ic e m odu l es/ c ontex ts P a th pref erenc e ( inb ou nd) U se R H I & R ou te m R ou te-m a p a p pref erred-pa th a tc h ip a ddress x. x. x. x set m etric -3 0 ( a l so see sl ide 15 ) L 3 L 2 A g g 1 P r i m a r y R o o t P r i m a r y H SR P A c ti v e Ser v i c es P ath P r ef Def g w D C Co r e L 3 + L 4 H a sh y A g g 2 21
22 m Ac c es s L ay er D es i gn B al anci ng V L A N s o n U p l i nk s: L 2 L o o p ed A ccess D i st ri b u t es t raf f i c lo ad acro ss u p li nk s S T P b lo ck s u p li nk p at h f o r V LA N s t o seco ndary ro o t sw i t ch I f act i v e/ st andb y serv i ce o du les are u sed; co nsi der i nt er-sw i t ch li nk u t i li z at i o n t o reach act i v e i nst ance M u l tipl e service m od u l es m ay b e d istrib u ted on b oth agg sw itches to achieve b al ance C onsid er b / w of inter-sw itch l ink in a f ail u re situ ation I f i v i v i m o u ( A C E S M 3. 1 ) B C l act e/ act e serv ce du les are sed; and FW al ance contex ts+ hsrp across agg sw itches onsid er estab ishing inb ou nd path pref erence L 3 L 2 A g g 1 B l ue-p r i m a r y R o o t B l ue-p r i m a r y H SR P R ed -Sec R o o t R ed -Sec H SR P D C Co r e L 3 + L 4 H a sh Def g w y Def g w y A g g 2 R ed -P r i m a r y R o o t R ed -P r i m a r y H SR P B l ue-sec R o o t B l ue-sec H SR P q T r unk s 22
23 A c c es s L ay er Des i g n L 2 L ooped Desi g n M od el 23
24 Ac c es s L ay er D es i gn L o o p ed Desi g n M o d el V LA N s are ex t ended b et w een ag g reg at i o n sw i t ch es, creat i ng t h e lo o p ed t o p o lo g y S p anni ng t ree i s u sed t o p rev ent act u al lo o p s ( rap i d P V S T +, M S T ) Redu ndant p at h ex i st s t h ro u g h a seco nd p at h t h at i s b lo ck i ng T w o lo o p ed t o p o lo g y desi g ns: T riangl e and sq u are V LA N s m ay b e lo ad b alanced acro ss access layer u p li nk s I nt er-sw i t ch li nk u t i li z at i o n m u st b e co nsi dered as t h i s m ay b e u sed t o reach act i v e serv i ces P m a S T P R P m a H S R P A c v S i c ri ry oot ri ry ti e erv es L 3 L 2 I nter -Sw F. 1 Q T r unk F F F F S ec on d a ry S T P R oot S ec on d a ry H S R P S ta n d b y S erv i c es F F F B F B F F B L o o p e d T r i a n g l e i tc h L i nk F F L o o p e d S q u a r e 24
25 Ac c es s L ay er D es i gn L 2 L o o p ed T o p o l o g i es L 2 L o o p ed T r ian g le L 3 L 2 L 2 L o o p ed S q u ar e L 3 L 2 V LA N 1 0 V LA N 1 0 L ooped T riangl e A ccess S u ppo r t s V L A N e x t e n s io n / L 2 a d j a c e n c y a c r o s s a c c e s s l a y e r R e s il ie n c y a c h ie v e d w it h d u a l h o m in g a n d S T P Q u ic k c o n v e r g e n c e w it h W / S V LA N 1 0 R o w 2, Ca bi net 3 R o w 9, Ca bi net 8 S u ppo r t s s t a t e f u l s e r v ic e s a t a g g r e g a t io n l a y e r P r o v e n a n d w id e l y u s e d V LA N 2 0 L ooped S q u are A ccess S u ppo r t s V L A N e x t e n s io n / L 2 a d j a c e n c y a c r o s s a c c e s s l a y e r R e s il ie n c y a c h ie v e d w it h d u a l h o m in g a n d S T P Q u ic k c o n v e r g e n c e w it h W / S V LA N 1 0 R o w 2, Ca bi net 3 R o w 9, Ca bi net 8 S u ppo r t s s t a t e f u l s e r v ic e s a t a g g r e g a t io n l a y e r V LA N 2 0 A c t iv e -a c t iv e u pl in k s a l ig n w e l l t o A C E / F W S M 3. 1 A c h ie v e s h ig h e r d e n s it y a c c e s s l a y e r, o pt im iz in g 1 0 G E a g g r e g a t io n l a y e r d e n s it y 25
26 Ac c es s L ay er D es i gn B enefi ts o f L 2 L o o p ed Desi g n S erv i ces li k e f i rew all and lo ad b alanci ng can easi ly b e dep lo yed at t h e ag g reg at i o n layer and sh ared acro ss m u lt i p le access layer sw i t ch es V LA N s are p ri m ari ly co nt ai ned b et w een p ai rs o f access sw i t ch es b u t V LA N s m ay b e ex t ended t o di f f erent access sw i t ch es t o su p p o rt N I C team ing C l u stering L 2 ad j acency A d m inistrative reasons G eographical chal l enges R ow A, C a b 7 R ow K, C a b 3 L 3 L 2 D C Co r e 26
27 Ac c es s L ay er D es i gn Draw b ack s o f L ay er 2 L o o p ed Desi g n M ai n draw b ack : i f a lo o p o ccu rs t h e net w o rk m ay b eco m e u nm anag eab le du e t o t h e i nf i ni t e rep li cat i o n o f f ram es w Rap i d P V S T + co m b i ned w i t h S T P relat ed f eat u res and b est p ract i ces i m p ro v e st ab i li t y and h elp t o p rev ent lo o p co ndi t i o ns U D L D L oopgu ard R ootgu ard B P D U gu ard L im ited d om ain siz e S tay u nd er S T P w aterm ark s f or l ogical and virtu al ports D S T M A / 2 3 / 2 3 / 1 3 / 1 S w c 1 S w c 2 D S T M A C it h it h C 27
28 A c c es s L ay er Des i g n L 2 L oopf ree Desi g n M od el 28
29 m Ac c es s L ay er D es i gn L o o p -F ree Desi g n A lt ernat i v e t o lo o p ed desi g n 2 M o dels: Lo o p F ree U and Lo o p F ree I nv ert ed U B enef i t : sp anni ng t ree i s enab led b u t no p o rt i s b lo ck i ng so all li nk s are f o rw ardi ng L 3 L 2 D C Co r e L 3 L 2 B enef i t : less ch ance o f lo o p co ndi t i o n du e t o i sco nf i g u rat i o ns o r o t h er ano m ali es L2-L3 b o u ndary v ari es b y lo o p -f ree m o del u sed: U o r I nv ert ed-u I m p li cat i o n co nsi derat i o ns w i t h serv i ce m o du les, L2 adj acency, and si ng le at t ach ed serv ers L o o p F r ee U L o o p F r ee I n v er t ed U 29
30 Ac c es s L ay er D es i gn L o o p -F ree T o p o l o g i es L 2 L o o p -F r ee U L 3 L 2 L 2 L o o p -F r ee I n v er t ed U L 3 L 2 V LA N 1 0 V LA N 1 0 V LA N 2 0 V LA N 1 0 V LA N 2 0 L oop-f ree U A c c ess V L A N s c onta ined in sw itc h pa irs ( no ex tension ou tside of sw itc h pa irs) N o S T P b l oc k ing; a l l u pl ink s a c tiv e A u tosta te im pl ic a tions f or c erta in serv ic e m odu l es ( C S M ) A C E su pports a u tosta te a nd per c ontex t f a il ov er L oop-f ree In v erted U A c c ess S u pports V L A N ex tension N o S T P b l oc k ing; a l l u pl ink s a c tiv e A c c ess sw itc h u pl ink f a il u re b l a c k h ol es singl e a tta c h ed serv ers S u pports a l l serv ic e m im pl em enta tions odu l e 30
31 Ac c es s L ay er D es i gn L o o p -F ree U Desi g n and S erv i ce M o d ul es ( 1 ) L 3 L 2 A g g 1, A c ti v e Ser v i c es H S R P A g g 2, Sta nd by Ser v i c es H SR P Sec o nd a r y o n A g g 2 T a k es O v er a s d ef - g w y, B ut H o w to R ea c h A c ti v e Ser v i c e M o d ul es? M S F C o n A g g 1 SV I f o r I nter f a c e v l a n 1 0 G o es to Do w n Sta te i f U p l i nk i s th e O nl y I nter f a c e i n v l a n 1 0 V L A N 1 0 V L A N 1 1 V L A N 2 0, 2 1 I f th e u pl ink c onnec ting a c c ess a nd a ggrega tion goes dow n, th e V L A N interf a c e on th e M S F C goes dow n a s w el l du e to th e w a y a u tosta te w ork s C S M a nd F W S M h a s im pl ic a tions a s a u tosta te is not c onv eyed ( l ea v ing b l a c k h ol e) T ra c k ing a nd m onitoring f ea tu res m a y b e u sed to a l l ow f a il ov er of serv ic e m odu l es b a sed on u pl ink f a il u re b u t w ou l d you w a nt a serv ic e m odu l e f a il ov er f or one a c c ess sw itc h u pl ink f a il u re? N ot rec om m ended to u se l oop-f ree L 2 a c c ess w ith a c tiv e-sta ndb y serv ic e m odu l e im pl em enta tions. ( S ee sl ide on A C E nex t) 31
32 Ac c es s L ay er D es i gn L o o p -F ree U Desi g n and S erv i ce M o d ul es ( 2 ) A CE Co ntex t 1 A CE Co ntex t 1 H S R P L 3 L 2 H S R P S ec o n dar y o n A g g 2 T ak es O v er as def -g w y V L A N 1 0, 1 1 V L A N 2 0, 2 1 W i t h A C E : P er co nt ex t f ai lo v er w i t h au t o st at e I f u p li nk f ai ls t o A g g 1, A C E can sw i t ch o v er t o A g g 2 ( u nder 1 sec) Req u i res A C E o n access t ru nk si de f o r au t o st at e f ai lo v er M ay b e co m b i ned w i t h F W S M 3. 1 f o r act i v e-act i v e desi g n 32
33 Ac c es s L ay er D es i gn Draw b ack s o f L o o p -F ree Inv erted -U Desi g n S i n g l e attac h ed serv ers are b l ac k -h ol ed i f ac c ess sw i tc h u pl i n k f ai l s Di stri b u ted E th erch an n el c an red u c e c h an c e of b l ac k h ol i n g N IC team i n g i m prov es resi l i en c y i n th i s d esi g n In ter-sw i tc h l i n k sc al i n g n eed s to b e c on si d ered w h en u si n g ac ti v e- stan d b y serv i c e m od u l es L 3 L 2 D C Co r e 33
34 M M Ac c es s L ay er D es i gn Co m p ari ng L o o p ed, L o o p -F ree L oop ed T ri a n g l e L oop ed S q u a re U pl ink vl ans on A gg S w itch in B l ock ing or S tand b y S tate V L A N E x tension S u pported A cross A ccess L ayer S ervice od u l e B l ack - H ol ing on U pl ink Fail u re ( 5 ) ( 4 ) S ingl e A ttached S erver B l ack - H ol ing on U pl ink Fail u re ( 1, 2 ) A ccess S w itch D ensity per A gg M od u l e u st C onsid er I nter-s w itch L ink S cal ing L oop -F ree U L oop -F ree I n v erted U ( 4 ) ( 1, 2 ) / ( 3 ) ( 3 ) 1. U s e o f d is t r ib u t e d E t h e r C h a n n e l g r e a t l y r e d u c e s c h a n c e s o f b l a c k h o l in g c o n d it io n 2. N I C t e a m in g c a n e l im in a t e b l a c k h o l in g c o n d it io n 3. W h e n s e r v ic e m o d u l e s a r e u s e d a n d a c t iv e s e r v ic e m o d u l e s a r e a l ig n e d t o A g g 1 4. A C E m o d u l e pe r m it s L 2 l o o pf r e e a c c e s s w it h pe r c o n t e x t s w it c h o v e r o n u pl in k f a il u r e 5. A ppl ie s t o w h e n u s in g C S M o r F W S M in a c t iv e / s t a n d b y a r r a n g e m e n t 34
35 A c c es s L ay er Des i g n L 3 Desi g n M od el 35
36 Ac c es s L ay er D es i gn Defi ni ng L ay er 3 A ccess L3 access sw i t ch es co nnect t o ag g reg at i o n w i t h a dedi cat ed su b net L3 ro u t i ng i s f i rst p erf o rm t h e access sw i t ch i t self ed i n. 1 Q t ru nk s b et w een p ai rs o f L3 access sw i t ch es su p p o rt L2 adj acency req u i rem ent s ( li m i t ed t o access sw i t ch p ai rs) A ll u p li nk s are act i v e u p t o E C M P m ax i m u m o f 8, no sp anni ng t ree b lo ck i ng o ccu rs C o nv erg ence t i m e i s u su ally b et t er t h an sp anni ng t ree ( rap i d P V S T + i s clo se) P ro v i des i so lat i o n/ sh elt er f o r h o st s af f ect ed b y b ro adcast s L 3 L 2 D C Co r e D C C ore D C A g g reg a ti on D C A c c es s 36
37 m M M Ac c es s L ay er D es i gn N eed L 3 fo r M ul ti cast S o urces? M u l ti c ast sou rc es on L 2 ac c ess w ork s w el l w h en IG M P sn oopi n g i s av ai l ab l e D C Co r e D C C ore IG M P sn oopi n g at ac c ess sw i tc h au tom ati c al l y l i m i ts u l ti c ast f l ow to i n terf ac es w i th reg i stered c l i en ts i n V L A N D C A g g reg a ti on U se L 3 w h en IG M P sn oopi n g i s n ot av ai l ab l e or w h en parti c u l ar L 3 ad m i n i strati v e f u n c ti on s are req u i red L 3 L 2 L 3 A c c ess w it h u lt ic ast S o u r c es D C A c c es s L 3 A c c ess w it h u lt ic ast S o u r c es 37
38 Ac c es s L ay er D es i gn B enefi ts o f L 3 A ccess M i n i m i z es b road c ast d om ai n s attai n i n g h i g h l ev el of stab i l i ty M eet serv er stab i l i ty req u i rem en ts or i sol ate parti c u l ar appl i c ati on en v i ron m en ts Creates sm al l er f ai l u re d om ai n s, i n c reasi n g stab i l i ty A l l u pl i n k s are av ai l ab l e path s, n o b l oc k i n g ( u p to E CM P m ax i m u m ) F ast u pl i n k c on v erg en c e: f ai l ov er an d f al l b ac k, n o arp tab l e to reb u i l d f or ag g sw i tc h es L 3 L 2 D C Co r e D C C ore D C A g g reg a ti on D C A c c es s 38
39 m Ac c es s L ay er D es i gn Draw b ack s o f L ay er 3 Desi g n L 2 ad j ac en c y i s l i m i ted to ac c ess pai rs ( c l u steri n g an d N IC team i n g l i m i ted ) IP ad d ress spac e m an ag em en t i s m ore d i f f i c u l t th an L 2 ac c ess If m i g rati n g to L 3 ac c ess, IP ad d ress c h an g es m ay b e d i f f i c u l t on serv ers ( m ay b reak apps) W ou l d n orm al l y req u i re serv i c es to b e d epl oy ed at eac h ac c ess l ay er pai r to ai n tai n L 2 ad j ac en c y w i th serv er an d prov i d e statef u l f ai l ov er L 3 L 2 D C Co r e D C C ore D C A g g reg a ti on D C A c c es s 39
40 Ac c es s L ay er D es i gn L 2 o r L 3? W h at A re M y R eq ui rem ents? A g g reg a ti on A g g reg a ti on L 3 L 2 A c c es s Rapid PVST+ or MST L 3 L 2 A c c es s O SPF, E I G RP D if f icu l ties in m anaging l oops S taf f sk il l set; tim e to resol u tion C onvergence properties N I C team ing; ad j acency H A cl u stering; ad j acency L a y e r 2 L a y e r 3 T h e C h o i c e o f O n e D e s i g n V e r s u s t h e O t h e r O n e H a s t o D o W i t h : A b il ity to ex tend V L A N s S pecif ic appl ication req u irem ents B road cast d om ain siz ing O versu b scription req u irem ents L ink u til iz ation on u pl ink s S ervice m od u l e su pport/ pl acem ent 40
41 A c c es s L ay er Des i g n B l ad es erv ers 41
42 B l ade S er v er R eq u i r em Co nnecti v i ty O p ti o ns ent s U s i n g P a s s -T h r o u g h M o d u l e s U s i n g I n t e g r a t e d E t h e r n e t S w i t c h e s A g g reg a ti on L a y er E x tern a l L 2 S wi tc h es I n teg ra ted L 2 S wi tc h es B l a d e S erv er C h a s s i s I n t er f ac e 1 I n t er f ac e 2 B l a d e S erv er C h a s s i s 42
43 O B l ade S er v er R eq u i r em Co nnecti v i ty O p ti o ns ent s L ay er 3 ac c ess ti er m ay b e u sed to ag g reg ate b l ad e serv er u pl i n k s P erm its u sing 10GE u pl ink s into a gg l a yer A v oi d d u al ti er L ay er 2 ac c ess d esi g n s S T P b l oc k ing L ay er 3 A c c ess L 3 L 2 A g g r eg at io n L ay er 1 0 G E L 3 L 2 L ay er 2 A c c ess v er-su b sc ription L a rger f a il u re dom a in I n t eg r at ed L 2 S w it c hes Con si d er T ru n k F ai l ov er f eatu re of i n teg rated sw i tc h 43
44 B l ade S er v er R eq u i r em T runk F ai l o v er F eature ent s S w i tc h tak es d ow n serv er i n terf ac es i f c orrespon d i n g u pl i n k f ai l s, f orc i n g N IC team i n g f ai l ov er S ol v es N IC team i n g l i m i tati on s; prev en ts b l ac k - h ol i n g of traf f i c A c h i ev es m ax i m u m b an d w i d th u ti l i z ati on : N o b l oc k ing b y S T P, b u t S T P is ena b l ed f or l oop protec tion C a n distrib u te tru nk f a il ov er grou ps a c ross sw itc h es Depen d en t u pon th e N IC f eatu re set f or N IC T eam i n g / f ai l ov er I n teg ra ted L 2 S wi tc h es A g g reg a ti on B l a d e S erv er C h a s s i s Interface 1 Interface 2 44
45 Dens i ty and S c al ab i l i ty I m p l i c ati o ns i n th e Data Center 45
46 O D ens i t y and S c al ab i l i t y I m p l i c at i o ns M o d ul ar o r 1 R U A ccess L ay er S w i tch i ng M o d el s Where are the issues? C ab li ng P o w er C o o li ng S p anni ng t ree scalab i li t y M anag em ent v ersu b scri p t i o n S p ari ng Redu ndancy T he rig ht so l utio n is usual l y b ased o n b usin ess req uirem en ts H y b p l n c d d o rid im em en tatio s an an ex ist 46
47 D ens i t y and S c al ab i l i t y I m S erv er F arm Cab i net L ay o ut p l i c at i o ns ~ RU Se rv e rs pe r Rac k N- R ac k s p er R o w Con si d erati on s: H ow M a ny I nterf a c es per S erv er T op of R a c k S w itc h pl a c em ent or End of R ow / W ith in th e R ow S epa ra te S w itc h f or O O B N etw ork C a b l ing ov erh ea d v s. u nder f l oor P a tc h system s C ool ing c a pa c ity P ow er distrib u tion/ R edu nda nc y 47
48 D ens i t y and S c al ab i l i t y I m Cab i net Desi g n w i th 1 R U S w i tch i ng S erv ers Co nnect Di rectl y to a 1 R U S w i tch M i ni m i z es t h e nu m b er o f cab les t o ru n f ro m each cab i net / rack I f N I C t eam i ng su p p o rt : t w o -1 RU sw i t ch es are req u i red W i ll t w o 1 RU sw i t ch es p ro v i de eno u g h p o rt densi t y? C o o li ng req u i rem ent s u su ally do no t p erm i t a f u ll rack o f serv ers Redu ndant sw i t ch p o w er su p p ly are o p t i o n Redu ndant sw i t ch C P U co nsi derat i o ns: no t an o p t i o n G E C o r 1 0 G E u p li nk co nsi derat i o ns p l i c at i o ns C ab l in g re m ain s in c ab in e t s S in g le R ac k -2 S w it c hes D u al R ac k -2 S w it c hes 48
49 D ens i t y and S c al ab i l i t y I m N etw o rk T o p o l o g y w i th 1 R U S w i tch i ng M p l i c at i o ns o d el P r o : E f f ic ien t Cab lin g P r o : I m p r o v ed Co o lin g Co n : N u m b er o f D ev ic es/ M g m t Co n : S p an n in g T r ee L o ad G E C or 10 G E U p l i n ks? D C Co r e 4 U p l i n ks p er C a b i n et = 10 0 U p l i n ks T ota l to A g g L a y er A g g reg a ti on A c c es s C a b i n et 1 C a b i n et 2 C a b i n et 2 5 W i t h ~ 1, S e r v e r s / 2 5 C a b i n e t s = 5 0 S w i t c h e s 49
50 m D ens i t y and S c al ab i l i t y I m p l i c at i o ns Cab i net Desi g n w i th M o d ul ar A ccess S w i tch es S erv ers Co nnect Di rectl y to a M o d ul ar S w i tch C a b l e b u l k a t c a b inet f l oor entry c a n b e dif f ic u l t to a na ge a nd b l oc k c ool a ir f l ow T ypic a l l y spa c ed ou t b y pl a c em ent a t ends of row or w ith in row M inim iz es c a b l ing to A ggrega tion R edu c es nu m b er of u pl ink s/ a ggrega tion ports R edu nda nt sw itc h pow er a nd C P U a re options GEC or 10GE U pl ink C onsidera tions N EB S C onsidera tions C a b l es R ou te U n d er R a i s ed F l oor or i n O v erh ea d T ra y s 50
51 D ens i t y and S c al ab i l i t y I m N etw o rk T o p o l o g y w i th M p l i c at i o ns o d ul ar S w i tch es i n th e A ccess P r o : F ew er D ev ic es/ M g m t Co n : Cab lin g Challen g es Co n : Co o lin g Challen g es D C Co r e 2 U p l i n ks p er = 16 U p l i n ks to A g g L a y er A g g reg a ti on G E C or 10 G E U p l i n ks? A c c es s W i t h ~ 1, S e r v e r s / 9 S l o t A c c e s s S w i t c h e s = 8 S w i t c h e s ~8 Access Switches to Manage 51
52 M M D ens i t y and S c al ab i l i t y I m 1 R U and M o d ul ar Co m p ari so n p l i c at i o ns L o w er S T P P r o c M o r e I / O Cab les o du lar A c c ess F ew er Up lin k s A g g r eg ati o n 1 R U A c c ess H ig her S T P P r o c F ew er I / O Cab les o r e Up lin k s 52
53 D ens i t y and S c al ab i l i t y I m Densi ty : H o w M any N ICs to P l an F o r? T h ree to f ou r N ICs per serv er are c om m on F ront end or pu b l ic interf a c e S tora ge interf a c e ( GE, F C ) B a c k u p interf a c e B a c k end or priv a te interf a c e integra ted L igh ts O u t ( il O ) f or O O B m gm t M ay req u i re m ore th an tw o 1 R U sw i tc h es per rac k 3 0 serv ers@ 4 ports = 120 ports req u ired in a singl e c a b inet ( 3 x 4 8 port 1R U sw itc h es) M a y need h a rd l im its on c a b l ing c a pa c ity O O B M a na g em ent Sto r a g e H B A o r G E N I C p l i c at i o ns F r o nt E nd I nter f a c e B a c k E nd I nter f a c e B a c k up N etw A v oid c ross c a b inet a nd oth er c a b l ing nigh tm a res S in g le R ac k -2 S w it c hes D u al R ac k -2 S w it c hes C ab l in g re m ain s in c ab in e t s o r k 53
54 D ens i t y and S c al ab i l i t y I m H y b ri d E x am p l e w i th S ep arate O O B p l i c at i o ns A g g r eg ati o n O O B O O B O O B O O B 1 R U en d of row approac h : S m a l l er f a il u re dom a ins L ow pow er c onsu m ption ( k w / h r) GEC or 10GE u pl ink s P erm its serv er distrib u tion v ia pa tc h El im ina tes T O R port density issu e R eq u ires sol id pa tc h & c a b l ing system S eparate O O B sw i tc h : U su a l l y 10M Eth ernet ( il o) V ery l ow u til iz a tion D oesn t req u ire h igh perf orm a nc e S epa ra te l ow end sw itc h ok I sol a ted f rom produ c tion netw ork H y b ri d m od u l ar + 1 R U P rov ides f l ex ib il ity in design D u a l C P U + pow er f or c ritic a l a pps S ec onda ry port f or N I C tea m ing 54
55 O D ens i t y and S c al ab i l i t y I m v ersub scri p ti o n and U p l i nk s p l i c at i o ns W h at i s th e ov ersu b sc ri pti on rati o per u pl i n k? D ev el op a n ov ersu b sc ription ref erenc e m I dentif y b y a ppl ic a tion, tier, or oth er m Con si d erati on s ea ns odel F u tu re- tru e serv er c a pa c ity ( P C I -X, P C I - Ex press) S erv er pl a tf orm u pgra de c yc l e w il l inc rea se l ev el s of ou tb ou nd tra f f ic U pl ink c h oic es a v a il a b l e Giga b it Eth erc h a nnel 10GE 10Gig Eth erc h a nnel F l ex ib il ity in a dj u sting ov ersu b sc ription ra tio C a n I u pgra de to 10GE ea sil y? 10G Eth erc h a nnel? U pgra de C P U a nd sw itc h f a b ric? ( su p ?) 55
56 D ens i t y and S c al ab i l i t y I m S p anni ng T ree p l i c at i o ns 1 R U sw itc hin g in c rease c han c es o f l arg er sp an n in g tree d iam eter B l ad es erv er sw itc hes are l o g ic al l y sim il ar to ad d in g 1 R U sw itc hes in to the ac c ess l ay er A hig her n um b er o f trun k s w il l in c rease S T P l o g ic al p o rt c o un ts in ag g reg atio n l ay er D eterm in e sp an n in g tree l o g ic al an d v irtual in terf ac es b ef o re ex ten d in g V L A N s o r ad d in g trun k s U se ag g reg atio n m o d ul es to sc al e S T P an d 1 0 G E d en sity 56
57 S c al i ng B and w i d th and Dens i ty 57
58 S c al i ng B / W w i t h G E C and 1 0 G E O p ti m i z i ng E th erch annel U ti l i z ati o n Id eal i s g raph on top ri g h t B ottom l ef t g raph m ore ty pi c al A n al y z e th e traf f i c f l ow s i n an d ou t of th e serv er f arm : I P a ddresses ( h ow m a ny?) L 4 port nu m b ers ( ra ndom iz ed?) Def au l t L 3 h ash m ay n ot b e opti m al f or G E C: L 4 h ash m ay i m prov e agg(config) # p or t -ch anne l l oad b al ance s r c-d s t -p or t 1 0 G i g E g i v es y ou ef f ec ti v el y th e f u l l b an d w i d th w i th ou t h ash i m pl i c ati on s 58
59 S c al i ng B / W w i t h G E C and 1 0 G E U si ng E th erch annel M i n-l i nk s M i n -L i n k s f eatu re i s av ai l ab l e as of S X F S et th e m i n i m u m n u m b er of m em b er ports th at m u st b e i n th e l i n k -u p state or d ec l are th e l i n k d ow n P erm i ts h i g h er b an d w i d th al tern ate path s to b e u sed or l ow er b an d w i d th path s to b e av oi d ed L oc al l y si g n i f i c an t c on f i g u rati on O n l y su pported on L A CP E th erch an n el s R o u t e r # c o nf i g ur e ter m i na l R o u t e r ( c o n f ig ) # i nter f a c e p o r t-c h a nnel 1 R o u t e r ( c o n f ig -if ) # p o r t-c h a nnel m i n-l i nk s 2 R o u t e r ( c o n f ig -if ) # end 59
60 S c al i ng B / W w i t h G E C and 1 0 G E M i g rati ng A ccess L ay er U p l i nk s to 1 0 G E H ow d o I sc al e as I m i g rate f rom G E C to 1 0 G E u pl i n k s? H ow d o I i n c rease th e 1 0 G E port d en si ty at th e ag g l ay er? Is th ere a w ay to reg ai n sl ots u sed b y serv i c e m od u l es? D C Co r e A g g reg a ti on A c c e s s P a i r 1 60
61 S c al i ng B / W w i t h G E C and 1 0 G E S erv i ce L ay er S w i tch M ov e c ertai n serv i c es ou t of ag g reg ati on l ay er D C Co r e Id eal f or A CE & F W S M m od u l es O pen s sl ots i n ag g l ay er f or 1 0 G E ports M ay n eed Q O S or separate l i n k s f or F T path s S erv i c e S wi tc h 1 A g g r eg a ti o n S erv i c e S wi tc h 2 ( R ed u n d a n t) E x ten d on l y n ec essary L 2 V L A N s to serv i c e sw i tc h es v i a. 1 Q tru n k s ( G E C/ T en G ) A c c es s R H I i n stal l s rou te i n l oc al M S F C on l y, req u i ri n g L 3 peeri n g w i th ag g reg ati on 61
62 S c al i ng B / W w i t h G E C and 1 0 G E Consolidate to ACE C o nsi der co nso li dat i ng m u lt i p le serv i ce m o du les o nt o A C E M o du le S L B Firew al l S S L 4 / 8 / 1 6 G F ab ri c C o nnect ed A ct i v e-a ct i v e D esi g ns H i g h er C P S + C o ncu rrent C P S S i ng le T C P t erm i nat i o n, lo w er lat ency F eat u re g ap m ay no t p erm i t t i ll lat er release D C Co r e A g g r eg a ti o n A c c es s 62
63 I nc reas i ng H A i n th e Data Center 63
64 W W I nc r eas i ng H A i n t h e D at a C ent er S erv er H i g h A v ai l ab i l i ty Common Points of Failure L 3 L 2 1. S erv er n etw ork ad apter 2. P ort on a m u l ti -port serv er ad apter 3. N etw ork m ed i a ( serv er ac c ess) 4. N etw ork m ed i a ( u pl i n k ) 5. A c c ess sw i tc h port 6. A c c ess sw i tc h m od u l e 7. A c c ess sw i tc h it ho u t D at a Cen t er H A R ec o m m en dat io n s it h D at a Cen t er H A R ec o m m en dat io n s T h ese N etw ork F a il u re I ssu es C a n B e A ddressed b y D epl oym ent of D u a l A tta c h ed S erv ers U sing N etw ork A da pter T ea m ing S of tw a re 64
65 M M M M I nc r eas i ng H A i n t h e D at a C ent er Co m m o n N IC T eam i ng Co nfi g urati o ns A F T A dap t er F au lt T o ler an c e S F T S w it c h F au lt T o ler an c e A L B A dap t iv e L o ad Balan c in g Default G W H S R P Heartbeats Heartbeats Default G W H S R P Heartbeats Default G W H S R P E th 0 : A c ti v e E th 1 : S tan d b y E th 0 : A c ti v e E th 1 : S tan d b y E th 0 : A c ti v e E th 1 -X : A c ti v e I P = A C = e c e0 f O n F ai lo v er, S r c M A C E th 1 = S r c M A C E th 0 I P A d d r es s E th 1 = I P A d d r es s E th 0 I P = A C = e c e0 f O n F ai lo v er, S r c M A C E th 1 = S r c M A C E th 0 I P A d d r es s E th 1 = I P A d d r es s E th 0 I P = A C = e c e0 f I P = A C = e c e0 e O n P o r R v, A P o r T r s m i I n c o r p o r F T o c O n I P A d d r s d M p M A C A d d r s e t ec ei es ll ts an t ates ault ler an e e es an ulti le es es N o t e: N I C m anu f act u rer dri v ers are ch ang i ng and m ay o p erat e di f f erent ly. A lso, serv er O S h av e st art ed i nt eg rat i ng N I C t eam i ng dri v ers w h i ch m ay o p erat e di f f erent ly. 65
66 I nc r eas i ng H A i n t h e D at a C ent er S erv er A ttach m ent: M ul ti p l e N ICs Y o u Can B und l e M ul ti p l e L i nk s to A l l o w G enerati ng H i g h er T h ro ug h p uts B etw een S erv ers and Cl i ents L 3 L 2 E t h e r C h a n n e l H a s h M a y N o t P e r m i t Fu l l U t i l i z a t i o n f o r C e r t a i n A p p l i c a t i o n s ( Ba c k u p E x a m p l e ) O n l y O n e L i n k A c ti v e: F a u l t T ol era n t M od e A l l L i n ks A c ti v e: L oa d B a l a n c i n g E th erc h a n n el s 66
67 M O I nc r eas i ng H A i n t h e D at a C ent er F ai l o v er: W h at Is th e T i m e to B eat? T h e ov eral l f ai l ov er ti m e i s th e c om b i n ati on of c on v erg en c e at L 2, L 3, + L 4 c om pon en ts S ta tef u l dev ic es c a n repl ic a te c onnec tion inf orm a tion a nd typic a l l y f a il ov er w ith in 3-5 sec Eth erc h a nnel s < 1sec S T P c onv erges in ~ 1 sec ( w ) H S R P c a n b e tu ned to < 1s W h ere d oes T CP b reak? M i c rosof t, L i n u x, A IX, etc. F ail ov e r Tim e L 2 Co n v er g en c e L 3 Co n v er g en c e L 4 Co n v er g en c e ~ 5 s ic r o so f t X P S er v er T CP S t ac k T o ler an c e ~ 9 s L in u x an d t her s T o ler at e a L o n g er O u t ag e 67
68 M M I nc r eas i ng H A i n t h e D at a C ent er F ai l o v er T i m e Co m p ari so n S T P w O n e sec O S P F -E IG R P O n e sec A CE M od u l e w i th A u tostate H S R P T h ree sec ( u si n g 1 / 3 ) F W S M M od u l e T h ree sec CS M M od u l e F i v e sec F ail ov e r Tim e W i n X P / S erv ert CP S tac k N i n e sec O SP F / E I G R P Sub-Sec o nd Sp a nni ng T r ee ~ 1 sec A CE ~ 1 s H SR P ~ 3 s ( m a y be tuned to l ess) F i r ew a l l Ser v i c e o d ul e ~ 3 s Co ntent Ser v i c e o d ul e ~ 5 s T CP Sta c k T o l er a nc e ~ 9 s 68
69 I nc r eas i ng H A i n t h e D at a C ent er N o n-s to p F o rw ard i ng / S tateful S w i tch -O v er N S F / S S O i s a su p erv i so r redu ndancy m ech ani sm f o r i nt rach assi s su p erv i so r f ai lo v er S S O synch ro ni z es layer 2 p ro t o co l st at e, h ardw are L2/ L3 t ab les ( M A C, F I B, adj acency t ab le), A C L and Q o S t ab les S S O synch ro ni z es st at e f o r: t ru nk s, i nt erf aces, E t h erc h annels, p o rt secu ri t y, S P A N / RS P A N, S T P, UD LD, V T P N S F w i t h E I G RP, O S P F, I S -I S, B G P m ak es i t p o ssi b le t o h av e no ro u t e f lap p i ng du ri ng t h e reco v ery A g g ressi v e RP t i m ers m ay no t w o rk i n N S F / S S O env i ro nm ent NS F -A wa re NS F -A wa re 69
70 I nc r eas i ng H A i n t h e D at a C ent er N S F / S S O i n th e Data Center S S O i n th e ac c ess l ay er: I m prov es a v a il a b il ity f or singl e a tta c h ed serv ers S S O i n th e ag g reg ati on l ay er: C onsider in prim a ry a gg l a yer sw itc h A v oids reb u il d of a rp, igp, stp ta b l es P rev ents serv ic e m odu l e sw itc h ov er ( c a n b e u p to ~ 6 sec depending on w h ic h m odu l e) S S O sw itc h ov er tim e l ess th a n tw o sec S X D 3 or h igh er P ossi b l e i m pl i c ati on s H S R P sta te b etw een A gg sw itc h es is not tra c k ed a nd w il l sh ow sw itc h ov er u ntil c ontrol pl a ne rec ov ers I GP T im ers c a nnot b e a ggressiv e ( tra deof f ) 70
71 w I nc r eas i ng H A i n t h e D at a C ent er B est P racti ces: S T P, H S R P, O th er R ap id P V S T + UD L D G lo b al S p an n in g T r ee P at hc o st M et ho d= L o n g L 3 + L 4 CE F H a sh A g g 1 : S T P P r y R o o t H S R P P r y H S R P P r p t D D u S u p w N S F S O im ar im ar eem an d elay al it h +S L A CP + L 4 H a sh Di st E th er Ch a nnel M i n-l i nk s F T Da ta L A CP + L 4 P o r t H a sh Di st E th er Ch a nnel f o r F T a nd Da ta V L A N s A g g 2 : S T P S ec o n dar y R o o t H S R P S ec o n dar y H S R P P r eem p t an d D elay S in g le S u p R o o t g u ar d L o o p G u ar d P o r t f ast + BP D Ug u ar d B lad e C h as s i s i th I n teg r ated S w i tc h R ap id P V S T +: M ax im u m N u m b er o f S T P A c t iv e L o g ic al P o r t s an d V ir t u al P o r t s P er L in ec ar d
72 Q and A 72
73 73
H ig h L e v e l O v e r v iew. S te p h a n M a rt in. S e n io r S y s te m A rc h i te ct
H ig h L e v e l O v e r v iew S te p h a n M a rt in S e n io r S y s te m A rc h i te ct OPEN XCHANGE Architecture Overview A ge nda D es ig n G o als A rc h i te ct u re O ve rv i ew S c a l a b ili
Positioning 40 and 100 GbE in data center inter-sw itch l ink ap p l ications and 40GbE PM D recom m endations Adam Carter, Cisco Al essan dro B arb ieri, Cisco 1 m Data Center inter-s w itc h l ink ap
ACE-1/onearm #show service-policy client-vips
M A C E E x a m Basic Load Balancing Using O ne A r m M ode w it h S ou r ce N A T on t h e C isco A p p licat ion C ont r ol E ngine Goal Configure b a s ic l oa d b a l a nc ing (L a y er 3 ) w h ere
1.- L a m e j o r o p c ió n e s c l o na r e l d i s co ( s e e x p li c a r á d es p u é s ).
PROCEDIMIENTO DE RECUPERACION Y COPIAS DE SEGURIDAD DEL CORTAFUEGOS LINUX P ar a p od e r re c u p e ra r nu e s t r o c o rt a f u e go s an t e un d es a s t r e ( r ot u r a d e l di s c o o d e l a
Data Center end users for 40G/100G and market dy nami c s for 40G/100G on S M F Adam Carter Ci s c o 1 W Now that 40GbE is part of the IEEE 802.3ba there will be a wid er array of applic ation s that will
SCHOOL PESTICIDE SAFETY AN D IN TEG R ATED PEST M AN AG EM EN T Statutes put into law by the Louisiana Department of Agriculture & Forestry to ensure the safety and well-being of children and school personnel
O s OAM Requirements for 40/100 GE Eth ernet AI S? Gary Nicholl C is co S ys t e m I E E E 8 0 2. 3 b a T as k F orce M arch 1 8, 2 0 0 8 rlan d o, F L 1 O O O O Background E t h e r n e t i s r a p i
Device I n s t r u m en t a t io n E x a m p l es : I P S L A s & N et F l o w Presented by Emmanuel Tychon Techni cal M ark eti ng Eng i neer TU D resden, J anuary 1 7 th 2 0 0 7 1. C is co I O S I P
First A S E M R e c to rs C o n f e re n c e : A sia E u ro p e H ig h e r E d u c a tio n L e a d e rsh ip D ia l o g u e Fre ie U n iv e rsitä t, B e rl in O c to b e r 2 7-2 9 2 0 0 8 G p A G e e a
SIV for VoiceXM 3.0: a n g u a g e a n d A p p l ica t ion D es ig n C on s id era t ion s Ken Rehor C i s c o S y s t em s, I nc. [email protected] March 05, 2009 G VoiceXM Application Architecture PSTN
G ri d m on i tori n g w i th N A G I O S (*) (*) Work in collaboration with P. Lo Re, G. S av a and G. T ortone WP3-I CHEP 2000, N F N 10.02.2000 M e e t i n g, N a p l e s, 29.1 1.20 0 2 R o b e r 1
UNDERSTANDING FLOW PROCESSING WITHIN THE CISCO ACE M ODULE Application de liv e r y pr odu cts can distr ib u te tr af f ic to applications and w e b se r v ice s u sing v ar y ing le v e ls of application
Collaboration in Public H e alth be tw e e n U niv e rs ity of H e id e lbe rg and U niv e rs ity of D ar e s S alaam How t h e c oop e r a t i on e m e r g e d Informal c ont ac t s from e arly 1 9
How to Subnet a Network How to use this paper Absolute Beginner: Read all Sections 1-4 N eed a q uick rev iew : Read Sections 2-4 J ust need a little h elp : Read Section 4 P a r t I : F o r t h e I P
3 k t h R e m e A c c e s s b t t t V T T c h t h p V T. Cl ic e ot rad io ut on nex o PN unnel yp e and oose e ap rop riat e PN unnel Int erfac e. 4.
C i s c o P r o f i l e C o n t a c t s & F e e d b a c k H e l p Cisc o SM B Sup p ort Assist ant Configure ASA/PIX as Easy VPN Server or Client H om e > W ork W it h M y Sec urit y D ev ic es > Cisc
IronPort Gateway Security Products The Leader in Communication Security Reiner Baumann IronPort Systems The Principles of Industry Leadership A n a l y s t L e a d e r s h i p R e c o g n i z e d a s t
Application Note: Cisco A S A - Ce r t if ica t e T o S S L V P N Con n e ct ion P r of il e Overview: T h i s a p p l i ca ti o n n o te e x p l a i n s h o w to co n f i g u r e th e A S A to a cco m
SCO TT G LEA SO N D EM O Z G EB R E-
SCO TT G LEA SO N D EM O Z G EB R E- EG Z IA B H ER e d it o r s N ) LICA TIO N S A N D M ETH O D S t DVD N CLUDED C o n t e n Ls Pr e fa c e x v G l o b a l N a v i g a t i o n Sa t e llit e S y s t e
FORT WAYNE COMMUNITY SCHOOLS 12 00 SOUTH CLINTON STREET FORT WAYNE, IN 468 02 6:02 p.m. Ma r c h 2 3, 2 015 OFFICIAL P ROCEED ING S Ro l l Ca l l e a r d o f h o o l u e e o f t h e r t y m m u t y h o
Campus Sustainability Assessment and Related Literature
Campus Sustainability Assessment and Related Literature An Annotated Bibliography and Resource Guide Andrew Nixon February 2002 Campus Sustainability Assessment Review Project Telephone: (616) 387-5626
The Business Case for D om aink ey s I d ent ified M ail Andy Spillane V ic e P r es ident, Y ah o o! M February 13, 2006 ail 1 Fighting Spam & Email Abuse R eq uir es a M ulti-fac eted Appr o ac h DomainKeys
I n la n d N a v ig a t io n a co n t r ib u t io n t o eco n o m y su st a i n a b i l i t y
I n la n d N a v ig a t io n a co n t r ib u t io n t o eco n o m y su st a i n a b i l i t y and KB rl iak s iol mi a, hme t a ro cp hm a5 a 2k p0r0o 9f i,e ls hv oa nr t ds eu rmv oedye l o nf dae cr
Bonn Declaration on Regional Cooperation in Quality Assurance in Higher Education Adopted on 20 June 2007 during the Conference Enhancing Quality Across Borders R egional Cooperation in Quality Assurance
i n g S e c u r it y 3 1B# ; u r w e b a p p li c a tio n s f r o m ha c ke r s w ith t his å ] í d : L : g u id e Scanned by CamScanner
![i n g S e c u r it y 3 1B# ; u r w e b a p p li c a tio n s f r o m ha c ke r s w ith t his å ] í d : L : g u id e Scanned by CamScanner](/thumbs/24/2864992.jpg "i n g S e c u r it y 3 1B# ; u r w e b a p p li c a tio n s f r o m ha c ke r s w ith t his å ] í d : L : g u id e Scanned by CamScanner")
í d : r ' " B o m m 1 E x p e r i e n c e L : i i n g S e c u r it y. 1-1B# ; u r w e b a p p li c a tio n s f r o m ha c ke r s w ith t his g u id e å ] - ew i c h P e t e r M u la e n PACKT ' TAÞ$Æo
EM EA. D is trib u te d D e n ia l O f S e rv ic e
EM EA S e c u rity D e p lo y m e n t F o ru m D e n ia l o f S e rv ic e U p d a te P e te r P ro v a rt C o n s u ltin g S E p p ro v a rt@ c is c o.c o m 1 A g e n d a T h re a t U p d a te IO S Es
e Videobewaking ov er I P Marty K n o p e rt 1 A l l m z u l l b t g r u m a k h w k h w k z a l z r E p r m a r k t t c m a r k t Video vision: e vor en va n video en in de na ij e oek om st eb ik en
PSTN. Gateway. Switch. Supervisor PC. Ethernet LAN. IPCC Express SERVER. CallManager. IP Phone. IP Phone. Cust- DB
M IPCC EXPRESS Product Solution (IPCC - IP Co n t a c t Ce n t e r ) E i n f ü h r u n g Ü b e r h u nd e r t M il l io ne n N u t ze r - P r o g no s e n zu f o l g e w e r d e n e s in d ie s e m J ah
AN EVALUATION OF SHORT TERM TREATMENT PROGRAM FOR PERSONS DRIVING UNDER THE INFLUENCE OF ALCOHOL 1978-1981. P. A. V a le s, Ph.D.
AN EVALUATION OF SHORT TERM TREATMENT PROGRAM FOR PERSONS DRIVING UNDER THE INFLUENCE OF ALCOHOL 1978-1981 P. A. V a le s, Ph.D. SYNOPSIS Two in d ep en d en t tre a tm e n t g ro u p s, p a r t ic ip
W Regional Cooperation in the Field of A u tom otiv e E ngineering in S ty ria Dr. Peter Riedler 2 9.1 1.2 0 1 1 i e n GmbH Graz B u s ines s S trategy S ty ria 2 0 2 0 H is tory 1 9 9 4 1 9 9 5 1 9 9
Put the human back in Human Resources.
Put the human back in Human Resources A Co m p l et e Hu m a n Ca p i t a l Ma n a g em en t So l u t i o n t h a t em p o w er s HR p r o f essi o n a l s t o m eet t h ei r co r p o r a t e o b j ect
C o a t i a n P u b l i c D e b tm a n a g e m e n t a n d C h a l l e n g e s o f M a k e t D e v e l o p m e n t Z a g e bo 8 t h A p i l 2 0 1 1 h t t pdd w w wp i j fp h D p u b l i c2 d e b td S t
Internationalization strategy of the SEPT Program Design of market-oriented training and ed u c ation p rod u c ts Utz D o r n b e r g e r ( Un i v e r s i ty o f L e i p zi g ) & N g u y e n T h i T h
M Mobile Based Clinical Decision Support System Bhudeb Chakravarti & Dr. Suman Bhusan Bhattacharyya Provider & Public Health Group, VBU-HL P S aty am C om puter S ervices L im ited Bhudeb_ C hak ravarti@
Unit 16 : Software Development Standards O b jec t ive T o p r o v id e a gu ide on ho w t o ac h iev e so f t wa r e p r o cess improvement through the use of software and systems engineering standards.
proxy cert request dn, cert, Pkey, VOMS cred. (short lifetime) certificate: dn, ca, Pkey mod_ssl pre-process: parameters->
Overview of the New S ec u rity M od el WP6 Meeting V I D t G R I D C o nf er enc e B r c el o ne, 1 2-1 5 M y 2 0 0 3 Overview focus is on VOMS C A d e t il s r e in D 7. 6 Se cur it y D e sig n proxy
Using Predictive Modeling to Reduce Claims Losses in Auto Physical Damage
Using Predictive Modeling to Reduce Claims Losses in Auto Physical Damage CAS Loss Reserve Seminar 23 Session 3 Private Passenger Automobile Insurance Frank Cacchione Carlos Ariza September 8, 23 Today
Video og IP TV - h v or da n p هv ir k es n et t v er k en e? t t a d A c c o u n t M a n a g S P / T o m S m t Ole-P et er R s er elec eg en 1 Hva gjorde vi u t en T V.... 2 2 0 0 m il l s am t idige
W Cisco Kompetanse eek end 2 0 0 8 SMB = Store Mu ll ii gg hh eter! Nina Gullerud ng ulleru@ c is c o. c o m 1 Vår E n t e r p r i s e e r f a r i n g... 2 S m å o g M e llo m s t o r e B e d r i f t e
CIS CO S Y S T E M S. G u ille rm o A g u irre, Cis c o Ch ile. 2 0 0 1, C is c o S y s te m s, In c. A ll rig h ts re s e rv e d.
CIS CO S Y S T E M S A c c e s s T e c h n o lo g y T e le c o m /IT Co n n e c tiv ity W o rk s h o p G u ille rm o A g u irre, Cis c o Ch ile g m o.a g u irre @ c is c o.c o m S e s s io n N u m b e
Enterprise Data Center A c h itec tu re Consorzio Operativo Gruppo MPS Case S t u d y : P r o g et t o D i sast er R ec o v er y Milano, 7 Febbraio 2006 1 Il G r u p p o M P S L a B a n c a M o n t e d
M P L S /V P N S e c u rity. 2 0 0 1, C is c o S y s te m s, In c. A ll rig h ts re s e rv e d.
M P L S /V P N S e c u rity M ic h a e l B e h rin g e r < m b e h rin g @ c is c o.c o m > M b e h rin g - M P L S S e c u rity 2 0 0 1, C is c o S y s te m s, In c. A ll rig h ts re s e rv e d. 1 W h
<?xml version="1.0" encoding="utf-8"?> <soapenv:envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
Applicazioni Java W S con Ax is sistema di tr ac c iab il ità ag r o al imen tar e Ing. Mario G.C.A. Cimino M.G.C.A.Cimino, Applicazioni Java-W S con Ax is, D ipar t ime nt o d i I ng e g ne r ia d e ll
w ith In fla m m a to r y B o w e l D ise a se. G a s tro in te s tin a l C lin ic, 2-8 -2, K a s h iw a z a, A g e o C ity, S a ita m a 3 6 2 -
E ffic a c y o f S e le c tiv e M y e lo id L in e a g e L e u c o c y te D e p le tio n in P y o d e r m a G a n g re n o su m a n d P so r ia sis A sso c ia te d w ith In fla m m a to r y B o w e l D
Workload Management Services. Data Management Services. Networking. Information Service. Fabric Management
The EU D a t a G r i d I n f o r m a t i o n a n d M o n i t o r i n g S er v i c es The European D at ag ri d P roj ec t Team http://www.eu- d a ta g r i d.o r g DataGrid is a p ro j e c t f u n de d
Ontwikkelingen van R o u ter N etwer ken Fred Rabouw 1 3-t i e r R o u t e r N e t w e r k e n. Core: forwarden van grote h oeveel h eden data. D i s tri b u ti e: Cl as s i fi c eren en fi l teren A c
1. Oblast rozvoj spolků a SU UK 1.1. Zvyšování kvalifikace Školení Zapojení do projektů Poradenství 1.2. Financování 1.2.1.
1. O b l a s t r o z v o j s p o l k a S U U K 1. 1. Z v y š o v á n í k v a l i f i k a c e Š k o l e n í o S t u d e n t s k á u n i e U n i v e r z i t y K a r l o v y ( d á l e j e n S U U K ) z í
Objectivity Data Migration after C5 presentation, 18 th O c t 2 0 0 2 Marcin Nowak, C E R N D at ab as e G rou p, h t t p : / / ce rn.ch / d b Overview Objectivity/DB cu r r en t u s a g e Da ta th a t
B a rn e y W a r f. U r b a n S tu d ie s, V o l. 3 2, N o. 2, 1 9 9 5 3 6 1 ±3 7 8
U r b a n S tu d ie s, V o l. 3 2, N o. 2, 1 9 9 5 3 6 1 ±3 7 8 T e le c o m m u n ic a t io n s a n d th e C h a n g in g G e o g r a p h ie s o f K n o w le d g e T r a n s m is s io n in th e L a te
How To Be A Successful Thai
D The Joint Master of Science eg ree C ou rse in V eterinary P u b l ic H eal th ( MScVPH), F U -C MU Dr. L e rt ra k S ri k i t j a k a rn R e g i o n a l C e n t re f o r V e t e ri n a ry P u b l i
M Official Bologna S e m inar Joint d e gr e e s- A H allm ar k of t h e E u r op e an H igh e r E d u cat ion A r e a? R e s u l t s o f q u e s t i o n n a i r e s e n t t o B o l o g n a F o l l o w
B R T S y s te m in S e o u l a n d In te g r a te d e -T ic k e tin g S y s te m
Symposium on Public Transportation in Indian Cities with Special focus on Bus Rapid Transit (BRT) System New Delhi 20-21 Jan 2010 B R T S y s te m in S e o u l a n d In te g r a te d e -T ic k e tin g
G S e r v i c i o C i s c o S m a r t C a r e u ي a d e l L a b o r a t o r i o d e D e m o s t r a c i n R ل p i d a V e r s i n d e l S e r v i c i o C i s c o S m a r t C a r e : 1 4 ع l t i m a A c
IntИg r a ti o n d e s s o l u ti o ns IB M e t C i s c o : C o l l a b o r a ti o n e t C o m m u ni c a ti o ns U ni f i Иe s ( U C 2 ) Mathieu in tr at Sales Business ev elop ent anag er om unic at
A n d r e w S P o m e r a n tz, M D
T e le h e a lth in V A : B r in g in g h e a lth c a r e to th e u n d e r s e r v e d in c lin ic a n d h o m e A n d r e w S P o m e r a n tz, M D N a tio n a l M e n ta l H e a lth D ir e c to r f
Cisco Security Agent (CSA) CSA je v í c eúčelo v ý s o f t w a r o v ý ná s t r o j, k t er ý lze p o už í t k v ynuc ení r ů zný c h b ezp ečno s t ní c h p o li t i k. CSA a na lyzuje c h o v á ní a
m Future of learning Zehn J a hr e N et A c a d ei n E r f o l g s p r o g r a m Cisco E x p o 2 0 0 7 2 6. J u n i 2 0 0 7, M e sse W ie n C. D or n in g e r, b m u k k 1/ 12 P r e n t t z d e r p u t
W h a t is m e tro e th e rn e t
110 tv c h a n n e ls to 10 0 0 0 0 u s e rs U lf V in n e ra s C is c o S y s te m s 2 0 0 2, C is c o S y s te m s, In c. A ll rig h ts re s e rv e d. 1 W h a t is m e tro e th e rn e t O b je c tiv
Voxeo CXP Analyzer Report Samples
Analysis of phone self-services including business tasks, customer behavior, application tuning, and system performance TABLE OF CONTENTS Introduction... 2 Business Task Analysis... 3 Personalization Analysis...
CREATE SHAPE VISUALIZE
SHAPE VISUALIZE B I M E q u i t y BIM Workflow Guide SHAPE VISUALIZE Introduction We o e to t e r t ook i t e BIM Workflow erie I t e o owi ter we wi o er e eryt i eeded or you to ter t e i o re ti i d
Overview of Spellings on www.spellzoo.co.uk
Overview of Spellings on www.spellzoo.co.uk Year 1 Set 1: CVC words Set 2: CVC and CCVC words Set 3: CVC, CCVC and CCVCC words Set 4: Words containing 'ch', 'sh', 'th' and 'wh' Set 5: Words ending in 'll',
Der Bologna- P roz es s u nd d i e S t aat s ex am Stefan Bienefeld i na Service-St el l e B o l o g n a d er H R K Sem in a r D er B o l o g n a P ro z es s U m s et z u n g u n d M it g es t a l t u
Workload Management Services. Data Management Services. Networking. Information Service. Fabric Management
The EU D a t a G r i d D a t a M a n a g em en t (EDG release 1.4.x) T h e Eu ro p ean Dat agri d P ro j ec t T eam http://www.e u - d a ta g r i d.o r g DataGrid is a p ro j e c t f u n de d b y th e
d e f i n i c j i p o s t a w y, z w i z a n e j e s t t o m. i n. z t y m, i p o jі c i e t o
P o s t a w y s p o і e c z e t s t w a w o b e c o s у b n i e p e і n o s p r a w n y c h z e s z c z e g у l n y m u w z g lb d n i e n i e m o s у b z z e s p o і e m D o w n a T h e a t t i t uodf
Victims Compensation Claim Status of All Pending Claims and Claims Decided Within the Last Three Years
Claim#:021914-174 Initials: J.T. Last4SSN: 6996 DOB: 5/3/1970 Crime Date: 4/30/2013 Status: Claim is currently under review. Decision expected within 7 days Claim#:041715-334 Initials: M.S. Last4SSN: 2957
Drive your marketing with Cisco Get more from your SMB marketing with Cisco Marketing Serv ices Quick Reference Guide All co n t e n t s a r e C o p y r i g h t 20 0 8 C i s co S y s t e m s, I n c. All
Software Quality Requirements and Evaluation, the ISO 25000 Series
Pittsburgh, PA 15213-3890 Software Quality Requirements and Evaluation, the ISO 25000 Series PSM Technical Working Group February 2004 Dave Zubrow Sponsored by the U.S. Department of Defense Background
Thuraya XT-LITE Simple. Reliable. Affordable.
Thuraya XT-LITE Simple. Reliable. Affordable. www.thuraya.com Follow us on /thurayatelecom Stayi n g c on n ec ted has n ever b een thi s eas y. In trodu c i n g T hu raya X T -LIT E, the wo r l d s be
PRIMER TESTIMONIO. -F o l i o n ú m e r o 1 2 0. ḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋḋ ESC RITU RA NU MERO TREINTA.- E n l a c i u d a d d e B u e n os A i r e s, c a p i t a l d e l a R e p ú b l i c
Online Department Stores. What are we searching for?
Online Department Stores What are we searching for? 2 3 CONTENTS Table of contents 02 Table of contents 03 Search 06 Fashion vs. footwear 04 A few key pieces 08 About SimilarWeb Stepping up the Competition
G d y n i a U s ł u g a r e j e s t r a c j i i p o m i a r u c z a s u u c z e s t n i k ó w i m p r e z s p o r t o w y c h G d y s k i e g o O r o d k a S p o r t u i R e k r e a c j i w r o k u 2 0
R e t r o f i t o f t C i r u n i s g e C o n t r o l
R e t r o f i t o f t C i r u n i s g e C o n t r o l VB Sprinter D e s c r i p t i o n T h i s r e t r o f i t c o n s i s t s o f i n s t a l l i n g a c r u i s e c o n t r o l s wi t c h k i t i n
M Fast forward into th e fu tu re Accelerating b u s ines s o p p o rtu nity and natio nal p ro s p erity Viktor Kovacs anaging D irecto r H u ngary & Ad riatic R egio n C h a n g e t h e w o r l d» O
CORSO AVANZATO DI NEGOZIAZIONE Un laboratorio intensivo per lo sviluppo e la pratic a d elle c apac ità neg oz iali Scotwork Italia S.r.l. C op y rig h t 2 0 0 6 1 O I m p l t l t z o l N o z n n l h l
Understanding, Modelling and Improving the Software Process. Ian Sommerville 1995 Software Engineering, 5th edition. Chapter 31 Slide 1
Process Improvement Understanding, Modelling and Improving the Software Process Ian Sommerville 1995 Software Engineering, 5th edition. Chapter 31 Slide 1 Process improvement Understanding existing processes
GlasCraft Air Motor Repair Kits
Parts GlasCraft ir Motor Repair Kits 30393B ENG For replacing wear items used on GlasCraft air motors. For professional use only. Not for use in explosive atmospheres. Models M-325, M-500-02, GC2267, GC2273
SEPTEMBER Unit 1 Page Learning Goals 1 Short a 2 b 3-5 blends 6-7 c as in cat 8-11 t 12-13 p
The McRuffy Kindergarten Reading/Phonics year- long program is divided into 4 units and 180 pages of reading/phonics instruction. Pages and learning goals covered are noted below: SEPTEMBER Unit 1 1 Short
How To Know If You Are A Good Or Bad Person
QuesCom I P -T E L E F O N I E & G S M -G A T E W A Y S Robert Urban D i rec tor I nternati onal S al es Agenda Üb e r Q u e s C o m K u n d e n M a r k t üb e r s i c h t Q u e s c o m Lös u n g Q u e
GENERAL INFORMAT ION:
> > >, < > < < _ Pos ta lc od e_ > > > PERFORM ANCE APPRAISAL Employee Name: [Click here
Tsukuba Recent Trends in Higher Education in Japan I. In t e r n a t i o n a l i z a t i o n o f J a p a n e s e U n i v e r s i t i e s II. C h a n g i n g U n i v e r s i t i e s i n J a p a n Hiroshi
Service Provider IPv6 Deployment Igor Giangrossi [email protected] 2 0 0 8 C i s c o S y s t e m s, I n c. A l l r i g h t s r e s e r v e d. C i s c o P u b l i c 1 Prerequisites: Session Abstract
OPENBARE ZITTING 1. U ni f o r m e a l g e m e ne p o l i t i e v e r o r d e ni ng e n p u nc t u e l e i m p l e m e nt a t i e GAS ( g e m e e nt e l i j k e a d m i ni s t r a t i e v e s a nc t i
Stratesave 6.0 The comfortably organized backup solution for your PCs U ser M an u al Stratesave Systems GmbH Copyright 1996-2010, Strate s av e Sys te m s G m bh, al l rights re s e rv e d. A l l trad
S y ste m s. T h e D atabase. D atabase m anagem e n t sy ste m
1 C h apte r 1 1 A D atabase M anagem e n t S y ste m s 1 D atabase M anagem e n t S y ste m s D atabase m anagem e n t sy ste m (D B M S ) S to re larg e co lle ctio n s o f d ata O rg anize th e d ata
Future Trends in Airline Pricing, Yield. March 13, 2013
Future Trends in Airline Pricing, Yield Management, &AncillaryFees March 13, 2013 THE OPPORTUNITY IS NOW FOR CORPORATE TRAVEL MANAGEMENT BUT FIRST: YOU HAVE TO KNOCK DOWN BARRIERS! but it won t hurt much!
/* ------------------------------------------------------------------------------------
Pr o g r a m v a r e fo r tr a fik k b e r e g n in g e r b a s e r t p å b a s is k u r v e m e to d e n n M a tr ix * x M a tr ix E s ta lp h a B e ta ; n M a tr ix * z M a tr ix ; g e n M a tr ix X
California Treasures Phonics Scope and Sequence K-6
California Treasures Phonics Scope and Sequence K-6 Phonics skills get progressively more complex throughout the grade and year to year (e.g., 1. short vowel CVC words; 2. final e CVCe words; 3. long vowel
Lockheed Martin s Move to Assurance: Software Safety and Security Certification Best Practices (BP)
Lockheed Martin s Move to Assurance: Software Safety and Security Certification Best Practices (BP) Dennis Beard, CISSP Lockheed Martin Syracuse, NY August 7, 2007 Page 1 Agenda Best Practices Guidebook
B rn m e d s rlig e b e h o v... 3 k o n o m i... 6. S s k e n d e tils k u d o g k o n o m is k frip la d s... 7 F o r ld re b e ta lin g...
V e lf rd s s e k re ta ria te t S a g s n r. 1 4 3 4 1 5 B re v id. 9 9 3 9 7 4 R e f. S O T H D ir. tlf. 4 6 3 1 4 0 0 9 s o fie t@ ro s k ild e.d k G o d k e n d e ls e s k rite rie r fo r p riv a tin
Transforming Cities in China: The Interplay of
The Art and Science of Service June 8-10, 2011, San Jose, California Transforming Cities in China: The Interplay of Business Architecture, Service Design and Smart Technologies Guang-Jie Ren, PhD IBM Almaden
Data Center Ethernet - The Framework for Server I / O C on s ol i d at i on, V i rt u al i z at i on an d U n i fi ed Fab ri c Ray O H an l o n C i s c o E u r o p e TERENA Workshop Day 2 S e pt e m b
U S B Pay m e n t P r o c e s s i n g TM
U S B Pay m e n t P r o c e s s i n g T h a t s S m a r t P r o c e s s i n g TM USB was simple to enroll in. They had competitive rates and all the fees were listed clearly with no surprises. Everyone
T c k D E GR EN S. R a p p o r t M o d u le Aa n g e m a a k t o p 19 /09 /2007 o m 09 :29 u u r BJB 06 013-0009 0 M /V. ja a r.
D a t a b a n k m r in g R a p p o r t M Aa n g e m a a k t o p 19 /09 /2007 o m 09 :29 u u r I d e n t if ic a t ie v a n d e m S e c t o r BJB V o lg n r. 06 013-0009 0 V o o r z ie n in g N ie u w la
COMTECH 2005 Dresden Ci sc o I P - Tel efo ni e i n der P ra x i s Dirk E b e rh a rd t I n t e rn e t w o rkin g C o n s u l t a n t 1 Aktuelle M a r ktz a h len Kundenzahl s t ei g t w ei t er an 28,000+
B I N G O B I N G O. Hf Cd Na Nb Lr. I Fl Fr Mo Si. Ho Bi Ce Eu Ac. Md Co P Pa Tc. Uut Rh K N. Sb At Md H. Bh Cm H Bi Es. Mo Uus Lu P F.
Hf Cd Na Nb Lr Ho Bi Ce u Ac I Fl Fr Mo i Md Co P Pa Tc Uut Rh K N Dy Cl N Am b At Md H Y Bh Cm H Bi s Mo Uus Lu P F Cu Ar Ag Mg K Thomas Jefferson National Accelerator Facility - Office of cience ducation