s Integratie v an F C o E A rea N etw erk en in b es taand e S to rage Rocky M a kki n j e C i s co S ys t e m r m a kki n j @ ci s co. com 1

Agenda 9 : 3 0 W e lk o m stw o o r d H e nd r ik B lo k h uis 9 : 3 5 C isc o -o n-c isc o D a ta c e nte r B o b S te m m e r ik 1 0 : 2 0 C isc o U nifie d C o m p uting M a r c S a m so m 1 1 : 0 5 P a uz e 1 1 : 3 0 V M -Aw a r e ne tw o r k ing m e t d e C isc o N e x us 1 0 0 0 V so ftw a r e sw itc h Ar j a n v a n d e r V a lk 1 2 : 1 5 L unc h 1 3 : 0 0 I nte gr a tie v a n F C o E in b e sta a nd e S to r a ge Ar e a N e tw e r k e n R o c k y M a k k inj e 1 3 : 4 5 V ir tua liz a tio n ta k e s a gia nt le a p J a n-w ille m L a m m e r s, v m w a r e 1 4 : 3 0 P a uz e 1 5 : 0 0 D a ta C e nte r Ac c e ss L a y e r D e signs w ith th e N e x us F a m ily F r e d R a b o uw 1 5 : 4 5 F C o E is r e a lite it R o b O o std a m 1 6 : 3 0 Afsluiting e n b o r r e l 2

Integratie v an F C o E N etw erk en in b estaand e S to rage A rea I/ O C o nso l id atie m et F C o E H et O p eratio nel e M o d el v an F C o E Integratie v an F C o E in b staand e S A N s 3

I/O C o n s o l i d a t i e m e t F C o E 4

D e b u si ness C ase v o o r I / O C o nso l i dat i e I/O consolidation Phase 1 L ANReduction of S AN server A adapters S AN B S im pl ification of access l ay er & cab l ing G atew ay free im pl em entation fits in instal l ed b ase of ex isting L A N and S A N L ow er T C O F ew er C ab l es F ew er A ccess L ay er S w itch es I nvestm S A Ns) Today I / O C on s ol i dat i on w i t h F C oe ent P rotection ( L A Ns and C onsistent O perational M anag em ent M odel T oday : L P AN a r a lle l L AN / S AN S AN I nfr Aa str uc tur e S AN B I ne ffic ie nt use o f N e tw o r k I nfr a str uc tur e 5 + c o nne c tio ns p e r se r v e r h igh e r a d a p te r a nd c a b ling c o sts Ad d s d o w nstr e a m p o r t c o sts; c a p -e x a nd o p -e x E a c h c o nne c tio n a d d s a d d itio na l p o ints o f fa ilur e in th e fa b r ic L o nge r le a d tim e fo r se r v e r p r o v isio ning M d o m a c o m p x d ultip le fa ult ins le ia gno stic s M a na ge m e nt c o m p le x ity Enhanced Ethernet and FCoE Ethernet FC 5

O O Wat i s e r n o d i g v o o r I / O C o n s o l i d ati e m e t F C o E? PP rr ii or ii tt y FF ll ow CC on tt rr ol DD at a CC ee nn tt ee r r BB rr ii dg ii nn gg CC ap ab ii ll ii tt y ee XX cc hh an gg e e PP rr ot oc ol T rans m i t Q u eu es Ethernet L i nk R ecei v e B u f f ers O ne O ne TT ww o TT ww o TT hree Fou r Fi vv e SS ii xx SS ev en Ei gg ht STOP PAUSE TT hree Fou r Fi vv e SS ii xx SS ev en Ei gg ht Ei g ht V i rtu al L anes Nuova S w i t c h Enables lossless Fabrics f or each class of serv ice P A U S E sent p er v irt u al lane w h en bu f f ers lim it ex ceed ed Handshaking Negotiation for: C os B W M anagem ent* P riority F l ow C ontrol ( P F C ) C ongestion M anagem ent ( B C N/ Q C N) * A p p l ic ation ( u ser_ p riority u sage) L ogic al L ink D ow n 6

Nexus 5000 F a m i l e P r o d uc t P o r t f o l i o Industry s F i rst I/ O C o nso l i da ti o n V i rtua l i z a ti o n F a b ri c f o r th e D a ta C e nte r N e x u s 5 0 0 0 S w i t ch F a m ily 2 8 -P o r t L 2 S w i t c h E x p a n s i on M od u l e s F ib r e C h a n n e l 2 0 Ports 10GE/FCoE/DCE, fixed 1 Exp a n sion M odu l e 8 Ports 1/2 /4G FC P a rtn e rs D a ta c e n te r u p d a te 1 9 /2 0 m e i 2 0 0 9 F C 40 Ports 10GE/FCoE/DCE, fixed 2 Exp a n sion M odu l es + E th e rn e t 4 Ports 10Gb E/FCoE/DCE 4 Ports 1/2 /4G FC 2x10GE/DCE/FCoE O S M g m t 56-P o r t L 2 S w i t c h SW FCoE/DCE + 2x10GE C i s co N X -O S E th e rn e t 6 Ports 10GE/FCoE/DCE 2x10GE C i s co F a b r i c M a n a g e r a n d C i s co D a t a C e n t e r N e t w or k M a n a g e r 2 0 0 9 C is c o S y s te m s, In c. A ll r ig h ts r e s e r v e d. C is c o C o n fid e n tia l 7

D e v o o r del en v an I / O C o nso l i dat i e m et F C o E M i nde r S w i tc h e s, H B A / N IC s p e r S e rv e r F C H B A F C T r a f f i c F C H B A N I C N I C F C T r a f f i c E n e t T r a f f i c E n e t T r a f f i c F C o E C N A F C o E C N A F C o E & E n e t @ 1 0 G E F C o E C o n v e r g e d N e t w o r k A d a p t e r C u st o m e r s p u r c h a se f e w e r N I C s, H B A s, S w i t c h e s a n d C a b l e s 8

E en v o o r b eel d : T o p o f R ac k (E S X ) L AN 8 S AN A S AN B L AN S AN A S AN B 4 2 2 33 or 44 x x tt hh e CC ables && SS ww it ch es E n F C T o t a l A d a p t 3 3 i t c h C a b l 3 9 M g m t P t 16 Servers et ers 2* 2 64 Sw es 2 2 4 es 64 2 6 s 2 2 4 E n F C T o t a l A d a p t 3 3 i t c h C a b l 3 3 M g m t P t 16 Servers et ers 2 0 2 Sw es 2 0 2 es 2 0 2 s 2 0 2 9

Het O p er a ti o n el e M o d el v a n F C o E 10

O O D e C o nv er ged N et w o r k Adap t er (C N A) L A N H B A C N A 1 0 G b EE 1 0 G b EE H B A H B A 1 0 G b E 1 0 G b E Link Link Link F i b re C ha nnel Ethernet F i b re C ha nne Ethernet P CI e P CI e P CI e E t h e r n e t D r i v e r s F i b r e C h a n n e l D r i v e r s E t h e r n e t D r i v e r s F i b r e C h a n n e l D r i v e r s p e r a t i n g S ys t e m p e r a t i n g S ys t e m 11

S t andaar d F i b r e C h annel C o nnec t i v i t ei t FC oe is tr ansp ar ent to FC E th ernet is a transport F C oe is j ust anoth er eth er-ty pe N ex u s 5 K is also an FC sw itch F C dom ain, z oning, services C onnects to ex isting Fab r ics Retain ex isting F C investm ent S am e m anag em ent m odel N ex u s 5 K can em u late S er v er p or ts N-port V irtual iz ation NP I V E th ernet H ost V irtual iz er* Con v e r g e d N e t w or k A d a p t e r : Se r v e r s e e s FCoE c om p on e n t a s Fi b r e Ch a n n e l De Nexus 5000 is vv oo ll ll ed ig cc oo mm pp aa tt ib ll e mm et bb est aa aa nn dd e FF C C SS AA N s 12

Met F C o E v er a n d er d er n i ets a a n h et O p er a ti o n el e Mo d el v a n F i b r e C h a n n el ( F C ) Et h e r n e t H e a d e r FCoE H e a d e r FC H e a d e r 1 2 b y t e s ( M A C a d d r e sse s) + 4 b y t e s ( 8 0 2. 1 Q t a g ) 1 6 b y t e s 2 4 b y t e s F C o E i s i n J u n i o f f i c i e e l e e n st a n d a a r d FC Payload U p t o 2 1 1 2 b y t e s 4 b y t e s Total: 2180 bytes G e b r u i k v a n d e z e l f d e M a n a g e m e n t t o o l s 1 b y t e ( E O F ) + 3 b y t e s ( p a d d i n g ) CR C EO F FCS 4 b y t e s 13

H et b eh eer v an S AN / L AN N et w Administrative Boundaries er k en L A N S A N A S A N B N e t w o r k A d m i n S A N A d m i n L o gin: N e t_ a d m in P a ssw o r d : a b c 1 2 3 4 L o gin: S AN _ a d m in P a ssw o r d : x y z 6 7 8 9 Et h e r n e t FC 14

G em een sc h a p p el i j k e L A N / S A N A r c h i tec tu u r Administrative Boundaries via R BAC L A N S A N A S A N B N e t w o r k A d m i n S A N A d m i n L o gin: N e t_ a d m in P a ssw o r d : a b c 1 2 3 4 L o gin: S AN _ a d m in P a ssw o r d : x y z 6 7 8 9 N X 5 0 0 0 C N A C N A C N A C N A Da t a Ce n t e r Et h e r n e t w i t h FCoE Et h e r n e t FC 15

N ex u s 5 K U n i f i ed I / O : O p er a ti o n eel g ez i en S er v er O p s B u s i n e s s P r e s s e s : S a m e a s t a y C v e r g e d N e t w k A d a p t e r ( C N A c f i g e q u i v a l e n t t N I C a n d H B A. B M g m t : N i m p a c t N e t w k M g m t s t e m : E x i s t i n g t s ( T i v i, B M C P a t r oc od o on or ) on o ox o or Sy o ool ol ol ) S AN B S AN A S A N O p s B u s i n e s s P r oc e s s : S a m e a s t od a y o C on f i g u r e F C I n t e r f a c e m od e, s p e e d, V S A N, P or t C h a n n e l s, T r u n k s, N P V e t c. o M on i t or S A N s p e c i f i c M I B s, S y s l og, R M O N. B ox M g m t : o C L I t r ou g h R ol e B a s e d A c c e s s o X M L A P I N e t w or k M g m t Sy s t e m : o E x i s t i n g t ool s - F a b r i c M a n a g e r C o n v er g ed A c t iv it ies N e x u s 5 K B u s i n e s s P r oc e s s e s : o S w i t c h r e b oot o I m a g e u p g r a d e o U s e r r ol e s o I n i t i a l c r e a t i on of v i r t u a l i n t e r f a c e s a n d f c oe v l a n + E t h I n t e r f a c e m a i n t e n a n c e B ox M g m t : C r e a t i on of M g m t I n t e r f a c e Da y -2 Sy s t e m l e v e l s u p p or t : M e m or y, C P U e r r or, C a l l H om e f e a t u r e, S p a n p or t s. 1 G b E 1 0 G b E 16 LAN F C 1 0 G b E F C O E Net w o r k O p s B u s i n e s s P r oc e s s : S a m e a s t od a y o C on f i g u r e E t h e r n e t p or t, V L A N, S T P, P or t C h a n n e l s, T r u n k s e t c. o M on i t or L A N s p e c i f i c M I B s, S y s l og, R M O N. B ox M g m t : o C L I t h r ou g h R ol e B a s e d A c c e s s o X M L A P I N e t w or k M g m t Sy s t e m : o E x i s t i n g G N C C t ool s ( S m a r t s, I n f ov i s t a, A l t e r p oi n t, O p n e t ) o C i s c o t ool - D C N M

F C a l s V i r tu el e I n ter f a c es o p d e N ex u s 5 0 0 0 ( T 1 1 F I P c o m p l i a n t) vf c 1 V ir t ua l F C in t er f a c e: m a p s a n F C v H B A o n se r v e r a t t a c h e d t o p o r t 1 / 2 V ir t ua l F C in t er f a c e: m a p s a n F C v H B A o n a se r v e r a t t a c h e d t o p o r t 1 / 1 8 vf c 2 V ir t ua l I n t er f a c e M aps a l og ical F C adapter port connecting to th e sw itch 1 F C interface per P h y sical E th ernet P ort 1 eth and 1 vfc per port A l l ow s offl ine config uration for l ink l evel properties* C onfig ured to b e b ound to a ph y sical interface 17

P P U n i f i ed I / O Ma n a g em en t v a n F C en E th er n et Fa b r i c M a n a g e r Cl i e n t 3. 2 F a b ri c M a n a g er Server 3. 2 w i t h N e x u s 5 0 0 0 E x t e n s i on s S O A P JNDI D C N M Server 4. 0 w i t h N e x u s 5 0 0 0 E x t e n s i on s S O A P JNDI DCM Cl i e n t 4. 0 S NM S NM P T r a p s NetConf S y s l og CL I / s s h S y s l og S NM D a em on CI M S er v er ( S M I -S ) Netc onf D a em on C isc o Nexus 5000 C isc o Nexus 5000 S M I -S P r ov i d er s S M I -S P r ov i d er s SA N L A N 18

D e v o o r del en v an F C o E FCoE is managed like FC at initiator, target, and switch level EE as y y tt o o UU nn dd er ss tt an dd C o m F C m p l e t e l y b a se d o n t h e o d e l Aligned with the Same OO FFpp CCer -B at BB ii oo-4 nn al MM oo MM del, oo dd el SS ta nda rr diz ed in FF CC -B BB -5 Same TT ec hh nn ii qq uu es oo ff TT TrTr af 11 11 ff ii c c FF CCMM oo an EE will ag emen bb e tt ss ta nda rr diz ed in JJ uu ne oo f f 22 00 00 99 Same MM an ag emen tt an d d Sec uu rr ii tt y y MM oo dd el ss S a m e h o st -t o -sw i t c h a n d sw i t c h -t o - sw i t c h b e h a v i o r o f F C E. g., i n o r d e r d e l i v e r y o r F S P F l o a d b a l a n c i n g W W N s, F C -I D s, h a r d / so f t z o n i n g, D N S, R S C N 19

I n teg r a ti e v a n F C o E b esta a n d e S A N s i n 20

B est aande S t o r age N et w er k en (S AN s) Is er een M D S 9 0 0 0 geb aseerd S A N? B etref t h et een B ro c ad e geb aseerd S A N? H o e z it h et m et b estaand e b ek ab el ing in h et D C? H et D atac enter P o D c o nc ep t 21

N ex u s5 0 0 0 F C S w i t c h M o de en M D S 9 0 0 0 E-P or t C on n e c t i v i t y S am e O p erating S y stem L AN S AN A S AN B S am e B eh av io r S am e O p eratio nal M o d el IS L P o rt C h annel ing N N e e x x us 5 5 0 0 0 0 0 0 22

H et g eb r u i k v a n F i b r e C h a n n el N -P o r t V i r tu a l i z er en MD S 9 0 0 0 i n b esta a n d e S A N s Pr ov ides p hy sical p or t lev el v ir tu aliz ation of m u ltip le FC end nodes to one F_ Por t of f a FC S w itch N e x u s5 0 0 0 S w i t c h o p e r a t e s i n N _ P o r t P r o x y M o d e ( n o t i n F C S w i t c h m o d e ) E lim inates the FC dom ain on N ex u s5 0 0 0 sw itch S im p lif ies m anag em ent U sed in conj u nction w ith N PIV on u p str eam M D S 9 0 0 0 S w itch F-Por t T r u nk ing and C hanneling w ill Pr ov ide Por t-c hannel ( R oadm ap ) F C N _ P or t V i r t u al i z e r N ex u s5 000 Sw i t c h 23 A A& B SA N B C C F i b r e Ch a nnel Atta c h m ents

H et g eb r u i k v a n F i b r e C h a n n el N -P o r t V i r tu a l i z er en B r o c a d e i n b esta a n d e S A N s Pr ov ides p hy sical p or t lev el v ir tu aliz ation of m u ltip le FC end nodes to one F_ Por t of f a FC S w itch N e x u s5 0 0 0 S w i t c h o p e r a t e s i n N _ P o r t P r o x y M o d e ( n o t i n F C S w i t c h m o d e ) S i m p l i f i e s m u l t i -v e n d o r i n t e r o p e r a t i o n E lim inates the FC dom ain on N ex u s5 0 0 0 sw itch S im p lif ies m anag em ent U sed in conj u nction w ith N PIV on u p str eam B r ocade S w itch F C N _ P or t V i r t u al i z e r N ex u s5 000 24 A A& B SA N B C C F i b r e Ch a nnel Atta c h m ents

I n teg r a ti e v a n N ex u s5 0 0 0 T o R o f Mo R i n b esta a n d e D C s U nif ied I / O P O D P rodu ction of P oc Core St oo rag e e Array ss SAN Fabric L3 N7 KK N7 KK Fabric A Fabric BB AA gg gg reg aa tt ii on L3 L2 AA cc cc es ss CC 66 KK N7 KK N7 KK CC 66 KK MM DD S9 55 00 00 MM DD S9 55 00 00 MM DD S9 55 00 00 MM DD S9 55 00 00 S AN E d g e A S AN E d g e B L2 L AN Ac c es s N5 KK N5 KK VF_Ports VN _Ports N5 KK N5 KK A B D E C NA E n e t FC FC o E Unified IO Server Farm Pod Environment C o nv e r ge d E d ge I nfr a str uc tur e : U I O using T o R / M o R a t th e e d ge, a nd C N A a t th e h o sts fo r 1 0 G E U I O S e r v e r P o D E nv ir o nm e nts L e v e r a ge E th e r ne t a nd S to r a ge C lo ud s to r e a c h tr a d itio na l L AN / S AN se r v ic e s 25

D at ac ent er - H et D C P o D C o nc ep t Rack #1 migrated to 10G Unified Fabric 10G s erv es in Rack #1 l ink to T op of Rack N ex u s 5 000 w ith FC oe 10GE u s ing C onv erged N etw ork A dap ters ( C N A ). N ex u s 5 000 in Rack #1 u p l inks to L 3 A GG M igrated rack maintains s ame netw ork p l atform and O S th rou gh migration N ex u s N X -O S 26

C i sc o N ex u s5 0 0 0 (F C o E ) W o r k sh o p Interac tiv e H and s-o n W S essie p er p artner M ax im aal 4 p erso nen W o rk sh o p o rd u k o stel o o s aangeb o d en Inf o rm atie : rm ak k inj @ c isc o. c o m o f av al k @ c isc o. c o m 27

K ey T ak e Aw ay s F C o E is real iteit U nif ic eren v an I/ O is z eer k o sten ef f ec tief en h eef t d e to ek o m st N u 0 0 0 F v p d u c z z v m d z v C o E ex s5 am il ie an ro ten ij n eer inno atief et e ek erh eid en erv aring an isc th ernet B erek en d e T C O b esp aring v o o r u w k l ant o nl ine! h ttp : / / w w w. c isc o. c o m / en/ U S / p ro d / c o l l ateral / sw itc h e s/ p s9 441 / p s9 6 7 0 / p l anetnex u s5 0 0 0 _ v d s_ ns9 5 1 _ N et w o rk ing_ S o l u tio ns_ P resentatio n. h tm l 28

29

Agenda 9 : 3 0 W e lk o m stw o o r d H e nd r ik B lo k h uis 9 : 3 5 C isc o -o n-c isc o D a ta c e nte r B o b S te m m e r ik 1 0 : 2 0 C isc o U nifie d C o m p uting M a r c S a m so m 1 1 : 0 5 P a uz e 1 1 : 3 0 V M -Aw a r e ne tw o r k ing m e t d e C isc o N e x us 1 0 0 0 V so ftw a r e sw itc h Ar j a n v a n d e r V a lk 1 2 : 1 5 L unc h 1 3 : 0 0 I nte gr a tie v a n F C o E in b e sta a nd e S to r a ge Ar e a N e tw e r k e n R o c k y M a k k inj e 1 3 : 4 5 V ir tua liz a tio n ta k e s a gia nt le a p J a n-w ille m L a m m e r s, v m w a r e 1 4 : 3 0 P a uz e 1 5 : 0 0 D a ta C e nte r Ac c e ss L a y e r D e signs w ith th e N e x us F a m ily F r e d R a b o uw 1 5 : 4 5 F C o E is r e a lite it R o b O o std a m 1 6 : 3 0 Afsluiting e n b o r r e l 30

P l at t egr o nd 31