Optical Trends in the Data Center. Doug Coleman Manager, Technology & Standards Distinguished Associate Corning Cable Systems

Transcription

1 Optical Trends in the Data Center Doug Coleman Manager, Technology & Standards Distinguished Associate Corning Cable Systems

2 Data Center Environment

3 Data Center Environment Higher speeds Higher density Higher reliability Lower capex Lower opex Green

4 VCSELs Drives MMF Value Proposition 850 nm VCSEL Highly-efficient manufacturing process (>100,000/wafer) Ease of packaging into transceiver TOSA Lowest Transceiver Price 10G Serial x Serial 3:1 ($SM/$MM) 40G Serial x Parallel 5:1 ($SM/$MM) 100G Serial x Parallel 20:1 ($SM/$MM) Vertical Cavity Surface Emitting Laser

5 Data Center Multimode Fiber Types Multimode Wavelength OFL BW EMB Fiber Type (nm) (MHz-km) MHz-km) 62.5/125 um (OM1) /125 um (OM2) 50/125 um (OM3) 50/125 um (OM4) * 500 *OFL BW utilized by fiber manufacturers who rely on DMD masks to validate the 4700 MHz-km EMB NA NA

6 Bend-Optimized Multimode Fiber Standards Compliant / Reliability OM4 OM3 OM2 Standards Compliance IEC TIA/EIA Type A1a.3 Fiber 492AAAD Type A1a.2 Fiber 492AAAC-A Type A1a.1 Fiber 492AAAB No interoperability issues with standards-compliant fibers!!

7 Data Center Environment 80% 70% 60% 50% 40% 30% 20% OM4 OM3 OM2 OM1 SMF 10% 0% Source: Corning Cable Systems

8 Data Center Multimode Cable Length Distribution Trunk Length Product Manufactured % 1 Trunk, 40% 2nd Trunk, 10% 3rd Trunk Freq quency Average = 54.2 m Length (m) Frequency Cumulative % 100m: 88% More 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Source: Corning Cable Systems

9 Data Center Single-mode Cable Length Distribution Trunk Length, Single-mode Product Manufactured January 2009-to-January % 1st Trunk, 40% 2nd Trunk, 10% 3rd Trunk % Fr requency m: 72% Average = 52.3 m 100m: 88% 90% 80% 70% 60% 50% 40% Average = 54.2 m Std Dev. = % 20% 10% Length (meters) More 0% Frequency Cumulative % Source: Corning Cable Systems

10 Standard Specified Distances 850 nm Ethernet Distance (m) 1G 10G 40G 100G OM OM / 550* *Engineered Length 850 nm Fibre Channel Distance (m) 4G 8G 16G OM OM

11 OM3/OM4 Connectivity plus 850 nm VCSEL Transceivers VCSEL manufacturers are planning 25G VCSELs to support: 32G Fibre Channel 100GbE EDR InfiniBand VCSELs are field-proven, reliable, low-cost, low-power solutions for data center interconnects Millions of VCSEL-based channels are shipped per month Synergistic MMF / VCSEL relationship provides lowest-cost solution in the data center

12 Migration to OM4 Finisar 28G modeling presented at the T11.2 Fibre Channel meeting (06/2010) TIA-942A recommends OM4 Expect Fibre Channel and Ethernet to utilize OM4 to define distance objectives Transmission and Cable Standards a s ss o a d Cab e Sta da ds recommend OM4

13 Migration to OM4 Do we need OM5

14 Do We Need OM5? Chromatic Dispersion Limited Source: VI Systems Legacy transceiver technology has minimal value with increased EMB

15 The Need for Speed: 10/40/100G

16 Server Virtualization Drives Higher Data Rates Multiple applications running in parallel on one server. (e.g.., apps/server) 10 to 50 servers consolidated Increases utilization efficiency to =< 90% Multi-core processors (4,8,16..50) PCIe2: 8 5G PCIe3: 16 8G Increased memory Less connectivity and reduced electronic ports Drive utilization of high-bandwidth optical connectivity to mitigate system bottlenecks and support required increased I/O speeds

17 Server Virtualization Drives Higher Data Rates Source: Discerning Analytics. 01/2012

18 40G / 100G Ethernet Source: Zarlink

19 10G/40G /100G Ethernet Switch Line Card Density 96 fibers OM3/OM4 528 fibers OM3/OM4 8 fibers SMF 620 fibers OM3/OM4 Source: Zarlink

20 Legacy Data Center Collapsed Architecture: EDGE, Aggregation and Core Switch Consolidation into MDA

21 Data Center Flat Architecture: Top of Rack EDGE Switch Source: FCI 4 QSFP+ 40G ports 48 SFP+ ports 10G or 1G 48 server connections Source: Blade Networks Technologies

22 Data Center Trend: Flat Architecture Two Tier Hierarchy Architecture Core to Edge to Server Non-blocking Core to Edge Over-subscription Edge to Server Facilitates east-west layer-two switch to server traffic flow Low network latency Ease VM movement Transparent Interconnection of lots of links (TRILL) management increases overall network bandwidth and availability Spanning tree replaced Source: Fulcrum Microsystems

23 Data Center Trend: Server Density Increasing/Rack Racks going taller to fit more gear in available vertical space 40/50U + Server Rack Server technology states the 50U-rack has become the most common for their new data center builds Higher-density top-of-rack switch/patch panel Source: Rack Solutions

24 Data Center Trend: Optical Tap Network security and performance Monitoring operational (opex) savings through improved operations Better tracking and adherence to SLAs enables move to private cloud infrastructures

25 Data Center Trends: Electronics and Connectivity Optical Electronics and Connectivity Focus Low Cost Low Power High Density Increase data rates, transceiver size reduction, server consolidation/virtualization, multicore processors, line card density, embedded optics, cloud computing, increased interconnect t density

26 10G Ethernet

27 10G Optical Connectivity Value Proposition: Lower the Total Cost of Network Ownership Fiber optic cabling is less expensive to operate Less power consumption Decreased cooling requirements Smaller transceiver size Some estimates blame up to 60 percent of all data center downtime Higher on heat-related electronic issues -- IDC port densities Fiber 10 Gb/s Operating Cost Fiber vs. Copper Power Consumption Cooling Requirements Copper ~1-4 W ~4-5W Transceiver Size Data Center Area $ $$$$

28 Benefits of 10G Optical Connectivity vs. Copper 10GBASE-TElectronicsIssues Electronics Significant switch power requirements 10G copper 4 to 5 watts per port (40 nm) Major silicon chip (28 nm) development required to reduce power Yield and $$$ issues 10G optical switches 1 to 4 watts per port Typical SFP+ 0.5 watts 10G copper Latency 2us/PHY 10GBASE-T Card Source: Fulcrum Microsystems

29 Optical Connectivity Green Value Proposition: Low Electronics and Cooling Energy Consumption OPTICAL CONNECTIVITY Enables The Green Data Center!

30 Optical Connectivity Green Value Proposition: Low CO2 Emissions OPTICAL CONNECTIVITY Enables The Green Data Center!

31 Fibre Channel

32 Data Center Fabrics Ethernet LAN (1/10/40/100G) OM3/OM4 fiber Non-deterministic Fibre Channel SAN (4/8/16G) OM3/OM4 fiber Deterministic Source: Info-Advantage

33 Fibre Channel Speed Roadmap Product Naming Throughput (MBps) Line Rate (GBaud) T11 Spec Technically Completed (Year) Market Availability (Year) 1GFC GFC GFC GFC GFC GFC GFC TBD Market Demand 128GFC TBD 2018 Market Demand 256GFC TBD GFC TBD 2024 Market Demand Market Demand

34 Fibre Channel 4/8/16G Variants: OM2, OM3, OM4 Multimode Cable Plant for OM2 Limiting Variants FC M5-SN-I 800-M5-SN-S 1600-M5-SN-S Data Rate (MB/s) Operating Range (m) Loss Budget (db) Multimode Cable Plant for OM3 Limiting Variants FC M5E-SN-I 800-M5E-SN-I 1600-M5E-SN-I Data Rate (MB/s) Operating Range (m) Loss Budget (db) Multimode Cable Plant tfor OM4Limiting iti Variants FC M5F-SN-I 800-M5F-SN-I 1600-M5F-SN-I Data Rate (MB/s) Operating Range (m) Loss Budget (db)

35 Fibre Channel 8G and 16G Limiting Variants: OM2, OM3, OM4

36 Fibre Channel FC-PI6 32G Fibre Channel, March G activity starting Expected completion: 2013 Commercial products: 2014 Brocade SAN Director Approved Objectives OM3/OM4 70 m-100 m SMF 10 km SFP+ SFP + form factor 70 m OM3 100 m OM4

37 Ethernet 40/100G IEEE approved motions 40 and 100 Gbps At least 100 m on OM3 multimode fiber At least 150 m on OM4 multimode fiber At least 10 km on single-mode fiber At least 40 km on single-mode fiber (100G only) At least 7 m on copper cable assembly At least 2 km on single-mode fiber (40G only) Key project dates Study group formed in July 2006 Project authorization in December 2007 Task force formed in January /100G standard completed June 2010

38 40G Ethernet Parallel Optics: OM3/OM4 12F MPO Connector Interface QSFP Transceiver Source: Avago

39 Ethernet 40G and 100G: OM3, OM4 OM3 and OM4 distances contingent upon 1.5 and 1.0 total connector loss, respectively

40 40G esr4 QSFP+ QSFP+ esr4 modules meets link distance specifications for 40G Ethernet applications 40G esr4 parallel optics extended reach OM3 / OM4: 300 m / 400 m Corning Cable Systems modeling shows 12% data center lengths >100 m Expected availability: Mid 2012

41 40G Optical Transceiver: OM3/OM4 QSFP transceiver technology Standard 12F MPO connector =< 1.0 watts per port Now used for 40G InfiniBand Source: Zarlink

42 100G Ethernet Parallel Optics: OM3/OM4 24F MPO Connector Interface Source: USConec Source: Molex

43 100G Optical Connectivity: OM3/OM4 8cardsperchassis chassis 16 ports per card 384 fibers per card 3072 fibers per chassis CXP Transceiver 24F MPO Pinless Connector Key-up interface

44 40/100G Data Center Architecture: Top of Rack EDGE Switch 40G: 2 x 24-fiber OM3/OM4 Uplink 100G: 2 x 48-fiber OM3/OM4 Uplink

45 40/100G Optical Transceiver: SMF CFP Transceiver technology Standard duplex LC connectors =< 20 watts per port 3 to 4 ports per card Large footprint Equivalent to two 10G XENPAKs Development in process CFP MSA Source: CFP MSA Duplex LC Connector

46 40/100G: Twinax Copper Traditionally, has been used for short-length InfiniBand connectivity and must be factory-connectorized No guidance is included in the standard for CAT UTP/STP copper cable QSFP Direct-Attached Twinax Cable 40GBASE-T NOT EXPECTED Copper Cable Manufacturers Promoting Interest Source: FCI

47 IEEE Next Generation 40/100 Gb/s Optical Ethernet Study Group Approved July 2010 Multimode parallel optics (100G) 4x25 Gb/s expected OM3/OM4: 100/150 m QSFP28 12F MPO Single-mode (100G) WDM, Parallel, PAM Single-mode (40G) Serial, WDM Completion 4 th quarter 2014 Future Activity 16x25 Gb/s: 400G Multimode parallel optics USConec 32F MPO 2012 Completion 2015+

48 IEEE NG 40/100G March Plenary Approved objectives for multimode and single-mode fibers Define a 100 Gb/s PHY for operation up to at least 100 m of MMF 4x25G parallel optics, QSFP+ Define a 100 Gb/s PHY for operation up to at least 20 m of MMF 4x25G parallel optics, QSFP+ Define a 100Gb/s PHY for operation up to at least 500 m of SMF (mega data centers) Task Force to define Define a 40 Gb/s PHY for operation over at least 40 km of SMF Task Force to define

49 Multimode NG 100G Activity FROM: TO: Source: Brocade

50 Mega Data Center >300 m to 500 m Distances

51 Future Multimode 100G: Relative Connectivity Cost/Circuit PMD Max Distance (m) Fiber Count Relative Connectivity Cost /Circuit at 100 m 100GBASE-SR10-OM GBASE-SR10-OM GBASE-SR4-OM GBASE-SR4-OM4SR GBASE-NR4-SM no WDM 100GBASE-NR4-SM with WDM GBASE-LR4-SM CFP GBASE-LR4-SM CFP

52 Future Multimode 100G: Relative Transceiver Cost/Circuit PMD Max Distance (m) Relative Module Cost Range 100GBASE-SR GBASE-SR4 SR , 1.2, GBASE-NR4 no WDM , GBASE-NR4 with WDM 100GBASE-LR4-SM CFP GBASE-LR4-SM CFP

53 Future Multimode 100G: Relative Link Cost/Circuit GBASESR10-OM3 100GBASESR10-OM4 100GBASESR4-OM3 100GBASESR4-OM4 100GBASENR4 - No WDM 100GBASENR4 - with WDM 100GBASELR4 CFP2 100GBASELR4 CFP Distance (m)

54 Contact Info Doug Coleman com Phone: Fax: Address: th Street NW Hickory, NC 28601