Design Issues: Copper and Optical Cables Options for 100GbE and Beyond

Size: px

Start display at page:

Download "Design Issues: Copper and Optical Cables Options for 100GbE and Beyond"

Marjory Miller
7 years ago
Views:

1 Design Issues: Copper and Optical Cables Options for 100GbE and Beyond Arlon Martin Sr. Director, Marketing Mellanox Technologies 1

2 A new gen of 100G switches is coming! Example: Accton AS x Gb/s Switch OCP Contribution 32 QSFP28 ports, capable of 100Gb/s each 1ru in either 19 or 21 Open Rack

3 Even NICS are moving to 100Gb/s ConnectX-4: Highest Performance Adapter in the Market Ethernet: 10 / 25 / 40 / 50 / 56 / 100GbE InfiniBand: SDR / DDR / QDR / FDR / EDR Connect. Accelerate. Outperform 100Gb/s, <0.7us latency 150 million messages per second (8B) 100 million packets per second (64B) RDMA, RoCE Multi-Host technology CORE-Direct technology GPUDirect RDMA Overlay Networks offload

4 Yosemite: First Ever Disaggregated Multi-Host Server Yosemite Sled With Quad CPU Cards 100Gb/s Copper Cable 100Gb/E QSFP Multi-Host PCI-Express Host Connections ConnectX-4 OCP Gb/s Multi-Core Adapter Facebook Yosemite Quad Core Multi-Host Platform

5 QSFP28 enables 100G across the data center New data centers architectures* Distributed and interconnected Disaggregated into pods Scale exponentially Evolve to new applications Requires interconnects which Scale Reduce power Reduce cost *Alexey Andreyev, Introducing data center fabric, the next generation Facebook data center network, blog, Nov. 14, 2014

6 Data Rate per Lane (Gb\s) Data centers require options 50 DACs VCSELs Silicon Photonics Copper Multi-mode fiber Single mode fiber OM3 OM Optical Link Length (m) Direct Attach Copper Zero power Demo d 8m at 100G Best fit for <5m Active Optical Cables VCELs or SiP Reaches to 200m Best fit for 5-20m VCSEL Transceivers Reaches to 100m Best fit for MMF SiP Transceivers Reaches to 2km Best fit for SMF Parallel or WDM 6

Optical Cables VCELs or SiP Reaches to 200m Best fit for 5-20m VCSEL Transceivers Reaches to 100m

7 100Gb/s technology solutions in QSFP28 Copper Cables VCSEL AOCs & Transceivers Silicon Photonics AOCs & Transceivers Direct Attach Copper Zero power Demo d 8m at 100G Best fit for <5m Active Optical Cables VCELs or SiP Reaches to 200m Best fit for 5-20m VCSEL Transceivers Reaches to 100m Best fit for MMF Making 100Gb/s Deployments as Easy as 10Gb/s Making 100Gb/s Deployments as Easy as 10Gb/s

Leadership In 25G and 50G Cabling Copper straight and splitter cables 100G QSFP28 to 4X 25G SFP28 100G QSFP28 to 2X 50G QSFP28 SFP28 copper cables (DACs) SFP28 active copper cables Optical 50G QSFP28

8 Leadership In 25G and 50G Cabling Copper straight and splitter cables 100G QSFP28 to 4X 25G SFP28 100G QSFP28 to 2X 50G QSFP28 SFP28 copper cables (DACs) SFP28 active copper cables Optical 50G QSFP28 AOCs 25G SFP28 transceivers Open Industry Consortium to Bring 25 and 50 Gigabit Ethernet to Cloud-Scale Networks : Mellanox is the only cabling and transceiver supplier in the MSA

9 Silicon Photonics Solutions at Mellanox QSFP28 Low power Integration

10 Modulator bank Ge PIN detector bank Echelle Gratings allows us to integrate WDM WDM does not increase chip size Power Monitors Ge Detectors Enables standard SMF duplex cabling Supports >2 km reach Lasers Modulators VOA Laser bank Mux DeMux

Responsivity(A/W) Loss (db) Loss(dB) Mellanox has demonstrated > 1Tb/s devices 0 TE/TM Spectrum 1.1 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 40 channel WDM Receiver Layout 16mm x 11.

11 Responsivity(A/W) Loss (db) Loss(dB) Mellanox has demonstrated > 1Tb/s devices 0 TE/TM Spectrum channel WDM Receiver Layout 16mm x 11.5mm TE TM Wavelength(nm) Wavelength(nm) Connecting one fiber is a little easier and cheaper than connecting 40! 11

Drivers Laser array Monitors Modulators MUX DEMUX Detectors RF Traces TIAs WDM scales from 4 to 32 Channels Tap Tx Si Chip Fiber Rx Si Chip MT MT WDM optical

12 Drivers Laser array Monitors Modulators MUX DEMUX Detectors RF Traces TIAs WDM scales from 4 to 32 Channels Tap Tx Si Chip Fiber Rx Si Chip MT MT WDM optical link for high bit-rate transmission 4x25Gbps, channel spacing: 400GHz 16 channel spacing: 400GHz Scale Bandwidth of Data Centers while Reusing Installed Fabric

13 Founders Contribute Specifications to OCP 100Gb/s 200Gb/s 400Gb/s 800Gb/s Tb/s 4 channels 8 channels 16 channels 32 channels

14 1550nm Provides the Best Optical Performance 1550 provides best responsivity for germanium detectors Lowest Fiber Loss Better Performance Lowers Transceiver Cost & Provides ROI

15 Designed for Data Center Economics Mellanox silicon photonics chips, drivers and TIAs, QSFP modules, Integrated WDM No WDM specific lasers, No laser sub-assembly, No hermetic packages No active laser alignment, No detector sub assembly Innovation Integration Low power Mellanox Delivers! Making 100Gb/s Deployments as Easy as 10Gb/s

16 Design Tradeoffs After 100G? Can 200G QSFP56 packages be next? Front panel, pluggable Double the switching bandwidth Breakout to SFP56 Support multiple technologies Servers at 50G or more NICs to support multi-host? How does COBO fit it in? Do we jump immediately to 400G? How many channels? Multiple technologies? What are the timeframes? 16

Low Cost 100GbE Data Center Interconnect

Low Cost 100GbE Data Center Interconnect Chris Bergey VP Marketing, Luxtera cbergey@luxtera.com February 2012 1 Low Cost 100GbE Data Center Interconnect Where does 100GbE come into the data center Challenges