New WAN Approach Proposals Feed Forward Rate Control (FFRC) & 10Gigabit Ethernet Network Interface Extension (10GENIE) IEEE P802.3ae 6-10 March, 2000 Albuquerque, NM Osamu ISHIDA and Haruhiko ICHINO NTT Yokosuka, Japan ishida@exa.onlab.ntt.co.jp New WAN- Approach (R1: revised for presentation)
Goal of Today s Presentation Propose 802.3ae-native capability of WAN by defining two features on XAUI (10 Gigabit Attachment Unit Interface) Feed-Forward Rate Control (FFRC) through autonegotiation that enables LAN- access to WAN without 802.3x flow control. 10 Gigabit Ethernet Network Interface Extension (10GENIE), that supports WAN signaling on LAN- Compatible by using InterPacket Gap (IPG). IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 2
Outline of Today s Presentation Why WAH-? What is main capability of WAN? Two alternatives for WAN providers, and their problems. WAN-Compatible Issues: Limited WAN-access design flexibility. Suffers Duplicated frame-encapsulation. No path to LAN-Native in WAN. Propose two new features on XAUI; Equip Feed-Forward Rate Control (FFRC). Define 10GbE Network Interface Extension (10GENIE). IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 3
What is Capability of WAN? (1/2) Providing reliable connection over multiple spans of fibers and Layer 1 relays. LAN WAN LAN remote monitor fault localization customer site 802.1D Relay MAC LAN MAC WAN Layer 1 Relays provider sites Ethernet Line Terminating Equipment (ELTE) SONET Regenerator λ n E R R R R R R E customer site 802.1D Relay MAC WAN MAC LAN 802.3 LAN Segment λ 1 802.3 WAN Path 802.3 LAN Segment IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 4
What is Capability of WAN? (2/2) Providing reliable and maintainable connection over multiple spans of fibers and L1 relays; this requires bandwidth dedicated to WAN-specific signaling for remote monitoring and fault localization. SONET provides this capability by its domainnested overhead bytes in its specific frame. SONET is NOT the only solution: Digital Wrapper, Ethernet-native... IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 5
WAN Providers Face Two Opportunities (1/2) Reuse legacy SONET infrastructure. Pack native Ethernet packets in SONET frame. Administer fibers and regenerators with SONET network operation system. Fine! But How far we should invest in expensive SONET gear? Forget SONET. Reuse installed fibers or rent dark fibers. Construct WAN with LAN-native. Great! But How to administer fibers & s remotely? IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 6
WAN Providers Face Two Opportunities (2/2) remote monitor / fault localization customer site provider relay site provider center site Reuse legacy SONET infrastructure How far we should invest in expensive SONET gear? IEEE 802.3 802.1D Relay MAC LAN MAC WAN ELTE Construct WAN without SONET SMF SONET Regenerator DSF SONET Regenerator How to administrate fibers & s remotely? SONET λ 1 λ n MAC LAN MMF Layer 1 Relay. LAN LAN SMF Layer 1 Relay LAN LAN Layer 1 Relay λ 1 Layer 1 Relay connects s at Attachment Unit Interface (AUI) for maintainability. DSF ELTE: Ethernet Line Terminating Equipment λ n IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 7
What do WAN providers want? Reusing installed SONET infrastructure; compatibility with SONET regenerators, that requires SONET framing at 9.95 Gb/s, and that requires MAC/PLS rate-control to 9.58 Gb/s. More essentially, low-cost solution with capability of WAN operation; compatibility with Network OpS, that requires dedicated bandwidth at AUI for OAM&P, that supports domain-nested fiber/ administration. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 8
Our Vision of 802.3ae Support both WAN providers opportunities: Reuse SONET infrastructure with minimal access cost. Reuse fiber infrastructure with LAN-native. WAN-Compatible approach is halfway. It has limitation on WAN-access design flexibility. It will suffer duplicated frame encapsulation. It provides no solution for LAN-native in WAN. Our proposals on XAUI are new WAN- approach to support both opportunities; FFRC allows LAN- access to WAN. 10GENIE enables WAN signaling on LAN-Compatible. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 9
Outline of Today s Presentation Why WAH-? What is main capability of WAN? Two alternatives for WAN providers, and their problems. WAN-Compatible Issues: Limited WAN-access design flexibility. Suffers duplicated frame-encapsulation. No path to LAN-Native in WAN. Propose two new features on HARI; Equip Feed-Forward Rate Control (FFRC). Define 10GbE Network Interface Extension (10GENIE). IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 10
WAN-Compatible Issues (1/2) Limitation on WAN-Access Design Flexibility SONET customer site provider relay site provider center site 802.1D Relay MAC 802.3x MAC MAC LAN LAN WAN 10G 9.58G ELTE SONET Regenerator λ 1 λ n ELTE: Ethernet Line Terminating Equipment MAC LAN 10G 802.3x flow control Layer 1 Relay LAN LAN 10G 802.1D Relay MAC MAC LAN WAN 9.58G ELTE λ 1 λ n WAN-C requires L2 Relay buffer and backward flow control. Flow control over longer distances is not welcome. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 11
Proposal 1 : FFRC (1/3) How FFRC Increases WAN-Access Design Flexibility SONET customer site provider relay site provider center site 802.1D Relay MAC 802.3x MAC MAC LAN LAN WAN 10G 9.58G ELTE SONET Regenerator λ 1 λ n ubiquitous Ethernet MAC LAN Auto-Negotiation Layer 1 Relay LAN LAN 9.58G 9.58G 802.1D Relay MAC MAC LAN WAN IEEE802.3 9.58G ELTE SONET λ 1 λ n ELTE: Ethernet Line Terminating Equipment IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 12
Proposal 1 : FFRC (2/3) Equip Feed-Forward Rate Control at XAUI Implementation example Busy IDLEer: Unified LAN/WAN Proposal - H. Frazier - January, 2000 http://grouper.ieee.org/groups/802/3/10g_study/public/jan00/frazier_1_0100.pdf XGMII XGXS XAUI XGXS/PCS/PMA/PMD IDLE counter feed-forward rate control busy IDLEer buffer monitor optional feed-back rate control busy IDLEer MAC rate is monitored and regulated at XAUI. All support both 10Gb/s and 9.58 Gb/s MAC rates, and is set through auto-negotiation process. Feed-back rate control by serial PCS may co-exist. XGMII = 10 Gigabit Media Independent Interface XAUI = 10 Gigabit Attachment Unit Interface XGXS = XGMII Extender Sublayer PCS = Physical Coding Sublayer PMA = Physical Medium Attachment PMD = Physical Medium Dependent IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 13
Proposal 1 : FFRC (3/3) Pros and Cons Increase WAN-Access design flexibility. Expand LAN- market, which will Enhance economies of scale. Some cost burden to LAN- Add rate provisioner and BUSY IDLEer at XGXS. simple IDLE counter will be enough for rate provisioning. Add an auto-negotiation process. XGXS = XGMII Extender Sublayer IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 14
Outline of Today s Presentation Why WAH-? What is main capability of WAN? Two alternatives for WAN providers, and their problems. WAN-Compatible Issues: Limited WAN-access design flexibility. Suffers duplicated frame-encapsulation. No path to LAN-Native in WAN. Propose two new features on XAUI; Equip Feed-Forward Rate Control (FFRC). Define 10GbE Network Interface Extension (10GENIE). IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 15
WAN-Compatible Issues (2/3) Duplicated Frame Encapsulation access to OTN OTN 802.1D Relay MAC MAC LAN WAN customer site provider relay site provider center site ELTE SONET frame Layer 1 Relays SONET Regenerator Digital Wrapper frame Digital Wrapper ITU-T may recommend G.709 Network Node Interface for the Optical Transport Network (OTN) in 02/2001, where another frame Digital Wrapper will provide upto-date domain-nestable overhead bytes for WAN signaling. SONET framing will be excessive just for OTN access, while WAN providers may still require remote fiber/ administration in access. λ 1 λ n FEC ELTE: Ethernet Line Terminating Equipment FEC: Forward Error Correction IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 16
WAN-Compatible Issues (3/3) No solution for LAN-native in WAN remote monitor / fault localization customer site provider relay site provider center site Reuse legacy SONET infrastructure How far we should invest in expensive SONET gear? IEEE 802.3 802.1D Relay MAC LAN MAC WAN ELTE Construct WAN without SONET SMF SONET Regenerator DSF SONET Regenerator How to administrate fibers & s remotely? SONET λ 1 λ n MAC LAN MMF Layer 1 Relay. LAN LAN SMF Layer 1 Relay LAN LAN Layer 1 Relay λ 1 Layer 1 Relay connects s at Attachment Unit Interface (AUI) for maintainability. DSF ELTE: Ethernet Line Terminating Equipment λ n IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 17
Proposal 2 : 10GENIE (1/6) 10 Gigabit Ethernet Network Interface Extension New WAN- approach: LAN-Compatible in WAN Implement nestable OAM&P bytes into IPG packet IPG IPG Line Section Bit Interleaved Parity (BIP), Path trace Info Info Protection switching trigger etc. (See Backup Foils) Ether packet IPG IPG Ether packet IPG: InterPacket Gap It s an extension: no influence on LAN- LAN- ignores Info bytes, treats them as just IPG. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 18
Proposal 2 : 10GENIE (2/6) Implementing WAN extension on XAUI WAN-Compatible approach MAC XGMII XGXS XAUI LAN-Compatible approach MAC XGXS XGMII XAUI XGXS PCS PMA XGXS PCS PMA Parallel PMD Serial PMD WAN PMD 10GENIExtension (WAN signaling on IPG) XGXS PCS PMA Parallel PMD Serial PMD LAN- WAN- XGMII = 10 Gigabit Media Independent Interface XAUI = 10 Gigabit Attachment Unit Interface PCS = Physical Coding Sublayer LAN(-Compatible) XGXS = XGMII Extender Sublayer PMA = Physical Medium Attachment PMD = Physical Medium Dependent IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 19
Proposal 2 : 10GENIE (3/6) Implementation Example Similar to FC-AL IDLE ordered set in IPG is occasionally replaced by Extended IDLE ordered set. This concept is used in Fibre Channel for arbitration. E-IDLE example : (-) / K28.5 / ID1 / ID2 / DATA / / ID1 /, / ID2 /, and / DATA / are valid 8B/10B data characters, and have some restriction on their disparity. / ID1 / indicates 10GENIE. (probably reserved for further extensions.) / ID2 / indicates what kind of signaling in what domain. / DATA / carries signaling, such as Bit-Interleaved Parity. LAN- should not distinguish E-IDLE from IDLE. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 20
Proposal 2 : 10GENIE (4/6) What Should Be Defined by Std.? All E-IDLE should be just IDLE for MAC/XGXS. MAC/XGXS transmits normal IDLE alone. IDLE and E-IDLE are removable without disparity control. Serial PCS is transparent to E-IDLE. Define minimal interoperable Extended-IDLE for nested BER monitoring, alarm forwarding, path tracing,... Data Communication Channel (DCC) Define rules for vender-specific extention. Valid definition must be established by Std. Unassigned SONET overhead bytes are a bad example. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 21
Proposal 2 : 10GENIE (5/6) Applications: WAN Access and LAN-Compatible customer site provider relay site provider center site 10GbE Network Interface Extension WAN access LAN-C in WAN MAC LAN MAC LAN MMF MMF IPG Layer 1 Relay. LAN LAN IPG Layer 1 Relay. LAN LAN Info Info IPG SMF SMF Layer 1 Relay LAN LAN IPG Line Layer 1 Relay LAN LAN Digital Wrapper frame DSF Digital Wrapper Layer 1 Relay FEC λ 1 λ n IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 22 Info IPG Section Info λ 1 λ n
Proposal 2 : 10GENIE (6/6) Pros and Cons LAN- unification at customer site enjoy economies of scale enjoy unified maintenance 802.3ae-native capability of WAN signaling enhance economies of scale on hardware enjoy compatibility with WAN operation system (OpS) pave the way to replace SONET with OTN infrastructure. Some constraint on XGXS coding to allow IDLE extension, and Serial PCS for extended IDLE transparency. XGXS = XGMII Extender Sublayer PCS = Physical Coding Sublayer OTN = Optical Transport Network IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 23
Summary Propose 802.3ae-native capability of WAN by defining two features on XAUI. XAUI = 10 Gigabit Attachment Unit Interface FFRC (Feed-Forward Rate Control) enables LAN- access to WAN without 802.3x flow control. 10GENIE (10 Gigabit Ethernet Network Interface Extension) supports WAN signaling without SONET. 10GENIE and FFRC accelerate true ubiquitous Ethernet and its economies of scale. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 24
Backup Foils IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 25
What is SONET? (1/5) SONET OC192 Framing (9.96 Gb/s) (270 x 64) x 9 = 155,520 bytes row 1 row 2 row 9 1st 3rd 2nd row 1 row 2 Section OH Section Section OH OH pointer pointer pointer Line OH Line Line OH OH Payload Payload #1 #64 row 9 9 bytes / row 261 bytes / row IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 26
What is SONET? (2/5) SONET function SONET is virtual wiring in fiber cascades, where wire is called Path, fiber cascades are called Line, and each fiber is called Section. SONET realizes three functions: bundling hundreds of Paths into Line by TDM Path-by-Path byte-stuffing (Sync.) by pointers hierarchical OAM&P* by using overhead bytes * Operations, Administration, Management, and Provisioning IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 27
What is SONET? (3/5) SONET Architecture Path Terminating Equipment #1 #2 Line Terminating Equipment LTE Regenerators = R R R fiber fiber fiber fiber Path Line Section Terminating Equipment LTE #1 #2 Section Section Section Section Sec. OH pointers Line OH VC3 #1 VC3 #2 VC3 #192 LTE synchronizes Path by Path with each pointer offset & stuffing. Regenerator is jitter-sensitive since transmit clock is the recovered received clock of the previous Section. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 28
What is SONET? (4/5) What Will Happen in 10 GbE WAN-Compatible? SONET provides just one function: (bundling hundreds of Paths into Line by TDM) (Path-by-Path byte-stuffing (Sync.) by pointers) 3 nested domain OAM&P by using OH bytes Path Line Section Section Section Section Sec. OH pointer Line OH Path OH STS-192concatinated SPE OAM&P = Operations, Administration, Maintenance, and Provisioning IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 29
What is SONET/SDH? (5/5) Nested-domain OAM&P with Over-Head (OH) bytes WAN providers administer fibers & regenerators remotely and hierarchically. WAN Operation System (OpS) PTE/LTE Regenerators LTE/PTE Path Line Section Section Section Section Path/Line OH is for end-end signal trace, error-rate monitor, protection switching,... Section OH is for remote monitor, alarm forwarding, fault localization,... IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 30
WAN-Compatible Issues WAN-Compatible approach was proposed: Ether on SONET (EOS) LITE, and 64B/66B on SONET. Their SONET framing provides best compatibility with installed SONET regenerators and network OpS. It has limited WAN-access design flexibility. It will suffer duplicated frame encapsulation. It provides no solution for LAN-native in WAN. IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 31
Proposal 2 : 10GENIE What Function Should Be Implemented? Support minimal WAN signaling, such as Bit-Interleaved Parity (BIP) for fiber/ administration protection switching trigger (K1/K2) for premier restoration path trace identifier (J0) for assure correct cross-connection Data Communication Channel (DCC) for extra signaling... Support flexible domain OAM&P, similar to Path, Tandem Connection, Line, Section (SDH) [G.707] Protected domain (ATM) [I.610] Nested administrative domain (OTN) [to be G.709] OAM&P = Operations, Administration, Maintenance, and Provisioning OTN = Optical Transport Network IEEE802.3ae - Albuquerque - MAR2000 New WAN- Approach (R1) 32