When the future becomes reality A change that has already happened

A paradigm shift Avaya VENA Fabric Connect When the future becomes reality A change that has already happened Johnny Hermansen Network Architect johnnyherman@avaya.com

Deployed in mission critical networks since Nov. 2011 WAN

Deployed in mission critical data center Nov. 2012

IEEE L2 Ethernet evolution Standard Year Name Loopfree topology by: Service ID s Provisioning Virtualization of IEEE 802.1Q 1998 Virtual Lans (VLAN Tagging) Spanning Tree SMLT 4096 Edge and Core Layer 2 IEEE 802.1ad 2005 Provider Bridging (QinQ) Spanning Tree SMLT 4096x4096 Edge and Core Layer 2 IEEE 802.1ah 2008 Provider Backbone Bridging (MacInMac) Spanning Tree SMLT 16 Mil. Edge and Core Layer 2 IEEE 802.1aq 2011 Shortest Path Bridging (SPBV & SPBM) Link-State- Protocol (IS-IS) 16 Mil. Only Service Access Points IEEE: Layer 2 IETF draft: Layer 3 Unicast & Multicast IEEE 802.1ag 2007 Connectivity Fault Management (CFM) Discovery and verification of path through IEEE bridged network Ethernet = IEEE

Payload VLAN TAG SMAC DMAC C-Payload VLAN TAG SMAC DMAC I-SID B-VID B-SA B-DA Payload VLAN TAG SMAC DMAC 00:00:11:11:11:11 00:00:22:22:22:22 00:00:aa:00:00:01 00:00:cc:00:00:01 Data Plane IEEE 802.1ah Provider Backbone Bridges Ethernet frame PC1 to S1 Ethernet frame encapsulated in SPB Ethernet frame payload Ethernet frame PC1 to S1 I-SID = 24-bit Global Service ID

Control Plane IEEE 802.1aq IS-IS IS-IS forms adjacencies to neighbouring nodes, discovers the core network topology and then automatically calculates shortest paths from itself to every other node in the network.

Integrated IS-IS vs OSPF IS-IS Widely used by ISPs Encapsulation IS-IS runs directly over L2 (Ethernet) More difficult to spoof or attack Packet encoding IS-IS is TLV based Easier to extend (e.g. to SPB) Area architecture outer is in only one area, plus perhaps the L2 backbone IS-IS area boundaries fall on links OSPF Widely used in the Enterprise Encapsulation OSPF runs on top of IP Subject to spoofing and DoS attacks Packet encoding OSPF uses many LSA types Tied to IPv4 (even IPv6 requires a new version of OSPF) Area architecture OSPF area boundaries fall within a router (ABs) Each link belongs to one area Area 49.0000 Area 49.0001 Area 0.0.0.0 Area 0.0.0.1 L1 L1/L2 L1/L2 Backbone router AB Internal router

IS-IS Adjacencies (always Point to Point) Node2 2/11 2/12 2/11 2/12 Node1 MLT Node3 LSP : Link State PDU CSNP : Complete Sequence Numbers Protocol Data Unit PSNP : Partial Sequence Numbers Protocol Data Unit IS-IS interfaces can be configured on: Discrete ethernet interfaces MLT bundles

7.2TLVs Standard TLVs SPB TLVs Pre-existing IS-IS TLVs TLVs used with SPB TLV Description Usage 1 Area Addresses IS-IS area 3 End System Neighbors B-MAC & SysName of itsself 22 Extended IS eachability IS-IS adjacencies & metric Sub-TLV for SBPM Link Metric (29) 129 Protocol Supported SPBM value 0xC1 135 TE IP eachability IP eachability for IP shortcuts in GT 143 SPBM Instance & BVIDs Sub-TLV 4: SPT configuration Identifier Sub-TLV 6: BVIDs to ECT algorithm Used in IS-IS Hellos only 144 SPBM Instance, Nickname, BVLANs & I-SIDs Sub-TLV 1: SPBM Instance & Nick-name Sub-TLV 3: B-VLANs & L2VSN I-SIDs 184 SPBM IPVPN eachability IP eachability for L3 VSNs 185 SPBM IPVPN Multicast for L3 VSNs 2 8

Shortest Path Bridging L2 Service VSN A VLAN provisioned at the edge of the fabric is mapped into the Virtual Service Network using the Service Identifier (I-SID) Unified Management Assign VLAN20 I-SID 100 Vlan 20 Virtual Service Network I-SID 100 Vlan 20 IS-IS advertises all new services and communities of interest (I-SID information) to the network and the Forwarding Data Base is updated with I-SID Service specific entries

Shortest Path Bridging L2 Services Extending the Service Single touch-point provisioning Unified Management Assign VLAN25 I-SID 100 Vlan 20 Virtual Service Network I-SID 100 Vlan 25 Interconnect any VLAN Irrespecitve of VLAN ID Vlan 20

Shortest Path Bridging L2 Service VSN Congruent unicast & multicast paths Congruent forward & reverse path Important Properties All traffic types (known, unknown traffic, broadcast) use the same path no out of order packets possible No MAC learning & flooding in the Core Fully QoS aware infrastructure Vlan 20 Service & Source Specific Multicast Tree Vlan 20 Unicast Path Vlan 20

Shortest Path Bridging L2 Service VSN Congruent unicast & multicast paths Congruent forward & reverse path Vlan 20 Vlan 20 Vlan 20 Service & Source Specific Multicast Tree Unicast Path

L2VSN UNI types C-VLAN UNI q-tag VLAN id 10 q-tag VLAN id 11 untagged traffic Tagged Port 1 PVID=12 BEB node UNI VLAN10 UNI VLAN11 L2 VSN I-SID 1000 L2 VSN I-SID 2000 untagged traffic Untagged Port 2 PVID=12 UNI VLAN12 L2 VSN I-SID 3000 SPB Fabric

L2VSN UNI types Switched UNI BEB node q tag VLAN id 10 Tagged L2 VSN I-SID 1000 UNI q tag VLAN id 11 Port 1 L2 VSN I-SID 2000 q tag VLAN id 10 Tagged q tag VLAN id 12 UNI Port 2 L2 VSN I-SID 3000 SPB Fabric

L2VSN UNI types Transparent UNI q-tagged traffic untagged traffic Transparent UNI Port 1 BEB node L2 VSN I-SID 2000 q-tagged traffic untagged traffic Transparent UNI Port 2 L2 VSN I-SID 3000 SPB Fabric

Shortest Path Bridging L3 Service VSN A Virtual outing instance (VF) provisioned at the edge of the fabric is mapped into the Virtual Service Network using the Service Identifier (I-SID) Unified Management Assign VF-2 IPVPN I-SID 200 Vlan / IP net1 VF2 Vlan / IP net2 Virtual Service Network I-SID 200 IS-IS advertises all new services and communities of interest (I-SID information) to the network as well as the VF IP routes which are only accepted and installed on other nodes in the same I-SID VF2 Vlan / IP net3 Vlan / IP net4

SPB Hierarchical addressing L2VSN Customer VLAN 10 FDB(Mac learning as usual) =========================================== 00:00:00:00:00:01 port 4/1 00:00:00:00:00:02 BMAC 00:bb:00:00:14:00 Customer VLAN 10 FDB(Mac learning as usual) =========================================== 00:00:00:00:00:01 BMAC 00:bb:00:00:13:00 00:00:00:00:00:02 port 4/1 CVLAN 10 L2VSN I-SID 20010 CVLAN 10 8600C BEB 00:bb:00:00:13:00 8600G BCB 00:bb:00:00:10:00 8600D BEB 00:bb:00:00:14:00 MLT 1 MLT 1 4/1 4/30 3/5 4/1 00:00:00:00:00:01 00:00:00:00:00:02 Backbone VLAN #1 : VID=4001 Backbone VLAN #2 : VID=4002 2 nd BVLAN used for load sharing Backbone VLAN 4001 FDB ( programmed) ======================================== 00:bb:00:00:10:00 port 4/30 00:bb:00:00:14:00 port 4/30 Backbone VLAN 4001 FDB ( programmed) ======================================== 00:bb:00:00:13:00 port 3/5 00:bb:00:00:14:00 MLT 1

SPB Hierarchical addressing L3VSN VF instance IP routing table =========================================== 10.1.101.0/24 vlan 101 (LOCAL/DIECT) 10.1.102.0/24 BMAC00:bb:00:00:14:00 () VF instance IP routing table =========================================== 10.1.101.0/24 BMAC00:bb:00:00:13:00 () 10.1.102.0/24 vlan 102 (LOCAL/DIECT) vlan 101 10.1.101.0/24 L3VSN I-SID 30001 vlan 102 10.1.102.0/24 8600C BEB 00:bb:00:00:13:00 8600G BCB 00:bb:00:00:10:00 8600D BEB 00:bb:00:00:14:00 MLT 1 MLT 1 10.1.101.10/24 4/1 4/30 3/5 4/1 10.1.102.10/24 Backbone VLAN #1 : VID=4001 Backbone VLAN #2 : VID=4002 2 nd BVLAN used for load sharing Backbone VLAN 4001 FDB ( programmed) ======================================== 00:bb:00:00:10:00 port 4/30 00:bb:00:00:14:00 port 4/30 Backbone VLAN 4001 FDB ( programmed) ======================================== 00:bb:00:00:13:00 port 3/5 00:bb:00:00:14:00 MLT 1

Shortest Path Bridging - Equal Cost Paths Cost =30 IS-IS sees 2 Equal Cost paths between 2 nodes (referred as Equal Cost Trees ECT) Cost =30 SPB 802.1aq defines max of 16 BVIDs Current implementation: 2 BVIDs IS-IS programs 1 st Equal Cost path in Forwarding Database of BVID 1 BVID-1 IS-IS programs 2 nd Equal Cost path in Forwarding Database of BVID 2 Service Networks (VSNs) are then hashed against one or the other or both (per flow hashing) BVIDs BVID-2

everse Path Forwarding Check (PFC) Loop suppression SPB requires that the shortest path in each direction be the same between any two devices for both unicast and multicast paths Mac-A Mac-B Mac-A Mac-B 2/11 2/12 BVLAN Forwarding Information Base (FIB) 2/11 MAC-A 2/12 MAC-B 2/11 2/12 Logic of everse path Forwarding Check is to examine all frames received on a interface and make sure that the source address and ingress interface are correct. If not the frame gets dropped.

SPB s Forwarding Model eplication done at optimal point based on shortest path algorithm Multicast traffic originates at Edge-1. One multicast packet sent to Core-1. Edge-9 Packets only traverse SPF links, no out of order packets, only nodes that are a member of the same service receive packets Edge-8 Edge-1 Core-1 Core-2 Edge-6 Edge-2 Common VLAN service Edge-3 Edge-4 Edge-5 All traffic is forwarded in the most optimal path based on SPF calculations

IGMP IGMP IGMP Shortest Path Bridging IP Multicast Services A multicast stream received at the edge of the fabric is mapped into a dedicated multicast Service Identifier (I-SID) eceiver Join 239.0.0.10 Unified Management Important Properties IGMP at the edge IS-IS in the fabric No need for PIM or DVMP complexity Can be constrained within a L2 or L3 VSN IPMC Multicast Sender Grp 239.0.0.10 I-SID 300 IS-IS advertises the stream to the rest of the fabric. The stream is not forwarded until a receiver requests it and is forwarded ONLY to those receivers who requested it Join 239.0.0.10 eceiver eceiver Join 239.0.0.10

Creating a Layer 2 Virtual service network 1 S2 3/20 8600A 3/11 VLAN1001 3 S1 8600G 3/31 MLT 1 3/1 3/32 VLAN1001 8600C L2VSN I-SID 21001 SPB Fabric 2 S3 3/20 8600B 3/12 3/11 3/12 VLAN1001 4 5 6 vlan create 1001 type port 1 vlan members 1001 3/1,3/31,3/32 vlan i-sid 1001 21001 vlan create 1001 type port 1 vlan members 1001 3/11,3/12,3/20 vlan i-sid 1001 21001

IS-IS/SPBM Multicast enable 1 S2 8600A node 11 3 S1 node 10 8600G 8600C node 13 4/11 MLT 1 4/12 3/10 SPB Fabric 3/10 4 5 2 S3 6 8600B node 12 router isis spbm 1 multicast enable exit

L2VSN Multicast enable config (IGMPv2) 1 S2 3/20 8600A 3/11 VLAN1001 3 S1 8600G 3/31 MLT 1 3/1 3/32 VLAN1001 8600C L2VSN I-SID 21001 SPB Fabric 2 S3 3/20 8600B 3/12 3/11 3/12 VLAN1001 4 5 6 interface vlan 1001 ip igmp snooping ip igmp snoop-querier-addr 10.1.255.201 exit

SPB QOS model & DiffServ SPB Fabric QOS based on BVLAN p-bits 8600G IP DSCP = EF BVID p-bit = 6 MLT 1 BVID p-bit MLT = 6 1 IP DSCP = EF Tester BEB BCB BEB Tester In the SPB model, all QOS within the SPB Fabric is based on the Backbone-VLAN p-bits Therefore it is essential that the desired QOS markings (IP DSCP or Customer-VLAN p-bits) or QOS policies at the edge BEBs are translated into correct B-VID p-bits so that inner BCB nodes can preserve the desired DiffServ PHB (Per Hop Behaviour)

IEEE 802.1ag CFM Connectivity Fault Management and ITU Y.1731 Performance Management 802.1ag CFM Maintenance hierarchies 802.1ag Maintenance levels/hierarchy Adapt customer demarcs Adapt Layer 2 Ping Layer 2 Traceroute Layer 2 Tracetree UNI Link Link OAM Link OAM Service OAM (SID) Trunk OAM UNI Link Link OAM CFM Level Hierarchies Service (e.g., all BEBs supporting common service instance) CMAC CFM (use level 6 or 7) Network (e.g. all devices common to a domain) SPBM CFM (use level 4 or 5) Y.1731 Performance Monitoring Frame Delay Frame Delay Variation Frame Loss Edge Switch NNI Link Transit Switch NNI Link Edge Switch Conceptually: -monitor the trunk or the service or both Service 802.1ag Trunk 802.1ag Built-in and on-switch

IEEE 802.1ag / Y.1731 Message Types Loopback Message (LBM) & Loopback eply (LB) L2 ping (like IP ping at L2) LBM MEP MEP LB Linktrace Message (LTM) & Linktrace eply (LT) L2 traceroute (like IP traceroute at L2) L2 tracetree (no IP equivalent) LTM MEP MIP LT MIP LT MEP LT Continuity Check Message (CCM) Delay Measurement (DM) Y.1731 Performance Monitoring: latency, jitter, frame loss * Future software release CCM MEP MEP CCM

Service Oriented Networking Benefit of SPB: The Deployment Framework Network Service Layer is independent from infrasturcture provider Network Service Layer Layer 3 Virtualized Multicast Service Layer 3 Virtualized Unicast Service Layer 2 Virtualized Multicast Service Layer 2 Virtualized Unicast Service VXLAN Service E-Line Service E-Tree Service ADN/SDN Service Customer Connectivity Service Layer Control Plane Forwarding Plane FC 6329 IS-IS / 802.1aq (SPBm) 802.1ah (MACinMAC) (2-16 BVLANs) SPB Layer Connectivity Layer Physical Infrastructure Copper Dark Fiber CWDM/ DWDM E-LINE/VPWS (PBB - or MPLS based) E-LAN/VPLS (two endpoints) SONET, SDH, Ethernet, etc Infrastructure Layer Multiple Service Providers

Changing the Game of data networking