. z/vm 6.3 Virtual Switch Enhancements for the IBM z13 z/vm Virtual Networking eam ick arcza arcza@us.ibm.com
Agenda Overview of the new z/vm VSWICH capabilities available in z/vm 6.3 for the IBM z13 with AAs VM65583 and I21053 Virtual Switch Enhancements Exclusive Link Aggregation Overview Multi-VSWICH Link Aggregation roup (LA) 2
Virtual Switch Enhancements 3
z/vm VSWICH is oing lobal Inter-VSWICH-Link Simulated NIC Network Simulated NIC Network ort ort ort ort ort Virtual Switch: CASEY.NEWOK1 UpLink z/vm System CASEY z System LA 1 LOBAL VSWICH ort ort ort ort ort Virtual Switch: JONES.NEWOK1 UpLink z/vm System JONES z System LA 2 hysical Network 4
z/vm lobal VSWICH Logically a single VSWICH with additional capabilities A single lobal VSWICH can span up to 16 z/vm Systems via the IVL Network System administrator only defines an instance of a lobal VSWICH in the z/vm System where it s required Each instance of a lobal VSWICH is identified by: SystemName.VSwitchName z/vm verifies the characteristics of each lobal VSWICH instance defined are compatible Each lobal VSWICH instance is independently managed to meet the needs of the z/vm System were it resides rovides the basic infrastructure required to implement a Multi-VSWICH-LA configuration and future cross system functions 5
Defining a z/vm lobal VSWICH Simulated NIC Network ort ort ort ort ort ort DEFINE VSWICH NEWOK1 LOBAL Virtual Switch: CASEY.NEWOK1 IVL Establishes an internal communication link for VSWICH to VSWICH operations Inter-VSWICH-Link IVL ort ort ort ort ort ort ort Virtual Switch: CASEY.NEWOK2 z/vm System CASEY z System LA 6
z/vm IVL Network Domain An IVL Domain is a system administrator defined network providing internal z/vm VSWICH to VSWICH communications IVL Network Domain An IVL Domain is a group of up to 16 z/vm Systems connected by an Ethernet LAN segment A lobal VSWICH can only span z/vm Systems within the same IVL Domain Up to 8 IVL Domains (A to H) can be defined per VLAN A z/vm System can be a member of only a single IVL Domain VLANs are not required. A maximum of 8 domains can be configured without VLANs he z/vm System is connected to the IVL Domain through a special system administrator defined IVL VSWICH he bandwidth required by the IVL VSWICH consists of both management and LA data recovery communications 7
New ype of IVL Virtual Switch DEFINE VSWICH IVL YE IVL DOMAIN A ULINK DEV 0300 0200 Only one IVL VSWICH allowed per z/vm System By default Domain A is selected Ethernet Layer 2 required for the IVL Network No support for guest coupled NIC ports An EXCLUSIVE (traditional) LA or single shared OSA Feature with backup Uplink ort may be deployed VLAN AWAE is supported on an IVL VSWICH SE VSWICH IVL IVLO (Optional) VLAN Sets the VLAN ID associated with the IVL Domain (VLAN AWAE) ESE Diagnostic which terminates and recreates the IVL ort on the VSWICH IN ests connectivity between z/vm Systems in the same IVL Domain HEABEA IMEOU Adjusts the frequency the local z/vm System confirms connectivity with other z/vm Systems in the same IVL Domain epeat the same setup for all z/vm Systems in the same domain 8
Exclusive Link Aggregation Overview 9
z/vm Exclusive Mode Link Aggregation z/vm configures all the OSA Features in Exclusive Mode to disable its MIF port sharing capabilities V S W I C H Exclusive ort roup O O U IEEE 802.3ad Cascading Switches roup two or more ports together to form a logical fat pipe between two switches S W I C H A physical switch is incapable of sharing a port 10
Multi-VSWICH Link Aggregation (LA) 11
z/vm Multi-VSWICH Link Aggregation z/vm configures all the OSA Features in a new roup Exclusive Mode allowing only the z/vm VSWICH to use its MIF port sharing capabilities V V S V S W S W I W I I C C H C H H Any z/vm System in the same IVL Domain Shared ort roup Instances O O O O O U O U U IEEE 802.3ad Cascading Switches S W I C H he physical switch still only sees a single peer z/vm VSWICH 12
Multi-VSWICH Distributive LAC Management Sharing of OSA-Express Features within a LA configuration is provided by both z/vm System and OSA hardware functions Sharing of VSWICH OSA-Express Features within a LA is now possible through roup Exclusive mode his is similar to Exclusive mode but refined to a group of VSWICH network connections VSWICH membership enforcement is provided by OSA-Express Feature A single VSWICH network connection still provides LAC control for a physical port, but no single VSWICH will necessarily provide control for all ports within the LA Only a single VSWICH LA ort Controller is active per LA port he remaining sharing connections will be standby LA ort Controllers Maintains high availability if any one VSWICH network connection becomes inoperable V V S V S W S W I W I I C H C H C H IEEE 802.3ad IEEE 802.3ad IEEE 802.3ad Any z/vm System in the same IVL Domain Shared ort roup Instances O O O O O U O U U 13
Multi-VSWICH Single oint of Control SE O OU ODLA1 LAC ACIVE SHAED lobal Scope Command Automatically Shared ort roup ODLA1 ropagated Shared ort roup ODLA1 z/vm System CASEY z System LA 2 Shared ort roup ODLA1 Inter-VSWICH-Link z/vm System JONES z System LA 1 An instance of the shared port group is automatically created within all z/vm Systems in the same IVL Domain z/vm System BIBOY z System LA 3 14
Multi-VSWICH MAC ake-over Error ecovery he physical partner switch has no knowledge of the multiple network connections sharing a specific port IEEE 802.3ad allows the sending switch to determine which port it wants to transmit a packet A receiving switch has no say in the balancing of incoming packets he OSA-Express Feature is responsible for routing a specific packet to its proper destination MAC A IVL Domain MAC A acket A MAC take-over error recovery action is taken by OSA when one of its sharing network connections becomes inoperable OSA automatically assigns all MAC Addresses from the failing network connection to one of the other sharing connections Informs the selected z/vm VSWICH s network connection of the MAC ake-over Any packet received from the partner switch for the failing host are now routed to the ake-over VSWICH z/vm will route the packet for the take-over MAC via the IVL to the appropriate lobal VSWICH within the IVL Domain MAC take-over typically handles transient network errors and resumes normal operation when the failing connection takes-back the MAC when it recovers VSWICH A OSA Switch VSWICH B ake-over MAC A 15
Multi-VSWICH LA Virtualization Benefits Consolidate all z/vm VSWICH network connections within a CEC or LA into a single highly available physical LA Simplifies physical network complexity and management using a single broadcast domain Increase utilization of OSA-Express Features Eliminate the need to dedicate OSA-Express Features Single point of control Add or remove OSA-Express Features as needed from any z/vm System in the same domain Dynamic z/vm load balancing as bandwidth changes Load balancing is still performed locally on a per VSWICH basis Maintain independent VSWICH capability V V S V S W S W I W I I C H C H C H IEEE 802.3ad IEEE 802.3ad IEEE 802.3ad Any z/vm System in the same IVL Domain Shared ort roup Instances O O O O O U O U U 16
More Information A complete description of the support for Multi-VSWICH Link Aggregation can be found in z/vm V6.3 Connectivity, SC24-6174-05 http://www.vm.ibm.com/virtualnetwork/ -- z/vm Virtual Switch Development http://www.vm.ibm.com/virtualnetwork/linkag.html -- z/vm Link Aggregation Development http://www.vm.ibm.com/library Hardware IBM z13 with Driver 22H -- z/vm Online ublications Minimum Bundle level of S11a with MCL N98805.007 Software z/vm 6.3 with VM65583 and I21053 erformance oolkit with VM65528 SMAI with VM65670 17