Data Center Virtualization and Cloud QA Expertise Highlights Broad Functional QA Experience Deep understanding of Switching and Routing Protocols Strong hands on experience in multiple hyper-visors like VMware, Microsoft, KVM and OpenStack Expertise in testing advanced networking functions like VXLAN and VRF Broad Non-Functional QA Experience Non-Functional Testing like Soak, Stress, Scale and Performance using variety of traffic generation tools like Spirent (L4-L7), Shenick and open-source tools like Nping, Iperf, ApacheBench, Netperf, Peirf, NUTTCP and Scapy Broad Automation Experience Design and implementation of Automation Framework, Experience in CLI Automation using Python, Tcl, Perl, Expect, PowerCLI and in UI automation using Selenium and Sikuli Background The client is a Fortune 100 American MNC engaged in the design, manufacture and sale of Internet Protocol (IP) based networking products and services. The GS Lab engineers assisted the client to develop various innovative automation solutions making effective use of their QA expertise and experience in cloud virtualization. The highlights of Application Aware Infrastructure (AWI) solution: Deployment of AWI, Policy Controller, Top of rack (TOR) and SPINE switches Integration testing of Virtual Switch and AWI using VMware platform Testing seamless Build Upgrade Manager CLI automation for configuration of Policy Controller The highlights of Virtual Firewall Appliance solution: Deployment, Interoperability, Integration of Virtual Firewall Appliance using Distributed Virtual Switch (DVS) on various hypervisors like VMware, Microsoft Hyper-V, KVM and OpenStack Testing cascading in different virtual service nodes like firewall, load balancer and WAN Optimizer Testing overlay networks like Network Virtualization using Generic Routing Encapsulation (NVGRE) and Virtual Extensible LAN (VXLAN) Testing network policies like Multi-tenancy, 5-Tuple and VM attribute through Network Service Controller Performance testing and generating throughput metrics Automation framework customization (proprietary), design, development, automation and regression testing of functions like VXLAN, hybrid, non-hybrid policy configurations, and upgrades 1
The highlights of QA Automation solution: Experience in generic automation framework design Expertise in Python, Java, Perl, Shell for automation Hands on experience in using REST APIs for automation Adept in GUI based automation tools like Selenium and Sikuli Expertise in Software Testing Automation Framework (STAF) for integrating multiple platforms to design an end to end automation solution Business Challenge Manage multi-tier applications using AWI The client was using a generic multi-tier application which had some limitations like lack of centralized control, complexity involved in network configuration, integration and management of large number of virtual hosts, and application security. The GS Lab engineers collaborated with the client to implement a reliable and scalable L3 architecture while supporting Virtual Machine (VM) mobility and security across all the servers in the client datacenter. The challenges faced by the client were VXLAN support on Distributed Virtual Switch (DVS), multicast and Layer 3 (L3) routing protocol support, VXLAN security and traffic routing. The client was searching for a testing partner to design an automation solution for tracking network traffic between Virtual Machines (VM) and the biggest challenge was to setup a test environment and connect the VMs. The client application made use of an Inter cloud connector product to integrate Enterprise cloud with public clouds. This design comprised of having a customized adapter for every cloud provider which had to be supported. This involved repetitive testing and hence the need to automate. Implementation of Distributed Virtual Switch (DVS) in Hyper-V Network Virtualization (HNV) environment While developing a solution for the client, the GS lab engineers faced challenges to find static MACs for the VMs, to validate Windows Server Gateway (WSG) integration and CRUD operations for VM Networks, to validate System Centre Orchestrator (SCO), Service Provider Foundation (SPF) and Windows Azure Pack (WAP) for Windows Server integration, and to validate system performance. Automation of Flex based User Interface (UI) The client application had a Flex based UI which posed challenges like complexity in automation, multiple browser support, integration of Windows based UI and Linux based CLI architecture and execution of UI automation scripts from Linux based execution server. 2
Solution Overview Manage multi-tier using Application Aware Infrastructure (AWI) The GS lab team developed a solution making use of core components of AWI technology like AWI controller, TOR switches, SPINE switches, VMware Hypervisor hosts, VMware Virtual center and virtual switches. The solution also supported a scalable infrastructure to accommodate increasing number of virtual loads. The GS lab team used VXLAN technology to create a logical network for clients VMs across different networks. They created a layer 2 network on top of client s existing layer 3 networks. They leveraged DVS technology to centrally control the different networks. The Virtual Security Appliance was configured on the top of DVS to protect critical workloads. VTEP was configured on every host for data path processing like maintenance of forwarding tables and encapsulation and de-encapsulation of packet. With their expertise in virtualization, the GS lab team developed a solution to connect multiple VMs using PySphere libraries, Shell scripts, process ids and log files. This solution helped them increase the efficiency and in turn overall productivity of the client application. The GS lab approach to test automation framework was based on decoupling the test case development from the test framework development. This helped the test developers focus only on writing test cases using XML. A separate team took ownership of building the test framework using Python libraries. Implementation of Distributed Virtual Switch (DVS) in HNV environment With their expertise in virtualization, the GS lab team developed a solution for implementing and supporting client applications in HNV environment. With the help of HNV, they were able to achieve decoupling of virtual networks from the physical network infrastructure, IP address reuse, network security, workload sharing, live migration, etc. Automation of Flex based UI The GS Lab engineers researched various testing tools and finalized on Sikuli for GUI testing. The solution involved leveraging STAF for process invocation, resource management, logging, and monitoring. STAF was installed on Microsoft Windows and Linux execution servers for executing automation scripts between Linux CLI and Microsoft Windows UI servers 3
How We Helped Manage multi-tier using Application Aware Infrastructure (AWI) Implemented network design to accommodate internal and external traffic Configured high-availability node policies for TOR, virtual switches and firewall policies Deployed and configured changes for multi-tier applications Automated PowerCLI based applications to configure VMware based virtual infrastructure Configured PERL, Shell and Expect-based CLI automation for Application Aware Infrastructure Implemented Windows Server 2012 gateway NVGRE support Configured mechanism on DVS to create HNV based network segments and pools for integration with SCO, SPF and WAP Implemented CRUD operations for VM networks Extensively used PySphere libraries for easy access to VMware console Made use of Shell scripts for generating network traffic Developed a generic script design to avoid impact of network changes on the underlying infrastructure Developed a framework design to decouple test case development from test framework development Used XML based test case development strategy with minimum dependency on framework Implemented support for multiple cloud providers Developed generic framework design to support any CLI/API based automation Implementation of DVS in HNV environment Configured mechanism on DVS to create VXLAN network segments and pools Implemented MTU configurations between the entire interconnection infrastructure to handle VXLAN encapsulation Implemented the flow detection and policy enforcement in the form of the security appliance Automation of Flex based UI Automation of Flex based GUI using Sikuli Use of STAF to trigger GUI automation between Windows server and Linux based automation server 4
Value Delivered Manage multi-tier application using AWI Successfully leveraged advanced switch functionality using Application Aware Infrastructure for managing 10000 virtual loads for over 150 hosts. Enabled multi-tenant support while preserving IP scheme and network topology with DVS. With the implemented solution the customer could scale their existing network by 30% along with securing the workloads. Complete test coverage by automating close to 1000 test cases spanning across 10 different setup combinations. Reused the framework for other products where API/CLI needs to be automated. The solution ensured focused and rapid test case development. Implementation of Distributed Virtual Switch (DVS) in HNV environment The implemented solution helped the customer to use HNV with DVS seamlessly while preserving the network topology. The unique design helped in sharing the workloads dynamically thus increasing efficiency and productivity of the datacenter. Automation of Flex based UI Increased the test coverage by automating close to 1000 test cases spanning across 10 different setup combinations. The solution simulated real Business scenarios like traffic testing and load testing on the virtual firewall appliance. 5
GS Lab helps software product companies to design, develop, test, implement and support products. We work with world leading technology vendors, as well as with start-ups, to take their product ideas to fruition. We draw on our experience of having worked on hundreds of products over 10 years to bring real value to the product development process. Our capabilities extend across the technology stack, including embedded and connected devices, Internet of Things (IoT), virtualization, networking, Software Defined Networks (SDN), public and hybrid cloud, Identity Management (IDM), social, mobility, analytics and cloud (SMAC), big data, web and mobile apps and UX design. At GS Lab, we travel the entire product journey together with our customers, whether they need a quick prototype of an idea, or to offer end-user support and professional services. USA: +1 630 655-8905 Unit 4301 60 E Monroe St Chicago IL 60603 INDIA: +91 20 4671 1300 Amar Arma Genesis Baner Road Pune 411045 Email: info@gslab.com Twitter: @_gslab www.gslab.com 6