Virtualizing your testing with Visual Studio Lab Management

Transcription

1 Virtualizing your testing with Visual Studio Lab Management Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation

2 Modern app development Continuous value delivery and rapid response to change

3

4 Manual testing User Interface Automated testing Services Business Processes Business Rules and Logic Service integrations Data access Identity Automated testing Data

5 Lab Management Overview

6

7

8 Lab Management Basics Environments Create and manage virtual or physical dev/test environments Snapshots Take snapshots or revert to existing snapshots Works on any virtual machine Deploy current or any build to environment Environment Viewer Interact with machines through the environment viewer Define test settings for environments

9 Leveraging Virtualization

10 Environments On-premise Cloud Lab management services

11 Benefits of Virtualization Testing Virtual test environments can be used for Testing CI builds using GUI automation Debugging Debug hard to reproduce defects Maintaining snapshots of older builds Demos Demos for customers Test Production hot-fixes Load Testing

12 Leveraging virtualization for ALM

13 Testing Architecture Team Foundation Server Test Controller System Center Virtual Machine Manager (SCVMM) Team Build VM Template Library SCVMM Environment Standard Environment VM Template 1 VM Template 2 VM Host Web Server VM Database Server VM Web Server Database Server Test Agent Test Agent VMMAgent Test Agent Test Agent Test Agent Test Agent

14 Build-Deploy-Test (1) Get Source Code (2) Compile projects Team Foundation Server Team Build (8) Publish results to Team Foundation Server Test Controller (6) Execute automated tests (7) Send test results VM Host VMMAgent SCVMM Environment Web Server VM Test Agent Database Server VM Test Agent (3) Copy build to running environment (4) Run deployment scripts for each machine (5) Create environment snapshot

15 Environment Differences SCVMM Environment Standard Environment Build-Deploy-Test Snapshot / Restore Share Bug Snapshots Network Fencing 3 rd Party Virtualization Physical Machines

16 Test Controller Run automated tests remotely Distribute automated tests to multiple environments Run tests and collect test data remotely using Microsoft Test Manager Run tests in a lab environment Deploy applications using a build-deploytest workflow

17 Test Agents Manage testing, workflow, and network isolation Scale out load generation Distributed data collection Distributed test execution Automatically installs test environments Can be manually installed/maintained using the VMPrepTool

18 Sharing and Libraries IT Administrator Manage virtual machine infrastructure Create, deploy, and manage virtual machines Monitor and manage hosts/library servers Manage global configuration settings VM Template Library SysPrepped golden images Tester Import VMs Create Environments Test in Environments Store Environments Self Provisioned VM Environment Win Server 2008 Win Server 2012 Win XP SP 3 Win Vista SP 2 Win 7 SP 1 Win 8 Create Active Environments Save Environments in Library 1) Domain Controller 2) Client VM 3) Web Server VM 4) Database Server VM Test Agent OS Support 4 machine environment

19 Lab Management

20 Save costs by virtualizing your labs

21 Licensing Lab Management is per CPU license for the hosts you want to manage For client you need either Ultimate/Test Professional SCVMM license for dev/test is included. Guest OS license is part of MSDN subscriptions VMWare Support Support through use of Standard Environments

22 Resources

23 Visit Team System Café Today! The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics!

24 Confused.com ICONICS Notion Solutions Minitab Fujitsu Canada

25 EPiServer Readify Länsförsäkringar AB Equiniti K2

26 Lab Management Resources Using a Lab Environment for Your Application Lifecycle Getting Started with Lab Management Guidance for Creating and Managing SCVMM Environments Cloning Virtual Machines through Network Isolation Creating Lab Environments Managing Lab Environments and Virtual Machines Testing for Continuous Delivery with Visual Studio 2012 Setting Up Automated Build-Deploy-Test Workflows

27 Best Practice Topology Guide Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling the test traffic in and out of Corp network Network load balancer Firewall rules Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based library and host SAN support Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual environment Setting up rules in Threat Management Gateway Deployment and testing on a shared machine outside the envt Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different domain DNS conditional forwarding

28 Other resources Visual Studio ALM + Team Foundation Server Blog Visual Studio Team Installing TFS 2012 with Lab Management 2012 Blog By Martin Hinshelwood Visual Studio Lab Management videos Lab Management Team Visual Studio Lab Management Guide By the Visual Studio Rangers

29 Lab Management Summary Built on Hyper-V Integrated with TFS 2012 Enabled by SCVMM 2012 Integrated management Multi-hypervisor management P2V and V2V Template deployment Cloning Optimize resource usage Managed by Microsoft Test Manager Reduces Hardware Utilization Remote Diagnostic Collection Virtual Environment Setup/Tear down Hyper-V Host Automated Build- Deploy-Test Workflow Virtual Machines

30

31 Appendix

32 Lab Management Highlights Create richer actionable bugs Simplifies environment setup and snapshots Create checkpoints to aid defect resolution Quickly debug issues in the same environment Connect to the test environment snapshot with network isolation Automate end-to-end workflow Out of the box build-deploy-test automation workflow Revert to baseline configuration Requires Visual Studio Ultimate or Visual Studio Premium Team Foundation Server Microsoft Test Manager Includes System Center Virtual Machine Manager license

33 Internal network Copy IIS DB Copy IIS DB Lab network

34 Lab Management Walkthrough

35 Reviewing a Rich Bug Detailed test steps including indexed video recording of test session and exact failed step A B Environment snapshot taken and attached Screen capture showing exact point of failure

36 SCVMM 2012

37

38 Create new multi-machine environment choices Start or Shutdown environments

39 Choose between two environment types

40 Configure machine to run UI tests

41 Create a multi-machine environment as close to production as possible for testing

42

43 Select the special lab build template Select an environment to deploy a build to Change the lab wizard workflow parameters

44 Queue a new build or deploy an existing one

45 Specify the deployment options to move application to servers Select the Test Plans and Test Suites to run in environment

46 Workflow run for Deployment and Lab Auto deployment of current build Test against Lab Environments Automatically

47 Thumbnail view of each machine in the environment Test Agent automatically started

48 Environment snapshot taken and attached as a link with bug Developers can quickly debug issues on the exact same testing environment

49 Select environment to store Storing in Library

50 Easily deploy currently stored environments Names of all the environments stored in the library

51 Right-click to connect to an environment Connect to individual machines via the environment viewer

52 See each machine in environment Shows desktop on individual machine via the environment viewer

53 Complete Snapshot maintenance across ALL machines in environment Shows test execution in environment

54 Support for GEO-Distributed Labs Host Group-US US Lab - Redmond Host Machine Host Machine Host Machine Library Share-US Library Server TFS App Tier Host Group-India Library Share-India US Lab - Hyderabad Host Machine Host Machine Host Machine Library Server

55 Environment Differences SCVMM Environments Standard Environments Testing Run manual tests Run coded UI and other automated tests File rich bugs using diagnostic adapters Build deployment Automatic build-deploy-test workflows Environment creation and management Use physical machines in addition to virtual machines Use third-party virtual machines Automatically install test agents Save and deploy lab environment snapshots Create lab environments from VM templates Start/stop/snapshot environment Connect to the environment using Environment Viewer Run multiple copies of an environment using network isolation

56 Continuous Value Delivery Define Ideation PowerPoint Storyboarding Agile Planning Tools Sprint, Backlog, Portfolio Develop Idea to working software Code Lens Team Rooms Suspend & Resume Code Reviews Feedback Collection Unit Testing Exploratory Testing Continuous Integrations Continuous Deployments REQUIREMENTS Sprint WORKING SOFTWARE Measure Actionable learning Continuous Integration Monitor Operate Deployment to feedback SCOM Integration IntelliTrace in Production PreEmptive Analytics Architect Architectural Discovery Understand the Domain Understand Code Complexity Maintain Control