"Testing Trends: Cloud, Virtualization, and Mobility"

Transcription

1 TK2 Keynote 4/19/2012 4:15:00 PM "Testing Trends: Cloud, Virtualization, and Mobility" Presented by: Theresa Lanowitz voke, inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL

2 Theresa Lanowitz voke, inc. Founder of voke, inc., Theresa Lanowitz is recognized worldwide as a strategic thinker and market influencer in application lifecycle, virtualization, cloud, and convergence markets. With more than twenty years of experience, Theresa has worked on some of the breakthrough technologies of our time the C-17 transport plane, Borland s JBuilder, and Sun s Jini project. As an industry analyst with voke, Theresa is a trusted advisor to some of the world s largest software companies. Previously, Theresa was a research director at Gartner; senior marketing and product manager at Sun Microsystems, Borland, and Taligent; and in development and IT at McDonnell Douglas (now Boeing).

3 Testing Trends: Cloud, Virtualization, and Mobility Theresa Lanowitz, voke Founder 19 April 2012 Orlando, FL 2012 voke media llc All Rights Reserved. Reproduction Prohibited. Agenda Market Trends Assess Your Organization Essential Technology Net/Net 1

4 Market Trends Forecasting the Future Importance of the application lifecycle broadly accepted Dev and test globally distributed Silos exist Global lifecycle transformation a necessity to align IT and line of business Mainstream virtualization in data centers Build-testdeploy broadly adopted Global economic crisis Cloud frenzy Technology driven by economy Mainstream desktop virtualization Cloud becomes pervasive Increased dev and testing productivity Tool usage in the cloud must be addressed for dev and test Lifecycle virtualization benefits deliver total value of ownership Global computing infrastructure challenged Global shortage of skilled testers Testing is strategic to the business

5 Mega Trends Business Software is the business Technology On-demand world Complexity Zero tolerance for errors Target Website Crash Missoni craze crashes Target website September 14, 2011 (CBS/AP) NEW YORK - There's Black Friday, then there's Target Tuesday. In a scene that was reminiscent of the shopping frenzy that typically comes on the day after Thanksgiving, Target's website crashed several times throughout the day, and more than a hundred shoppers lined up at many of its stores early in the morning on Tuesday for a sale of limited offerings of its Missoni for Target collection of bikes, luggage, clothes and housewares 3

6 Free Cash Commonwealth Bank Australia Sydney Morning Herald 1 March 2011 a Commonwealth Bank spokesman said the problem started after a "maintenance issue" overnight which sent the ATMs into what was called "stand-in" mode. "The ATM doesn't have visibility over a customer's balance," the spokesman said. "They could take out $500 even if there was only $100 in their account. The maintenance issue also affected Netbank, the bank's internet banking service, but had now been fixed, the spokesman said. Verizon Wireless Emergency Alert Message 4

7 PlayStation Network outage for 6 days no answers available for customers April 26, 2011 Sony gamers threaten to leave after hack April 27, 2011 Sony's Stringer under fire as 25 million more accounts hacked Fund manager says CEO Stringer should resign May 3, 2011 Sony hires firms to clean up after breach May 3, 2011 Attorney general confirms Sony data breach probe May 4, 2011 Subcommittee Chairwoman Mary Bono Mack noted with dismay - Sony first disclosed the breach on a blog May 4, 2011 N.Y. attorney general subpoenas Sony, CEO Stringer offers the first apology and explanation for what may have happened May 5, 2011 Sony's insurers to help foot bill for data breach May 5, 2011 Sony breached again, hackers disclose 2,000 more customer accounts May 26, 2011 Sony insurer sues to deny data breach coverage July 21, 2011 More Software Impacts Daily 5

8 Why are Software Failures Making Headlines? Economy Lack of IT/technology investment during economic crisis impacting market today with constant software failures Faster faster faster Faster is not better - important to understand impact of time-to-market and quality Tool gap New versions of tools are significant Make sure you are on the latest release Reluctance to embrace new technology New solutions work and deliver immediate impact Assess Your Organization 6

9 What is Your Primary Testing Challenge? Cloud Devices Time-to-market Lower costs Defects Assess Your Organization Has your brand been impacted by a catastrophic event? Have you had a security breach? Do your applications meet the needs of the customers the first time? Is the line of business available when you need them to ensure project success throughout the lifecycle? Do you spend a significant amount of your software budget on rework? Do your customers complain about performance? Is your organization in balance, or does one team rule? Do you have development and test labs equivalent to production physically or virtually? 7

10 Essential Technology voke 2010 Market Mover Array TM Chart: Testing Platforms Source: voke Research August

11 voke 2011 Market Mover Array TM Chart: ALM Source: voke Research June 2011 Infrastructure Test Optimization (ITO) Definition Infrastructure test optimization (ITO) encompasses the practices required to ensure infrastructures meet a defined quality of service and quality of experience required to deliver strategic business objectives. ITO Practice Areas Emulation & Analysis Automation Quality Management Development Testing Lifecycle Virtualization Definition Vendors Professional Services Reproducing real world networks and/or actively simulating real users on the network to ensure infrastructures meet designed requirements including: verification of conformance to networking standards, meet performance of functional requirements, measure performance under load at scale Agilent Technologies, Anritsu, EXFO, Ixia, JDSU, Rohde & Schwarz, Spirent Using tools to efficiently develop and execute tests, compare actual vs. predicted outcomes, establish test pre-conditions such as automated configuration of test beds, test reporting functions Electric Cloud, HP, IBM/Rational, Microsoft, MRV, OnPath, Spirent Using tools to manage previously specified tests. May include requirements, resource management, reporting, metrics, defect tracking and management HP, IBM/Rational, Keynote DeviceAnywhere, Microsoft, PTC, Wind River A set of processes and technologies designed to help development organizations find and fix software problems early in the lifecycle and acts as documentation and a pre-cursor to QA testing Coverity, IBM/Rational, Klocwork, Parasoft, Spirent On-demand access to critical resources needed for testing such as: environments, servers, devices, databases, defects. etc. CA, Citrix, HP, IBM/Rational, ITKO/CA, Keynote DeviceAnywhere, Microsoft, Parasoft, QualiSystems, Replay Solutions, Spirent, Skytap, Vmware, Wind River Cognizant, ERISA, HP Professional Services, Infosys, IBM Global Services, Tata Consultancy, Tech Mahindra, Spirent Professional Services, Wipro ITO Goals Ensure that infrastructure is not a bottleneck. Ensure that anything added to the infrastructure does not negatively impact the network or other connected elements voke voke media media, llc. All IlcRights All Rights Reserved. Reserved. Reproduction Reproduction Prohibited. Prohibited. voke research available at 9

12 Solving Classic Problems Through Innovation Cost Lifecycle Virtualization Development Testing Infrastructure Test Optimization Quality Schedule Evolution of Virtualization Server Desktop Lifecycle Market Adoption Phase Mature Trending Early Technology Phase Stable and full featured Stable with emerging features Dominant Vendor VMware Citrix? Stable and evolving Competitive Vendors Microsoft, Citrix VMware, Quest CA, CA/ITKO,Citrix, Electric Cloud HP, IBM/Rational, Keynote DeviceAnywhere, Microsoft, Parasoft, QualiSystems, Replay Solutions, Skytap, Spirent, VMware, Wind River Primary Users Data center Service center Dev, test, ops 10

13 Transform the Lifecycle Lifecycle Virtualization Lifecycle Virtualization The use of technologies such as virtual lab management, service virtualization, defect virtualization, device virtualization, virtualized cloud platforms, etc. to enhance the application or product lifecycle through the reduction of defects, lowering costs, speeding time-to-market, and increasing customer satisfaction. Benefits Accessibility Eliminates tactical activities and controls labor costs Manage and control complexity Handle change Moves to total value of ownership (TVO) model Delivery Models On-premise Cloud (Public, Private, Hybrid) Primary Audience QA and Testing Development and Engineering Lab Management Operations Solve Classic Problems with Lifecycle Virtualization Issue #1 Problem It works on my machine Solution Lifecycle virtualization through virtual test lab and management deliver an environment as close to production as possible and eliminate defect replication issues while enabling the testing of more environments and platforms 11

14 Solve Classic Problems with Lifecycle Virtualization Issue #2 Problem We re waiting for our dev and test environments to be deployed Solution Lifecycle virtualization through selfprovisioning enables set-up, tear down at any time with any tool configuration enables environment accessibility Solve Classic Problems with Lifecycle Virtualization Issue #3 Problem We are waiting for the components to be ready for testing. Solution Lifecycle virtualization through service virtualization allows testers access to any service or component when and where needed to enable faster time-tomarket 12

15 Solve Classic Problems with Lifecycle Virtualization Issue #4 Problem How much are we spending on this test lab? Solution Lifecycle virtualization delivers selfservice provisioning for test labs of any size at any time. Once used the virtual machines are released. Solve Classic Problems with Lifecycle Virtualization Issue #5 Problem How long has this bug been in the code? Solution Lifecycle virtualization enables developers and testers to identify and remove defects before they become features 13

16 Transform the Lifecycle Development Testing Development Testing A set of processes and technologies designed to help development organizations find and fix software problems early in the development cycle and identify and fix software problems as the code is being written. Benefits Predictability in software development Traceability Supply chain visibility Enhanced collaboration across the lifecycle Lifecycle transparency Delivery Models On-premise Primary Audience Development and Engineering QA and Testing Solve Classic Problems with Development Testing Issue #1 Problem We need more visibility into the supply chain Solution Use fully integrated development test solutions to deliver: Fast and accurate results Predictability Software supply chain traceability Metrics 14

17 Solve Classic Problems with Development Testing Issue #2 Problem We just wait for development to give us anything Solution Deliver higher quality builds to QA teams to facilitate: Focus on more critical defects Lifecycle transparency into development Enhanced collaboration Greater business value Transform the Lifecycle Infrastructure Test Optimization Infrastructure Test Optimization (ITO) The practices required to ensure infrastructures meet a defined quality of service and quality of experience required to deliver strategic business objectives. Ensure that infrastructure is not a bottleneck. Ensure that anything added to the infrastructure does not negatively impact the network or other connected elements. Benefits Automation Predictability Reusable and sharable test assets Delivery Models On-premise Cloud (Public, Private, Hybrid) Professional services Primary Audience QA and Testing Development and Engineering 15

18 Solve Classic Problems with ITO Issue #1 Problem We are writing our own tools for infrastructure testing. Solution Use commercially created tools for infrastructure testing and benefit from: Automation Ongoing updates through vendor Open standards architecture Support, training, and expert services through a vendor of partner Solve Classic Problems with ITO Issue #2 Problem We are not so sure about our infrastructure. Solution Use ITO solutions to deliver end-toend predictability 16

19 Net / Net Net/Net Software complexity continues Understand the impact of business and technology trends Assess your organization Solve classic problems Tackle the cost, quality, schedule triangle New and innovative technology works and delivers fast ROI Leverage the productivity of new solutions to deliver more strategic value and solve classic problems Investigate and invest Lifecycle Virtualization Development Testing Infrastructure Test Optimization (ITO) 17