GETTING THE BIGGEST BANG FOR YOUR SOURCE CODE ANALYSIS BUCK
|
|
- Nicholas Higgins
- 8 years ago
- Views:
Transcription
1 GETTING THE BIGGEST BANG FOR YOUR SOURCE CODE ANALYSIS BUCK Combine a smart deployment strategy with realistic goals, and you ll achieve your payback in no time
2 Companies that create smartphones, military systems, aerospace technology, medical devices, and communications software and equipment are all looking at source code analysis (SCA) as a way to reduce their costs while creating more secure and reliable code. Naturally, people want to know what payoff to expect from deploying SCA and how they can show ROI within their organization. This paper shows you how to build a business case for source code analysis and demonstrates a few different ways to calculate ROI for this technology. Key topics covered in this paper include: Fundamental ROI principles for source code analysis Three areas that can ruin your business case before you get started Example ROI model that you can use in your own deployment 2
3 As every software development professional knows, the later bugs are found, the more they cost to fix. This make sense, of course. But unfortunately, as the chart below shows, while the majority of bugs are introduced during the coding phase of the development process, most are not actually detected and fixed until the later and more expensive stages. To improve efficiency and save money, development teams should be moving a larger percentage of that bug detection and repair into the coding stage, where it s less expensive to deal with. If you take that approach, you ll get a big payoff, as long as the approach you introduce doesn t add more cost or effort to the front end of your process. And that s really the primary value proposition for the latest generation of source code analysis tools. Designed to find critical defects and security vulnerabilities as the developer is writing their code (following the usability model of a spell checker), errors can be found and fixed the instant they re created. Source code analysis is automated and requires no significant amount of effort by the developer, other than reviewing and correcting defects identified by the tool. Figure 1 Defect Detection vs. Cost to Repair Source: Capers Jones Before you present this chart as a way to justify your investment in SCA, let s take a look at some best deployment practices to protect you from common pitfalls that can imperil your business case (see 3 Deployment Rules for ROI Success below). Once armed with these deployment do s and don ts, we provide you with specific tips for building an ROI model that works for your organization (see How to Build a Business Case and Show ROI). 3 DEPLOYMENT RULES FOR ROI SUCCESS All the detailed ROI numbers and cost justifications are great, but if you don t follow the rules outlined below, you ll have a tough time achieving the business goals and ROI model you ve put in place. 1. Don t Fall into the Smoking Gun Trap As a development team, you need to be in agreement that the source code analysis tool is finding real and important issues that need to be addressed. This is really the fundamental assumption that underlies your adoption of the technology in the first place, and flows into your ROI model. The mistake many engineering teams make is they instinctively want to justify their source code analysis deployment by finding that one EPIC & LEGENDARY bug that could or did cost them millions of dollars in the field. We call this the Smoking Gun bug, and if you find it, you can stop reading this paper because you have your cost justification. The reality is that most deployments have trouble correlating their source code analysis results to the Smoking Gun bug, if for no other reason than the complexity of doing so. You need to correlate hundreds of bug reports that were found statically with debug information from this single colossal field failure, and prove that it would have been found with a source code analysis tool. 3
4 The true value of SCA isn t about the Smoking Gun; it s about the cumulative effect of reducing hundreds, and more likely many thousands of bugs from your code with each and every build, story, and release. We see this time and time again when customers stop new issues from being introduced, systematically burn down their backlog of Klocwork-reported bugs, and measure the results. From a Polycom case study: [...]The impact of SCA on the HDX product line can be measured in customer satisfaction and product stability. We are getting fewer customer call-ins, and we see better stability in test cycles. That improvement can be measured empirically through Polycom s field data. Our service cases have reduced significantly and that is trending positive. Our customers are highly satisfied. To appreciate the cumulative effect, you need to satisfy yourself and the development team that, across the board, the tool is finding real and important issues that must be fixed. The most common approach to achieving this goal is to have a few key developers who are respected and have good knowledge of the code review a set of bug reports generated by the source code analysis tool normally from a code base that s already been through your normal testing process and assess their validity. This is a simple, cost-effective way to achieve group-level confidence in the tool. A novel approach to achieving this goal was conducted by Overture Networks, as described below: Each time a detected bug was fixed, the developer included a log statement in the revised code. During lab testing, if the fixed code ran, the benign statement would appear to let the test team know that, If we hadn t made Bug Fix X, Error Y would have occurred here. These instances were documented by the test lab. Regardless of how you do this, once you ve proven that the tool is finding real issues, you can move on to more productive activities. 2. Avoid Hidden Deployment Costs Let s start by stating the obvious: You ll reduce your ROI if you increase your costs. So, how do you avoid this situation? There are two cost-chewing activities that every source code analysis deployment can run into: False Positives and Opening the Flood Gates. The Cost of False Positives In the case of false positives, you can run into a couple of quagmires, both of which are very avoidable: The first is selecting a tool that, frankly, isn t very good. There are some source code analysis tools out there that throw 99% false positives, and the defects they do find aren t that interesting (see Rule #1). To avoid this trap, evaluate modern source code analysis tools that run a comprehensive build of your code, perform deep, interprocedural dataflow analysis, and use some kind of formalism in their analysis, such as symbolic logic. If you re dealing with a tool that doesn t meet these criteria, don t bother. The other false positive quagmire is what we call perceptual false positives. These are situations where the tool is correct but developers provide the following reaction: Meh, no big deal. This is directly related to the issues discussed in Rule #1 (Smoking Gun) but also goes to a bigger deployment issue that you need to address. Developers need to be on-board, understand the value, and realize the cumulative effect that cleaning 4
5 thousands of issues will have on their code over time. It will save them time, will help stop the repetitive and distracting process of reworking issues found by testing or in the field, and will generally make them better developers. It s not as glamorous as finding the Smoking Gun bug, but it works. Opening the Flood Gates There are two sure-fire ways you can blunder into this mistake: Target all your product lines/teams at once. You need to work through your engineering teams and/or product lines in a systematic way. Pick a product line or engineering team some sort of cohesive group of people and code that makes sense in your organization and start your source code analysis deployment there. Once you ve done a rollout with this group and worked through the inevitable lessons-learned and developed some key best practices that work for your organization, then you can begin expanding the SCA deployment to other groups. Deal with backlog on Day 1. When you first run a good source code analysis tool on a code base that has been around for some time, there will be lots of results to sift through. The best practice here is to separate the backlog of existing issues from new ones being created from that point forward. There are a few ways to do that, which could be its own deployment best practices paper, but the key thing is to get strict about new issues being introduced (zero tolerance would be a good place to start) and either gradually introduce backlog bugs to developers who will clean them up during implementation, or explicitly allocate time for your development team to aggressively burn down the backlog in a shorter period of time. 3. Measure Your Progress This is true for any new business or engineering process, and source code analysis is no exception. Most decent source code analysis tools include a reporting interface that will allow you to automatically collect a set of core metrics. Use that data, share it with your engineering management (and the whole team if that fits your development culture) and get disciplined about monitoring these key performance indicators (KPIs). This is the exact approach Polycom took: One of the disciplines that was key to the successful rollout is the use of Klocwork reports to give Polycom management greater visibility. We report on Klocwork every week at our operations review. It s in front of everyone s eyes, and the managers know how many defects they have in their queue, how many are being fixed, and what the trend lines look like. Here are three must-have metrics you ll want to collect on Day 1, and on a regular basis thereafter: Distribution of defect types across code base. This is a state of your code base view to see what you re dealing with and will help you immediately prioritize clean-up based on defect types that are important to you. Defect injection rate. Once you know the current state of your code, you ll want to know if it s getting better or worse, and that s the defect inject rate. Track this every build since it will show you which way the problem is trending, and also allows you to gauge the effectiveness of your deployment. Cost of fix activity. This can be discovered by identifying where bugs are being fixed during implementation (pre-check-in) or after the integration build. The metric here is really the inverse of defect injection since it s identifying where defects have been removed rather than injected, and it gives you the opportunity to start fine tuning your deployment. You ll want to know whether bugs are being fixed during implementation (where they are cheapest to fix) or later at build time. As long as they re getting fixed before testing and not leaking later into the release cycle, that s a good thing, but the more issues you can find and remove pre check-in, the better. 5
6 Systematically repeat this process for every team, on-board them the same way, share lessons learned, and be consistent. HOW TO BUILD A BUSINESS CASE AND SHOW ROI The basis for a source code analysis ROI model goes back to the very first chart shown in this paper the more bugs you find during implementation, the more money you ll save. As mentioned, everyone understands this, but the trick is to develop a model that s conservative, grounded in some real numbers that make sense, and will get buy-in from others in your organization. A slightly modified version of that chart to assess the impact of source code analysis would look like the one shown below. Figure 2 Defect Detection vs. Person Hours to Repair Explanation of the Assumptions Used Implementation = 15 minutes. Before code check-in is the optimal place to find and remove bugs, and when you think about what s required to fix a bug at the desktop, it s a fairly conservative number. A developer is in-context working on a particular file and the source code analysis tool automatically finds a list of potential issues in that local file, complete with traceback information that steps the developer through the code. For most bugs found here, the fix is very quick. Integration Build = 1 hour. When bugs are identified, then triaged at integration build, it requires developers to understand, interpret the bug report, check out the file in question, take some time to get back into the context of that code, make the fix, resubmit, and wait for the subsequent build to make sure it has been fixed. Also, there s an inevitable administrative overlay to this model, which adds to the person hours, since it requires triaging of bugs from a central repository and distributing them to the developers. Test = 12.5 hours. Now you have test engineers involved who need to file a bug report in their bug tracking system, which eventually gets to the developer, who then needs to go through a traditional debug cycle, isolate the issue, fix and resubmit code, followed by a subsequent re-test. Production = 25 hours. This number can vary widely depending on the type of software being developed, but there are significantly higher levels of effort required to fix these issues when you consider the involvement of support teams, account management teams, not to mention the cost of brand damage, etc. 6
7 Applying These Assumptions The simplest way to apply these assumptions is to just assign an average savings per defect found by source code analysis, which will result in a straightforward cost avoidance ROI. That s what Johns Hopkins/DARPA did, using an estimated savings of 4 person hours per bug: We had a very tight schedule and without Klocwork, we would have had difficulty meeting our objectives on time. Even with a relatively small development team, we estimate 900 person hours saved by using Klocwork. Alternatively, you can apply the same principle using cost of defects (rather than person hours), and come up with a straightforward, conservative ROI. Spirent took this approach and using a conservative estimate for defects found per release, came up with a compelling business case: We ve calculated that the cost of fixing a defect in the field is $962 and the cost to fix it with static analysis is $96. With a large code base such as ours, we could easily find hundreds of bugs in one release cycle, so the ROI is very compelling and easy to justify. Another approach which is more involved, and is best used when you have more detailed source code analysis usage data to work with, involves calculating person hour savings based on a distribution of where the defects are actually found. After some usage with the tool, you ll have data on fix activity at both the implementation and integration build, as well as data on what bugs weren t fixed at all, which represents bug leakage into testing or beyond (hopefully there are none of these!). Let s assume a modestly sized project of 750,000 LOC and a 1 bug/kloc rate, which would translate into 750 bugs that need to be repaired. Your usage data shows that 90% of SCA-found bugs are getting fixed at the desktop, 10% at integration build, and your zero-tolerance program for SCA bugs is ensuring none are leaking into testing or beyond. You then need to paint a picture of life without source code analysis, which is a bit trickier and requires making some assumptions. For this example, we ll use a conservative assumption that 50% of the bugs found by the tool (remember, these are real bugs that exist in your code!) would be found within that same time period, either at testing or in the field. Person hour Effort % Defects Repaired w/sca % of Defects Repaired w/o SCA Developer Desktop % Integration Build 1 10% Testing % Field 25 25% Savings Summary Total Person Hours Spent 244 person hours 7,032 person hours Total Time Saved w/sca 6789 person hours / 3.4 person years saved Notes: 1. These numbers represent bugs found by source code analysis and not all bugs that could exist in your software. 2. The Without SCA scenario assumes only 50% of the bugs will be discovered during the time period of the ROI. 7
8 Using these conservative assumptions, you can see that even a modestly sized code base can yield significant productivity gains across your team. There are, of course, some nuances to this that will be unique to every deployment (mix of backlog defects vs. newly injected ones, different cost estimates, etc) but the basic premise is that you have a universe of bugs that must be repaired within a period of time, and the cost of repairing them can be significantly less if you address them in a more cost-effective manner. Once you ve made these calculations, you can convert person hour savings into financial costs using your own loaded labour rates, apply any additional conservative assumptions as you see fit, and work with this as a baseline model for cost justifying your investment in source code analysis. CONCLUSION There is much evidence that source code analysis can find a large number of significant issues in your code that need to be addressed. Furthermore, there s no other automated code analysis technology that can help you find these issues as efficiently as source code analysis. The key to cost justifying the use of SCA technology on an ongoing basis within your organization is to combine real, tangible source code analysis deployment data with some conservative cost-savings assumptions and come up with a model that s accepted within your organization and that you can use throughout the life of your deployment. Rogue Wave provides software development tools for mission-critical applications. Our trusted solutions address the growing complexity of building great software and accelerates the value gained from code across the enterprise. The Rogue Wave portfolio of complementary, cross-platform tools helps developers quickly build applications for strategic software initiatives. With Rogue Wave, customers improve software quality and ensure code integrity, while shortening development cycle times Rogue Wave Software, Inc. All rights reserved.
WHY YOUR MOBILE APP STRATEGY IS KILLING YOUR BUSINESS. And How To Calculate The ROI On Fixing It
And How To Calculate The ROI On Fixing It INTRODUCTION If you re a consumer-facing business of any size, you ve probably got a mobile app. You may well take a close interest in how well it functions, and
More informationSreerupa Sen Senior Technical Staff Member, IBM December 15, 2013
Sreerupa Sen Senior Technical Staff Member, IBM December 15, 2013 Abstract In this experience report, I ll talk about how we transformed ourselves from a team that does one big bang release a year, to
More informationThe ROI of Test Automation
The ROI of Test Automation by Michael Kelly www.michaeldkelly.com Introduction With the exception of my first project team out of college, in every project team since, I ve had to explain either what automated
More informationManaging Agile Projects in TestTrack GUIDE
Managing Agile Projects in TestTrack GUIDE Table of Contents Introduction...1 Automatic Traceability...2 Setting Up TestTrack for Agile...6 Plan Your Folder Structure... 10 Building Your Product Backlog...
More informationcase study Coverity Maintains Software Integrity of Sun Microsystems Award-Winning Storage Products
case study Coverity Maintains Software Integrity of Sun Microsystems Award-Winning Storage Products 25% of the defects identified by Coverity would have stalled a product launch and delayed time to market
More informationREDUCE YOUR OPEN SOURCE SECURITY RISK: STRATEGIES, TACTICS, AND TOOLS
REDUCE YOUR OPEN SOURCE SECURITY RISK: STRATEGIES, TACTICS, AND TOOLS Open source security must be a priority While there s no doubt that open source software (OSS) is here to stay, that doesn t mean that
More informationTOP 3 STRATEGIES TO REDUCE RISK IN AUTOMOTIVE/IN-VEHICLE SOFTWARE DEVELOPMENT
TOP 3 STRATEGIES TO REDUCE RISK IN AUTOMOTIVE/IN-VEHICLE SOFTWARE DEVELOPMENT Go beyond error detection to ensure safety and security TABLE OF CONTENTS The Three Biggest Challenges...4 Ensure compliance
More informationStories From the Front Lines: Deploying an Enterprise Code Scanning Program
Stories From the Front Lines: Deploying an Enterprise Code Scanning Program Adam Bixby Manager Gotham Digital Science 10/28/2010 YOUR LOGO HERE Introduction Adam Bixby, CISSP, MS o Manager at Gotham Digital
More informationStatic Analysis Best Practices
Static Analysis Best Practices This is the first in a series of interviews in which Adam Kolawa Parasoft CEO and Automated Defect Prevention: Best Practices in Software Management (Wiley-IEEE, 2007) co-author
More informationTotal Quality Management (TQM) Quality, Success and Failure. Total Quality Management (TQM) vs. Process Reengineering (BPR)
Total Quality Management (TQM) Quality, Success and Failure Total Quality Management (TQM) is a concept that makes quality control a responsibility to be shared by all people in an organization. M7011
More informationAvoiding CRM s Common Pitfalls
Avoiding CRM s Common Pitfalls Implementing CRM Doesn t Have to be Painful; Learn from the Experience of Others By Craig Bailey President & Founder of Customer Centricity, Inc. Avoiding CRM s Common Pitfalls
More informationFIREWALL CLEANUP WHITE PAPER
FIREWALL CLEANUP WHITE PAPER Firewall Cleanup Recommendations Considerations for Improved Firewall Efficiency, Better Security, and Reduced Policy Complexity Table of Contents Executive Summary... 3 The
More informationDesigning and Implementing Your Communication s Dashboard: Lessons Learned
Designing and Implementing Your Communication s Dashboard: Lessons Learned By Katie Delahaye Paine President, Paine & Partners Contact Information: Katie Delahaye Paine CEO KDPaine & Partners Durham, NH
More informationThe Dirty Little Secret of Software Pricing
WHITEPAPER The Dirty Little Secret of Software Pricing Stan Schneider Mr. Customer, our price is $13,349 dollars per floating development seat. Larger teams need more support, so we charge 20% maintenance
More informationReducing the Costs of Employee Churn with Predictive Analytics
Reducing the Costs of Employee Churn with Predictive Analytics How Talent Analytics helped a large financial services firm save more than $4 million a year Employee churn can be massively expensive, and
More informationThe Importance of Continuous Integration for Quality Assurance Teams
The Importance of Continuous Integration for Quality Assurance Teams Without proper implementation, a continuous integration system will go from a competitive advantage for a software quality assurance
More informationTop Producer Secrets About Cheap Leads Revealed!
Special Insider s Report Top Producer Secrets About Cheap Leads Revealed! Avoiding The 5 Ways Cheap Leads Can Steal Your Money By Clint Jones CEO, ProspectZone TM Smart leads. Cost per Lead vs. Cost per
More informationSolution Spotlight KEY OPPORTUNITIES AND PITFALLS ON THE ROAD TO CONTINUOUS DELIVERY
Solution Spotlight KEY OPPORTUNITIES AND PITFALLS ON THE ROAD TO CONTINUOUS DELIVERY C ontinuous delivery offers a number of opportunities and for organizations. By automating the software buildtest-deployment
More information5 Best Practices for Mobile Business Intelligence
5 Best Practices for Mobile Business Intelligence Author: Ellie Fields Director, Product Marketing Tableau Software June 2011 p2 5 Best Practices for Mobile Business Intelligence Mobile business intelligence
More informationAN ENVOY WHITE PAPER TOTAL COST OF OWNERSHIP A SAAS B2B WHOLESALE ECOMMERCE PLATFORM
AN ENVOY WHITE PAPER TOTAL COST OF OWNERSHIP A SAAS B2B WHOLESALE ECOMMERCE PLATFORM 02 Executive Summary There has been a great deal written about determining the total cost of ownership (TCO) of implementing
More informationThe Impact of Transaction-based Application Performance Management
An AppDynamics Business White Paper MASTERING APPLICATION PERFORMANCE IN FINANCIAL SERVICES The Impact of Transaction-based Application Performance Management Managing applications in the world of Financial
More informationTerminology and Scripts: what you say will make a difference in your success
Terminology and Scripts: what you say will make a difference in your success Terminology Matters! Here are just three simple terminology suggestions which can help you enhance your ability to make your
More informationMost Common. Marketing Budget Pitfalls. Avoiding the Mouse Trap
Most Common Marketing Budget Pitfalls Avoiding the Mouse Trap Regardless of industry, marketers across organizations from those in PR and marketing communications, to those in marketing operations struggle
More informationHow to Avoid the 10 BIGGEST MISTAKES. in Voice Application Development
How to Avoid the 10 BIGGEST MISTAKES in Voice Application Development Are you building the next generation mobile app that provides users anytime, anywhere voice and messaging communication? Maybe you
More informationFleet Management Software: Build or Buy?
Fleet Management Software: Build or Buy? So you ve decided to automate your motor pool management. Now what? You ask yourself, should we buy an off-the-shelf fleet and motor pool management system or build
More informationINTRODUCING CONTINUOUS DELIVERY IN THE ENTERPRISE
INTRODUCING CONTINUOUS DELIVERY IN THE ENTERPRISE The situation Today Not too long ago customers and prospects had to find a computer to visit your site. In stark contrast with just a few years ago, this
More informationWhy A/ B Testing is Critical to Email Campaign Success
Why A/ B Testing is Critical to Email Campaign Success A / B Testing By systematically running controlled campaigns, A/B testing helps you determine which message or offer will resonate best with your
More informationSin #1 - Not Establishing a Clear and Realistic Goal
A s a B2B lead generation tool, search engine marketing (SEM) is all the rage everyone wants a piece of the pie. Unfortunately, countless companies lose time and money trying to cash in on the alluring
More informationBUSINESS PROCESS OPTIMIZATION IN THE CONTACT CENTER
BUSINESS PROCESS OPTIMIZATION IN THE CONTACT CENTER By Brian Hinton Principal Consultant Strategic Contact, Inc. June 2010 2010 Strategic Contact, Inc. All Rights Reserved WHITE PAPER ABOUT THE AUTHOR
More informationB2B Customer Satisfaction Research
Circle Research White Paper B2B Customer Satisfaction B2B Customer Satisfaction Research IN SUMMARY This paper on B2B customer satisfaction research: Identifies why customer satisfaction matters Provides
More informationHOW TO IMPROVE QUALITY AND EFFICIENCY USING TEST DATA ANALYTICS
HOW TO IMPROVE QUALITY AND EFFICIENCY USING TEST DATA ANALYTICS Discover 8 ways in our guide for advanced manufacturers Do you perform advanced manufacturing in an industry such as aerospace, automotive,
More informationFundamentals Every B2B Marketer Must Know
Account-Based Marketing: Fundamentals Every B2B Marketer Must Know Demandbase.com Introduction If you re a B2B marketer today, you re in a tough spot. You d love to be an innovative marketer who impresses
More informationFrequency Matters. The keys to optimizing email send frequency
The keys to optimizing email send frequency Email send frequency requires a delicate balance. Send too little and you miss out on sales opportunities and end up leaving money on the table. Send too much
More informationIT SERVICE MANAGEMENT: HOW THE SAAS APPROACH DELIVERS MORE VALUE
1 IT Service Management: How the SaaS Approach Delivers More Value IT SERVICE MANAGEMENT: HOW THE SAAS APPROACH DELIVERS MORE VALUE EXECUTIVE SUMMARY Today s companies are very reliant on their technology
More informationA robust metrics program can provide directional guidelines and a basis for advancement in process efficiency and flexibility.
A robust metrics program can provide directional guidelines and a basis for advancement in process efficiency and flexibility. Gary Smith, Intelligent Enterprise INTRODUCTION A common saying in business
More informationWho Wants To Literally Save Thousands In AdWords Management Fees?
How to Keep Your PPC Management Company Honest Who Wants To Literally Save Thousands In AdWords Management Fees? HERE S THE PROBLEM Not all PPC managers are created equal. Some are really good at what
More informationBeyond the Customer Satisfaction Horizon Fostering Loyalty through Customer Service
Beyond the Customer Satisfaction Horizon Fostering Loyalty through Customer Service By Nancy Jamison Jamison Consulting January 2010 Jamison Consulting Page 1 1. Beyond Customer Satisfaction The contact
More informationDoes Your Sales Training Measure Up? By Randy Illig Franklin Covey Sales Performance Practice
Does Your Sales Training Measure Up? By Randy Illig Franklin Covey Sales Performance Practice Measuring ROI in your sales improvement initiatives can mean the difference between success and failure of
More informationPersuasive. How to Write Persuasive. Social Media Proposals
Persuasive Social Media Proposals How to Write Persuasive Social Media Proposals How to Write Persuasive Social Media Proposals! You got started in social media because you wanted to connect with people
More informationGood Call. A Guide to Driving Calls with AdWords
Good Call A Guide to Driving Calls with AdWords Introduction Some people want to talk to a real person when they re looking for information. In fact, 70% of mobile searchers have called a business directly
More informationChapter 10. Becoming an Agile Enterprise
Chapter 10. Becoming an Agile Enterprise Continuous improvement is not about the things you do well that's work. Continuous improvement is about removing the things that get in the way of your work. The
More informationTesting Metrics. Introduction
Introduction Why Measure? What to Measure? It is often said that if something cannot be measured, it cannot be managed or improved. There is immense value in measurement, but you should always make sure
More informationResponsive Design How to get started
Best Practices Guide Responsive Design How to get started oho.com 617 499 4900 @ohointeractive Website traffic from mobile devices has grown significantly year over year prompting marketers to include
More informationLoad Testing and Monitoring Web Applications in a Windows Environment
OpenDemand Systems, Inc. Load Testing and Monitoring Web Applications in a Windows Environment Introduction An often overlooked step in the development and deployment of Web applications on the Windows
More informationSTATIC CODE ANALYSIS IN AN AGILE WORLD. Establishing a repeatable process to achieve working software with each iteration
STATIC CODE ANALYSIS IN AN AGILE WORLD Establishing a repeatable process to achieve working software with each iteration To keep pace with ever-increasing customer demands on software functionality and
More informationEffective Software Verification for Medical Devices
STERLINGTECH AND KLOCWORK WHITE PAPER NOVEMBER 2009 Effective Software Verification for Medical Devices Achieving compliance and meeting productivity goals with static analysis In addition to producing
More informationSERVICE-ORIENTED IT ORGANIZATION
NEW SKILLS FOR THE SERVICE-ORIENTED IT ORGANIZATION Being the IT leader of an enterprise can feel very much like standing on a burning oil platform. The IT department is going through major transformation
More informationGUIDE TO THE. 12 Must-Have KPIs for Sales Enablement
GUIDE TO THE 12 Must-Have KPIs for Sales Enablement Introduction Key Performance Indicators (KPIs) are a set of metrics that measure a business s progress towards achieving their organizational goals.
More informationHow Effectively Are Companies Using Business Analytics? DecisionPath Consulting Research October 2010
How Effectively Are Companies Using Business Analytics? DecisionPath Consulting Research October 2010 Thought-Leading Consultants in: Business Analytics Business Performance Management Business Intelligence
More informationTesting, What is it Good For? Absolutely Everything!
Testing, What is it Good For? Absolutely Everything! An overview of software testing and why it s an essential step in building a good product Beth Schechner Elementool The content of this ebook is provided
More informationBjörn Bäckström, Lars Olsén and Simon Renström Copyright 2011 ClaroBet AB. Updated: May. 12, 11 You may not distribute or copy any of the text or use
Björn Bäckström, Lars Olsén and Simon Renström Copyright 2011 ClaroBet AB. Updated: May. 12, 11 You may not distribute or copy any of the text or use it in any other way except for personal use, without
More informationFIX YOUR FOLLOW-UP PROCESS
FIX YOUR FOLLOW-UP PROCESS CAPTURING THE LOST OPPORTUNITIES IN YOUR SALES FUNNEL Automated Advisor - Fix Your Follow Up Process BRANDON STUERKE 1 Fix Your Follow Up Process The Cold, Hard Facts Here is
More informationManual Tester s Guide to Automated Testing Contents
Manual Tester s Guide to Automated Testing Contents Introduction...3 Knowing the Differences...3 Common Misconceptions About Automated Testing...4 How to Transition to a Blended Manual/Automated Approach...7
More information6 A/B Tests You Should Be Running In Your App
6 A/B Tests You Should Be Running In Your App Introduction Everyone in mobile believes in A/B testing. But if you re wasting your days testing nothing more than various colors or screen layouts: you re
More information2015 State of B2B Mobile Growth Metrics
{ O P E N V I E W V E N T U R E P A R T N E R S } 2015 State of B2B Mobile Growth Metrics by Arsham Memarzadeh, Research Analyst Tien Anh Nguyen, Director of Market Insights Introduction During the initial
More informationIT Operations Management: A Service Delivery Primer
IT Operations Management: A Service Delivery Primer Agile Service Delivery Creates Business Value Today, IT has to innovate at an ever- increasing pace to meet accelerating business demands. Rapid service
More informationTHE TOP10WAYS SOMESEO COMPANIES RIPYOUOF
SOMESEO COMPANIES RIPYOUOF THE TOP10WAYS PUBLISHEDBYIGNITEVIRALMEDIACOPYRIGHT2015 1. They don t do a full panda audit Most SEO firms start by simply building links to your website. The problem with that
More informationQuality Meets the CEO
Quality Meets the CEO Jeffery E. Payne jepayn@rstcorp.com Reliable Software Technologies Corporate management does not care about quality. This is the cold, hard reality of the software world. Management
More informationSpecial Reports. Finding Actionable Insights through AdWords Reporting
Special Reports Finding Actionable Insights through AdWords Reporting Introduction We re closer than we ve ever been to understanding which aspects of our marketing work. Impressions, clicks, conversions
More informationQuick Preview PROPERTY DAMAGE
Quick Preview PROPERTY DAMAGE You are you first priority, take care of you first Understand rental insurance, towing and storage costs Figure out what kind of insurance coverage you have Choose a reputable
More informationSaaS or On-Premise? How to Select the Right Paths for Your Enterprise. David Linthicum
SaaS or On-Premise? How to Select the Right Paths for Your Enterprise David Linthicum SaaS or On-Premise? How to Select the Right Paths for Your Enterprise 2 Executive Summary The growth of Software- as-
More informationHow To Test For Elulla
EQUELLA Whitepaper Performance Testing Carl Hoffmann Senior Technical Consultant Contents 1 EQUELLA Performance Testing 3 1.1 Introduction 3 1.2 Overview of performance testing 3 2 Why do performance testing?
More informationTable of contents. Automated testing ROI: fact or fiction? A customer s perspective: What real QA organizations have found.
Automated testing ROI: fact or fiction? A customer s perspective: What real QA organizations have found. White paper Table of contents About the author... 2 Automated software testing expense or investment?...
More informationThe Complete Guide to DEVELOPING CUSTOM SOFTWARE FOR ANY BUSINESS CHALLENGE
The Complete Guide to DEVELOPING CUSTOM SOFTWARE FOR ANY BUSINESS CHALLENGE Developing Custom Software for Any Business Challenge: The Complete Guide Copyright 2015 Published by Art & Logic All rights
More informationWhite Paper. Making the case for PPM
Introduction There are many reasons why organizations decide to implement project portfolio management solutions, but typically it is to help senior management confidently and consistently answer questions
More informationCut. software development. Improve defect removal efficiency while simultaneously lowering costs and shortening schedules.
Cut software development Improve defect removal efficiency while simultaneously lowering costs and shortening schedules. Introduction In his paper entitled Software Defect Origins and Removal Methods,
More information1. The RSA algorithm In this chapter, we ll learn how the RSA algorithm works.
MATH 13150: Freshman Seminar Unit 18 1. The RSA algorithm In this chapter, we ll learn how the RSA algorithm works. 1.1. Bob and Alice. Suppose that Alice wants to send a message to Bob over the internet
More informationAccelerate Testing Cycles With Collaborative Performance Testing
Accelerate Testing Cycles With Collaborative Performance Testing Sachin Dhamdhere 2005 Empirix, Inc. Agenda Introduction Tools Don t Collaborate Typical vs. Collaborative Test Execution Some Collaborative
More informationTop tips for online campaign optimisation
Contents 1. The best laid plans... 3 2. Playing to the right audience... 3 3. Quality not quantity... 4 4. You only get out what you put in.. 4 5. Less is more... 5 6. Did you get my message?... 6 7. If
More informationA better way to calculate equipment ROI
page 1 A better way to calculate equipment ROI a West Monroe Partners white paper by Aaron Lininger Copyright 2012 by CSCMP s Supply Chain Quarterly (www.supplychainquarterly.com), a division of Supply
More informationProgressive companies see RPM as a potential competitive differentiator in a business climate where organic growth is often a rare commodity.
executive summary The concept of Revenue Performance Management (RPM) was introduced less than two years ago, but it has already generated a The interest generated by the new category is understandable
More information12 Proven Principles for Process Improvement & Organizational Success
12 Proven Principles for Process Improvement & Organizational Success EU SEPG Conference June 2008 Dr. Richard Bechtold : Slide #: 2 12 Proven Principles for Process Improvement and Organizational Success
More informationRSA VIA LIFECYCLE AND GOVERNENCE: ROLE MANAGEMENT BEST PRACTICES
RSA VIA LIFECYCLE AND GOVERNENCE: ROLE MANAGEMENT BEST PRACTICES A practitioner s perspective on best practices for Role Management ABSTRACT This white paper provides an overview of the Role Management
More informationRecalled Medical Billing - A Productive Outbound Call
Recalls, Revisited Brett Gerlach, MBA, Trent Muhlestein Most eye clinics rely on recalls to ensure patients return for needed care. They assume recalls are a reliable means of bringing patients back to
More informationThe 5 Biggest Mistakes Migraineurs Make
The 5 Biggest Mistakes Migraineurs Make.. migrainepal.com MigrainePal was founded in 2013 by Carl Cincinnato. Carl previously worked at several Fortune 500 companies whilst battling chronic migraines.
More informationAn Oracle Strategy Brief April 2011. Building the Case for Business Intelligence in the Insurance Industry
An Oracle Strategy Brief April 2011 Building the Case for Business Intelligence in the Insurance Industry Executive Overview... 1 Before and After Business Intelligence... 2 Challenges of Measuring ROI
More informationTest Automation: A Project Management Perspective
Test Automation: A Project Management Perspective Abstract Amith Pulla amith.pulla@intel.com For most QA leads or managers, it s always difficult to get the project manager (PM) to invest in test automation.
More informationAn Introduction to. Metrics. used during. Software Development
An Introduction to Metrics used during Software Development Life Cycle www.softwaretestinggenius.com Page 1 of 10 Define the Metric Objectives You can t control what you can t measure. This is a quote
More informationWHITE PAPER. The Five Fundamentals of a Successful FCR Program
The Five Fundamentals of a Successful FCR Program April 2012 Executive Summary Industry analysts agree that First Contact Resolution (FCR) is the best way to measure the effectiveness of your contact center.
More informationBest Practices for Migrating from Lotus Notes to Microsoft Exchange and SharePoint
Best Practices for Migrating from Lotus Notes to Microsoft Exchange and SharePoint A White Paper Written by Technology Strategy Research, LLC and Sponsored by Quest Software - Best Practices for Migrating
More informationGLOBAL TELECOM EXPENSE MANAGEMENT (TEM) The Essential Guide to Planning and Implementing Your Global TEM Initiative. www.profitline.
GLOBAL TELECOM EXPENSE MANAGEMENT (TEM) The Essential Guide to Planning and Implementing Your Global TEM Initiative www.profitline.com "Would you tell me which way I ought to go from here?" asked Alice.
More informationHOW TO. to Executives. You know that marketing automation is the greatest thing since sliced bread. After all, what else can help you...
HOW TO Sell Marketing to Executives Automation You know that marketing automation is the greatest thing since sliced bread. After all, what else can help you... 1 making inroads with the corner office
More informationConverting to Fee-Based A BETTER BUSINESS MODEL FOR TODAY S MARKET AND FOR YOUR FUTURE
Converting to Fee-Based A BETTER BUSINESS MODEL FOR TODAY S MARKET AND FOR YOUR FUTURE CONVERTING TO FEE-BASED 2 Chances are, you ve thought about switching to a fee-based practice before. Maybe you have
More informationAutomated Equipment Data Analytics to Detect Issues, Trends, Faults & Anomalies
AABC Commissioning Group AIA Provider Number 50111116 Automated Equipment Data Analytics to Detect Issues, Trends, Faults & Anomalies Course Number: CXENERGY1633 Paul Bergquist SkyFoundry April 12, 2016
More information7 Ways To Explode Your Profits as a Tint Professional and Change your Life Forever!
WINDOW FILM CUTTING SYSTEM 7 Ways To Explode Your Profits as a Tint Professional and Change your Life Forever! 2012 Tint Tek The automobile window tinting industry is a highly profitable trade and, for
More informationAPPLICATION LIFECYCLE MANAGEMENT AS A BUSINESS PROCESS
APPLICATION LIFECYCLE MANAGEMENT AS A BUSINESS PROCESS DAVID CHAPPELL SPONSORED BY MICROSOFT CORPORATION COPYRIGHT 2010 CHAPPELL & ASSOCIATES Not too long ago, the bond rating agency Moody s disclosed
More information3 Signs That You Need a PPC Agency. Is it time to outsource your PPC management? A WordStream Guide
3 Signs That You Need a PPC Agency Is it time to outsource your PPC management? A WordStream Guide 3 Signs That You Need a PPC Agency Is it time to outsource your PPC management? WordStream Customer Success
More informationBEST PRACTICE GUIDE TO SMALL BUSINESS PROTECTION: BACKUP YOUR SMALL BUSINESS INFORMATION
BEST PRACTICE GUIDE TO SMALL BUSINESS PROTECTION: BACKUP YOUR SMALL BUSINESS INFORMATION ENTER YOUR BUSINESS depends on electronic customer lists, confidential information and business records. Protecting
More informationImproving Management Review Meetings Frequently Asked Questions (FAQs)
Improving Management Review Meetings Frequently Asked Questions (FAQs) Questions from Conducting and Improving Management Review Meetings Webinar Answers provided by Carmine Liuzzi, VP SAI Global Training
More informationAdopting Agile Testing
Adopting Agile Testing A Borland Agile Testing White Paper August 2012 Executive Summary More and more companies are adopting Agile methods as a flexible way to introduce new software products. An important
More informationCoverity White Paper. Effective Management of Static Analysis Vulnerabilities and Defects
Effective Management of Static Analysis Vulnerabilities and Defects Introduction According to a recent industry study, companies are increasingly expanding their development testing efforts to lower their
More information<Insert Picture Here> When to Automate Your Testing (and When Not To)
When to Automate Your Testing (and When Not To) Joe Fernandes (Oracle) Alex Di Fonzo (Synchronoss Technologies) Three Myths of Automated Testing 1. Automated testing always results
More informationTHE DO S AND DON TS OF WEB CHAT. with Johan Jacobs
THE DO S AND DON TS OF WEB CHAT with Johan Jacobs TABLE OF CONTENTS Introduction. 3 Best Practice #1: Commit or Skip..4 Best Practice #2: Run Multiple Sessions from Day One 6 Best Practice #3: Never Make
More informationMoney Math for Teens. Dividend-Paying Stocks
Money Math for Teens Dividend-Paying Stocks This Money Math for Teens lesson is part of a series created by Generation Money, a multimedia financial literacy initiative of the FINRA Investor Education
More information10 Best Practices for Application Performance Testing
Business white paper 10 Best Practices for Application Performance Testing Leveraging Agile Performance Testing for Web and Mobile Applications 10 Best Practices for Application Performance Testing Table
More information8 Email Strategies for 2008
TM 8 Strategies for 2008 www.subscribermail.com This report is provided to you courtesy of SubscriberMail, an award-winning provider of email marketing services and technology that enable organizations
More information1. Introduction...3 2. Email Deliverability-Benchmarks...4 2.1. Working with Your Service Provider...4 2.2. Email sent...4 2.3. Email delivered...
1. Introduction...3 2. Email Deliverability-Benchmarks...4 2.1. Working with Your Service Provider...4 2.2. Email sent...4 2.3. Email delivered...4 2.4. Bounces....4 2.5. Email unsubscribe requests....5
More informationDevOps Practical steps towards greater business agility AND stable IT operations.
DevOps Practical steps towards greater business agility AND stable IT operations. White Paper BUSINESS AGILITY VS OPERATIONAL STABILITY In today s world, organisations, and the software teams that deliver
More informationEnterprise Social Networking: Finding Value in Serendipity
Enterprise Social Networking: Finding Value in Serendipity by Daniel W. Rasmus If the only economics you have to work with come from the industrial age, then everything looks like a factory. Most organizations
More informationThe Change Management Handbook
1 ebook The Change Management Handbook Getting Your Organization to Adapt to a New Technology By Christopher Smith, WalkMe 2 Table of Contents Introduction The Challenges of Software Changes in the Fast-Moving
More information