Performance Engineering & Production Monitoring lifecycle

Size: px

Start display at page:

Download "Performance Engineering & Production Monitoring lifecycle"

Bridget Veronica Carroll
8 years ago
Views:

1 Performance Engineering & Production Monitoring lifecycle FiSTB Testing Assembly Juho Aarnio 1 Nokia 2012 PEM_public.pptx v J.Aarnio

2 Agenda Introduction Performance testing why? Performance testing how? Performance testing with monitoring synergy? Lifecycle thinking Expensive hype or actual smart thing to do? Are we having fun yet? 2 Nokia 2012 PEM_public.pptx v J.Aarnio

3 Nokia s mission Nokia s mission is simple: Connecting People. Our goal is to build great mobile products that enable billions of people worldwide to enjoy more of what life has to offer. Our challenge is to achieve this in an increasingly dynamic and competitive environment. 3 Nokia 2012 PEM_public.pptx v J.Aarnio

4 Nokia in numbers BILLION Nokia users ,000 Nokia phones sold every second Points of sale 4 Nokia 2012 PEM_public.pptx v J.Aarnio

5 Introduction Juho Aarnio Senior Capability Manager Performance Engineering & Monitoring Nokia ICM Infrastructure Services High Availability System Monitoring since 2001 Performance Testing since 2002 Working for Nokia from 2004 onwards. 5 Nokia 2012 PEM_public.pptx v J.Aarnio

6 Performance Engineering & Monitoring Providing for Nokia the tools, the procesess and the competences of performance engineering as a centralized service 6 Nokia 2012 PEM_public.pptx v J.Aarnio

Increased end user satisfaction Less testing More testing Loss of revenue due to bad performance

7 Performance Testing why? Failure Unkown performance risks Slowness in system Uncertainty of success Improved quality Increased end user satisfaction Less testing More testing Loss of revenue due to bad performance and availability Managed risks Responsive systems Unhappy users Successful launches Minimal amount of issues reaching end users 7 Nokia 2012 PEM_public.pptx v J.Aarnio

Requires stabile target environment, proper test data and solid non-functional requirements.

8 Performance Testing how? Emulates production workloads on an IT system Controller Simulated users Internet/ WAN Web server App. server Database Mimics real user behavior and Provides easily understood, in-depth information about the system under test. Requires stabile target environment, proper test data and solid non-functional requirements. Answers questions such as How does the IT system handle current and future load? Will the system meet the continuity requirements? Do we have a serious bottleneck in the system? If so, where is it? 8 Nokia 2012 PEM_public.pptx v J.Aarnio

Performance Monitoring Business Process Monitoring (E2E monitoring) Security Monitoring Hardware Monitoring Users Internet/ WAN Web server App.

9 Performance Monitoring Business Process Monitoring (E2E monitoring) Security Monitoring Hardware Monitoring Users Internet/ WAN Web server App. server Database Storage Network Monitoring Web monitoring App. Monitoring DB monitoring Storage Monitoring Real User Monitoring Synthetic End User Monitoring 9 Nokia 2012 PEM_public.pptx v J.Aarnio

10 Performance testing with monitoring Synergy? Capacity Planning Performance Requirements Performance test use cases Performance test threshold Performance Testing Capacity usage trends Performance trends Capacity Management Production Monitoring Monitoring tresholds System behavior trends 10 Nokia 2012 PEM_public.pptx v J.Aarnio

11 Life Cycle Thinking in Nokia case Life Cycle Know how Tools Service Information flow optimization Co-operation between intrest groups Shared competences For example same specialists in testing and monitoring Unified Procesess Shared Good practises Area wide lessons learned Peer to Peer mentoring and reviewing Global tool architecture Flexible license pool Comparable results Optimized Tool Maintenance On demand competence pool Unified Vendor management Unified Vendor QA Volume based discounts Plan Design Test Fine tune Monitor Manage...and Repeat 11 Nokia 2012 PEM_public.pptx v J.Aarnio

12 "Are we having fun yet?" is the most famous quote by bizarre, non-sequitur-spouting comic strip character Zippy the Pinhead. It was coined in 1979 by cartoonist Bill Griffith as one of the typically strange comments by Zippy, and caught on with the general public. 12 Nokia 2012 PEM_public.pptx v J.Aarnio

13 Thank you! Any questions?

Why Performance Test Outside the Firewall? Exposing What You Have Missed

Why Performance Test Outside the Firewall? Exposing What You Have Missed Why Test Outside the Firewall? Exposing What You Have Missed Introduction The testing of web systems for performance is becoming a somewhat regular exercise for many enterprises. This is great progress