Performance Testing: Scott Barber

Transcription

1 Performance Testing: Throughout the Application Life-Cycle Created for: Throughout the Life-Cycle By: Scott Barber Chief Technologist PerfTestPlus, Inc PerfTestPlus, Inc. All rights reserved.

2 Performance Testing: Throughout the Application Life-Cycle Author: Scott Barber Chief Technologist, PerfTestPlus, Inc. Co-Founder: Workshop On Performance and Reliability Co-Author: Contributing Author: Books: Throughout the Life-Cycle About me: about.me/scott.barber 2012 PerfTestPlus, Inc. All rights reserved.

3 This keynote is a sub-set of 7 days of instruction (about the same as a 1 semester university course) I do not believe in Best Practices (I believe in problem solving via experience, experiment & education) Everything in this keynote is based on personal experience in *some* context (but not yours) Adapt concepts to your situation/context Do network with others who are here (I bet they have great ideas too) Follow up with me (what works for you or doesn t) I *like* questions! Notes Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

4 Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

5 What is Performance? System or application characteristics related to: Speed: - responsiveness - user experience Scalability: - capacity - load - volume Stability - consistency - reliability - stress Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

6 What is Performance Testing? What mom tells people: I help people make websites go fast. What I tell people: I help and/or teach individuals and organizations to optimize software systems by balancing: Cost Time to market Capacity while remaining focused on the quality of service to system users. Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

7 Performance vs. Load Testing? Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

8 Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

9 Who is Responsible?

10 Where Does it Fit?

11

12 To Prevent Poor Performance don t just react when it happens.

13 An Ounce of Prevention

14

15 The Performance Lifecycle is: Conception to Headstone Not Cradle to Grave

16

17 Do you like Swim Lanes?

18 Or maybe Circles?

19 Or Annotated Pie Charts? Current Capacity Projections Scalability Plan Reliability DevOps & Architects Architects Analysts & Scrum Single User Responsiveness Resource Management Component-Level Concurrency Prod Dev Stage Test Prepare for Prod Tune/Optimize Predict Early Warning Identification Load Team & DevOps Scrum & Load Team Multi-User Responsiveness Resource Trending Limit Identification

20 Relativistic Comparisons?

21 How about Colors?

22

23

24

25 Application Delivery Activities

26

27

28

29

30

31

32

33 With: A Test-Driven Application Performance Management Model

34

35 Proactive Micro & Macro Establish Goals Update Targets The four T s stand for Units Stories Tiers Resources Goals Dev & Prod Times Resources Sizes Frequencies Dashboard! Assess Compare Investigate Accept Answer

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50 Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

51 Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

52

53 Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

54 Load Testing Principles Project context is central to successful testing. Business, project, system, & user success criteria. Identify system usage, and key metrics; plan and design tests. Install and prepare environment, tools, & resource monitors. Script the tests as designed. Run and monitor tests. Validate tests, test data, and results. Analyze the data individually and as a cross-functional team. Consolidate and share results, customized by audience. "Lather, rinse, repeat" as necessary. Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

55

56

57

58 Unit-Level Testing Tools ( cause folks always ask) FireBenchmarks; Performance testing addin for NUnit JUnitPerf; a collection of JUnit test decorators for performance Firefox Performance Tester's Pack HTTPerf

59

60 Questions?

61 Preventing Poor Performance with a little work every day from every one.

62 Contact Info Scott Barber Chief Technologist PerfTestPlus, Inc Blog: scott-barber.blogspot.com Web Site: Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.

63 Review & Questions Did we learn anything? Throughout the Life-Cycle 2012 PerfTestPlus, Inc. All rights reserved.