Continuous Performance Testing

Size: px
Start display at page:

Download "Continuous Performance Testing"

Transcription

1 Continuous Performance Testing Confoo.ca Kore Nordmann 27. Feb 2013 Continuous Performance Testing 1 / 30

2 About me Degree in computer sience Professional PHP since 2000 Open source enthusiast Passion for Software Design Automated Testing Continuous Performance Testing 2 / 30

3 About me Degree in computer sience Professional PHP since 2000 Open source enthusiast Passion for Software Design Automated Testing Continuous Performance Testing 2 / 30

4 About me Degree in computer sience Professional PHP since 2000 Open source enthusiast Passion for Software Design Automated Testing Continuous Performance Testing 2 / 30

5 About me Degree in computer sience Professional PHP since 2000 Open source enthusiast Passion for Software Design Automated Testing Continuous Performance Testing 2 / 30

6 Co-founder of Qafoo passion for software quality Helping people to create high quality web applications. Expert consulting Individual training Get a training on object oriented design for your team! Continuous Performance Testing 3 / 30

7 Co-founder of Qafoo passion for software quality Helping people to create high quality web applications. Expert consulting Individual training Get a training on object oriented design for your team! Continuous Performance Testing 3 / 30

8 Co-founder of Qafoo passion for software quality Helping people to create high quality web applications. Expert consulting Individual training Get a training on object oriented design for your team! Continuous Performance Testing 3 / 30

9 Co-founder of Qafoo passion for software quality Helping people to create high quality web applications. Expert consulting Individual training Get a training on object oriented design for your team! Continuous Performance Testing 3 / 30

10 Outline Motivation Conclusion Continuous Performance Testing 4 / 30

11 Motivation Why should we do performance tests? Locate unknown bottlenecks Mesaure behaviour of the full stack Why should we do that continuously? Find performance regressions Ensure optimizations are persistent Continuous Performance Testing 5 / 30

12 Motivation Why should we do performance tests? Locate unknown bottlenecks Mesaure behaviour of the full stack Why should we do that continuously? Find performance regressions Ensure optimizations are persistent Continuous Performance Testing 5 / 30

13 Motivation Why should we do performance tests? Locate unknown bottlenecks Mesaure behaviour of the full stack Why should we do that continuously? Find performance regressions Ensure optimizations are persistent Continuous Performance Testing 5 / 30

14 Motivation Why should we do performance tests? Locate unknown bottlenecks Mesaure behaviour of the full stack Why should we do that continuously? Find performance regressions Ensure optimizations are persistent Continuous Performance Testing 5 / 30

15 Often used tools Often misused tools siege ApacheBench (ab) Testing for micro-optimizations Evaluating Hello-World-examples of Frameworks Useful tools, I won t talk about xdebug Profiling xhprof Database profiling tools System metrics (Graphite,... ) Continuous Performance Testing 6 / 30

16 Often used tools Often misused tools siege ApacheBench (ab) Testing for micro-optimizations Evaluating Hello-World-examples of Frameworks Useful tools, I won t talk about xdebug Profiling xhprof Database profiling tools System metrics (Graphite,... ) Continuous Performance Testing 6 / 30

17 Often used tools Often misused tools siege ApacheBench (ab) Testing for micro-optimizations Evaluating Hello-World-examples of Frameworks Useful tools, I won t talk about xdebug Profiling xhprof Database profiling tools System metrics (Graphite,... ) Continuous Performance Testing 6 / 30

18 Often used tools Often misused tools siege ApacheBench (ab) Testing for micro-optimizations Evaluating Hello-World-examples of Frameworks Useful tools, I won t talk about xdebug Profiling xhprof Database profiling tools System metrics (Graphite,... ) Continuous Performance Testing 6 / 30

19 Often used tools Often misused tools siege ApacheBench (ab) Testing for micro-optimizations Evaluating Hello-World-examples of Frameworks Useful tools, I won t talk about xdebug Profiling xhprof Database profiling tools System metrics (Graphite,... ) Continuous Performance Testing 6 / 30

20 The problem is more complex Your task: Create a new webshop Assume it s march The deadline is October this year, right before Christmas Continuous Performance Testing 7 / 30

21 The problem is more complex Your task: Create a new webshop Assume it s march The deadline is October this year, right before Christmas Continuous Performance Testing 7 / 30

22 The problem is more complex Your task: Create a new webshop Assume it s march The deadline is October this year, right before Christmas Continuous Performance Testing 7 / 30

23 A webshop Awesome Shop 0 articles 0.00 Smartphone Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. 1337,-- 5 items in stock Comments Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor. Continuous Performance Testing 8 / 30

24 A webshop 2 articles Continuous Performance Testing 8 / 30

25 A webshop Smartphone Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. 1337,-- 5 items in stock Continuous Performance Testing 8 / 30

26 A webshop Comments Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor. Continuous Performance Testing 8 / 30

27 A webshop 1337,-- 5 items in stock Continuous Performance Testing 8 / 30

28 A real tool for performance tests JMeter Complex user paths Concurrend requests Record on proxy Clustering Continuous Performance Testing 9 / 30

29 A real tool for performance tests JMeter Complex user paths Concurrend requests Record on proxy Clustering Continuous Performance Testing 9 / 30

30 A real tool for performance tests JMeter Complex user paths Concurrend requests Record on proxy Clustering Continuous Performance Testing 9 / 30

31 A real tool for performance tests JMeter Complex user paths Concurrend requests Record on proxy Clustering Continuous Performance Testing 9 / 30

32 A real tool for performance tests JMeter Complex user paths Concurrend requests Record on proxy Clustering Continuous Performance Testing 9 / 30

33 JMeter 101 Thread Group An execution plan (like a user registration) Controller Controls how samplers are executed (loop, random,... ) Config Element Timer Sampler Configration, optionally from external sources Defining timing constraints for sampler execution Perform the actual work (like HTTP requests) Continuous Performance Testing 10 / 30

34 JMeter 101 Thread Group An execution plan (like a user registration) Controller Controls how samplers are executed (loop, random,... ) Config Element Timer Sampler Configration, optionally from external sources Defining timing constraints for sampler execution Perform the actual work (like HTTP requests) Continuous Performance Testing 10 / 30

35 JMeter 101 Thread Group An execution plan (like a user registration) Controller Controls how samplers are executed (loop, random,... ) Config Element Timer Sampler Configration, optionally from external sources Defining timing constraints for sampler execution Perform the actual work (like HTTP requests) Continuous Performance Testing 10 / 30

36 JMeter 101 Thread Group An execution plan (like a user registration) Controller Controls how samplers are executed (loop, random,... ) Config Element Timer Sampler Configration, optionally from external sources Defining timing constraints for sampler execution Perform the actual work (like HTTP requests) Continuous Performance Testing 10 / 30

37 JMeter 101 Thread Group An execution plan (like a user registration) Controller Controls how samplers are executed (loop, random,... ) Config Element Timer Sampler Configration, optionally from external sources Defining timing constraints for sampler execution Perform the actual work (like HTTP requests) Continuous Performance Testing 10 / 30

38 Getting started Create a test plan Example: What do users actually do on your site? Random browser User registration Sign on Shopping with checkout Commenting products Continuous Performance Testing 11 / 30

39 Getting started Create a test plan Example: What do users actually do on your site? Random browser User registration Sign on Shopping with checkout Commenting products Continuous Performance Testing 11 / 30

40 Using JMeter Demo Continuous Performance Testing 12 / 30

41 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

42 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

43 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

44 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

45 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

46 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

47 Automation Ant JMeter integration Automation of your environment Setting up different software versions Testing with different extensions Running different database setups Handling multi-node environments Plain Ant or Puppet, Chef, Vagrant Continuous Performance Testing 13 / 30

48 Apache Ant example 26 < target name= build apc bytecode cache user cache f i l e 27 depends= setup apc bytecode f i l e cache, build 28 description= > Run with APC opcode cache and f i l e based cache. /> < target name= build apc bytecode cache user cache apc 31 depends= setup apc bytecode apc cache, b u i l d 32 description= > Run with APC opcode cache and APC based cache. /> 211 < target name= remote exec p a r a l l e l > 212 <subant t a r g e t = $ { t a r g e t } i n h e r i t a l l = t r u e > 213 < f i l e s e t d i r = $ { p r o j e c t. d i r } i n c ludes= server. xml /> 214 </ subant> 215 </ target > < target name= remote exec > 218 <sshexec command= $ {command} 219 username= $ { ssh. username } 220 password= $ { ssh. password } 221 host= $ { hostname } 222 trust = true /> 223 </ target > Continuous Performance Testing 14 / 30

49 Apache Ant example 26 < target name= build apc bytecode cache user cache f i l e 27 depends= setup apc bytecode f i l e cache, build 28 description= > Run with APC opcode cache and f i l e based cache. /> < target name= build apc bytecode cache user cache apc 31 depends= setup apc bytecode apc cache, b u i l d 32 description= > Run with APC opcode cache and APC based cache. /> 211 < target name= remote exec p a r a l l e l > 212 <subant t a r g e t = $ { t a r g e t } i n h e r i t a l l = t r u e > 213 < f i l e s e t d i r = $ { p r o j e c t. d i r } i n c ludes= server. xml /> 214 </ subant> 215 </ target > < target name= remote exec > 218 <sshexec command= $ {command} 219 username= $ { ssh. username } 220 password= $ { ssh. password } 221 host= $ { hostname } 222 trust = true /> 223 </ target > Continuous Performance Testing 14 / 30

50 Apache Ant example 26 < target name= build apc bytecode cache user cache f i l e 27 depends= setup apc bytecode f i l e cache, build 28 description= > Run with APC opcode cache and f i l e based cache. /> < target name= build apc bytecode cache user cache apc 31 depends= setup apc bytecode apc cache, b u i l d 32 description= > Run with APC opcode cache and APC based cache. /> 211 < target name= remote exec p a r a l l e l > 212 <subant t a r g e t = $ { t a r g e t } i n h e r i t a l l = t r u e > 213 < f i l e s e t d i r = $ { p r o j e c t. d i r } i n c ludes= server. xml /> 214 </ subant> 215 </ target > < target name= remote exec > 218 <sshexec command= $ {command} 219 username= $ { ssh. username } 220 password= $ { ssh. password } 221 host= $ { hostname } 222 trust = true /> 223 </ target > Continuous Performance Testing 14 / 30

51 Apache Ant example 26 < target name= build apc bytecode cache user cache f i l e 27 depends= setup apc bytecode f i l e cache, build 28 description= > Run with APC opcode cache and f i l e based cache. /> < target name= build apc bytecode cache user cache apc 31 depends= setup apc bytecode apc cache, b u i l d 32 description= > Run with APC opcode cache and APC based cache. /> 211 < target name= remote exec p a r a l l e l > 212 <subant t a r g e t = $ { t a r g e t } i n h e r i t a l l = t r u e > 213 < f i l e s e t d i r = $ { p r o j e c t. d i r } i n c ludes= server. xml /> 214 </ subant> 215 </ target > < target name= remote exec > 218 <sshexec command= $ {command} 219 username= $ { ssh. username } 220 password= $ { ssh. password } 221 host= $ { hostname } 222 trust = true /> 223 </ target > Continuous Performance Testing 14 / 30

52 Apache Ant example 26 < target name= build apc bytecode cache user cache f i l e 27 depends= setup apc bytecode f i l e cache, build 28 description= > Run with APC opcode cache and f i l e based cache. /> < target name= build apc bytecode cache user cache apc 31 depends= setup apc bytecode apc cache, b u i l d 32 description= > Run with APC opcode cache and APC based cache. /> 211 < target name= remote exec p a r a l l e l > 212 <subant t a r g e t = $ { t a r g e t } i n h e r i t a l l = t r u e > 213 < f i l e s e t d i r = $ { p r o j e c t. d i r } i n c ludes= server. xml /> 214 </ subant> 215 </ target > < target name= remote exec > 218 <sshexec command= $ {command} 219 username= $ { ssh. username } 220 password= $ { ssh. password } 221 host= $ { hostname } 222 trust = true /> 223 </ target > Continuous Performance Testing 14 / 30

53 Apache Ant example 454 < target name= restart host > 455 < antcall target= remote exec > 456 <param name= command value= shutdown r now /> 457 </ a n t c a l l > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } to stop... /> 460 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 461 <not> 462 <http url = http : / / $ { hostname } /> 463 </ not> 464 </ w a i t f o r > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } i s up again... /> 467 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 468 <http url = http : / / $ { hostname } /> 469 </ w a i t f o r > 470 </ target > Continuous Performance Testing 15 / 30

54 Apache Ant example 454 < target name= restart host > 455 < antcall target= remote exec > 456 <param name= command value= shutdown r now /> 457 </ a n t c a l l > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } to stop... /> 460 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 461 <not> 462 <http url = http : / / $ { hostname } /> 463 </ not> 464 </ w a i t f o r > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } i s up again... /> 467 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 468 <http url = http : / / $ { hostname } /> 469 </ w a i t f o r > 470 </ target > Continuous Performance Testing 15 / 30

55 Apache Ant example 454 < target name= restart host > 455 < antcall target= remote exec > 456 <param name= command value= shutdown r now /> 457 </ a n t c a l l > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } to stop... /> 460 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 461 <not> 462 <http url = http : / / $ { hostname } /> 463 </ not> 464 </ w a i t f o r > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } i s up again... /> 467 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 468 <http url = http : / / $ { hostname } /> 469 </ w a i t f o r > 470 </ target > Continuous Performance Testing 15 / 30

56 Apache Ant example 454 < target name= restart host > 455 < antcall target= remote exec > 456 <param name= command value= shutdown r now /> 457 </ a n t c a l l > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } to stop... /> 460 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 461 <not> 462 <http url = http : / / $ { hostname } /> 463 </ not> 464 </ w a i t f o r > <echo taskname= w a i t f o r message= Wait f o r $ { hostname } i s up again... /> 467 < waitfor maxwait= 5 maxwaitunit= minute checkevery= 100 > 468 <http url = http : / / $ { hostname } /> 469 </ w a i t f o r > 470 </ target > Continuous Performance Testing 15 / 30

57 Apache Ant example 421 < target name= jmeter depends= settings i n i t, start jmeter /> < t a r g e t name= s t a r t jmeter > 424 < antcall target= start jmeter before hook /> <jmeter jmeterhome= $ { l o c a l. jmeter.home. d i r } 427 r e s u l t l o g = $ { l o c a l. jmeter. log. f i l e } 428 t e s t p l a n = $ { l o c a l. jmeter. t e s t. d i r } / $ { jmeter. f i l e } > <p r op e r ty name= jmeter. data. d i r value= $ { l o c a l. p r o j e c t. data. d i r } /> 431 <property name= jmeter. rampup. time value= $ { jmeter. rampup. time } /> 432 <property name= jmeter. execution. time value= $ { jmeter. execution. time } /> 433 </ jmeter > < antcall target= start jmeter after hook /> 436 </ target > Continuous Performance Testing 16 / 30

58 Apache Ant example 421 < target name= jmeter depends= settings i n i t, start jmeter /> < t a r g e t name= s t a r t jmeter > 424 < antcall target= start jmeter before hook /> <jmeter jmeterhome= $ { l o c a l. jmeter.home. d i r } 427 r e s u l t l o g = $ { l o c a l. jmeter. log. f i l e } 428 t e s t p l a n = $ { l o c a l. jmeter. t e s t. d i r } / $ { jmeter. f i l e } > <p r op e r ty name= jmeter. data. d i r value= $ { l o c a l. p r o j e c t. data. d i r } /> 431 <property name= jmeter. rampup. time value= $ { jmeter. rampup. time } /> 432 <property name= jmeter. execution. time value= $ { jmeter. execution. time } /> 433 </ jmeter > < antcall target= start jmeter after hook /> 436 </ target > Continuous Performance Testing 16 / 30

59 Apache Ant example 421 < target name= jmeter depends= settings i n i t, start jmeter /> < t a r g e t name= s t a r t jmeter > 424 < antcall target= start jmeter before hook /> <jmeter jmeterhome= $ { l o c a l. jmeter.home. d i r } 427 r e s u l t l o g = $ { l o c a l. jmeter. log. f i l e } 428 t e s t p l a n = $ { l o c a l. jmeter. t e s t. d i r } / $ { jmeter. f i l e } > <p r op e r ty name= jmeter. data. d i r value= $ { l o c a l. p r o j e c t. data. d i r } /> 431 <property name= jmeter. rampup. time value= $ { jmeter. rampup. time } /> 432 <property name= jmeter. execution. time value= $ { jmeter. execution. time } /> 433 </ jmeter > < antcall target= start jmeter after hook /> 436 </ target > Continuous Performance Testing 16 / 30

60 Apache Ant example 351 < target name= backup data from host > 352 <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. e r r o r. log } 353 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} e r r o r. log 354 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. access. log } 357 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} access. log 358 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. php. e r r o r. log } 361 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} php errors. log 362 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. basedir } / s c r i p t s / load. log 365 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} load. log 366 trust = true /> </ target > Continuous Performance Testing 17 / 30

61 Apache Ant example 351 < target name= backup data from host > 352 <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. e r r o r. log } 353 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} e r r o r. log 354 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. access. log } 357 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} access. log 358 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. php. e r r o r. log } 361 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} php errors. log 362 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. basedir } / s c r i p t s / load. log 365 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} load. log 366 trust = true /> </ target > Continuous Performance Testing 17 / 30

62 Apache Ant example 351 < target name= backup data from host > 352 <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. e r r o r. log } 353 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} e r r o r. log 354 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. access. log } 357 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} access. log 358 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. php. e r r o r. log } 361 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} php errors. log 362 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. basedir } / s c r i p t s / load. log 365 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} load. log 366 trust = true /> </ target > Continuous Performance Testing 17 / 30

63 Apache Ant example 351 < target name= backup data from host > 352 <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. e r r o r. log } 353 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} e r r o r. log 354 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. access. log } 357 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} access. log 358 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. php. e r r o r. log } 361 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} php errors. log 362 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. basedir } / s c r i p t s / load. log 365 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} load. log 366 trust = true /> </ target > Continuous Performance Testing 17 / 30

64 Apache Ant example 351 < target name= backup data from host > 352 <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. e r r o r. log } 353 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} e r r o r. log 354 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. webserver. access. log } 357 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} access. log 358 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. php. e r r o r. log } 361 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} php errors. log 362 trust = true /> <scp r e m o t e f i l e = $ { ssh. username } : $ { ssh. password }@${ hostname } : $ { remote. basedir } / s c r i p t s / load. log 365 l o c a l t o f i l e = $ { l o c a l. b u i l d d i r } / $ { hostname} load. log 366 trust = true /> </ target > Continuous Performance Testing 17 / 30

65 Test Setup What do we actually test? Continuous Performance Testing 18 / 30

66 Test Setup jmeter Continuous Performance Testing 19 / 30

67 Test Setup iftstat, iftop jmeter Continuous Performance Testing 19 / 30

68 Test Setup iftstat, iftop jmeter Load Balancer Verify Sessions vmstat, top FrontEnd FrontEnd FrontEnd Continuous Performance Testing 19 / 30

69 Test Setup iftstat, iftop jmeter Load Balancer Verify Sessions vmstat, top FrontEnd FrontEnd FrontEnd vmstat, top Slave Master Continuous Performance Testing 19 / 30

70 Test Setup iftstat, iftop jmeter Load Balancer Verify Sessions vmstat, top FrontEnd FrontEnd FrontEnd vmstat, top Slave Master Services Continuous Performance Testing 19 / 30

71 Test Setup iftstat, iftop jmeter Response Times Load Balancer Verify Sessions vmstat, top FrontEnd FrontEnd FrontEnd Profiling, xhprof, Response Times vmstat, top Slave Master Slow Query Log, Services Continuous Performance Testing 19 / 30

72 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

73 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

74 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

75 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

76 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

77 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

78 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

79 Hardware Test in a realistic environment If your software runs in the cloud test against virtual environment If you use real hardware, also test against real hardware JMeter might have serious hardware requirements Use real hardware Use the biggest VM available Ensure that not the JMeter hardware is the bottleneck Be sure that the network is not the bottleneck See ifstat, iftop Measure several system metrics See vmstat, top Continuous Performance Testing 20 / 30

80 Extended Statistics Demo Continuous Performance Testing 21 / 30

81 Continuous Performance Plugins available for: Jenkins Sonar Maintaining all those servers can be expensive Continuous Performance Testing 22 / 30

82 Continuous Performance Plugins available for: Jenkins Sonar Maintaining all those servers can be expensive Continuous Performance Testing 22 / 30

83 Continuous testing with Jenkins Continuous Performance Testing 23 / 30

84 Questions Common questions: Can we survive christmas? What is the maximum we can accomplish with the current setup? Does (APC XCache MemCache) really help us? Continuous Performance Testing 24 / 30

85 Questions Common questions: Can we survive christmas? What is the maximum we can accomplish with the current setup? Does (APC XCache MemCache) really help us? Continuous Performance Testing 24 / 30

86 Questions Common questions: Can we survive christmas? What is the maximum we can accomplish with the current setup? Does (APC XCache MemCache) really help us? Continuous Performance Testing 24 / 30

87 Getting realistic settings Ask for real access logs: Extract exact request model from those Your customer usually only knows very broad values, like: PIs per month sold articles per month registrations per month Very seldom, that you get more: Ask for access statistics before Christmas and the ratio compared with regular months Ask for hours with the highest conversion rates Maybe get the aggregated access logs from existing similar shops Continuous Performance Testing 25 / 30

88 Getting realistic settings Ask for real access logs: Extract exact request model from those Your customer usually only knows very broad values, like: PIs per month sold articles per month registrations per month Very seldom, that you get more: Ask for access statistics before Christmas and the ratio compared with regular months Ask for hours with the highest conversion rates Maybe get the aggregated access logs from existing similar shops Continuous Performance Testing 25 / 30

89 Getting realistic settings Ask for real access logs: Extract exact request model from those Your customer usually only knows very broad values, like: PIs per month sold articles per month registrations per month Very seldom, that you get more: Ask for access statistics before Christmas and the ratio compared with regular months Ask for hours with the highest conversion rates Maybe get the aggregated access logs from existing similar shops Continuous Performance Testing 25 / 30

90 Getting realistic settings Ask for real access logs: Extract exact request model from those Your customer usually only knows very broad values, like: PIs per month sold articles per month registrations per month Very seldom, that you get more: Ask for access statistics before Christmas and the ratio compared with regular months Ask for hours with the highest conversion rates Maybe get the aggregated access logs from existing similar shops Continuous Performance Testing 25 / 30

91 Getting realistic settings Ask for real access logs: Extract exact request model from those Your customer usually only knows very broad values, like: PIs per month sold articles per month registrations per month Very seldom, that you get more: Ask for access statistics before Christmas and the ratio compared with regular months Ask for hours with the highest conversion rates Maybe get the aggregated access logs from existing similar shops Continuous Performance Testing 25 / 30

92 Getting realistic settings Ask for real access logs: Extract exact request model from those Your customer usually only knows very broad values, like: PIs per month sold articles per month registrations per month Very seldom, that you get more: Ask for access statistics before Christmas and the ratio compared with regular months Ask for hours with the highest conversion rates Maybe get the aggregated access logs from existing similar shops Continuous Performance Testing 25 / 30

93 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

94 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

95 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

96 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

97 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

98 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

99 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

100 Example calculation Customer provided values, for a classic webshop: PIs per month sold articles per month registrations per month Per day: /26 = (non-business) Per hour: /12 = (national shop) Peak hour: = (18:00 to 19:00) Per second: /3600 = 7PI/s Add Christmas / Easter bonus Add launch bonus So PI/s should be safe? Spare resources for scaling are always a business decision Provide with trade-off: Costs vs. downtime / slowness Fail gracefully Continuous Performance Testing 26 / 30

101 Verification Do your requests actually model customer requirements? Compare generated accesss logs with real access logs Compare user registrations / checkouts per hour with requested values Continuous Performance Testing 27 / 30

102 Outline Motivation Conclusion Continuous Performance Testing 28 / 30

103 Conclusion Plan your test scenario Use realisitic thresholds Choose the right tool with care Continuous Performance Testing 29 / 30

104 Conclusion Plan your test scenario Use realisitic thresholds Choose the right tool with care Continuous Performance Testing 29 / 30

105 Conclusion Plan your test scenario Use realisitic thresholds Choose the right tool with care Continuous Performance Testing 29 / 30

106 Conclusion Plan your test scenario Use realisitic thresholds Choose the right tool with care Continuous Performance Testing 29 / 30

107 Thanks for Listening Rate this talk: Stay in touch Kore Rent a web quality expert: Continuous Performance Testing 30 / 30

108 Thanks for Listening Rate this talk: Stay in touch Kore Rent a web quality expert: Continuous Performance Testing 30 / 30

Behave! - Behavior Driven Development IPC 2013 SE. Tobias Schlitt (@tobysen) June 5th 2013

Behave! - Behavior Driven Development IPC 2013 SE. Tobias Schlitt (@tobysen) June 5th 2013 Behave! - Behavior Driven Development IPC 2013 SE Tobias Schlitt (@tobysen) June 5th 2013 About me Tobias Schlitt (Toby) Degree in computer sience Proessional PHP since 2000 Open source enthusiast Passion

More information

BDD DPC 2014 Tutorial

BDD DPC 2014 Tutorial Behave! - BDD DPC 2014 Tobias Schlitt (@tobysen) 2014-06-26 Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Comments 0 articles

More information

Concept. Texting Service

Concept. Texting Service Concept User Profiles Business Advertising Texting Service Users Cellphone User Coupons Texting Service Users create account name or Handle on account creation Can search and contact other users by texting

More information

Bill Pay Marketing Program Campaign Guide

Bill Pay Marketing Program Campaign Guide Bill Pay Marketing Program Campaign Guide This guide provides details on each of the creative components in this campaign, including the target audience, timing, placement, and sample images. SEASONAL

More information

Web Application Testing. Web Performance Testing

Web Application Testing. Web Performance Testing Web Application Testing Web Performance Testing Objectives of Performance Testing Evaluate runtime compliance to performance requirements Check different properties such as throughput (bits/sec, packets/sec)

More information

Drupal Performance Tuning

Drupal Performance Tuning Drupal Performance Tuning By Jeremy Zerr Website: http://www.jeremyzerr.com @jrzerr http://www.linkedin.com/in/jrzerr Overview Basics of Web App Systems Architecture General Web

More information

SOA Solutions & Middleware Testing: White Paper

SOA Solutions & Middleware Testing: White Paper SOA Solutions & Middleware Testing: White Paper Version 1.1 (December 06, 2013) Table of Contents Introduction... 03 Solutions Testing (Beta Testing)... 03 1. Solutions Testing Methods... 03 1.1 End-to-End

More information

Load Testing with JMeter

Load Testing with JMeter Load Testing with JMeter Presented by Matthew Stout - mat@ucsc.edu JMeter Overview Java application for load testing and measuring performance Originally for web applications but has grown to support lots

More information

New Relic & JMeter - Perfect Performance Testing

New Relic & JMeter - Perfect Performance Testing TUTORIAL New Relic & JMeter - Perfect Performance Testing by David Sale Contents Introduction 3 Demo Application 4 Hooking Into New Relic 4 What Is JMeter? 6 Installation and Usage 6 Analysis In New Relic

More information

Jérôme Lepage - CFCamp 2013. Mondadori France

Jérôme Lepage - CFCamp 2013. Mondadori France Jérôme Lepage - CFCamp 2013 Mondadori France French press magazine group (#3) Subsidiary of Mondadori Italia ~ 30 magazines 10,6% market in 2011 381,6 million in 2012 In Web Development since 1999 Php

More information

Diagnosing Production Java Applications Madhav Sathe

Diagnosing Production Java Applications Madhav Sathe Diagnosing Production Java Applications Madhav Sathe Oracle India Agenda Types of applications and issues Challenges Approaches to diagnostics Runtime JVM diagnostics Best practices Demo Q & A Folientitel

More information

Evolution of Web Application Architecture International PHP Conference. Kore Nordmann / @koredn / <kore@qafoo.com> June 9th, 2015

Evolution of Web Application Architecture International PHP Conference. Kore Nordmann / @koredn / <kore@qafoo.com> June 9th, 2015 Evolution of Web Application Architecture International PHP Conference Kore Nordmann / @koredn / June 9th, 2015 Evolution Problem Too many visitors Evolution Evolution Lessons Learned:

More information

Coding Serbia. Systematic Load Testing of Web Applications.

Coding Serbia. Systematic Load Testing of Web Applications. Coding Serbia. Systematic Load Testing of Web Applications. Jürg Stuker. CEO. Partner. October 9, 2015 Nutrition Facts Serving Size about 45 Minutes % Daily Value* Performance Tuning 1% Load Test Basics

More information

Architecting ColdFusion For Scalability And High Availability. Ryan Stewart Platform Evangelist

Architecting ColdFusion For Scalability And High Availability. Ryan Stewart Platform Evangelist Architecting ColdFusion For Scalability And High Availability Ryan Stewart Platform Evangelist Introduction Architecture & Clustering Options Design an architecture and develop applications that scale

More information

How to Extend your Identity Management Systems to use OAuth

How to Extend your Identity Management Systems to use OAuth How to Extend your Identity Management Systems to use OAuth THE LEADER IN API AND CLOUD GATEWAY TECHNOLOGY How to extend your Identity Management Systems to use OAuth OAuth Overview The basic model of

More information

IERG 4080 Building Scalable Internet-based Services

IERG 4080 Building Scalable Internet-based Services Department of Information Engineering, CUHK Term 1, 2015/16 IERG 4080 Building Scalable Internet-based Services Lecture 10 Load Testing Lecturer: Albert C. M. Au Yeung 18 th November, 2015 Software Performance

More information

1 How to Monitor Performance

1 How to Monitor Performance 1 How to Monitor Performance Contents 1.1. Introduction... 1 1.1.1. Purpose of this How To... 1 1.1.2. Target Audience... 1 1.2. Performance - some theory... 1 1.3. Performance - basic rules... 3 1.4.

More information

JMETER - MONITOR TEST PLAN

JMETER - MONITOR TEST PLAN http://www.tutorialspoint.com JMETER - MONITOR TEST PLAN Copyright tutorialspoint.com In this chapter, we will discuss how to create a Test Plan using JMeter to monitor webservers. The uses of monitor

More information

Ensuring scalability and performance with Drupal as your audience grows

Ensuring scalability and performance with Drupal as your audience grows Drupal performance and scalability Ensuring scalability and performance with Drupal as your audience grows Presented by Jon Anthony Bounty.com Northern and Shell (OK! Magazine etc) Drupal.org/project/

More information

Performance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering

Performance Testing. Why is important? An introduction. Why is important? Delivering Excellence in Software Engineering Delivering Excellence in Software Engineering Performance Testing An introduction. Why is important? Why is important? 2 1 https://www.youtube.com/watch?v=8y8vqjqbqdc 3 4 2 Introduction Why is important?

More information

Practicing Law with a Virtual Law Office

Practicing Law with a Virtual Law Office Practicing Law with a Virtual Law Office presented by Stephanie Kimbro, MA, JD Attorney, Kimbro Legal Services Technology Consultant, Total Attorneys Greensboro Bar March 29, 2011 Overview Part One: Introduction

More information

How to create a load testing environment for your web apps using open source tools by Sukrit Dhandhania

How to create a load testing environment for your web apps using open source tools by Sukrit Dhandhania How to create a load testing environment for your web apps using open source tools by Sukrit Dhandhania Open source load testing for web putting demand on an application and measuring its response see

More information

MAGENTO HOSTING Progressive Server Performance Improvements

MAGENTO HOSTING Progressive Server Performance Improvements MAGENTO HOSTING Progressive Server Performance Improvements Simple Helix, LLC 4092 Memorial Parkway Ste 202 Huntsville, AL 35802 sales@simplehelix.com 1.866.963.0424 www.simplehelix.com 2 Table of Contents

More information

Benchmark Performance Test Results for Magento Enterprise Edition 1.14.1

Benchmark Performance Test Results for Magento Enterprise Edition 1.14.1 Benchmark Performance Test Results for Magento Enterprise Edition 1.14.1 March 2015 Table of Contents 01 EXECUTIVE SUMMARY 03 TESTING METHODOLOGY 03 TESTING SCENARIOS & RESULTS 03 Compare different Enterprise

More information

CA APM Cloud Monitor. Scripting Guide. Release 8.2

CA APM Cloud Monitor. Scripting Guide. Release 8.2 CA APM Cloud Monitor Scripting Guide Release 8.2 This Documentation, which includes embedded help systems and electronically distributed materials, (hereinafter referred to as the Documentation ) is for

More information

WHITE PAPER WORK PROCESS AND TECHNOLOGIES FOR MAGENTO PERFORMANCE (BASED ON FLIGHT CLUB) June, 2014. Project Background

WHITE PAPER WORK PROCESS AND TECHNOLOGIES FOR MAGENTO PERFORMANCE (BASED ON FLIGHT CLUB) June, 2014. Project Background WHITE PAPER WORK PROCESS AND TECHNOLOGIES FOR MAGENTO PERFORMANCE (BASED ON FLIGHT CLUB) June, 2014 Project Background Flight Club is the world s leading sneaker marketplace specialising in storing, shipping,

More information

Cincinnati State Admissions UX Design 06.02.14

Cincinnati State Admissions UX Design 06.02.14 Cincinnati State Admissions UX Design 06.0.4 About This Document This documents seeks to establish high level requirements for functionality and UI. It suggests content and ways to accommodate content.

More information

Apache JMeter HTTP(S) Test Script Recorder

Apache JMeter HTTP(S) Test Script Recorder Apache JMeter HTTP(S) Test Script Recorder This tutorial attempts to explain the exact steps for recording HTTP/HTTPS. For those new to JMeter, one easy way to create a test plan is to use the Recorder.

More information

SAIP 2012 Performance Engineering

SAIP 2012 Performance Engineering SAIP 2012 Performance Engineering Author: Jens Edlef Møller (jem@cs.au.dk) Instructions for installation, setup and use of tools. Introduction For the project assignment a number of tools will be used.

More information

Making Sense of the Numbers DOs and DON'Ts of Quality Performance Testing

Making Sense of the Numbers DOs and DON'Ts of Quality Performance Testing Making Sense of the Numbers DOs and DON'Ts of Quality Performance Testing Erik Webb, Jeff Beeman Sr. Technical Consultants, Acquia Building Bridges, Connecting Communities About Erik Senior Technical Consultant

More information

Hudson configuration manual

Hudson configuration manual Hudson configuration manual 1 Chapter 1 What is Hudson? Hudson is a powerful and widely used open source continuous integration server providing development teams with a reliable way to monitor changes

More information

Profiling and Testing with Test and Performance Tools Platform (TPTP)

Profiling and Testing with Test and Performance Tools Platform (TPTP) Profiling and Testing with Test and Performance Tools Platform (TPTP) 2009 IBM Corporation and Intel Corporation; made available under the EPL v1.0 March, 2009 Speakers Eugene Chan IBM Canada ewchan@ca.ibm.com

More information

The Future of Ticketing: Solutions for Museums of All Sizes

The Future of Ticketing: Solutions for Museums of All Sizes The Future of Ticketing: Solutions for Museums of All Sizes May 21, 2014 Lord Cultural Resources Creating Cultural Capital STRATEGIC QUESTIONS Should museums have queues? How could a strategic approach

More information

CommandCenter Secure Gateway

CommandCenter Secure Gateway CommandCenter Secure Gateway Quick Setup Guide for CC-SG Virtual Appliance - VMware, XEN, HyperV This Quick Setup Guide explains how to install and configure the CommandCenter Secure Gateway. For additional

More information

Performance Testing Process

Performance Testing Process Delivering Excellence in Software Engineering Performance Testing An introduction. 1 2 3 4 5 6 Introduction Performance Testing Process Performance Test Types Tools JMeter Questions 2 1 Introduction This

More information

depl Documentation Release 0.0.1 depl contributors

depl Documentation Release 0.0.1 depl contributors depl Documentation Release 0.0.1 depl contributors December 19, 2013 Contents 1 Why depl and not ansible, puppet, chef, docker or vagrant? 3 2 Blog Posts talking about depl 5 3 Docs 7 3.1 Installation

More information

CI Pipeline with Docker 2015-02-27

CI Pipeline with Docker 2015-02-27 CI Pipeline with Docker 2015-02-27 Juho Mäkinen, Technical Operations, Unity Technologies Finland http://www.juhonkoti.net http://github.com/garo Overview 1. Scale on how we use Docker 2. Overview on the

More information

WordPress Optimization

WordPress Optimization WordPress Optimization markkelnar WP Engine @renderandserve howdy@wpengine.com wpengine.com/optimizing-wordpress WordCamp Atlanta 2012 Who is this guy? Head of Technology, System Administration, database,

More information

Thesis Format Guidelines. Department of Curriculum and Instruction Purdue University

Thesis Format Guidelines. Department of Curriculum and Instruction Purdue University Thesis Format Guidelines Department of Curriculum and Instruction Purdue University 2 Overview All theses must be prepared according to both departmental format requirements and University format requirements,

More information

How To Test Your Web Site On Wapt On A Pc Or Mac Or Mac (Or Mac) On A Mac Or Ipad Or Ipa (Or Ipa) On Pc Or Ipam (Or Pc Or Pc) On An Ip

How To Test Your Web Site On Wapt On A Pc Or Mac Or Mac (Or Mac) On A Mac Or Ipad Or Ipa (Or Ipa) On Pc Or Ipam (Or Pc Or Pc) On An Ip Load testing with WAPT: Quick Start Guide This document describes step by step how to create a simple typical test for a web application, execute it and interpret the results. A brief insight is provided

More information

How To Monitor A Server With Zabbix

How To Monitor A Server With Zabbix & JavaEE Platform Monitoring A Good Match? Company Facts Jesta Digital is a leading global provider of next generation entertainment content and services for the digital consumer. subsidiary of Jesta Group,

More information

RTI Quick Start Guide for JBoss Operations Network Users

RTI Quick Start Guide for JBoss Operations Network Users RTI Quick Start Guide for JBoss Operations Network Users This is the RTI Quick Start guide for JBoss Operations Network Users. It will help you get RTI installed and collecting data on your application

More information

Extending Remote Desktop for Large Installations. Distributed Package Installs

Extending Remote Desktop for Large Installations. Distributed Package Installs Extending Remote Desktop for Large Installations This article describes four ways Remote Desktop can be extended for large installations. The four ways are: Distributed Package Installs, List Sharing,

More information

Serving 4 million page requests an hour with Magento Enterprise

Serving 4 million page requests an hour with Magento Enterprise 1 Serving 4 million page requests an hour with Magento Enterprise Introduction In order to better understand Magento Enterprise s capacity to serve the needs of some of our larger clients, Session Digital

More information

1 How to Monitor Performance

1 How to Monitor Performance 1 How to Monitor Performance Contents 1.1. Introduction... 1 1.2. Performance - some theory... 1 1.3. Performance - basic rules... 3 1.4. Recognizing some common performance problems... 3 1.5. Monitoring,

More information

Clusters in the Cloud

Clusters in the Cloud Clusters in the Cloud Dr. Paul Coddington, Deputy Director Dr. Shunde Zhang, Compu:ng Specialist eresearch SA October 2014 Use Cases Make the cloud easier to use for compute jobs Par:cularly for users

More information

5/12/2011. Promoting Your Web Site and Search Engine Optimization. Roger Lipera. Interactive Media Center. http://libraryalbany.

5/12/2011. Promoting Your Web Site and Search Engine Optimization. Roger Lipera. Interactive Media Center. http://libraryalbany. Promoting Your Web Site and Search Engine Optimization Define the Goals for Your Web site Questions that Web designers ask http://libraryalbany.edu Define the Goals for Your Web site Define the Goals for

More information

Black-Red XML Template

Black-Red XML Template Black-Red XML Template by artibaj Flash version: CS5 ActionScript version: 3.0 This template site is an Flash (AS3) fully XML driven website template that allows you to modify the whole content without

More information

File Transfer Examples. Running commands on other computers and transferring files between computers

File Transfer Examples. Running commands on other computers and transferring files between computers Running commands on other computers and transferring files between computers 1 1 Remote Login Login to remote computer and run programs on that computer Once logged in to remote computer, everything you

More information

5 Mistakes to Avoid on Your Drupal Website

5 Mistakes to Avoid on Your Drupal Website 5 Mistakes to Avoid on Your Drupal Website Table of Contents Introduction.... 3 Architecture: Content.... 4 Architecture: Display... 5 Architecture: Site or Functionality.... 6 Security.... 8 Performance...

More information

Camilyo APS package by Techno Mango Service Provide Deployment Guide Version 1.0

Camilyo APS package by Techno Mango Service Provide Deployment Guide Version 1.0 Camilyo APS package by Techno Mango Service Provide Deployment Guide Version 1.0 Contents Introduction... 3 Endpoint deployment... 3 Endpoint minimal hardware requirements:... 3 Endpoint software requirements:...

More information

SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS

SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS SUCCESFUL TESTING THE CONTINUOUS DELIVERY PROCESS @huibschoots & @mieldonkers INTRODUCTION Huib Schoots Tester @huibschoots Miel Donkers Developer @mieldonkers TYPICAL Experience with Continuous Delivery?

More information

OpenLoad - Rapid Performance Optimization Tools & Techniques for CF Developers

OpenLoad - Rapid Performance Optimization Tools & Techniques for CF Developers OpenDemand Systems, Inc. OpenLoad - Rapid Performance Optimization Tools & Techniques for CF Developers Speed Application Development & Improve Performance November 11, 2003 True or False? Exposing common

More information

Assignment # 1 (Cloud Computing Security)

Assignment # 1 (Cloud Computing Security) Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual

More information

Implementation Guide:

Implementation Guide: Zend Blueprint for Continuous Delivery Implementation Guide: Jenkins and server by Slavey Karadzhov Implementation Guide: Jenkins and Zend Server This pattern contains instructions on how to implement

More information

Installing and Configuring DB2 10, WebSphere Application Server v8 & Maximo Asset Management

Installing and Configuring DB2 10, WebSphere Application Server v8 & Maximo Asset Management IBM Tivoli Software Maximo Asset Management Installing and Configuring DB2 10, WebSphere Application Server v8 & Maximo Asset Management Document version 1.0 Rick McGovern Staff Software Engineer IBM Maximo

More information

Using JMeter for Testing a Data Center. Siegfried Goeschl

Using JMeter for Testing a Data Center. Siegfried Goeschl Using JMeter for Testing a Data Center Siegfried Goeschl 1 Siegfried, do you want to do some performance testing? Well, what would you like to test? 2 Some Data Centers with 300 servers, MSSQL clusters,

More information

A SHORT INTRODUCTION TO BITNAMI WITH CLOUD & HEAT. Version 1.12 2014-07-01

A SHORT INTRODUCTION TO BITNAMI WITH CLOUD & HEAT. Version 1.12 2014-07-01 A SHORT INTRODUCTION TO BITNAMI WITH CLOUD & HEAT Version 1.12 2014-07-01 PAGE _ 2 TABLE OF CONTENTS 1. Introduction.... 3 2. Logging in to Cloud&Heat Dashboard... 4 2.1 Overview of Cloud&Heat Dashboard....

More information

Simple Tips to Improve Drupal Performance: No Coding Required. By Erik Webb, Senior Technical Consultant, Acquia

Simple Tips to Improve Drupal Performance: No Coding Required. By Erik Webb, Senior Technical Consultant, Acquia Simple Tips to Improve Drupal Performance: No Coding Required By Erik Webb, Senior Technical Consultant, Acquia Table of Contents Introduction................................................ 3 Types of

More information

Desktop Publishing (DTP)

Desktop Publishing (DTP) Desktop Publishing (DTP) ICHS Graphic Communication What is it? Desktop Publishing is what graphic designers would use to produce work which requires organization of text, images and style. Desktop Publishing

More information

<Insert Picture Here>

<Insert Picture Here> Designing the Oracle Store with Oracle Application Express Marc Sewtz Software Development Manager Oracle Application Express Oracle USA Inc. 540 Madison Avenue,

More information

Magento & Zend Benchmarks Version 1.2, 1.3 (with & without Flat Catalogs)

Magento & Zend Benchmarks Version 1.2, 1.3 (with & without Flat Catalogs) Magento & Zend Benchmarks Version 1.2, 1.3 (with & without Flat Catalogs) 1. Foreword Magento is a PHP/Zend application which intensively uses the CPU. Since version 1.1.6, each new version includes some

More information

Scalability of web applications. CSCI 470: Web Science Keith Vertanen

Scalability of web applications. CSCI 470: Web Science Keith Vertanen Scalability of web applications CSCI 470: Web Science Keith Vertanen Scalability questions Overview What's important in order to build scalable web sites? High availability vs. load balancing Approaches

More information

Installing a Symantec Backup Exec Agent on a SnapScale Cluster X2 Node or SnapServer DX1 or DX2. Summary

Installing a Symantec Backup Exec Agent on a SnapScale Cluster X2 Node or SnapServer DX1 or DX2. Summary Technical Bulletin Application Note April 2013 Installing a Symantec Backup Exec Agent on a SnapScale Cluster X2 Node or SnapServer DX1 or DX2 Summary This application note describes how to install the

More information

The easy way to a nice looking website design. By a total non-designer (Me!)

The easy way to a nice looking website design. By a total non-designer (Me!) The easy way to a nice looking website design By a total non-designer (Me!) Website Refresher Three types of Website 1.Hand rolled HTML. Lightweight static pages. 2.Scripted Website. (PHP, ASP.NET etc.)

More information

Deploying and Managing SolrCloud in the Cloud ApacheCon, April 8, 2014 Timothy Potter. Search Discover Analyze

Deploying and Managing SolrCloud in the Cloud ApacheCon, April 8, 2014 Timothy Potter. Search Discover Analyze Deploying and Managing SolrCloud in the Cloud ApacheCon, April 8, 2014 Timothy Potter Search Discover Analyze My SolrCloud Experience Currently, working on scaling up to a 200+ node deployment at LucidWorks

More information

Load testing with. WAPT Cloud. Quick Start Guide

Load testing with. WAPT Cloud. Quick Start Guide Load testing with WAPT Cloud Quick Start Guide This document describes step by step how to create a simple typical test for a web application, execute it and interpret the results. 2007-2015 SoftLogica

More information

CHAPTER 1 - JAVA EE OVERVIEW FOR ADMINISTRATORS

CHAPTER 1 - JAVA EE OVERVIEW FOR ADMINISTRATORS CHAPTER 1 - JAVA EE OVERVIEW FOR ADMINISTRATORS Java EE Components Java EE Vendor Specifications Containers Java EE Blueprint Services JDBC Data Sources Java Naming and Directory Interface Java Message

More information

EXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1.

EXECUTIVE SUMMARY CONTENTS. 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix. 1. CONTENTS 1. Summary 2. Objectives 3. Methodology and Approach 4. Results 5. Next Steps 6. Glossary 7. Appendix EXECUTIVE SUMMARY Tenzing Managed IT services has recently partnered with Amazon Web Services

More information

Installing Oracle 12c Enterprise on Windows 7 64-Bit

Installing Oracle 12c Enterprise on Windows 7 64-Bit JTHOMAS ENTERPRISES LLC Installing Oracle 12c Enterprise on Windows 7 64-Bit DOLOR SET AMET Overview This guide will step you through the process on installing a desktop-class Oracle Database Enterprises

More information

Benchmarking and monitoring tools

Benchmarking and monitoring tools Benchmarking and monitoring tools Presented by, MySQL & O Reilly Media, Inc. Section one: Benchmarking Benchmarking tools and the like! mysqlslap! sql-bench! supersmack! Apache Bench (combined with some

More information

DevShop. Drupal Infrastructure in a Box. Jon Pugh CEO, Founder ThinkDrop Consulting Brooklyn NY

DevShop. Drupal Infrastructure in a Box. Jon Pugh CEO, Founder ThinkDrop Consulting Brooklyn NY DevShop Drupal Infrastructure in a Box Jon Pugh CEO, Founder ThinkDrop Consulting Brooklyn NY Who? Jon Pugh ThinkDrop Consulting Building the web since 1997. Founded in 2009 in Brooklyn NY. Building web

More information

Installation of PHP, MariaDB, and Apache

Installation of PHP, MariaDB, and Apache Installation of PHP, MariaDB, and Apache A few years ago, one would have had to walk over to the closest pizza store to order a pizza, go over to the bank to transfer money from one account to another

More information

Recommended File System Ownership and Privileges

Recommended File System Ownership and Privileges FOR MAGENTO COMMUNITY EDITION Whenever a patch is released to fix an issue in the code, a notice is sent directly to your Admin Inbox. If the update is security related, the incoming message is colorcoded

More information

DMA MARKETING BRIEF B2C DIRECT MARKETING PROFESSIONALS EVERY WEEK MEDIA KIT

DMA MARKETING BRIEF B2C DIRECT MARKETING PROFESSIONALS EVERY WEEK MEDIA KIT REACH62,000 MEDIA KIT B2C DIRECT MARKETING PROFESSIONALS EVERY WEEK DMA MARKETING BRIEF A C B MANY WAYS TO DELIVER YOUR MESSAGE TO THIS MARKET F A ADVERTISING OPTIONS LEADERBOARD This premier position

More information

The Benefits of WordPress Specific Web Hosting. Jamii Corley, Southwest Cyberport

The Benefits of WordPress Specific Web Hosting. Jamii Corley, Southwest Cyberport The Benefits of WordPress Specific Web Hosting Jamii Corley, Southwest Cyberport Jamii Corley Southwest Cyberport Web Hosting since 1994 Web Hosting Options Free - (Banners, type of URL you can use, owning

More information

Beyond Unit Testing. Steve Loughran Julio Guijarro HP Laboratories, Bristol, UK. steve.loughran at hpl.hp.com julio.guijarro at hpl.hp.

Beyond Unit Testing. Steve Loughran Julio Guijarro HP Laboratories, Bristol, UK. steve.loughran at hpl.hp.com julio.guijarro at hpl.hp. Beyond Unit Testing Steve Loughran Julio Guijarro HP Laboratories, Bristol, UK steve.loughran at hpl.hp.com julio.guijarro at hpl.hp.com Julio Guijarro About Us Research scientist at HP Laboratories on

More information

Bernd Ahlers Michael Friedrich. Log Monitoring Simplified Get the best out of Graylog2 & Icinga 2

Bernd Ahlers Michael Friedrich. Log Monitoring Simplified Get the best out of Graylog2 & Icinga 2 Bernd Ahlers Michael Friedrich Log Monitoring Simplified Get the best out of Graylog2 & Icinga 2 BEFORE WE START Agenda AGENDA Introduction Tools Log History Logs & Monitoring Demo The Future Resources

More information

Tips for getting started! with! Virtual Data Center!

Tips for getting started! with! Virtual Data Center! Tips for getting started with Virtual Data Center Last Updated: 1 July 2014 Table of Contents Safe Swiss Cloud Self Service Control Panel 2 Please note the following about for demo accounts: 2 Add an Instance

More information

Advanced Web Security, Lab

Advanced Web Security, Lab Advanced Web Security, Lab Web Server Security: Attacking and Defending November 13, 2013 Read this earlier than one day before the lab! Note that you will not have any internet access during the lab,

More information

RTI Quick Start Guide

RTI Quick Start Guide RTI Quick Start Guide This is the RTI Quick Start guide for new users or evaluators. It will help you get RTI installed and collecting data on your application quickly in an environment where you develop

More information

CycleServer Grid Engine Support Install Guide. version 1.25

CycleServer Grid Engine Support Install Guide. version 1.25 CycleServer Grid Engine Support Install Guide version 1.25 Contents CycleServer Grid Engine Guide 1 Administration 1 Requirements 1 Installation 1 Monitoring Additional OGS/SGE/etc Clusters 3 Monitoring

More information

Tipping The Scale Tips, Tools, and Techniques For Building Scalable. Steve French Senior Software Engineer digg.com

Tipping The Scale Tips, Tools, and Techniques For Building Scalable. Steve French Senior Software Engineer digg.com Tipping The Scale Tips, Tools, and Techniques For Building Scalable Steve French Senior Software Engineer digg.com First Thing s First... The Stack Server OS Linux, MacOS X, UNIX, Windows Web Server apache,

More information

Various Load Testing Tools

Various Load Testing Tools Various Load Testing Tools Animesh Das May 23, 2014 Animesh Das () Various Load Testing Tools May 23, 2014 1 / 39 Outline 3 Open Source Tools 1 Load Testing 2 Tools available for Load Testing 4 Proprietary

More information

CAA NEWS 15,000 VISUAL ART PROFESSIONALS REACH EVERY WEEK MEDIA KIT

CAA NEWS 15,000 VISUAL ART PROFESSIONALS REACH EVERY WEEK MEDIA KIT REACH 15,000 MEDIA KIT VISUAL ART PROFESSIONALS EVERY WEEK CAA NEWS A MANY WAYS TO DELIVER YOUR MESSAGE B TO THIS MARKET C G F ADVERTISING OPTIONS A E LEADERBOARD This premier position provides your company

More information

WEBAPP PATTERN FOR APACHE TOMCAT - USER GUIDE

WEBAPP PATTERN FOR APACHE TOMCAT - USER GUIDE WEBAPP PATTERN FOR APACHE TOMCAT - USER GUIDE Contents 1. Pattern Overview... 3 Features 3 Getting started with the Web Application Pattern... 3 Accepting the Web Application Pattern license agreement...

More information

TRADING PLAN. Lorem ipsum dolor

TRADING PLAN. Lorem ipsum dolor Lorem ipsum dolor Sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet. Insert Name

More information

Load and Performance Load Testing. RadView Software October 2015 www.radview.com

Load and Performance Load Testing. RadView Software October 2015 www.radview.com Load and Performance Load Testing RadView Software October 2015 www.radview.com Contents Introduction... 3 Key Components and Architecture... 4 Creating Load Tests... 5 Mobile Load Testing... 9 Test Execution...

More information

Bubble Code Review for Magento

Bubble Code Review for Magento User Guide Author: Version: Website: Support: Johann Reinke 1.1 https://www.bubbleshop.net bubbleshop.net@gmail.com Table of Contents 1 Introducing Bubble Code Review... 3 1.1 Features... 3 1.2 Compatibility...

More information

Simple and powerful site deployment with capistrano

Simple and powerful site deployment with capistrano Simple and powerful site deployment with capistrano Kim Pepper kim@previousnext.com.au @scorchio96 d.o: kim.pepper How are you deploying now? FTP, SFTP, SCP? SSH + GIT? Aegir? Drush? Debian packages? Don't

More information

Oracle WebLogic Server 11g Administration

Oracle WebLogic Server 11g Administration Oracle WebLogic Server 11g Administration This course is designed to provide instruction and hands-on practice in installing and configuring Oracle WebLogic Server 11g. These tasks include starting and

More information

Server Deployment and Configuration. Qlik Sense 1.1 Copyright 1993-2015 QlikTech International AB. All rights reserved.

Server Deployment and Configuration. Qlik Sense 1.1 Copyright 1993-2015 QlikTech International AB. All rights reserved. Server Deployment and Configuration Qlik Sense 1.1 Copyright 1993-2015 QlikTech International AB. All rights reserved. Copyright 1993-2015 QlikTech International AB. All rights reserved. Qlik, QlikTech,

More information

DevOps Course Content

DevOps Course Content DevOps Course Content INTRODUCTION TO DEVOPS What is DevOps? History of DevOps Dev and Ops DevOps definitions DevOps and Software Development Life Cycle DevOps main objectives Infrastructure As A Code

More information

Magento Theme Instruction

Magento Theme Instruction Magento Theme Instruction We are extremely happy to present Metros Magento theme to you, it is designed and developed by highly qualified Designer & Developers in a way that make it usable for any type

More information

Law Firm Website On-Page SEO Best Practices Guide

Law Firm Website On-Page SEO Best Practices Guide In Collaboration With Law Firm Website On-Page SEO Best Practices Guide When it comes to on-page content optimization for websites, there are very specific elements you need to review to ensure they re

More information

Spam Marshall SpamWall Step-by-Step Installation Guide for Exchange 5.5

Spam Marshall SpamWall Step-by-Step Installation Guide for Exchange 5.5 Spam Marshall SpamWall Step-by-Step Installation Guide for Exchange 5.5 What is this document for? This document is a Step-by-Step Guide that can be used to quickly install Spam Marshall SpamWall on Exchange

More information

Oracle Enterprise Manager

Oracle Enterprise Manager Oracle Enterprise Manager System Monitoring Plug-in Installation Guide for Microsoft Internet Information Services Release 12.1.0.2.0 E28547-05 February 2014 This document provides a brief description

More information

QlikView 11 Upgrade & Migrations

QlikView 11 Upgrade & Migrations QlikView 11 Upgrade & Migrations QlikView Technical Brief Published: November 2011 qlikview.com Introduction This guide is provided as a reference and best practices for upgrading and migrating an existing

More information

OutDisk 4.0 FTP FTP for Email Users using Microsoft Windows and/or Microsoft Outlook. 5/1/2012 2012 Encryptomatic LLC www.encryptomatic.

OutDisk 4.0 FTP FTP for Email Users using Microsoft Windows and/or Microsoft Outlook. 5/1/2012 2012 Encryptomatic LLC www.encryptomatic. OutDisk 4.0 FTP FTP for Email Users using Microsoft Windows and/or Microsoft Outlook 5/1/2012 2012 Encryptomatic LLC www.encryptomatic.com Contents What is OutDisk?... 3 OutDisk Requirements... 3 How Does

More information

Top 10 reasons your ecommerce site will fail during peak periods

Top 10 reasons your ecommerce site will fail during peak periods An AppDynamics Business White Paper Top 10 reasons your ecommerce site will fail during peak periods For U.S.-based ecommerce organizations, the last weekend of November is the most important time of the

More information