Brace for 2012 Christoph

Transcription

1 Brace for 2012 Christoph

2 basilicom

3

4 (short term) High Load Scenarios

5 DISCLAIMER PHP

6 TV == ( if successful )

7 /. "Slashdot Effect" ( now: Facebook, Bild.de,... )

8 Bäm!

9 Why care?

10 $$$ TV ads are expensive downtime == wasted money

11 Why me? 5 yrs++ Deutsche Bahn, Ferrero, Peugeot BMW, Sony, UMG, studivz,...

12 Image source: CC BY-NC 2.0

13 Flight Plan 1. MAKE A PLAN 2. MAKE IT SCALE? 3. MAKE IT FAST! 4. [ TEST, SIZE ] 5. WATCH IT! } Architecture 6. BONUS: EXAMPLES

14 Brace for impact

15 Plan Brace for impact

16 Knowledge is Power Media plans TV schedules

17

18 Planning just Peaks matter Media / marketing exposure? Target group? Click Rate? Max. daily visits? Top hour? Pages ^ visit, resources ^ page? Do not forget storage / traffic requirements.

19 Planning

20 Planning

21 Architecture ( & Tool Time )

22 Fancy Solution E l a s t i c i t y Scaling

23 "just add more boxes.." n

24 really?

25 System complexity ++

26 Database?

27 Time to spawn?...

28 TV-Ad 10 min. later 10 sec. later

29 Traditional Solution Performance ++

30 Performance SERVER BROWSER USER

31 Performance FAST! SERVER BROWSER USER

32 Performance Rules

33 Rule #1 Don't get hit. landing page on a different server.

34 Rule #2 Let others do the work use a Content Delivery Network (CloudFlare is free).

35 Rule #3 Serve static content

36 SERVE STATIC CONTENT!

37 Rule #3 Serve static content use a caching reverse proxy: Varnish NGINX is fast, too "static" can even mean only 5 mins.

38 Rule #4 Serve static content once use correct cache headers leverage browser caches allow external proxies to cache your content.

39 Rule #5 Minimize requests compress HTML combine / minify JS, CSS inline images == get a good SpeedRanking.

40 Rule #6 Avoid dynamic requests load data upfront stay in browser, validate via JS first collect data / batch requests load only on action (captcha,...).

41 Rule #7 small is BIG don't load a framework for an insert() just write a logfile? use nodejs.

42 Rule #8 De-couple / postpone use queuing and finite # of workers use external services (transloadit, youtube,...).

43 Rule #9 Degrade gracefully skip doing hard work (thumbnails,...) hide expensive functionality (edit)... to keep the site online.

44 Secret Rule #10 Cheat discard requests stats & voting: sample only 10% simulate server calls (spinner).

45 Final Rule #11 Don't go offline. put campaign on different server limit resources, don't kill your server if all fails, be sure to display a notice.

46

47 Testing Goal: Determine app limits/threshold Testing is HARD Test the production environment Monitor performance & resources httperf, apache bench, siege, JMeter.

48 Sizing & Tuning

49 Sizing & Tuning RAM CPU cores / CPU speed IO: Storage Type / Storage Size Cache memory (Varnish) MySQL tuning (Caches,...) System/Network tuning (max_open_files,...) Apache (max. childs,...)

50 Rinse, repeat. (building, testing, sizing)

51 Online: Monitoring Image source: Attribution

52 Monitoring Access (Google Analytics) External Availability (Pingdom,...) Speed, Latency & Resources (New Relic,...) Application (# participants,... StatHat) OR homegrown (statsd, etc.).

53 Examples

54 Forms

55 Forms 1 3 2

56 Gallery detail pages IMAGE

57 Gallery detail pages ==> :-( #3Jsk31KOsk2 ==> :-) static! 3Jsk31KOsk2.JPG

58 Simplified setup

59 Summary

60 SERVE STATIC CONTENT!

61 CRITICAL LOAD FOLLOWS

62 Questions? Suggestions?

63 Thanks... and always have a safe landing! Contact Christoph Lühr luehr@r-pentomino.de, christoph.luehr@basilicom.de Slides license Attribution-NonCommercial-ShareAlike 3.0

64 Links Google PageSpeed Insights Transloadit: Image / Video uploads / conversion Pingdom Monitoring & Tools New Relic application & server monitoring CloudFlare CDN

65 Links Continuous Performance Testing com/talks/12_05_ipc_se_continuous_performance_tests.pdf Varnish Varnish Speed no/posts/2010_10_23 High_End_Varnish 275_thousand_request s_per_second.html

66 Links NGINX High Performance Web Sites - Steve Souders Pound Load Balancer, Reverse Proxy & SSL Offloader