Arnaud Becart ip- label 11/9/11

Transcription

1 Arnaud Becart ip- label 11/9/11

2

3

4

5

6 RUM Synthe2c Tests

7 You should measure HTML and RIA (Flash ) Page Rendering Onload + Full Page Load InteracBons in your page Third Party content How Synthe2c / Real browsers (Renderstart + onload + Full page) RUM (onload only) Advanced diagnos2cs (video, HTTP logs, headers, code ) Code OpBmizaBon Build SLA with 3 rd Party Web is complex But not so much from a User Perspec2ve

8 Before AGer Client GET /psp/crprd/?cmd=login&languagecd=eng HTTP/1.1 Accept: image/gif, image/jpeg, image/pjpeg, image/pjpeg, application/xshockwave-flash, application/x-ms-application, application/x-ms-xbap, application/ vnd.ms-xpsdocument, application/xaml+xml, */* Accept-Language: fr User-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0;.NET Client CLR ;.NET CLR ;.NET CLR ) Accept-Encoding: gzip, deflate Host: dsxeco.3ds.com Connection: Keep-Alive GET /psp/crprd/?cmd=login&languagecd=eng HTTP/1.1 Host: dsxeco.3ds.com User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv: ) Gecko/ Firefox/ (.NET CLR ) Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: EN Accept-Encoding: gzip,deflate Accept-Charset: ISO ,utf-8;q=0.7,*;q=0.7 Keep-Alive: 115 Connection: keep-alive Server HTTP/ Moved Temporarily Date: Wed, 20 Apr :04:24 GMT Location: Content-Type: text/html Expires: Thu, 01 Dec :00:00 GMT Set-Cookie: CRPRDWEB1-PORTAL- PSJSESSIONID=2l97NnhDJhNnllrwQLsM1LJHq9QXqY58! ; path=/ Connection: close Server HTTP/ Moved Temporarily Date: Wed, 20 Apr :11:13 GMT Location: Content-Type: text/html Cache-Control: no-cache Set-Cookie: CRPRDWEB1-PORTAL- PSJSESSIONID=y4RYNnbRTV44lR6gzSYQv902TRXfW1kq! ; path=/ Transfer-Encoding: chunked + Keepalive

9 Before AGer

10 Before AGer +30% Web Server Conf Change

11 Page + CDN op2miza2on 18% to 41% perf gain

12 They re everywhere they re moving...

13 they expect different response 2mes

14 Measuring Loca2on Good when you know the User CONTEXT Last Mile Backbone 20 Mb 100 Mb actual Mb 2GHz, 4GB RAM actual resource Telefonica Vodafone DTAG Fixed user Mobile user MAC PC Tablet Smartphone IE Firefox Chrome safari How SyntheBc : where your users are RUM, qualifying : Actual user s bandwidth Actual processing capaci2es Isolate Mobiles/Tablets Isolate Synthe2c tests

15 34 browsers 6.5 M monthly visitors Driving 75% of its revenue on the web Exhaus2ve Browser monitoring

16 You should measure Compa2bility across releases First Bme / repeated view Cross- browsers tesbng Real browsers observing (in a known context) Mobile browsers How SyntheBc : up- to- date (real) browsers, benchmark RUM : Truly exhaus2ve Fast changing market shares Real- Time (release valida2on) Correla2on with analy2cs

17 A True Mobile Monitoring story Mobile App + Data App + Voice App

18 ios5 vs ios % performance gain measured with ip- label Cloud Observer Many devices Many OS

19 Why is mobile monitoring complex? TesBng a site or an app Many devices & OS 3G / 4G / WIFI Emulator Vs Real Device monitoring? Yet it s cribcal Users expect an equal response <me than from desktop How to make it simple? SyntheBc : Real- device & technology independent monitoring RUM : Quite exhaus2ve For a limited cost Automa2c update of devices (js compliant) & new OS

20 More & More Web- Based internal Apps Web Services based communica2ons What about my employees?

21 You should measure Employees produc2vity (can they use their applicabons?) Measuring real usages : Browser / Same se`ngs WorkstaBon / Virtual session Environment (internal network) Web + External App usages How? Internal Synthe2c DIY (license) or SaaS Internal RUM : Exhaus2ve Very limited cost Internal SLA

22 Website : 1 million visitors/day + 82 physical shops 6000 worksta2ons Results : Hardware upgrade Browser updates Release valida2on 13s 6s per page Internal RUM

23 Origin Hos2ng New Hos2ng + 40% CDN +66% 3/ Benchmarking to choose the good CDN at the good place 2/ How to jus2fy the cost and calculate ROI? 1/ Do I need a CDN?

24 You should measure CDN effecbveness on a locabon/area ROI CalculaBon SLA based on actual users How Synthe2c : worldwide, mulb- carrier Tracking only CDN performance Benchmarking RUM where Robots are too expensive or complex to deploy don t forget Video Content!

25 40 sec before playing a live content Robot Streaming Servers Stream Provider Robot Real- 2me or Catch- Up TV Video on mobile Is video cri2cal to your business? Mobile Network

26 You should measure Buffering Bme Frame- rate & image quality Breakdowns during playing Real- 2me / Live Channels VOD / Progressive Download Mobile video / adapbve streaming How Synthe2c : video/audio streams, live TV, VOD Portals Image quality (MOS) with or w/o reference RUM : stream quality delivered to anyone

27 VOIP PSTN ISDN Mobile MOS PESQ ITU P Speech Quality Is voice cri2cal to your business? Call Center App & IVR availability

28 You should measure Voice of the Customer (VOC) : can they reach you? Click- 2- call Inbound/oubound calls Speech quality Call center produc2vity if phone system or CRM are down How TesBng real phone calls Monitoring IP & PSTN lines Universal & objecbve quality evaluabon (MOS PESQ) Monitoring InteracBve Voice Responder (IVR) and call centers Mixing Data & Voice monitoring

29 You should measure A user accessing to a virtual or cloud plagorm External/Internal depending on usages Physical vs. Virtual performance & load impact SLA achievement? < 99.9 uptime for end-users How SyntheBc transacbon in a virtual environment External SyntheBc transacbon on a cloud plalorm Load tesbng : 2VCPU = 1.2 CPU RUM script based CloudObserver Third Party SLA calculabon Cloud Monitoring

30 Too many KPIs! A minimum to make decisions Sa2sfac2on (EUEM) / Apdex Sa2sfac2on (actual) Conversion Revenue and be customizable An simple Dashboard

31 IP- LABEL Synthe2c RUM Load Tes2ng BAM

32 No 1 In Europe OFFICES & PARTNERS in 15 countries Join us at booth 16 TRUSTED THIRD- PARTY