HP Application Performance Management What s New Vivit User Group Chicago Dan Simanaitis HP BSM Solution Architect February 7, 2013 daniel.simanaitis@hp.com
Discussion Topics Agenda : Business Service Management Overview HP s Point of View HP Application Performance Management Overview & What s New Business Process Monitor (BPM) Real User Monitor (RUM) Diagnostics Demo Diagnostics Client Monitoring Audience Participation Required Questions & Answers 2
BSM Portfolio The different components of BSM 1) Analytics Service Intelligence 2) Event Management 3) Unified Monitoring Event Management & Correlation (OMi) Applications Mgmt System Mgmt Virtualization Mgmt Network Mgmt Storage Mgmt Log Mgmt Run Time Service Model (RTSM), Foundation Platform Services 3
HP Application Performance Management 360 degree view of application health DevOps Cloud Mobile Proactive Identify issues using global synthetic transactions before your customers find them Real Time Capture each real user experience, transactions and behavior from every location Depth Drill down deep into transactions across the entire transaction value delivery chain, from end-user to the mainframe 4
HP Application Performance Management (APM) 1) Monitor End User Performance Business Process Monitor (BPM) / Real User Monitor (RUM) End-User Management (Synthetic/Real/Client) 2) Pinpoint Application Bottlenecks Diagnostics, TransactionVision, Business Process Insight Transaction Management (Deep Diagnostics/Tracking/Business Visibility) 3) Predict Application Performance Issues Service Health Analyzer Predictive Analyzer Analytics Transaction flow, e.g.; e-commerce order 5
HP Business Process Monitor Overview and What s New
HP Business Process Monitor (BPM) Synthetic end-user monitoring for all application from all locations 1 Develop script or reuse testing script to quickly monitor applications Synthetic user Switzerland Synthetic user New York Synthetic mobile user Singapore (BAC Anywhere) 7 2 Monitor from all locations 3 Verify key business service 4 Verify business service (script) Synthetic user Launch Script Singapore (BAC Anywhere) Txn1 Txn2 Txn3 Report and alert in centralized console
Industry s Broadest Protocol Support For Synthetic Monitoring HP Business Process Monitor.NET Flex AJAX FTP AJAX TruClient IMAP C VUser I-mode Citrix 1.8 Informix COM/DCOM Jacada CORBA-java JAVA over HTTP Siebel Web JAVA Record/Replay Siebel DB2 CLI Java VUser Siebel MSSQL JavaScrip Vuser Siebel Oracle JMS Real LDAP RMI-Java Silverlight Mobile App (HTML/HTTP) Mobile App TruClient MSSQL Server Multi protocol web ODBC Oracle (2-tier) Oracle NCA PeopleSoft 8 POP 3 SAP Click and Script SAP GUI SAP Web SMTP SOAP Sybase CtLib Sybase Dblib Terminal Emulation[RTE] Tuxedo 6 Tuxedo 7 VB VUser Voice XML WAP Web [HTTP/HTML] Web Click and Script Windows sockets DB2CLI DNS EJB 8
Monitor the availability and performance of mobile applications Monitor mobile web and native mobile applications Combine mobile application performance with underlying infrastructure BPM Monitor location can be configured with access to a Wireless Carrier Internet Business Application 9 BPM Monitor application over Internet from local location or remote location. BPM
HP Business Process Monitor What s New Automated Baselines Mobile Protocols VuGen IPv6 support Enhanced Reports for Synthetic Monitoring of Mobile Apps Alerts by Mobile Device Type Import data from HP Performance Center (BPM scripts & SiteScope Config templates) 10
BPM baselining motivation What is normal behavior for an application? 11
BPM baselining calculations, granularity & thresholds Calculations from samples: Mean Standard deviation Granularity is per: Transaction Location Thresholds for: Performance But NOT Availability 12
BPM baseline trends & seasonality Seasonality Repeated pattern Constant time intervals Trend Consistent linear change over time How much data? ~1 week s worth to begin Updated weekly Mon Tu Wed Th Fri 13
Baseline in BPM reports The baseline threshold sleeves will be shown in Metrics Over Time report for BPM metrics. Includes Adoption mode use static thresholds and compare them to baseline results before applying baseline mode. 14
Metrics Over Time report displays baseline data 15
Baseline is transparent in all other reports Baseline in Reports - transparent to the user 16
Alerts display Baseline data 17
HP Real User Monitor Overview and What s New
HP Real User Monitor (RUM) HP Real User Monitor measures the real user experience of key business applications Browser Cloud services/isps Real User Monitor Reporting and alerting in central console Citrix Employees/ Customers Mobile Mobile carriers Firewall Network Employees Web servers /Load balancer Web services Databases Application servers/ composite applications Virtual / physical hybrid environments Mainframe 19
VDI Mail Backend /Middleware Frontend Various Increasing Real-Time End-User Coverage RUM Protocols, Templates and Protocol SDK Application Protocol Application Protocol Custom web Flash Flex SAP Oracle Forms NCA Siebel HTTP/HTTPs AMF0, AMF3 HTTP/S, SAP GUI Over HTTP/TCP HTTP/S FTP LDAP ISO 8583 FTP LDAP VISA Base I, MasterCard CIS PeopleSoft HTTP/s SOAP IBM WebSphere MQ HTTP/s MQ Streaming/VoIP IMAP SMTP POP3 UDP IMAP SMTP POP3 Oracle DB MS SQL MySQL DB2 Oracle DB MS SQL MySQL DB2 Citrix Xen Citrix ICA 20
RUM Architecture Version 9.20 and prior 21
RUM Architecture Version 9.21 22 RUM Svr Colltr lightwt agent servers as a virtual tap
Real User Monitor new capabilities for mobile apps Flexible deployment for any use-case New New Network (Traditional) Browser Hybrid = Network + Browser Network Real User Monitor Browser Real User Monitor Browser Real User Monitor Collects data from network, measure inside data center, monitor frontend and backend tiers Collect data from browser, measure Client tier accurately, No Network settings required! Network Combines data from browser and network for true end to end visibility Discovery Network Backend Web 2.0 User Analytics End to End User Experience 23
HP Real User Monitor What s New New Protocols AMF (Flex), MQ, SAP GUI, Generic Routing Encapsulation (GRE) Tunneling Web-tier breakdown Automated baselines Support for IPv6 based traffic Just-in-time discovery Web-client monitoring (RUM Browser) RUM data export to csv file(s) RUM Server Collector RUM Probe on RHEL 6 24
RUM supports Flex Flex - a framework for developing Flash applications Flex uses AMF protocol to communicate between Flash client & server Flash Client AMF0 AMF3 Server RUM 9.12 supports AMF0 and AMF3 25
RUM supports MQ Application Server Web Server MQ {channel, queue manager, request type} queues users permissions etc MQ Queue Manager User names Message type Message queue Manager queue Message content: Mask sensitive content RUM Application Server queues users permissions etc MQ Queue Manager 26
Session Details report with MQ actions 27
RUM supports SAPGUI SAP: multitier application with two UIs: SAPGUI client NetWeaver (HTML) SAPGUI Client Browser Business process ID d by T-CODE RUM monitors: SAP Transactions User name Performance Sessions Classification Network quality DB SAP R/3 Server 28
Real User Monitoring of SAP GUI Clients Example RUM passively monitoring All SAP Transactions from All Locations, All the Time Monitor HTTP NetWeaver and SAP GUI based SAP Clients Measure Performance, including network Auto Transaction detection based on SAP TCODEs (SAP GUI only) Trace an individual user s session Detect and filter by username SAP TCODE SAP Topology SAP topology in respect to Application Tiers and SAP Transactions SAP Business Impact Analysis through SLM Alert on Transactions, App and Network Performance Adding Real User Perspective to HP s SAP Monitoring through BSM (infrastructure monitoring, discovery, topology and synthetic monitoring) 29
Front-end HTTP tier breakdown Client Reverse Proxy Load Balancer App. Server Track HTTP traffic passing through several Web servers App. Server 30
New Report Web Tier Breakdown Show transaction breakdown by Web tier 31
RUM baselining goals Simplify the definition of pages User does not know what threshold to use for each page Automatic thresholds for classified pages No need to define the page to have a separate threshold for it Dynamic thresholds for pages and transactions Transaction threshold changes whenever there is a change in the behavior 32
RUM baselining details Calculations from samples: Mean & Standard deviation: use predefined bucket size, configurable in JMX Console Updated with every sample Mean + 2*StdDev configurable in JMX Console Thresholds for: Page time Server time Set value to avoid false alerts No seasonality due to current overhead Granularity is per: Page Transaction But NOT Location 33
RUM baselining the bucket Bucket consists of: Four sample queues (default) Each queue holds 2000 samples (default) Both are configurable in JMX Console algorithmqueuesize = 4 algorithmsamplesperqueueditem = 2000 Baseline calculated over all samples When all are filled, oldest is dropped 34
RUM baseline - Reports Action Summary different thresholds for undefined pages Tier summary performance includes dynamic thresholds RUM reports are sleeveless Dynamic threshold in tooltip 35
RUM baseline - Configuration Per application tier Allow to force static threshold per defined page Dynamic threshold definition in transaction (regardless of baseline) Available for search and update in GSAR (Global Search And Replace) 36
Response Time RUM Browser Monitor application performance, availability and usage volume Aggregated Performance & Availability (all users, individual or all apps) Sessions by Usernames Browsers OS Devices Locations (all users, all sessions, per app) Track User Session Location Username Browser OS Device User Session Clickstream (single user) Transaction Transaction Page Page Page Page comp comp comp comp comp 37
Response Time RUM Browser Breakdown user experience by location, username, browser, OS, device Aggregated Performance & Availability (all users, individual or all apps) Sessions by Usernames Browsers OS Devices Locations (all users, all sessions, per app) Track User Session Location Username Browser OS Device User Session Clickstream (single user) Transaction Transaction Page Page Page Page comp comp comp comp comp 38
Response Time RUM Browser Search for individual user session by various properties Aggregated Performance & Availability (all users, individual or all apps) Sessions by Usernames Browsers OS Devices Locations (all users, all sessions, per app) Track User Session Location Username Browser OS Device User Session Clickstream (single user) Transaction Transaction Page Page Page Page comp comp comp comp comp 39
Response Time RUM Browser Transaction Matching monitor multi step user flows Aggregated Performance & Availability (all users, individual or all apps) Sessions by Usernames Browsers OS Devices Locations (all users, all sessions, per app) Track User Session Location Username Browser OS Device User Session Clickstream (single user) Transaction Transaction Page Page Page Page comp comp comp comp comp 40
RUM Browser Enables Analytics Collects and Stores every user action, for all users New Browser Real User Monitor Business Process Recognition Export RAW Data Business Process Distribution Troubleshooting/Isolation and deep dive VERTICA Network Perf Identify Common User Flows Easy Export of ALL user recorded data for data analysis Analyze Transaction popularity & response time to generate load tests 41
RUM for HP Universal Discovery (UD) Just-in-time Passive Discovery Real Time Discovery Performed Passively (no noise) Credential-less Continuous Shallow discovery Capturing ALL Connections Noise Filtering *RUM Probe deployment requires configured Span Port/Tap RUM Integrates to UD Sends Event 1 2 UD (DDM) Active Probe Report CIs Captured in Event CMS (UCMDB) Use Cases Real time dependencies mapping 42 Example: Identify UDP based business critical application dependencies Transient dependencies detection Example: Threshold based automated backup Reduced overhead and TCO Example: can be a replacement for setting and maintaining NetFlow for discovery 4 Discovers Additional CI s 3 Invoke Active Discovery Jobs
HP Diagnostics Overview and What s New
HP Diagnostics Depth into application performance more insight into the toughest problems Proactively find bottlenecks and throughput issues before the end users Internet/ Intranet Firewall Web Servers Application SAP, Siebel, Oracle J2EE,.Net Middleware JMS, MQS, SOA Backend Mainframe, CICS Database 44
HP Diagnostics - Isolate issues in complex hybrid environments Example: HP Diagnostics quickly isolate issues in complex cloud & Mobile environments 1 Proactive notification of issue 3 Application component details isolating issue to the transaction calls 2 Transaction topology showing point of issue 4 Root cause of application issue 45
Unique depth into applications HP Diagnostics HP Diagnostics give you in-depth details of the application so you can solve issues faster Simple solution that is easily used by both developers and IT to solve the hardest of application problems Data monitoring and collection Transaction typology In-depth isolation Collaborative devops End User Experience Monitoring Troubleshooting/Isolation and deep dive Business Impact and SLA Historical, Subcomponent level data Application flow instances Business Transaction & Service Request Correlation Root Cause Thread performance to identify issues 24x7 stability Global scalability 46
HP Diagnostics What s New Platform Support Client Monitoring Integration w/bsm Performance Grapher (PMi) Java Thread State Analyzer Diagnostics Python Agent probe Support for OpenStack (Diablo & Essex releases) Easier application search within UI Improved ease-of-use navigating UI Diagnostics tracks licenses by operating system instances now instead of application instances 47
Platform Support The official HP Diagnostics support matrix get it! http://support.openview.hp.com/sc/support_matrices.jsp#diagnostics Diagnostics Server Windows 32/64, Linux, HP-UX, Solaris Java Probe (1.4 thru 1.7) HP-UX, AIX, Z/OS, OS/400, Windows 32/64, Linux, Solaris.NET Probe (2.0 thru 4.0) Windows x86 2003-2008 (32/64) Collectors Java 1.7 support is new! Oracle 10g/11g, SQL Server 2005/2008, Tibco EMS, IBM WebSphere MQ, SAP R/3 NetWeaver, VMWare 48
Web client monitoring business case Business benefits Collect end-to-end performance measurements for Web pages direct from users browser. User story Customers want to be able to monitor the actual browsing experience the mobile revolution has made this need more urgent than before. What s new Unified view of end-user and back end performance for each URL. Captures total, server and client time as experienced by the user. Results may be organized by URL, Browser type, or location. 49
Web Client Monitoring Supportability Items to Note.NET-based applications At this point,.net applications are not supported. Only Java web applications are supported. BSM Integration Unfortunately, this release does not integrate any client monitoring related events into BSM. The impact is that you will only see status of client monitoring health within HP Diagnostics. Not stand-alone The client monitoring capability requires that the Java web applications be instrumented with the HP Diagnostics Java probe. Client monitoring only use-cases are not supported. Automatic instrumentation Diagnostics can automatically instrument Tomcat, JBoss, WebLogic and WebSphere JSPs. All you need to do is deploy a single.war file ClientMonitoring.war. 50
Web Client Monitoring in HP Diagnostics - URL 51
Web Client Monitoring in HP Diagnostics - Browser 52
Web Client Monitoring in HP Diagnostics - Location 53
Diagnostics Client Monitoring Demo On your laptop, smart phone, IPAD, or other mobile device bring up: http://tinyurl.com/diagpetclinichpcs Find Owner Simanaitis and / or Add New Owner
New Features HP Diagnostics Data source support Host,.Net and J2EE Probe SaaS Support Templates available to all customers Performance & Usability Improvements RTSM performance/improved UI OMi Decoupling OMi license not required 55
BSM Grapher (PMi) Diagnostics data source support Visualize data from Host,.Net and J2EE Probe metrics Cross-domain analysis of performance bottlenecks Correlate Diagnostics data with Agent/SiS/EUM data Top-down approach to performance troubleshooting Faster root cause analysis Data retrieved from Time-Series DB OpalRegistrationClient API 56
Java Thread State Analyzer Business Case Business benefits Reduced MTTR. Isolate thread issues visually without having to compare thread stack traces over time by hand. User story Diagnostics has Thread monitoring in the Profiler and can capture Stack Traces over time but the job to isolate issues still takes too much time. What s new New visualizer of Java Thread States over time find threading issues fast! Visualize state distribution (%) by thread : states include - Deadlocked, Blocked, Running, I/O, Sleeping, Waiting, Starving, Unknown. Adjustable sampling interval, history length, and stack trace depth. 57
Manual Examination of Stack Traces is Exhausting Examining every stack trace to determine the state of each thread will get very tedious (this example had 55 threads)! 58
Java Thread State Analyzer Visualize Java Thread States over time find thread issues faster! Save hours of time! Visualize state distribution (%) by thread where states include - Deadlocked, Blocked, Running, I/O, Sleeping, Waiting, Starving, Unknown. Adjustable sampling interval, history length, and stack trace depth Thread Method and Line Number Thread State over time 59 Clear situation of I/O resource contention
HP Diagnostics now monitors Python & OpenStack! Python Probe for deep dive diagnostics monitoring of Python-based applications Quick isolation of performance problems for Python based applications Supports Python application servers for monitoring for standard HP Diagnostics capabilities Supports Python code snippet capability for custom instrumentation OpenStack Instrumentation OpenStack monitoring including the collection of transactions and SQL statements OpenStack Probes Example: Openstack Topology Probe Details 60
Questions?
Thank you HP Restricted.