Augmented Search for Web Applications. New frontier in big log data analysis and application intelligence

Transcription

1 Augmented Search for Web Applications New frontier in big log data analysis and application intelligence Business white paper May 2015

2 Web applications are the most common business applications today. Your organization's success is based on the quality and availability of these business applications. Web applications are multi-tiered in nature, asynchronous, hybrid, and extremely dynamic. Web applications can run on multiple application and web servers, both on private and public clouds. Critical Data and Intelligence Every tier in the web applications generates logs, metrics, database records, and other events. Analyzing this data can help users: 1. Understand statistics trends, application intelligence, and IT to business correlation. 2. Understand Web Analytics web logs with rich analytics information. 3. Benefit from application quality and performance quickly find errors, problems, and anomalies. 4. Isolate problems faster, preventing loss of business. 5. Investigate security and fraud quickly. 6. Track and investigate business transaction problems. 2

3 Analyzing Web Application Data Web application architecture can be complex, with load balancers, application and web servers, web applications, application tiers, and messaging and data repositories. Web applications are usually composed of many components, with dynamic data loading over AJAX calls, static and dynamic content, and more. How can we win this battle over massive volumes of valuable data, and extract web analytics, applications performance and quality issues, security analysis, and intelligence? The challenge is to have a single platform that can handle all data types and sources, correlate them, and provide out of the box value for any type of web application. Augmented Search for Web Applications XpoLog Augmented Search brings new technology and approach to the big data management domain. Augmented Search combines end-to-end log analysis and management platform with cutting edge machine learning and automated Analytics. The new solution delivers: Log management and analysis of data across all sources. Super-fast search for manual investigation and troubleshooting. Automatic visualization of complex log data for reports and dashboards. Proactive monitoring. Automatic Analytics engine, executing many algorithms for machine learning, data mining, statistical analysis, semantic analysis, discovery, and profiling. The result is a built-in intelligence engine that supports user decisions during analysis, proactively adding layers of information and helping to understand data faster and in an automated fashion. This approach is technology oriented and does not require tags, filters, or predefined rules. It supports both homegrown solutions and 3 rd party applications. Augmented Search helps organizations generate ongoing value from log and machine data without manual work. Augmented Search combines a super-fast search with super-smart Analytics. 3

4 Web Applications Log Analysis Platform The XpoLog log data analysis platform is built over the following primary components: 1. User interface Web user interface with built-in Tomcat server 2. Dashboards and reports 3. Virtual Data Engine log access, collection, parsing, and management 4. Indexing and Search engine 5. Analytics engines many algorithms that auto generate intelligence This high-level architecture has subcomponents that handle security, proactivity, system health, self-healing system, map/reduce management, connectors, and more. Please visit for more information. Augmented Search for Web Applications Once XpoLog Augmented Search is deployed, all data is collected and analyzed. The following participants experience great value from their use of XpoLog: 1. Web admins 2. Web servers and App server infrastructure teams 3. Support engineers 4. Developers and testers 5. Business application owners 6. Production support 7. DevOps 8. Operations Application data is securely visible to the right people for search and analysis. Auto detected analytics presents problems, trends, and transactions to users. XpoLog generates live dashboards and reports for ongoing intelligence. Managers can make better decisions with improved understanding of the application state. The XpoLog platform can digest both structured and unstructured data from multiple sources. By indexing and analyzing log and business data, it is possible to create a rich set of intelligence reports, both on common data format and homegrown generated data. Some examples from our customers: 1. Web analytics, trends, and web app usage 2. Trade transaction statistics, volumes, and trends 3. Application features, profiling, and statistics 4. Ecommerce website business intelligence 4

5 ROI Augmented Search helps troubleshoot faster, and automatically visualizes complex data. With constant proactive Analytics, you can support homegrown solutions and 3 rd party applications, significantly reducing TCO and time-consuming exhausting manual work. This combination of automated intelligence with super-fast search and dashboards drives efficient out of the box value quickly. Customer Use Cases Troubleshooting of Web Applications Users can quickly search transaction Ids, users, errors, exceptions, and more, across all log data and sources. They can search for an IP address and a corresponding user ID, and focus their search query on a specific server or log. Instead of manually connecting to many servers and logs, they can search all the data in one place. Proactive Problems Detection Augmented Search Augmented Search helps quickly find problems in the application tiers. Once a user searches or navigates the application data (web, apps, OS logs, and more), Augmented Search presents a summary of problems and anomalies that were detected in that app's log data. The augmented search intelligence layers help focus on the important things first, without the need to read millions of log events. Performance and Analysis Reports With XpoLog Complex Analysis Search, users can visualize data automatically. They can measure response time between different log events, and create summaries of thread activity, memory allocations, exceptions, and more. Users can also understand the trends and bottlenecks of their application tiers across the board. 5

6 Investigation and Analysis of Transactions Users can correlate log events and build an advanced visual transaction search engine. They can use our transaction analysis options to track and correlate different events across logs and servers. XpoLog can measure time and data integrity in the transactions, saving hours of work by defining flows and custom dashboards with statistics and transaction metrics. Web Analytics and Statistics Reports Users can create web app statistics, and analyze access logs and application server logs. Web server logs contain an enormous volume of information on web application usage patterns. With advanced reporting and querying, it is possible to create advanced intelligence reports, correlate navigation patterns between web pages to business data, measure the time between actions, and create application usage trend reports. Summary Augmented Search is a unique technology based on our deep understanding of IT data and organization use cases. This technology helps organizations build a more robust ROI oriented strategy towards big log data in today's data centers. We invite you to read more about technical features in our data sheets and documentation. 6