Big Data Volume, Velocity, Variability

Transcription

1 Big Fast Data Anwendungen und Lösungen der Software AG Big Data Volume, Velocity, Variability Dr. Jürgen Krämer VP Product Strategy IBO & Product Management Apama the time window to analyze & act to cause a smart response 2 Big Fast Data Volume, Velocity, Variability 3 requires: Continuous analysis & intelligent in-time action 4 Traditional Business Intelligence Batch Analytics/ Data Warehouse Rapid and proactive response is the key to surviving the pace of competition 1 week 5 days 1 day Many industries face shrinking time windows to make smart responses to critical business patterns 20 min 30 sec 8 hr 10 sec 1 day 15 min 3 days 4 weeks 1 day Intra-day Batch Analytics 5 min 1 min 100 ms < 1 ms Algorithmic trading Typical Business SLAs weeks days hours minutes seconds milliseconds Airline operations Call center inquiries Track financial position Supply chain updates Phone activation 0.5 hour Refresh data warehouse 2 hrs. Real-time Continuous Intelligence Needed Continuous inmemory Analytics Low Latency Analytics Trade settlement Build-to-order PC 1

2 Value Business event Data captured Improve response time to problems & opportunities Link real-time insights with the right actions Information delivered What is IBO? Intelligent Business Operations are a style of work in which real-time analytic and decision management technologies are integrated into the transaction-executing and book-keeping operational activities that run the business Action time Action taken Gartner. March 2011 W. Roy Schulte, Janelle B. Hill, Nigel Rayner Time 5 SOURCE: Richard Hackathorn The BI Watch: Real Time to Real Value 6 Gartner s definition focuses on operational effectiveness BI and other Historical Analysis complement IBO IBO Platform: Capabilities Data Warehouse 7 Store data Observe Situational Awareness Data in motion Source: W. Roy Schulte, Gartner Inc. Traditional BI, statistical analytics, data mining, etc. for historical analysis Decide Faster & Better Decisions Running business operations Reporting Ad-hoc BI analytics Act Dynamic Actions Traditional BI and off-line analytics Strategic and tactical decisions Improve Intelligent Business Operations 8 Decisions Analytics Streaming analytics Historical analytics Process KPIs and SLAs Fast (In-Memory) Data Connectivity and Access Process Activity Business Processes Intelligent Actions Visualizations Alerts Big Data Live Transactions & Events $ Financial & Hadoop& Data System alerts, sensors & News Events Warehouse machines Social Media Events Mobile events Other SAG capabilities will be used to augment this stack as required 2

3 Software AG Context IBO Platform: Functions SOLUTION BLUEPRINT Customer Experience Mgmt SOLUTION BLUEPRINT Capital Markets SOLUTION BLUEPRINT VISUALIZATION ANALYSIS DECISIONS ACTIONS In-Memory Data Management Real-time continuous analytics & event processing Real-time process analytics & operational monitoring Process discovery & historic process analytics Connectivity & messaging 9 IBO becomes more compelling when aligned to the full SAG suite 10 $ IBO Platform: Primary products Facts & Figures SOLUTION BLUEPRINT Customer Experience Mgmt SOLUTION BLUEPRINT Capital Markets SOLUTION BLUEPRINT Leading provider of in-memory data management and CEP (real-time analytics) solutions Enterprise Customers 500K+ Enterprise Deployments 70% of Global 1000 use our software CEP Optimize PPM Behind some of the most widely deployed software for scalability and performance 5+ PB of data in memory 2.1M Developers in 190 Countries $ Powers 2 of the top 3 marketleading Foreign Exchange platforms

4 BigMemory: In-Memory Data Management Speed Up Scale Up Scale Out Increase Data in Memory BigMemory BigMemory Server Array Elastic Scale In the Cloud BigMemory Server Array Unified Productivity Tooling The Correlator: Apama Run- Time Engine Complex Event Processing Scalable, highperformance Correlator Rich, intuitive development environment for developers and business analysts Analytics, Patterns and Applications are deployed into the Correlator Real-time output streams feed Apama s real-time, interactive, dashboards or any external system Reduce Reliance Integration with Live and Static Data Systems Cache integration Integration with any data source/ sink or library Real-time Data Visualization & Analytics Real-time visibility Better, faster decisions Fix problems early Use cases

5 Global E-commerce Avoiding Black Friday Blackouts Global E-commerce Avoiding Black Friday Blackouts Challenges: Huge spikes in customer traffic at peak times Proactive customer care Legacy Approach: FORTUNE 150 ATHLETIC BRAND Product catalogue & shopping cart pulled from multiple disk-bound databases Violated SLA Order bungled Delivery late FORTUNE 150 ATHLETIC BRAND Solution: Move data access to in-memory Results: 90% of product requests served instantly Backend services load slashed by 40% Average page load time reduced by 16% Search time reduced by 30% Dell s Global Command Centers fix problems before they hit the customer Use cases SLA Events Inventory Equipment Locations Real-time visibility Better, faster decisions Fix problems early Continuous optimization Do more with less Social Media Weather Patterns Identify that an onsite support SLA could be violated Visualize status & proactively address impending problem

6 Convey data reliably from the remote ships & dock side machines Real-time and historic/enriched information on ships 21 Ship Movements (Sat) Ship reporting Port Messages Smart shipping logistics Pilot Project: Lines on Sea Detect a ship passing a certain area, determine the relevance Detect when ships cross a certain line, and give a meaning to it. Space based AIS generates large number of ship movements Start appropriate process Real-time tracking of all entities, highlighting efficiencies and predicted problems Real-time access to ships inventories and planning schedules 22 Sabre: Largest Airline Reservation System Challenges Scalability to meet business growth requirements Keep operational & development cost to a minimum 750K reservations a day Maximum of 10,000 transactions per second Retain high reliability of mainframe Solution Terracotta BigMemory Storing 500GBs of travel reservation sessions and itineraries per day Business Value Delivered SLA s of 99.99% uptime Offload Mainframe MIPs by 80% Use cases Intelligent Offers: Right Place, Right Time, Relevant Real-time visibility Better, faster decisions Fix problems early Seize real-time revenue opportunities Outperform your competitors Multi-payments Data Interoperability Continuous optimization Do more with less Credit Card Transactions Program Triggers Profile Changes Purchase flat screen TV at partner store using bank credit card Low current account balance History of responding to attractive credit offers Push payment plan to mobile phone Real-time, One-to-One Marketing Thank You for Using Our Credit Card. We are offering 2% APR finance over 60 months on this TV to loyal bank customers. Click here to accept

7 Call Records Program Triggers Profile Changes Location Changes 35 million subscriber profiles analyzed each day Event streams with 40,000 events/second 200 business criteria checked in real-time 25 Location & context-aware promotions increase revenue & loyalty Customer location detected entering mall Visualize campaign effectiveness in real-time; New campaigns can be deployed in 24 hours Customer who subscribes to the Live Sports Results package enters a Mall Partner Sports Bar Diner has capacity Push offer of 15% off any main meal this lunchtime Real-time, One-to-One Marketing Enjoy 15% discount off any main meal at Sports Bar Diner in Wellington Mall this lunchtime Marketing the right offer at the right time has yielded $15m revenue increase and 10x offer uptake 26 Real-time visibility Better, faster decisions Fix problems early Seize real-time revenue opportunities Outperform your competitors Multi-payments Data Interoperability Continuous optimization Do more with less Continuously manage risk Reduce losses by spotting problems early Use cases Trades Quotes News Trader Behavior Social Media Real-time and historic market data feeds Mitigate potential regulatory violations before they make the headlines Large numbers of complex risk and surveillance rules that can detect market abuse or problems before the situation becomes critical Unusual trading activity just before news release suggests insider trading Compliance staff visualize trade abuse alerts; drill in to investigate Notify relevant Compliance Officer Transforming Security PayPal Globally leading online payments company with more than 100 million customers in close to 200 countries and an annual payment volume of above $10B. Opportunity Fraud detection Reduce fraud loss Improve speed and accuracy of fraud detection system Increase rules in fraud detection algorithm from 50 to over 1,000 Fraud detection in milliseconds drives profit up by 10s of millions Result (first 9 months) Drive profit up by tens of millions of Euros Meet 650 millisecond end-to-end SLA 99% of the time Achieve better accuracy

8 Summary Intelligent Business Operations (IBO) Best of breed technologies Apama, Terracotta, webmethods Store, analyze and respond to patterns in process data, big data, fast data and transaction data in the same platform Streamlined for in-memory and real-time operations (Big Fast Data) Operates on commodity hardware no specialized hardware appliances required Market-leading time-to-value from solution blueprints + integrated platform components Thank you! Dr. Jürgen Krämer [email protected] 29 8