Data Management in der Ära von Big Data

Transcription

1 Data Management in der Ära von Big Data Eine neue Generation der Geschwindigkeit und Effizienz Harald Gröger IBM Big Data 2013 IBM Corporation

2 IBM Big Data Strategie: Analyse näher zu den Daten bringen Ingestion and Real-time Analytic Zone and Reporting Zone Warehousing Zone BI & Reporting Connectors Enterprise Warehouse Predictive MapReduce Hive/HBase Col Stores Data Marts Documents in variety of formats Landing and Sandbox Zone Integration and Governance Zone

3 Analyze amounts of data data that were impossible to analyze before (in time) T-Mobile scales engineering success with PureData System for Need Everything that we do with Netezza was pretty much impossible before. It was a complete change in our experience of data warehousing when we moved to Netezza. Christine Twinord, Manager of Network Solutions, T-Mobile USA They have even begun an initiative with social networking analytics, where they have been able to access in real-time, which can help to prevent churn Provide end-to-end extraction for downstream applications including revenue assurance, billing and customer care. Provide longer retention and more meaningful results for click stream data Benefits Reduce tax and call-routing fees by using the data stored to defend against false claims Acquire dropped-call and churn-reduction analysis capabilities Increase network availability by identifying and fixing any network holes Storage capacity increased from 100 TB to 2 PB IBM PureData System for (powered by Netezza technology)

4 IBM Big Data Referenzen Ingestion and Real-time Analytic Zone and Reporting Zone Warehousing Zone Connectors MapReduce Hive/HBase Col Stores T-Mobile USA analytics Enterprise Warehouse false claims churn reduction network Data availability Marts PD4A / NZ BI & Reporting Predictive Documents in variety of formats Landing and Sandbox Zone Integration and Governance Zone

5 Petabyte analysis in hours with reduced IT and reduced financial risk Vestas optimizes capital investments based on 2.5 Petabytes of information Need We can give customers much better financial warrantees than we have been able to in the past and can provide a solid business case that is on par with any other investment that they may have. Lars Christian Christensen, Vice President, Vestas Wind Systems A/S Wind turbines are a multi-million dollar investment with a lifespan of 20 to 30 years. A large number of location-dependent factors must be considered including temperature, precipitation, wind velocity, humidity, and atmospheric pressure. Model the weather to optimize placement of turbines, maximizing power generation and longevity Benefits Reduce time required to identify placement of turbine from weeks to hours Reduces IT footprint and costs, and decreases energy consumption by 40 % -- while increasing computational power Incorporate 2.5 PB of structured and semistructured information flows. Data volume expected to grow to 6 PB IBM InfoSphere BigInsights

6 IBM Big Data Referenzen Ingestion and Real-time Analytic Zone and Reporting Zone Warehousing Zone Connectors VestasMapReduce 2.5 PB (weather model) optimize placement maximize power maximize longevity BigInsights Documents in variety of formats Hive/HBase Col Stores T-Mobile USA analytics Enterprise Warehouse false claims churn reduction network Data availability Marts PD4A / NZ BI & Reporting Predictive Landing and Sandbox Zone Integration and Governance Zone

7 Early warnings based on subtle moment-bymoment changes I could see that there were enormous opportunities to capture, store and utilize this data in real time to improve the quality of care for neonatal babies. Dr. Carolyn McGregor, Canada Research Chair in Health Informatics, University of Ontario Institute of Technology Holds the potential to give clinicians an unprecedented ability to interpret vast amounts of heterogeneous data in real time, enabling them to spot subtle trends Provides a flexible platform that can adapt to a wide variety of medical monitoring needs University of Ontario Institute of Technology (UOIT) uses big data to improve quality of care for neonatal babies Need Performing real-time analytics using physiological data from neonatal babies Continuously correlates data from medical monitors to detect subtle changes and alert hospital staff sooner Early warning gives caregivers the ability to proactively deal with complications Benefits: Detecting life threatening conditions 24 hours sooner than symptoms exhibited Lower morbidity and improved patient care IBM InfoSphere IBM DB2

8 IBM Big Data Referenzen Ingestion and Real-time Analytic Zone and Reporting Zone Connectors University of Ontario early warning (babies) detect subtle changes 24 h before symptoms lower morbidity VestasMapReduce 2.5 PB (weather model) optimize placement maximize power maximize longevity BigInsights Documents in variety of formats Hive/HBase Col Stores Warehousing Zone T-Mobile USA analytics Enterprise Warehouse false claims churn reduction network Data availability Marts PD4A / NZ BI & Reporting Predictive Landing and Sandbox Zone Integration and Governance Zone

9 Single view across all data silos to reduce cost and improve productivity Leading insurance provider call center enables 14,000 agents with single view of customer and product data Need The company has reduced costs to hire and train new agents, and InfoSphere Data Explorer Case has Study delivered link value equal to 141 fulltime employees, saving USD11.2 million per year. mon/ssi/ecm/en/imc14799usen /IMC14799USEN.PDF Call center agents sometimes had to access all applications to handle just one call opening multiple windows and jumping from one application to the next. Integrate huge volumes of data from across multiple sources and applications and effectively support managing inbound customer calls. Seamlessly connect disparate data sources and provide quick, fluid access to organizational information in a single unified view from one access point Inefficient access to huge volumes of siloed customer and product data reduced agent productivity and increased average call handle time. Agents needed faster access to information Benefits Improved productivity for 14,000 agents, saving an average of 3 seconds on call handle time, and millions of dollars annually Helped ensure percent uptime at every location, delivering a commanding query-persecond speed Improved application performance to support daily operations and business users at 180 sites IBM InfoSphere Data Explorer

10 IBM Big Data Referenzen Ingestion and Real-time Analytic Zone and Reporting Zone Connectors University of Ontario early warning (babies) detect subtle changes 24 h before symptoms lower morbidity VestasMapReduce 2.5 PB (weather model) optimize placement maximize power maximize longevity BigInsights Documents in variety of formats Hive/HBase Col Stores Warehousing Zone T-Mobile USA analytics Enterprise Warehouse false claims churn reduction network Data availability Marts PD4A / NZ Insurance Provider single BI view & on Reporting customer > agents 180 sites saves Predictive 3 sec per call 11.2 mio $ savings per year Data Explorer Landing and Sandbox Zone Integration and Governance Zone

11 IBM bietet eine komplette Plattform für Analysen Ingestion and Real-time Analytic Zone and Reporting Zone Industry App System BLU Acceleration Predictive Big SQL Application Development Functional App Connectors Data Warehouse Content 2 H 1 3 Information Integration & Governance Landing and Sandbox Zone Integration and Governance Zone Analytic Applications Systems Management Exploration / Stream Computing BI / Reporting Warehousing Zone

12 Data Management in der Ära von Big Data Eine neue Generation der Geschwindigkeit und Effizienz Datenbank-Analyse PureData, DB2 BLU Stream Computing Kosteneffektive Analyse InfoSphere BigInsights, BigSQL, PureData Datenstrom-Analyse InfoSphere Beschleunigte Analyse System Soziale Medien, Maschinen, Mining, Zeitreihen Systems Management IBM Big Data Platform Data Warehouse Application Development Accelerators BI / Reporting Exploration / Functional App Industry App Predictive Analytic Applications Erforschende Analyse InfoSphere Data Explorer Content Integration und Governance Information Integration & Governance InfoSphere Information Server, Optim, Guardium