Einsatzfelder von IBM PureData Systems und Ihre Vorteile demirkaya@de.ibm.com
Agenda Information technology challenges PureSystems and PureData introduction PureData for Transactions PureData for Analytics PureData for Operational Analytics PureData for Hadoop Summary
Technology is the leading force for impacting business Is IT ready for the challenge? New server spending Power & cooling costs Server mgmt & admin costs 1996 29% 2013 68% 68% of IT operating costs in 2013 will be for management and administration * IDC; Converged Systems: End-User Survey Results presentation; September 2012; Doc #236966 Only 1 in 5 organizations allocate more than 50% of IT budget to new projects * 2012 IBM Global Data Center Study
Let s view IT from a new perspective Systems with integrated expertise and built for cloud Integrated by Design Deeply integrate and tune hardware and software Built-in Expertise Capture and automate what experts do Simplify the Experience Make every part of the IT lifecycle easier Get up and running faster: from 4 7 months to hours! Streamline development and operations: months to minutes (with repeatability) Optimize ongoing effort: single management console; no downtime upgrades!
PureSystems simplify the entire systems lifecycle Traditional: Time and effort is spent tuning general purpose components Design / Deploy Manage / Maintain General Purpose Components PureSystems: Custom Built System Reduced Time, Cost and Risk Design / Deploy Manage / Maintain Expert Integrated System
PureSystems simplify each phase of the lifecycle Streamlined: Pre-integrated, pre-tested, ready to run Optimized configurations with high availability Single part to order Advantages for Customers Infrastructure is already pre-installed and tested All HW and SW dependencies are resolved System configured for optimal performance High availability included in System Design DB2 purescale offers continuous availability HW and SW products are bundled for easier implementation
IBM PureData System: Data Platform, built for cloud Workload optimized for high performance, high availability, high scalability Workload optimized performance Data load ready in hours Integrated management Simplified maintenance Data Platform Delivering Data Services Single point of support
Different applications drive different data workloads Order Management Transaction Processing Reporting and Analytics Operational Analytics Any Structure Analytics
Data systems need to be optimized for different data workloads Order Management Transaction Processing Reporting and Analytics Operational Analytics Any Structure Analytics Scalable Transactional Database Analytics Data Warehouse Operational Data Warehouse Map-Reduce Distributed File System
Delivering workload optimized performance System for Transactions System for Analytics System for Operational Analytics System for Hadoop For apps like Order Management Database cluster services optimized for transactional throughput and scalability For apps like Sales Analysis Data warehouse services optimized for high-speed, peta-scale analytics and simplicity For apps like Real-time Fraud Detection Operational data warehouse services optimized to balance high performance analytics and real-time operational throughput For apps like Big Data Exploration Hadoop services optimized for exploration of large volumes of data with any type of structure; and as a queryable archive to augment traditional data warehousing
Data Platform Simplicity & Optimization out-of-the-box Select model for Transactions for Analytics for Operational Analytics for Hadoop Select size Load data Delivering Data Services
System for Transactions Optimized exclusively for transactional data workloads Handles 100+ databases on 1 system Up to 30x database scalability Up to 10x storage space savings Database node recovery in seconds Supports DB2 applications unchanged Supports Oracle Database applications with minimal change
Simplified deployment of high availability Uninterrupted access to data with consistent performance Traditional systems - build it yourself Over several days/weeks: 1.Define High Availability topology 2.Configure HW/SW/Network 3.Set up storage pools 4.Install multiple operating systems 5.Install database instances 6.Set up primary and secondary management systems 7.Set up database members 8.Set up backup processes 9.Test, tune, reconfigure 6-node database cluster PureData System with built-in expertise In minutes, 1.Just specify database, description and topology pattern
Built with DB2 purescale Technology Highly available and scalable database environment with application transparency Work spread across a cluster of nodes Acts as a single database system If one node (member) fails, no disruption to work System automatically detects the failure System automatically routes work to the other members System automatically recovers and restarts the failed member System automatically rebalances work across the members by default Additional nodes can be added Start small and grow
Simplified deployment of multi-tenant databases Deploy topology and databases in minutes using patterns Topology patterns purescale TM Instances Automatically creates, configures and deploys a database system topology with built-in redundancy and high performance Database patterns Automatically creates, configures and deploys IBM or client-specified databases optimized for transactional workloads
Creating a database cluster 1 2 3 4
Creating a database within the cluster 1 2 3 4
Simplified deployment across systems HA Proxy Deploy Software application Caching Server HA Proxy Do you Applicati require on distributed Server deployment? Database Application Server Caching Server Database
Simplified, integrated system management Single pane of glass Consistent IBM PureSystem console to manage all resources and workloads Role-based security and tasks Easy integration with data center monitoring tools and processes System firmware and OS updates applied with no planned downtime Single point of contact for support
PureData TX is optimized for transaction processing out of the box 3x more memory than Competitor OLTP workloads have huge benefits from in memory caching Centralized memory caching for hot / updated pages (built-in DB2 purescale) very efficient to move pages from member in-memory to CF in-memory Nearly all writes go to SSD devices Automatic migration of most important data to the fastest storage (built-in EasyTear)
Simplified capacity upgrades Live upgrade from one configuration to another Upgrade Small 96 cores 32 TB* Medium 192 cores 64 TB* Upgrade Large 384 cores 128 TB* * Raw storage space
PureData for Transactions key ingredients Small 1/4 Med 1/2 Large full Cores 32 96 192 384 More cores to optimize transactional performance DRAM (TB) 1.5 3.1 6.1 Allows more queries to execute entirely in-memory SSD (TB) 4.8 9.6 19.2 Allows placement of most important objects in fastest storage HDD (TB) 32 64 128 High performance storage for today s growing data demands IOPS 375K 750K 1.5M Provides sustained high transactional throughput Advanced Storage Tiering Adaptive Compression up to 10x High Speed Interconnect Dual 10 GB network Automatically migrates most important data to fastest storage Store more data in less space and reduce I/O transfers RDMA low latency, near-linear cluster scalability High speed redundant database connectivity 22
PureData System for Transactions Configurations Standard configurations to choose from T1500-96 (small or ¼ rack) T1500-192 (medium or ½ rack) T1500-384 (large or full rack) NEW Growth on Demand pricing starting with 32 Cores Part Just Name a single part number to order IBM PureData System T1500-96 Appliance Install Appliance + Subscription and Support 12 Months Part Number D0TC0LL IBM PureData System T1500-192 Appliance Install Appliance + Subscription and Support 12 Months D0TC4LL IBM PureData System T1500-384 Appliance Install Appliance + Subscription and Support 12 Months D0TC9LL
IBM PureData System for Analytics Optimized exclusively for analytic data workloads System for Analytics Delivering data services for analytics Speed 10-100x faster than traditional custom systems 1 20x greater concurrency and throughput for tactical queries 2 Patented MPP hardware acceleration (Massively Parallel Processing) Simplicity Data load ready in hours No database indexes No tuning No storage administration Scalability Peta-scale data user capacity Smart Designed to run complex analytics in minutes, not hours 1 Based on IBM customers' reported results. "Traditional custom systems" refers to systems that are Richest set of in-database analytics not professionally pre-built, pre-tested and optimized. Individual results may vary. 2 Based on IBM internal performance benchmarking.
IBM PureData System for Operational Analytics Optimized exclusively for operational analytic data workloads System for Operational Analytics Delivering data services for operational analytics 1. Based on internal tests of prior generation system,, and on system Design for normal operation under expected typical workload. Individual Results may vary. 2. Total raw data capacity based on 1 XLarge configuration with five full rack data expansion add-ons. 3. Based on client testing in the DB2 10 Early Access Program. Speed Handles 1000+ concurrent operational queries 1 Continuous ingest of operational data MPP analytics (Massively Parallel Processing) Simplicity Automatic, policy-based data placement and workload management Integrated management and support Scalabilty Available in multiple sizes with up to a Petabyte of data capacity 2 Smart In-database analytics for leading applications Supports DB2 applications unchanged and Oracle Database apps with minimal change Clients have experienced cases of 10x storage space savings via Adaptive Compression 3
Loading the PureData System for Analytics Data Integration Ab Initio Cloudera Composite Software IBM Big Insights IBM Information Server IBM InfoSphere Streams Informatica Oracle Data Integrator Oracle GoldenGate SAP Business Objects Data In SQL ODBC JDBC OLE-DB 26
Querying the PureData System for Analytics Reporting and Analysis IBM Cognos IBM SPSS IBM Unica Information Builders Kalido KXEN Microsoft Excel MicroStrategy Oracle OBIEE SAP Business Objects SAS Actuate Data Out SQL ODBC JDBC OLE-DB
IBM PureData System for Hadoop Accelerate Hadoop analytics with appliance simplicity System for Hadoop Speed Speed to insight with built-in analytics Speed to value with accelerated deployment Simplicity Ready to load data in hours Integrated system management Appliance approach reduces complexity Single point of support Smart Establish a cost efficient online data archive Easily leverage data across the big data platform Enterprise security, governance and high availability
Part of the IBM Big Data Platform Workload Optimized Solutions for all your analytic needs Analytic Applications BI / Exploration / Functional Industry Predictive Content Reporting Visualization App App Analytics Analytics IBM Big Data Platform Visualization & Discovery Application Development Systems Management Accelerators Hadoop System Stream Computing Data Warehouse Information Integration & Governance PureData System for (Operational) Analytics
Thank you!