How To Manage Big Data In A Microsoft Cloud (Hadoop)
|
|
- Damon Strickland
- 3 years ago
- Views:
Transcription
1
2 Oracle Database 12c and the Future of Data Warehousing in the Era of Big Data George Lumpkin Data Warehousing Neil Mendelson Big Data & Advanced AnalyEcs Vice Presidents Server Technologies September 29, 2014
3 Safe Harbor Statement The following is intended to outline our general product direceon. It is intended for informaeon purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or funceonality, and should not be relied upon in making purchasing decisions. The development, release, and Eming of any features or funceonality described for Oracle s products remains at the sole discreeon of Oracle. 3
4 Big Data Opportunity Typical use cases in today s world of fast exploraeon of big data Big Data PorZolio Analysis Financial Services Fraud UEliEes Manufacturing Retail Session- izaeon Telcos Call Quality Tracking Stock Market Money Laundering Network Analysis Quality Assessment Supply Planning Buying Pa\erns Returns Fraud SIM Card Fraud Money Laundering Slide - 4
5 Extending Data Management Big Data = Hadoop + NoSQL + Rela5onal Hadoop Change the Business Disrupt compeetors Disintermediate supply chains Leverage new paradigms Exploit new analyses NoSQL Scale the Business Meet mobile challenges Accelerate developer agility Scale- out economically Serve data faster Rela5onal Run the Business Integrate exiseng systems Support mission- criecal tasks Protect exiseng expenditures Insure skills relevance Oracle ConfidenEal Internal/Restricted/Highly Restricted 5
6 But fundamental architectures remain Oracle InformaEon Management Reference Architecture Data IngesEon Access & Performance Layer Past, current and future interpretaeon of Access and enterprise Performance data. Structured to support Layer agile Foundation Data Layer Raw Data Reservoir access & navigaeon Immutable modelled data. Business Process Neutral form. Abstracted from business process changes Immutable raw data reservoir Raw data at rest is not interpreted InformaEon InterpretaEon
7 New features for Data Warehousing and Big Data Oracle Database 12c Release 1 ( ) Oracle Database In- Memory SIMD Vector Processing Column- Store Storage Indexes In- Memory AggregaEon New SQL Capabili5es A\ribute Clustering Zone Maps for Exadata JSON SQL FuncEons Approximate Count DisEnct Big Data SQL Public 7
8 Oracle In- Memory Columnar Technology Pure In- Memory Columnar SALES Pure in- memory column format Not persistent, and no logging 2x to 20x compression Enabled at table or pareeon level Public 8
9 Scans Billions of Rows per Second per CPU Core Memory CPU Load muleple region values REGION Vector Register CA CA CA CA Example: Find all sales in region of CA Vector Compare all values in 1 cycle > 100x Faster Each CPU core scans local in- memory columns Scans use super fast Single InstrucEon muleple Data Values (SIMD) vector instruceons Originally designed for graphics & science Billions of rows/sec scan rate per CPU core Public 9
10 In- Memory Column Store Storage Index In- Memory IMCU IMCU IMCU IMCU SALES ORDER_DATE Min Max Min Max Min Max Min Max Data stored in In- Memory Compression Units (IMCU s) A storage index records min/ max values for each column unit Storage indexes allow IMCU pruning select * from SALES where ORDER_DATE between and
11 In- Memory AggregaEon New opemized algorithm for star query processing Processing steps Transform joins into scan of the fact table Fast in- memory scan with array lookups OpEmize aggregaeon using in- memory arrays OpEmized in- memory data structures Late joins to dimension data Minimizes data movement in the execueon plan Example: Report sales by Quarter and Region Time Quarters Customers Regions Regions In- Memory Report Outline Quarters $ $$ $$$ $ Sales Sales Oracle ConfidenEal Internal/Restricted/Highly Restricted 11
12 Zone Maps and A\ribute Clustering X AUribute Clustering Orders data so that columns values are stored together on disk Zone maps Stores min/max of specified columns per zone Used to filter un- needed data during query execueon Combined Benefits: Improved query performance and concurrency Reduced physical data access Significant IO reduceon for highly seleceve operaeons OpEmized space uelizaeon Less need for indexes Improved compression raeos through data clustering Full applicaeon transparency Any applicaeon will benefit Public 12
13 A\ribute Clustering Concept and Benefits Orders data so that it is in close proximity based on selected columns values: a\ributes A\ributes can be from a single table or muleple tables e.g. from fact and dimension tables Able to cluster data during MOVE PARTITION Benefits Significant IO pruning when used with zone maps Also, reduced block IO for table lookups in index range scans Improved performance for queries that sort and aggregate pre- ordered data Improved compression raeos Ordered data is likely to compress more than unordered data Public 13
14 Zone Maps Persisted storage index X Stores minimum and maximum of specified columns Analogous to a coarse index structure Much more compact than an index Zone maps filter out what you don t need, indexes find what you do need Significant performance benefits with complete applicaeon transparency IO reduceon for table scans with predicates on the table itself or even a joined table using join zone maps (a.k.a. hierarchical zone map ) ParEEoning pruning for every column of a pareeoned table, not only the pareeon key columns Benefits are most significant with ordered data Used in combinaeon with a\ribute clustering or data that is naturally ordered Public 14
15 A\ribute Clustering With Zone Maps Example X CLUSTERING BY INTERLEAVED ORDER (category, country) Zone map benefits are most significant with ordered data INTERLEAVED ORDER Pruning with: SELECT.. FROM table WHERE category = BOYS ; SELECT.. FROM table WHERE country = US SELECT.. FROM table WHERE category = BOYS ; AND country = US
16 Zone Maps with A\ribute Clustering Star Schema Benchmark X Overall, 2.6X elapsed Eme improvement over baseline Comparing with and without zone map and a\ribute clustering Query Elapsed Time Improvements Improvement X Query Step Public 16
17 New Performance Features MulEply the Benefits 100 TB of User Data 10 TB of User Data With 10x Compression 2TB of User Data With ParEEon Pruning 2 TB of User Data 100 GB of User Data 1TB on disk, 1TB in- memory With Storage Indexes and Zone Maps 30 GB of User Data With Smart Scan Sub second Scan No Indexes
18 EvoluEon of AnalyEcal SQL IntroducEon of window funceons StaEsEcal funceons SQL model clause ParEEon Outer Join In- database Data Mining PaUern matching Top N clause Approx Count dis5nct JSON support 8i 9i 10g 11g 12c Enhanced window funceons (percenele, etc) Rollup, grouping sets, cube SQL Pivot Recursive WITH ListAgg, Nth value window
19 Why SQL? 1. Enhanced ProducEvity Using SQL, users simply describe the results they want They do not have to describe how to get those results Widespread availability of SQL skills and tools 2. Increased Performance The SQL engine, not the user, determines how to opemize each query Mature SQL engines have broad arsenal of performance techniques 3. Adaptability SQL has proven extensible to new data types and analyecs
20 Approximate Count DisEnct Not every query requires a completely accurate result How many disenct individuals visited our website last week? New SQL funceon for approximate results for COUNT DISTINCT aggregates APPROX_COUNT_DISTINCT() Approximate results can be significantly faster and use less resources than exact calculaeons 5x to 50x ++ Emes faster (depending upon number of disenct values and complexity of SQL) Accuracy > 97% (with 95% confidence) Public 20
21 Full power of SQL over JSON documents Sample customers document: { "firstname": "John", lastname : "Smith", cused :55241 "age": 25, "address": { "streetaddress": "21 2nd Street", "city": "New York", "state": "NY", "postalcode": "10021, "isbusiness" : false}, "phonenumbers": [ {"type": "home, "number": " }, {"type": "fax "number": " } ] } select J.CUSTOMER_DOC.postalCode, count(*) from JSON_CUSTOMERS J group by J.CUSTOMER_DOC.postalCode; select J.CUSTOMER_DOC.postalCode, sum(s.sales_revenue) from JSON_CUSTOMERS J SALES S where J.CUSTOMER_DOC.custid = S.custid group by J.CUSTOMER_DOC.postalCode;
22 Future of Data Warehousing in the Age of Big Data
23 Barriers to Big Data AdopEon Complexity Skills Lack tools and training to exploit Big Data IT OperaEons ability administer and manage Big Data IntegraEon Adding Big Data to exiseng architecture is complex Too much effort required in data preparaeon Security No clear route to governance or enforcement
24 Big Data Management Hadoop + NoSQL + Rela5onal The Power of Oracle SQL Wide variety of Big Data types Structured data Numeric, string, date, Unstructured data LOBs, Text, XML, JSON, SpaEal, Graph, MulEmedia Rich SQL AnalyEc FuncEons Ranking, Windowing, LAG/LEAD, Aggregate, StaEsEcal, Linear Regression, CorrelaEons, Cross Tabs, Hypothesis TesEng, DistribuEon Fing, 24
25 What gives Exadata extreme performance? Exadata: Applies SmartScan Close to the Data Query Data in RDBMS Oracle SQL Exadata Oracle Exadata Storage Server Oracle Exadata Storage Server
26 Oracle Big Data SQL Exadata & Big Data SQL: Applies SmartScan Close to All Data Query Data in RDBMS and Hadoop Oracle SQL Exadata Fast Massive Parallelism Filtered Locally Minimized Data Movement HDFS Data Node BDS Server HDFS Data Node BDS Server Oracle Exadata Storage Server HDFS Data Node BDS Server Big Data Appliance HDFS Data Node BDS Server Oracle Exadata Storage Server
27 Oracle Big Data SQL: A New Hadoop Processing Engine MapReduce and Hive Processing Layer Spark Impala Search Big Data SQL Resource Management (YARN, cgroups) Storage Layer Filesystem (HDFS) NoSQL Databases (Oracle NoSQL DB, Hbase) Oracle ConfidenEal Internal/Restricted/Highly Restricted 27
28 Apply Advanced Security on Hadoop & NoSQL Same security policies apply to Hadoop & Rela5onal JSON JSON data unconverted in Hadoop SQL Customer data in Oracle RedacEon Virtual Private Database Fine- grain Access Control Hadoop Redacted data subset Oracle Database 12c Small data subset quickly returned DBMS_REDACT.ADD_POLICY( object_schema => 'txadp_hive_01', object_name => 'customer_address_ext', column_name => 'ca_street_name', policy_name => 'customer_address_redaction', function_type => DBMS_REDACT.RANDOM, expression => 'SYS_CONTEXT(''SYS_SESSION_ROLES'', ''REDACTION_TESTER'')=''TRUE''' ); 28
29 Govern and Secure Your Data With Oracle Hadoop, NoSQL & Rela5onal BDA Capability AuthenEcaEon through Kerberos AuthorizaEon through Apache Sentry AudiEng through Oracle Audit Vault EncrypEon for Data- at- Rest Network EncrypEon Big Data SQL adds Advanced Security on Hadoop & NoSQL RedacEon Virtual Private Database Fine- grain Access Control Oracle ConfidenEal Internal 29
30 When eaeng an elephant take one bite at a Eme. General Creighton Abrams
31 Experiment Big Data Appliance X4-2 6 Node Starter Rack 2 * 8 Core Intel Xeon E5 Processors/Node 384 GB / 3 TB (64 GB Memory / expandable to 512 GB/Node) 288 TB (48TB Disk space/node) Integrated So ware Oracle Linux, Oracle Java VM Oracle Big Data SQL*, Oracle Big Data Connectors* Cloudera DistribuEon of Apache Hadoop EDH EdiEon Cloudera Manager Oracle R DistribuEon Oracle NoSQL Database 40 % Cost Savings 33 % Faster Time to Value * Licensed separately 31
32 Data Lifecycle Management & Query Offload More data on- line and available at a lower cost Month 14- n Oracle Big Data SQL Move Par55on to BDA Rolling 13 months Big Data Rolling DRAM Windows Process PCI FLASH Copy older pareeon AcEve to Data BDA Update views Drop older Exadata pareeon Oracle Ho\est Data Warm Data Offloaded Data data can be accessed via Oracle & Hadoop No ApplicaEon changes required Hadoop Data Deep Data
33 Offload ETL from Data Warehouse Offload long running ETL jobs to Hadoop New Sources via Hadoop Leave exiseng ETL in place Sources Staging Files MR Detail MR Temp Fast load Data Warehouse Files SQL Oracle GoldenGate Oracle Data ETL Tool Integrator Oracle Company ConfidenEal 33
34 StaEsEcal & PredicEve AnalyEcs Bring the Analy5cs to the Data Hadoop / Big Data Appliance Oracle R DistribuEon 1 Oracle R Advanced AnalyEcs for Hadoop 2 SAS High Performance AnalyEcs Oracle Database / Exadata Oracle Advanced AnalyEcs OpEon SAS High Performance AnalyEcs 1 Included with BDA 2 Included w/oracle Big Data Connectors
35 Oracle Big Data Discovery + Advanced AnalyEcs Changing the Game for Agile Business Innova5on on Big Data Profile Find Understand Transform Discover Predict Collaborate Easily add data and see it automaecally and conenuously cataloged, enriched and related Use familiar guided search across massive amounts of diverse data Know what s important from diagnosec analysis of millions of data characterisecs Powerful tools to quickly clean up and wrangle dirty data so it s ready to go Uncover valuable new insights Use new insights to define and refine prediceve models Publish, share and evolve as you learn more Oracle ConfidenEal Internal 35
36 Cloud PlaZorm: Big Data AnalyEcs Big Data Service Integrated with DBaaS SQL on Hadoop Hadoop 2.0 Cluster NoSQL Service for key value data Persistent Data Reservoir in Storage Service Single tenant or muletenant IaaS offerings for performance/qos commodity with NAS, Big Data Appliance Big Data Discovery The Visual Face of Big Data Business user and data scienest collaboraeon Self- service data discovery and exploraeon to separate signal from noise Fully managed infrastructure by Oracle Cloud operaeons Hadoop scalability and cost economies 36
37 Summary
38 Oracle Data Warehousing in the era of Big Data Innova5ng and preserving customer investments Leverage 12c innovaeons Real Eme analyecs with Oracle Database In- Memory Performance of Exadata Power of SQL Extend your Data Warehouse with Big Data Oracle SQL across Oracle, Hadoop & NoSQL Fast, massively parallel and interaceve data access Reduced data movement throughout the enterprise Securing access to Big Data analyecs Deploy on choice of private and public Clouds 38
39 39
40
Safe Harbor Statement
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment
More informationOracle Big Data SQL Technical Update
Oracle Big Data SQL Technical Update Jean-Pierre Dijcks Oracle Redwood City, CA, USA Keywords: Big Data, Hadoop, NoSQL Databases, Relational Databases, SQL, Security, Performance Introduction This technical
More informationBig Data SQL and Query Franchising
Big Data SQL and Query Franchising An Architecture for Query Beyond Hadoop Dan McClary, Ph.D. Big Data Product Management Oracle Copyright 2014, Oracle and/or its affiliates. All rights reserved. Safe Harbor
More informationOracle Big Data SQL. Architectural Deep Dive. Dan McClary, Ph.D. Big Data Product Management Oracle
Oracle Big Data SQL Architectural Deep Dive Dan McClary, Ph.D. Big Data Product Management Oracle Copyright 2014, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement The following is
More informationOracle Big Data Building A Big Data Management System
Oracle Big Building A Big Management System Copyright 2015, Oracle and/or its affiliates. All rights reserved. Effi Psychogiou ECEMEA Big Product Director May, 2015 Safe Harbor Statement The following
More informationNews and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren
News and trends in Data Warehouse Automation, Big Data and BI Johan Hendrickx & Dirk Vermeiren Extreme Agility from Source to Analysis DWH Appliances & DWH Automation Typical Architecture 3 What Business
More informationCyber Security With Big Data
Cyber Security With Big Data Fast. Complete. Cost-Effec1ve. Harry J Foxwell, PhD Principal Consultant Oracle Public Sector Oct 2015 Safe Harbor Statement The following is intended to outline our general
More informationCopyright 2012, Oracle and/or its affiliates. All rights reserved.
1 Oracle Big Data Appliance Releases 2.5 and 3.0 Ralf Lange Global ISV & OEM Sales Agenda Quick Overview on BDA and its Positioning Product Details and Updates Security and Encryption New Hadoop Versions
More informationOracle Database 12c Plug In. Switch On. Get SMART.
Oracle Database 12c Plug In. Switch On. Get SMART. Duncan Harvey Head of Core Technology, Oracle EMEA March 2015 Safe Harbor Statement The following is intended to outline our general product direction.
More informationSeamless Access from Oracle Database to Your Big Data
Seamless Access from Oracle Database to Your Big Data Brian Macdonald Big Data and Analytics Specialist Oracle Enterprise Architect September 24, 2015 Agenda Hadoop and SQL access methods What is Oracle
More informationOracle Database In-Memory The Next Big Thing
Oracle Database In-Memory The Next Big Thing Maria Colgan Master Product Manager #DBIM12c Why is Oracle do this Oracle Database In-Memory Goals Real Time Analytics Accelerate Mixed Workload OLTP No Changes
More information2009 Oracle Corporation 1
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material,
More informationPreview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Preview of Oracle Database 12c In-Memory Option 1 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any
More informationOracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya
Oracle Database - Engineered for Innovation Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya Oracle Database 11g Release 2 Shipping since September 2009 11.2.0.3 Patch Set now
More informationTUT NoSQL Seminar (Oracle) Big Data
Timo Raitalaakso +358 40 848 0148 rafu@solita.fi TUT NoSQL Seminar (Oracle) Big Data 11.12.2012 Timo Raitalaakso MSc 2000 Work: Solita since 2001 Senior Database Specialist Oracle ACE 2012 Blog: http://rafudb.blogspot.com
More informationOracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here>
s Big Data solutions Roger Wullschleger DBTA Workshop on Big Data, Cloud Data Management and NoSQL 10. October 2012, Stade de Suisse, Berne 1 The following is intended to outline
More informationUsing RDBMS, NoSQL or Hadoop?
Using RDBMS, NoSQL or Hadoop? DOAG Conference 2015 Jean- Pierre Dijcks Big Data Product Management Server Technologies Copyright 2014 Oracle and/or its affiliates. All rights reserved. Data Ingest 2 Ingest
More informationConstructing a Data Lake: Hadoop and Oracle Database United!
Constructing a Data Lake: Hadoop and Oracle Database United! Sharon Sophia Stephen Big Data PreSales Consultant February 21, 2015 Safe Harbor The following is intended to outline our general product direction.
More informationThe Future of Data Management
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class
More informationMobile Big Data AnalyEcs
Copyright 2014 Splunk Inc. Mobile Big Data AnalyEcs Marc Courtemanche, Sr. Director Alain Brunet, Sr. Lead Developer Vantrix CorporaEon Disclaimer During the course of this presentaeon, we may make forward-
More informationIntegrating Apache Spark with an Enterprise Data Warehouse
Integrating Apache Spark with an Enterprise Warehouse Dr. Michael Wurst, IBM Corporation Architect Spark/R/Python base Integration, In-base Analytics Dr. Toni Bollinger, IBM Corporation Senior Software
More informationUsing distributed technologies to analyze Big Data
Using distributed technologies to analyze Big Data Abhijit Sharma Innovation Lab BMC Software 1 Data Explosion in Data Center Performance / Time Series Data Incoming data rates ~Millions of data points/
More informationOracle Big Data Fundamentals Ed 1 NEW
Oracle University Contact Us: +90 212 329 6779 Oracle Big Data Fundamentals Ed 1 NEW Duration: 5 Days What you will learn In the Oracle Big Data Fundamentals course, learn to use Oracle's Integrated Big
More informationOracle Big Data Strategy Simplified Infrastrcuture
Big Data Oracle Big Data Strategy Simplified Infrastrcuture Selim Burduroğlu Global Innovation Evangelist & Architect Education & Research Industry Business Unit Oracle Confidential Internal/Restricted/Highly
More informationIntegrate Master Data with Big Data using Oracle Table Access for Hadoop
Integrate Master Data with Big Data using Oracle Table Access for Hadoop Kuassi Mensah Oracle Corporation Redwood Shores, CA, USA Keywords: Hadoop, BigData, Hive SQL, Spark SQL, HCatalog, StorageHandler
More informationArchitecting for the Internet of Things & Big Data
Architecting for the Internet of Things & Big Data Robert Stackowiak, Oracle North America, VP Information Architecture & Big Data September 29, 2014 Safe Harbor Statement The following is intended to
More informationOracle Big Data Discovery Unlock Potential in Big Data Reservoir
Oracle Big Data Discovery Unlock Potential in Big Data Reservoir Gokula Mishra Premjith Balakrishnan Business Analytics Product Group September 29, 2014 Copyright 2014, Oracle and/or its affiliates. All
More informationExecutive Summary... 2 Introduction... 3. Defining Big Data... 3. The Importance of Big Data... 4 Building a Big Data Platform...
Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5 Infrastructure Requirements... 5 Solution Spectrum... 6 Oracle s Big Data
More informationActian SQL in Hadoop Buyer s Guide
Actian SQL in Hadoop Buyer s Guide Contents Introduction: Big Data and Hadoop... 3 SQL on Hadoop Benefits... 4 Approaches to SQL on Hadoop... 4 The Top 10 SQL in Hadoop Capabilities... 5 SQL in Hadoop
More informationAn Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise
An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise Solutions Group The following is intended to outline our
More informationOracle Big Data, In-memory, and Exadata - One Database Engine to Rule Them All Dr.-Ing. Holger Friedrich
Oracle Big Data, In-memory, and Exadata - One Database Engine to Rule Them All Dr.-Ing. Holger Friedrich Agenda Introduction Old Times Exadata Big Data Oracle In-Memory Headquarters Conclusions 2 sumit
More informationLuncheon Webinar Series May 13, 2013
Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration
More informationAn Oracle White Paper June 2012. High Performance Connectors for Load and Access of Data from Hadoop to Oracle Database
An Oracle White Paper June 2012 High Performance Connectors for Load and Access of Data from Hadoop to Oracle Database Executive Overview... 1 Introduction... 1 Oracle Loader for Hadoop... 2 Oracle Direct
More informationNative Connectivity to Big Data Sources in MSTR 10
Native Connectivity to Big Data Sources in MSTR 10 Bring All Relevant Data to Decision Makers Support for More Big Data Sources Optimized Access to Your Entire Big Data Ecosystem as If It Were a Single
More informationIntroduction to Hadoop HDFS and Ecosystems. Slides credits: Cloudera Academic Partners Program & Prof. De Liu, MSBA 6330 Harvesting Big Data
Introduction to Hadoop HDFS and Ecosystems ANSHUL MITTAL Slides credits: Cloudera Academic Partners Program & Prof. De Liu, MSBA 6330 Harvesting Big Data Topics The goal of this presentation is to give
More informationBig Data Technologies Compared June 2014
Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development
More informationBIG DATA CAN DRIVE THE BUSINESS AND IT TO EVOLVE AND ADAPT RALPH KIMBALL BUSSUM 2014
BIG DATA CAN DRIVE THE BUSINESS AND IT TO EVOLVE AND ADAPT RALPH KIMBALL BUSSUM 2014 Ralph Kimball Associates 2014 The Data Warehouse Mission Identify all possible enterprise data assets Select those assets
More informationInge Os Sales Consulting Manager Oracle Norway
Inge Os Sales Consulting Manager Oracle Norway Agenda Oracle Fusion Middelware Oracle Database 11GR2 Oracle Database Machine Oracle & Sun Agenda Oracle Fusion Middelware Oracle Database 11GR2 Oracle Database
More informationOracle MulBtenant Customer Success Stories
Oracle MulBtenant Customer Success Stories Mul1tenant Customer Sessions at Customer Session Venue Title SAS Cigna CON6328 Mon 2:45pm SAS SoluBons OnDemand: A MulBtenant Cloud Offering CON6379 Mon 5:15pm
More informationWell packaged sets of preinstalled, integrated, and optimized software on select hardware in the form of engineered systems and appliances
INSIGHT Oracle's All- Out Assault on the Big Data Market: Offering Hadoop, R, Cubes, and Scalable IMDB in Familiar Packages Carl W. Olofson IDC OPINION Global Headquarters: 5 Speen Street Framingham, MA
More informationAn Oracle White Paper June 2013. Oracle: Big Data for the Enterprise
An Oracle White Paper June 2013 Oracle: Big Data for the Enterprise Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5 Infrastructure
More informationSafe Harbor Statement
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment
More informationAGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW
AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this
More informationMain Memory Data Warehouses
Main Memory Data Warehouses Robert Wrembel Poznan University of Technology Institute of Computing Science Robert.Wrembel@cs.put.poznan.pl www.cs.put.poznan.pl/rwrembel Lecture outline Teradata Data Warehouse
More informationInteractive data analytics drive insights
Big data Interactive data analytics drive insights Daniel Davis/Invodo/S&P. Screen images courtesy of Landmark Software and Services By Armando Acosta and Joey Jablonski The Apache Hadoop Big data has
More informationHadoop Ecosystem B Y R A H I M A.
Hadoop Ecosystem B Y R A H I M A. History of Hadoop Hadoop was created by Doug Cutting, the creator of Apache Lucene, the widely used text search library. Hadoop has its origins in Apache Nutch, an open
More informationBest Practices for Hadoop Data Analysis with Tableau
Best Practices for Hadoop Data Analysis with Tableau September 2013 2013 Hortonworks Inc. http:// Tableau 6.1.4 introduced the ability to visualize large, complex data stored in Apache Hadoop with Hortonworks
More informationESS event: Big Data in Official Statistics. Antonino Virgillito, Istat
ESS event: Big Data in Official Statistics Antonino Virgillito, Istat v erbi v is 1 About me Head of Unit Web and BI Technologies, IT Directorate of Istat Project manager and technical coordinator of Web
More informationPlay with Big Data on the Shoulders of Open Source
OW2 Open Source Corporate Network Meeting Play with Big Data on the Shoulders of Open Source Liu Jie Technology Center of Software Engineering Institute of Software, Chinese Academy of Sciences 2012-10-19
More informationOracle BI Roadmap & Visual Analyzer Ljiljana Perica, Oracle Business Solution Leader Ljiljana.perica@oracle.com
Oracle BI Roadmap & Visual Analyzer Ljiljana Perica, Oracle Business Solution Leader Ljiljana.perica@oracle.com Copyright 2015, Oracle and/or its affiliates. All rights reserved. 1 Safe Harbor Statement
More informationSafe Harbor Statement
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment
More informationNoSQL for SQL Professionals William McKnight
NoSQL for SQL Professionals William McKnight Session Code BD03 About your Speaker, William McKnight President, McKnight Consulting Group Frequent keynote speaker and trainer internationally Consulted to
More informationOracle Database In-Memory A Practical Solution
Oracle Database In-Memory A Practical Solution Sreekanth Chintala Oracle Enterprise Architect Dan Huls Sr. Technical Director, AT&T WiFi CON3087 Moscone South 307 Safe Harbor Statement The following is
More informationHDP Hadoop From concept to deployment.
HDP Hadoop From concept to deployment. Ankur Gupta Senior Solutions Engineer Rackspace: Page 41 27 th Jan 2015 Where are you in your Hadoop Journey? A. Researching our options B. Currently evaluating some
More informationHow To Use A Data Center With A Data Farm On A Microsoft Server On A Linux Server On An Ipad Or Ipad (Ortero) On A Cheap Computer (Orropera) On An Uniden (Orran)
Day with Development Master Class Big Data Management System DW & Big Data Global Leaders Program Jean-Pierre Dijcks Big Data Product Management Server Technologies Part 1 Part 2 Foundation and Architecture
More informationOracle Database 11g Comparison Chart
Key Feature Summary Express 10g Standard One Standard Enterprise Maximum 1 CPU 2 Sockets 4 Sockets No Limit RAM 1GB OS Max OS Max OS Max Database Size 4GB No Limit No Limit No Limit Windows Linux Unix
More informationThe Future of Data Management with Hadoop and the Enterprise Data Hub
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah Cofounder & CTO, Cloudera, Inc. Twitter: @awadallah 1 2 Cloudera Snapshot Founded 2008, by former employees of Employees
More informationImplement Hadoop jobs to extract business value from large and varied data sets
Hadoop Development for Big Data Solutions: Hands-On You Will Learn How To: Implement Hadoop jobs to extract business value from large and varied data sets Write, customize and deploy MapReduce jobs to
More informationTrends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum
Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms
More informationBig Data: Are you ready?
Big Data: Are you ready? Oracle Big Data SQL George Bourmas Enterprise Architect EMEA XLOB Enterprise Architects September 13, 2014 Oracle Confidential Internal/Restricted/Highly Restricted Thoughts Things
More informationOracle Big Data Management System
Oracle Big Data Management System A Statement of Direction for Big Data and Data Warehousing Platforms O R A C L E S T A T E M E N T O F D I R E C T I O N A P R I L 2 0 1 5 Disclaimer The following is
More informationWhere is... How do I get to...
Big Data, Fast Data, Spatial Data Making Sense of Location Data in a Smart City Hans Viehmann Product Manager EMEA ORACLE Corporation August 19, 2015 Copyright 2014, Oracle and/or its affiliates. All rights
More informationAn Oracle White Paper November 2010. Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics
An Oracle White Paper November 2010 Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics 1 Introduction New applications such as web searches, recommendation engines,
More informationBig Data Course Highlights
Big Data Course Highlights The Big Data course will start with the basics of Linux which are required to get started with Big Data and then slowly progress from some of the basics of Hadoop/Big Data (like
More informationBig Data Are You Ready? Thomas Kyte http://asktom.oracle.com
Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated
More informationOracle Database 12c for Data Warehousing and Big Data ORACLE WHITE PAPER SEPTEMBER 2014
Oracle Database 12c for Data Warehousing and Big Data ORACLE WHITE PAPER SEPTEMBER 2014 ORACLE DATABASE 12C FOR DATA WAREHOUSING AND BIG DATA Table of Contents Introduction Big Data: The evolution of data
More informationCost-Effective Business Intelligence with Red Hat and Open Source
Cost-Effective Business Intelligence with Red Hat and Open Source Sherman Wood Director, Business Intelligence, Jaspersoft September 3, 2009 1 Agenda Introductions Quick survey What is BI?: reporting,
More informationBig Data on Microsoft Platform
Big Data on Microsoft Platform Prepared by GJ Srinivas Corporate TEG - Microsoft Page 1 Contents 1. What is Big Data?...3 2. Characteristics of Big Data...3 3. Enter Hadoop...3 4. Microsoft Big Data Solutions...4
More informationWho am I? Copyright 2014, Oracle and/or its affiliates. All rights reserved. 3
Oracle Database In-Memory Power the Real-Time Enterprise Saurabh K. Gupta Principal Technologist, Database Product Management Who am I? Principal Technologist, Database Product Management at Oracle Author
More informationBig Data Can Drive the Business and IT to Evolve and Adapt
Big Data Can Drive the Business and IT to Evolve and Adapt Ralph Kimball Associates 2013 Ralph Kimball Brussels 2013 Big Data Itself is Being Monetized Executives see the short path from data insights
More informationBig Data Approaches. Making Sense of Big Data. Ian Crosland. Jan 2016
Big Data Approaches Making Sense of Big Data Ian Crosland Jan 2016 Accelerate Big Data ROI Even firms that are investing in Big Data are still struggling to get the most from it. Make Big Data Accessible
More informationIBM Data Retrieval Technologies: RDBMS, BLU, IBM Netezza, and Hadoop
IBM Data Retrieval Technologies: RDBMS, BLU, IBM Netezza, and Hadoop Frank C. Fillmore, Jr. The Fillmore Group, Inc. Session Code: E13 Wed, May 06, 2015 (02:15 PM - 03:15 PM) Platform: Cross-platform Objectives
More informationGanzheitliches Datenmanagement
Ganzheitliches Datenmanagement für Hadoop Michael Kohs, Senior Sales Consultant @mikchaos The Problem with Big Data Projects in 2016 Relational, Mainframe Documents and Emails Data Modeler Data Scientist
More informationAn Oracle White Paper October 2011. Oracle: Big Data for the Enterprise
An Oracle White Paper October 2011 Oracle: Big Data for the Enterprise Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5
More informationBig Data & QlikView. Democratizing Big Data Analytics. David Freriks Principal Solution Architect
Big Data & QlikView Democratizing Big Data Analytics David Freriks Principal Solution Architect TDWI Vancouver Agenda What really is Big Data? How do we separate hype from reality? How does that relate
More informationSQL Server 2012 Performance White Paper
Published: April 2012 Applies to: SQL Server 2012 Copyright The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication.
More informationBig Data Analytics Platform @ Nokia
Big Data Analytics Platform @ Nokia 1 Selecting the Right Tool for the Right Workload Yekesa Kosuru Nokia Location & Commerce Strata + Hadoop World NY - Oct 25, 2012 Agenda Big Data Analytics Platform
More informationHow To Use Big Data For Telco (For A Telco)
ON-LINE VIDEO ANALYTICS EMBRACING BIG DATA David Vanderfeesten, Bell Labs Belgium ANNO 2012 YOUR DATA IS MONEY BIG MONEY! Your click stream, your activity stream, your electricity consumption, your call
More informationChukwa, Hadoop subproject, 37, 131 Cloud enabled big data, 4 Codd s 12 rules, 1 Column-oriented databases, 18, 52 Compression pattern, 83 84
Index A Amazon Web Services (AWS), 50, 58 Analytics engine, 21 22 Apache Kafka, 38, 131 Apache S4, 38, 131 Apache Sqoop, 37, 131 Appliance pattern, 104 105 Application architecture, big data analytics
More informationAn Oracle White Paper September 2014. Oracle: Big Data for the Enterprise
An Oracle White Paper September 2014 Oracle: Big Data for the Enterprise Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform...
More informationManaging Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database
Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica
More informationPresenters: Luke Dougherty & Steve Crabb
Presenters: Luke Dougherty & Steve Crabb About Keylink Keylink Technology is Syncsort s partner for Australia & New Zealand. Our Customers: www.keylink.net.au 2 ETL is THE best use case for Hadoop. ShanH
More informationOffload Enterprise Data Warehouse (EDW) to Big Data Lake. Ample White Paper
Offload Enterprise Data Warehouse (EDW) to Big Data Lake Oracle Exadata, Teradata, Netezza and SQL Server Ample White Paper EDW (Enterprise Data Warehouse) Offloads The EDW (Enterprise Data Warehouse)
More information<Insert Picture Here> Best Practices for Extreme Performance with Data Warehousing on Oracle Database
1 Best Practices for Extreme Performance with Data Warehousing on Oracle Database Rekha Balwada Principal Product Manager Agenda Parallel Execution Workload Management on Data Warehouse
More informationArchitecture & Experience
Architecture & Experience Data Mining - Combination from SAP HANA, R & Hadoop Markus Severin, Solution Principal Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein
More informationApache Hadoop: The Pla/orm for Big Data. Amr Awadallah CTO, Founder, Cloudera, Inc. aaa@cloudera.com, twicer: @awadallah
Apache Hadoop: The Pla/orm for Big Data Amr Awadallah CTO, Founder, Cloudera, Inc. aaa@cloudera.com, twicer: @awadallah 1 The Problems with Current Data Systems BI Reports + Interac7ve Apps RDBMS (aggregated
More informationOracle: Database and Data Management Innovations with CERN Public Day
Presented to Oracle: Database and Data Management Innovations with CERN Public Day Kevin Jernigan, Oracle Lorena Lobato Pardavila, CERN Manuel Martin Marquez, CERN June 10, 2015 Copyright 2015, Oracle
More informationDell Cloudera Syncsort Data Warehouse Optimization ETL Offload
Dell Cloudera Syncsort Data Warehouse Optimization ETL Offload Drive operational efficiency and lower data transformation costs with a Reference Architecture for an end-to-end optimization and offload
More informationSafe Harbor Statement
Safe Harbor Statement "Safe Harbor" Statement: Statements in this presentation relating to Oracle's future plans, expectations, beliefs, intentions and prospects are "forward-looking statements" and are
More informationDatenverwaltung im Wandel - Building an Enterprise Data Hub with
Datenverwaltung im Wandel - Building an Enterprise Data Hub with Cloudera Bernard Doering Regional Director, Central EMEA, Cloudera Cloudera Your Hadoop Experts Founded 2008, by former employees of Employees
More informationINTRODUCTION TO APACHE HADOOP MATTHIAS BRÄGER CERN GS-ASE
INTRODUCTION TO APACHE HADOOP MATTHIAS BRÄGER CERN GS-ASE AGENDA Introduction to Big Data Introduction to Hadoop HDFS file system Map/Reduce framework Hadoop utilities Summary BIG DATA FACTS In what timeframe
More informationHDP Enabling the Modern Data Architecture
HDP Enabling the Modern Data Architecture Herb Cunitz President, Hortonworks Page 1 Hortonworks enables adoption of Apache Hadoop through HDP (Hortonworks Data Platform) Founded in 2011 Original 24 architects,
More informationDigital Transformation
Digital Transformation The Leadership Edge Pascal Giraud Senior Director EMEA Technology Copyright 2014 Oracle and/or its affiliates. All rights reserved. 2 Enterprise Computing Trends GLOBALIZATION DATA
More informationOracle9i Data Warehouse Review. Robert F. Edwards Dulcian, Inc.
Oracle9i Data Warehouse Review Robert F. Edwards Dulcian, Inc. Agenda Oracle9i Server OLAP Server Analytical SQL Data Mining ETL Warehouse Builder 3i Oracle 9i Server Overview 9i Server = Data Warehouse
More informationGetting Started Practical Input For Your Roadmap
Getting Started Practical Input For Your Roadmap Mike Ferguson Managing Director, Intelligent Business Strategies BA4ALL Big Data & Analytics Insight Conference Stockholm, May 2015 About Mike Ferguson
More informationBIG DATA & ANALYTICS. Transforming the business and driving revenue through big data and analytics
BIG DATA & ANALYTICS Transforming the business and driving revenue through big data and analytics Collection, storage and extraction of business value from data generated from a variety of sources are
More informationInformation Builders Mission & Value Proposition
Value 10/06/2015 2015 MapR Technologies 2015 MapR Technologies 1 Information Builders Mission & Value Proposition Economies of Scale & Increasing Returns (Note: Not to be confused with diminishing returns
More informationDisrupt or be disrupted IT Driving Business Transformation
Disrupt or be disrupted IT Driving Business Transformation Gokula Mishra VP, Big Data & Advanced Analytics Business Analytics Product Group Copyright 2014 Oracle and/or its affiliates. All rights reserved.
More informationUnderstanding the Value of In-Memory in the IT Landscape
February 2012 Understing the Value of In-Memory in Sponsored by QlikView Contents The Many Faces of In-Memory 1 The Meaning of In-Memory 2 The Data Analysis Value Chain Your Goals 3 Mapping Vendors to
More informationSQL - The Goto Language for Big Data Analy&cs!
SQL - The Goto Language for Big Data Analy&cs! Analy&cal SQL SQL Made Great Hermann Bär, hermann.baer@oracle.com Product Management Data Warehousing 1 Who Am I Not?.. But Who SHOULD be Here.. Keith Laker
More information