Artur Borycki. Director International Solutions Marketing

Transcription

1 Artur Borycki Director International Solutions

2 Agenda! Evolution of Teradata s Unified Architecture Analytical and Workloads! Teradata s Reference Information Architecture

3 Evolution of Teradata s" Unified Architecture! Technology Independent! Requirements! Workload Requirements

4 The New Teradata story is an evolution of the original Teradata story INSIGHT ACTION

5 ARCHITECTURAL FRAMEWORK ERP MOVE MANAGE ACCESS Executives SCM CRM WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video Frontline Workers Machine DISCOVERY PLATFORM Analysts Text Scientists Languages Web and Social Engineers SOURCES 5 15/06/14 Teradata Confidential ANALYTIC TOOLS & APPS USERS

6 ARCHITECTURAL FRAMEWORK ERP MOVE MANAGE ACCESS Executives SCM CRM Images PLATFORM WAREHOUSE Predictive, ad-hoc analytics Operational Systems Customers Partners Audio and Video Fast Loading Operational Frontline Workers Machine Filtering and Processing DISCOVERY PLATFORM Analysts Text Online Archival Discovery Analytics Scientists Web and Social Path, graph, time-series analysis Integrated Analytics Languages Engineers SOURCES 6 15/06/14 Teradata Confidential ANALYTIC TOOLS & APPS USERS

7 ENTERPRISE WAREHOUSE Technology Independent ERP MOVE MANAGE ACCESS Executives SCM CRM Integrated Complex SQL Concurrency Workload Mgt Operational Systems Images Customers Partners Audio and Video Machine 100% of Drive is Active ETL Servers for data load and transformations Frontline Workers Analysts Text Scientists Languages Web and Social Engineers SOURCES ANALYTIC TOOLS & APPS USERS

8 Driving the Value of Integrated 8 15/06/14 Teradata Confidential

9 Integrated Warehouse The Solution Integrated Complex SQL Concurrency Workload Management Integrated data provides consistency of data, lower costs, better decisions 9 15/06/14 Teradata Confidential

10 ENTERPRISE WAREHOUSE Value of Integrated Technology Independent ERP Value of Integrated Warehouse $/Value Executives SCM CRM Images Integrated Complex SQL Concurrency Workload Mgt $/Value Operational Systems Customers Partners Audio and Video Machine 100% of Drive is Active ETL Servers for data load and transformations $/TB Frontline Workers Analysts Text Scientists Languages Web and Social Engineers USERS SOURCES ANALYTIC TOOLS & APPS

11 INTEGRATED WAREHOUSE Purpose Built Appliances (RDBMS) Technology Independent ERP Purpose Built Appliances Workload Specific Executives SCM CRM Integrated Complex SQL Concurrency Workload Mgt Operational Systems Images Lower $/TB $/Value Customers Partners Audio and Video Machine 20% of Drive is Active 80% is Virtually Free Storage Parallel ELT $/TB Frontline Workers Analysts Text Labs Statistics Predictive Languages Scientists Web and Social SOURCES Lower $/ Specific Workload $/Insight ANALYTIC TOOLS & APPS Engineers USERS

12 INTEGRATED WAREHOUSE Big Market Changes Technology Independent ERP Evolving Big Requirements Capture All, New Analytics Executives SCM CRM Images Capture all data 10+ Years of History Lower cost ETL Integrated Complex SQL Concurrency Workload Mgt $/Value Operational Systems Customers Partners Audio and Video Machine Text Web and Social SOURCES 20% of Drive is Active 80% is Virtually Free Storage Parallel ELT $/TB MapReduce Unstructured data Flexible modeling Labs SQL Statistics Predictive $/Insight Languages ANALYTIC TOOLS & APPS Frontline Workers Analysts Scientists Engineers USERS

13 UNITFIED ARCHITECTURE Value of IDW Doesn t Go Away Technology Independent ERP IDW Value Remains Analytics and Workloads Critical Executives SCM CRM Operational Systems Images Customers Partners Audio and Video Frontline Workers Machine Capture all data 10+ Years of History Lower cost ETL Analysts Text Scientists Languages Web and Social Engineers SOURCES ANALYTIC TOOLS & APPS USERS

14 UNITFIED ARCHITECTURE Value of IDW Doesn t Go Away Technology Independent ERP Integrated Discovery Platform SQL, MapReduce, Graph, Text Executives SCM CRM Operational Systems Images Customers Partners Audio and Video Frontline Workers Machine Capture all data 10+ Years of History Lower cost ETL INTEGRATED DISCOVERY PLATFORM Analysts Text Scientists Languages Web and Social Engineers SOURCES ANALYTIC TOOLS & APPS USERS

15 Analytics 3.0 (Next Generation Analytics) The Problem The Solution Integrated Discovery Platform (IDP) 15 15/06/14 Teradata Confidential Consistency Reduction in Skills Required Right Analytic for the Job

16 Teradata Aster Discovery Platform 6 Highlights Next-Generation Graph Analytic Engine Over 100 Pre-Built Analytic Functions SNAP Framework for Discovery Analytic Processing Engines New Store: Aster File Store 16 15/06/14 Teradata Confidential

17 UNITFIED ARCHITECTURE Value of IDW Doesn t Go Away Technology Independent ERP Lower $/TB Storage, ETL Investigative Analytics Executives SCM CRM Operational Systems Images PLATFORM Customers Partners Audio and Video Frontline Workers Machine Text Capture all data 10+ Years of History Archival Retrieval Exploratory Analytics Lower cost ETL INTEGRATED DISCOVERY PLATFORM Languages Analysts Scientists Web and Social Engineers SOURCES ANALYTIC TOOLS & APPS USERS

18 One solution, Many uses Contextual Analytics Unrefined Multi-structured data 18 15/06/14 Resource Flexibility Always On Corporate memory Current data IDW data years 1-5 Archival data IDW data years 5-10 Raw data Teradata Confidential Unrefined structured data

19 Hadoop Use Cases Land/source operational data > Only one extract from source system History or long term storage > Low cost storage Preprocess data > Sessionize data, remove XML tags Transformations > Structured and semi-structured Exploration > Investigate value of new data sources Batch scoring Single subject reporting Cost New cost/value equation for data size Depth More data/raw data for small user community Multi-Structure Raw data (typically web logs) stored for later parsing Non-SQL Analytics Workload requires procedural programming or Map Reduce Flexibility Access to raw data, no prod constraints, no IT governance Parallel App that require MPP Application Environment 19 15/06/14 Teradata Confidential

20 Platform Choices: Type Source Final Landing Operations Staging Operations Production Structured Structured Hadoop, EDW, ETL Semi- Structured Structured Unstructured Structured Semi- Structured Semi- Structured Unstructured Semi- Structured Hadoop, ETL Hadoop, ETL Hadoop, ETL Hadoop Parsing, Type Conversion, Validation Parsing, Type Conversion, Validation, Flattening Parsing, Entity Extraction Parsing, Type Conversion, Validation Parsing, Entity Extraction Hadoop, EDW, ETL Hadoop, EDW, ETL Hadoop, EDW, ETL Hadoop, ETL Hadoop Transforma tion, Rule Validation Hadoop, EDW Hadoop, EDW Hadoop, EDW Hadoop Hadoop Unstructured Unstructured Hadoop Parsing Hadoop Indexing Hadoop 20 15/06/14 Teradata Confidential

21 UNIFIED ARCHITECTURE Conceptual View Technology Independent ERP Focus on Workload Whether One or Multiple Systems Executives SCM CRM Images PLATFORM INTEGRATED WAREHOUSE Predictive Analytics Operational Systems Customers Partners Audio and Video Fast Loading & Availability Operational Frontline Workers Machine Filtering & Processing DISCOVERY PLATFORM Analysts Text Web and Social Deep History: Online Archival Discovery Fast-Fail Hypothesis Testing Path, stats, text, graph, time-series analysis Pattern Detection Languages Scientists Engineers SOURCES ANALYTIC TOOLS & APPS USERS

22 TERA UNIFIED ARCHITECTURE System Conceptual View Technology Independent ERP MOVE MANAGE ACCESS Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video $/Value Frontline Workers Machine $/TB INTEGRATED DISCOVERY PLATFORM Analysts Text Scientists Languages Web and Social SOURCES $/Insight ANALYTIC TOOLS & APPS Engineers USERS

23 UNIFIED ARCHITECTURE Technology Independent ERP Each Environment Will Have Different Storage or Capacity Executives SCM CRM PLATFORM INTEGRATED WAREHOUSE Operational Systems Images Customers Partners Audio and Video Frontline Workers Machine Analysts Text INTEGRATED DISCOVERY PLATFORM Scientists Languages Web and Social Engineers SOURCES ANALYTIC TOOLS & APPS USERS

24 UNIFIED ARCHITECTURE Technology Independent ERP Each Environment Will Drive Different Value Executives SCM INTEGRATED WAREHOUSE Operational Systems CRM Images Audio and Video PLATFORM Frontline Workers Customers Partners Machine Text INTEGRATED DISCOVERY PLATFORM Engineers Scientists Web and Social Languages Analysts' SOURCES APPLICATIONS USERS

25 TERA UNIFIED ARCHITECTURE System Conceptual View Technology Independent ERP Which Technology is Best? How Many Systems to Deploy? Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video Frontline Workers Machine INTEGRATED DISCOVERY PLATFORM Analysts Text Scientists Languages Web and Social Engineers SOURCES ANALYTIC TOOLS & APPS USERS

26 TERA UNIFIED ARCHITECTURE Logical System - Software Teradata s Advocated ERP VIEWPOINT MOVE TVI CONNECTORS MDM UNITY MANAGE VIEWPOINT TVI, MDM ACCESS SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video TERA BASE Frontline Workers Machine Text TERA PORTFOLIO FOR HADOOP DISCOVERY PLATFORM Analysts Scientists Languages Web and Social Engineers TERA ASTER BASE SOURCES ANALYTIC TOOLS & APPS USERS

27 TERA UNIFIED ARCHITECTURE Logical System - Software Why 3 Environments? ERP You Can Try Discovery on Hadoop Ease of Use? Performance? Cost? VIEWPOINT TVI CONNECTORS MDM UNITY VIEWPOINT TVI, MDM SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video TERA BASE Frontline Workers Machine Text TERA PORTFOLIO FOR HADOOP DISCOVERY PLATFORM Analysts Scientists Languages Web and Social SOURCES TERA PORTFOLIO FOR HADOOP ANALYTIC TOOLS & APPS Engineers USERS

28 TERA UNIFIED ARCHITECTURE Logical System - Software Why 3 Environments? ERP You Can Try Discovery on Teradata MapReduce?, Graph?, Pre-Built? VIEWPOINT TVI CONNECTORS MDM UNITY VIEWPOINT TVI, MDM SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video TERA BASE Frontline Workers Machine Text TERA PORTFOLIO FOR HADOOP DISCOVERY PLATFORM Analysts Scientists Languages Web and Social TERA BASE Engineers SOURCES ANALYTIC TOOLS & APPS USERS

29 TERA UNIFIED ARCHITECTURE Logical System - Software Why 3 Environments? ERP You Can Use Teradata 1700 DR, HA, Offload, ELT, Historical VIEWPOINT TVI CONNECTORS MDM UNITY VIEWPOINT TVI, MDM SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video TERA BASE Frontline Workers Machine Text TERA BASE 1700 DISCOVERY PLATFORM Analysts Scientists Languages Web and Social Engineers TERA ASTER BASE SOURCES ANALYTIC TOOLS & APPS USERS

30 Customers use cases for the Platform on Teradata Large US Credit Card Company Deep history queries Compliance queries International Telecom In-database mining with SAS Aggregation layer BAR / DR xdr hosting offload Subscriber info Large US Online Retailer Behavioral Analytics Free up capacity on IDW Large US Financial Institution Backup Copy of IDW DR 2 nd copy of IDW Offload Archiving Activity 30 15/06/14 Teradata Confidential

31 TERA UNIFIED ARCHITECTURE Logical System - Software Why 3 Environments? ERP VIEWPOINT TVI CONNECTORS MDM UNITY Hadoop and 1700 Leverage Value of Both VIEWPOINT TVI, MDM SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video Machine TERA BASE 1700 TERA BASE DISCOVERY PLATFORM Frontline Workers Analysts Text TERA PORTFOLIO FOR HADOOP Languages Scientists Web and Social Engineers TERA ASTER BASE SOURCES ANALYTIC TOOLS & APPS USERS

32 TERA UNIFIED ARCHITECTURE Logical System - Software Why 3 Environments? ERP VIEWPOINT TVI CONNECTORS MDM UNITY 1700 and Aster AFS Leverage Value of Both VIEWPOINT TVI, MDM SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video Machine TERA BASE 1700 TERA BASE DISCOVERY PLATFORM Frontline Workers Analysts Text TERA ASTER BASE Languages Scientists Web and Social Engineers TERA ASTER BASE SOURCES ANALYTIC TOOLS & APPS USERS

33 TERA UNIFIED ARCHITECTURE Logical System - Software Workload Decision ERP 1700, Aster AFS, and Hadoop Large Companies May Deploy VIEWPOINT TVI CONNECTORS MDM UNITY VIEWPOINT TVI, MDM SQL-H, UNITY, STUDIO Executives SCM CRM INTEGRATED WAREHOUSE Operational Systems Images PLATFORM Customers Partners Audio and Video TERA BASE 1700 TERA BASE Frontline Workers Machine Text TERA ASTER BASE TERA PORTFOLIO FOR HADOOP DISCOVERY PLATFORM Languages Analysts Scientists Web and Social Engineers TERA ASTER BASE SOURCES ANALYTIC TOOLS & APPS USERS

34 Teradata QueryGrid IDW Discovery TERA BASE TERA ASTER BASE HADOOP TERA ASTER BASE TERA BASE OTHER BASES LANGUAGES Remote, push-down processing in Hadoop Aster functions such as SQL- MapReduce, graph Teradata bases RDBMS bases Leverage Languages such as SAS, Perl, Python, Ruby, R When fully implemented, the Teradata base or the Teradata Aster base will be able to intelligently use the functionality and data of multiple heterogeneous processing engines 34 15/06/14 Teradata Confidential

35 SQL-H 15.0 High Level Description SQL-H 15.0 > Server grammar Simplify via server name > Hadoop import operator Load_from_hcatalog Added server grammar > Hadoop export operator (new) Load_to_hcatalog Query push-down > Qualify both rows and columns Bi-directional data transfer Provide access rights 35 15/06/14 Teradata Confidential

36 BI Tools Query Hadoop Through Teradata 36 15/06/14 Teradata Confidential

37 QueryGrid TM Demo

38 Conquering Telematic Big Hybrid and EV cars generate massive amounts of sensor data Most of this data has little immediate business value Will have high business value when needed How Big? Over 3.3 million Hybrid and EV cars 100 s of sensors per car (battery, speed, safety, chassis, comfort, braking, pedal, ) Over 300 million sensors deployed in Hybrid and EV cars alone; over 10.4 billion sensors for all cars since 2007 Approximately 300TB a year of self-reported Freeze Frame data when collected every 10 minutes, growing to over 5PB s per year by 2020 Requirements: Store massive amounts of data quickly, inexpensively, and in its native format Process data where it resides and with the right analytic engine Make data readily accessible by end-users at time of need Maintain IT governance/controls 800, , , ,000 0 Hybrid and EV Sales (est) 38 15/06/14 Teradata Confidential

39 How Do You Meet These Requirements? Visualization app - Browser / d3.js REST Interface HADOOP RAW MULTI- STRUCTURED Sensor readings. Time-series Freeze Frame when Engine light comes on Freeze_frames 10 s of PB s Teradata QueryGrid TERA PRODUCTION BOM (Bill of Material) Customers Dealers DTC Mfg_plants Parts Service_visits 100 s of TB s 39 15/06/14 Teradata Confidential Administrators can monitor both systems via Teradata Viewpoint

40 Reference Information Architecture Focus on Architecture

41 Layered Architecture USERS BUSINESS ANALYSTS POWER USERS SCIENTISTS LAB Virtual Sandboxes & Prototypes PRESENTATION Application Specific Views AGGREGATIONAL BU Specific Rollups USER OWNED BUSINESS RULES CALCULATION Key Performance Indicators INTEGRATION Integrated Model at Lowest Granularity ATOMIC STAGING 1:1 Source Systems 41 15/06/14 Copyright 2014 Teradata Teradata Confidential TERA CONFIDENTIAL DO NOT COPY OR DISTRIBUTE WITHOUT THE EXPRESS WRITTEN CONSENT OF TERA

42 Reference Information Architecture Version 3.4 October 2013 Sources The entry point into the any system or process that provides data that can or may be used for analysis. These sources can take the form of highly structured, such as a database e.g. RDBMS, or multi structured format such as log data or machine generated data. Acquisition1..n The entry point into the business analy.c systems that acquire data from one or more sources. Metadata Integrated It is the physical instan.a.on of a logical data model. Its purpose is to store data in a single integrated data format, designed to promote cross- func.onal usage.. Access1..n Constructed to maximize user- friendliness and performance in producing the answers to business ques.ons within a secured and controlled environment while insula.ng the user from complexity. Discovery 1..n A data lab or sand box area to support rapid experimentation and evaluation of data with less formality of data governance rules which are applied to the other layers.. Delivery Facilitates use of the data provided by the Access layer and may be in the form of various patterns including on-line analysis, statistical analysis, reporting, dashboard or applications /06/14 Teradata Confidential

43 Teradata Reference Information Architecture Metadata ERP Executives SCM CRM Images Audio and Video Acquisition 1..n Multi Structured Structured Integrated Master Reference Common Summary & Derived Values Access 1..n Logical Structures (e.g., Views) LANGUAGES MATH &STATS &STATS MINING MINING Operational Customers Systems Partners Frontline Frontline Workers Workers Customers Partners Executives Machine Text Events, Interactions & Transactions, Physical Structures BUSINESS INTELLIGENCE APPLICATIONS Engineers Analysts Scientists Scientists Web and Social Discovery 1..n Languages Analysts Engineers SOURCES 43 15/06/14 Teradata Confidential ANALYTIC TOOLS & APPS USERS

44 Why UDA Architecture Framework is important Hadoop JSON Store NoSQL Store 44 15/06/14 Teradata Confidential

45 Teradata Reference Information Architecture - Framework AUDIT & LINEAGE META ERP SCM Acquisition 1..n ARCHIVE Integrated Access 1..n LANGUAGES SCIENTISTS CRM Images Audio and Video Multi - structured Structured Detail data for the advance analytic flow Master Reference Transaction Common Summary & Derived Values needed for AA visualiation Logical Structures (e.g., Views) MATH &STATS &STATS MINING MINING ENGINEERS BUSINESS ANALYTICS CUSTOMERS PARTNERS Machine Text Multi-structure and structure data for advance analytics Events, Interactions & Transaction (HCatalog) Physical Structures Direct Access to HCatalog (Virtual ) BUSINESS INTELLIGENCE APPLICATIONS MARKETING EXECUTIVES FRONTLINE WORKERS Web and Social Discovery Environment 1..n Labs Hadoop Labs SOURCES 45 15/06/14 Teradata Confidential Languages ANALYTIC TOOLS OPERATIONAL SYSTEMS

46 Teradata Reference Information Architecture - Framework AUDIT & LINEAGE META ERP SCM Acquisition 1..n ARCHIVE Integrated Access 1..n LANGUAGES SCIENTISTS CRM Images Audio and Video Machine Text LOADER, ETL, STREAMING Multi - structured Structured Multi-structure and structure data for advance analytics LOADER, ETL, SQL & QUERYGRID Detail data for the advance analytic flow Master Reference Transaction Common Summary & Derived Values Events, Interactions & Transaction (HCatalog) QUERYGRID & SQL needed for AA visualiation Logical Structures (e.g., Views) Physical Structures Direct Access to HCatalog (Virtual ) MATH &STATS &STATS MINING MINING BUSINESS INTELLIGENCE APPLICATIONS ENGINEERS BUSINESS ANALYTICS CUSTOMERS PARTNERS MARKETING EXECUTIVES FRONTLINE WORKERS Web and Social Discovery Environment 1..n Labs Hadoop Labs SOURCES 46 15/06/14 Teradata Confidential Languages ANALYTIC TOOLS OPERATIONAL SYSTEMS

47 UDA / RIA System / technical view Metadata DI Platform Acquisition (1..n) Integrated Access (1..n) Delivery Structure Sources / Text ETL ETL ETL Teradata RDBMS Aster HDFS ELT SQL SQL-MR SQL-H SQL-MR SQL-MR SQL-H Teradata RDBMS Aster SQL-H SQL SQL-MR SQL-H SQL-MR Teradata RDBMS OLAP Reporting Ad hoc Dashboard External Machine / Sensor SQL-H SQL SQL-MR Other FS Archive Online / Offline ETL HDFS (Hcatalog) SQL-H Discovery Aster Hive SQL-H SQL SQL-MR EAI Bus Export Files Intercore Downstream Results Loop Event processing External user files Teradata (Lab) Aster (Discovery) Hodoop (Hive) Discovery & Investigation Loaders 47 15/06/14 Teradata Confidential

48 Teradata Reference Information Architecture - Acquisition AUDIT & LINEAGE META ERP ARCHIVE SCM CRM Images Audio and Video Machine Text LOADER, ETL, STREAMING Acquisition 1..n Multistructured Structured Multi-structure and structure data for advance analytics Acquisition Options (Implementation options: Teradata RDBMS as a regular Acquisition layer LANGUAGES Aster platform for the loading of variable data that are needed to perform advance analytics production tasks Hadoop (HDFS) cluster to store raw data, also use for preprocessing of the data. MATH &STATS &STATS Loading to Acquisition: Standard DI tools (Informatica, Talend, Stage, ) Smart Loader for Hadoop Streaming and even processing tools TTU (Loaders) GCFR loading patterns using TTU Webservices User external files can be loaded using TTU, DI or Teradata Studio ( Labs) MINING MINING BUSINESS INTELLIGENCE Web and Social Discovery Environment 1..n SOURCES Discovery and Labs

49 Teradata Reference Information Architecture - Integrated data AUDIT & LINEAGE META ARCHIVE Acquisition 1..n Multistructured Structured Multi-structure and structure data for advance analytics LOADER, ETL, SQL & SQL-H Integrated Detail data for the advance analytic flow Master Reference Transaction Common Summary & Derived Values Events, Interactions & Transaction (HCatalog) Integrated Options (Implementation options): Teradata RDBMS as a regular data warehouse repository to store data in the detail form transform according to business requirements Aster platform to store preprocess detail data, that will be required to execute analytical functions (those data are logically becoming part of the detail layer core information. Hadoop (HDFS/HCatalog) cluster to store raw transactional data, that represent historical archive that is not needed in the day by day operation. need to be translated to HCatalog in the same structure as hot detail data transformation and population: Standard DI tools (Informatica, Talend, Stage, ) Smart Loader for Hadoop - GCFR transformation patterns - Ansi SQL - SQL-H to read and transform data between UDA platforms.

50 Teradata Reference Information Architecture - Access Layer AUDIT & LINEAGE Integrated Detail data for the advance analytic flow Master Reference Transaction Common Summary & Derived Values Events, Interactions & Transaction (HCatalog) META SQL-H & SQL Access 1..n needed for AA visualisation Logical Structures (e.g., Views) Physical Structures Direct Access to HCatalog (Virtual ) Discovery Environment 1..n LANGUAGES MATH &STATS &STATS MINING MINING BUSINESS INTELLIGENCE APPLICATIONS Languages Access Layer Options (Implementation options): Teradata RDBMS should be use as a prime access component inside UDA, to allow full control and management of the information in the DWH ecosystem Aster platform in Access Layer is use for the execution of the advance analytic tasks in the production regime Hadoop (Hive) can be use to access directly cold data from the HDFS in the integration layer Access to the data: Teradata RDBMS and Aster need to utilize SQL-H capabilities in the control manner, so that from the use access perspective he do not need to understand what technological components are involve the UDA realization. Standard SQL for the Teradata RDBMS SQL-MR for the Aster platform Hive as a SQL emulation on the HDFS data Discovery and Lab users will follow the same logic of using SQL, SQL/MR and SQL-H and a medium to access data from the production areas Discovery and Labs ANALYTIC TOOLS

51 Teradata Reference Information Architecture at Media and Entertainment Company AUDIT & LINEAGE META ARCHIVE ERP Acquisition 1..n Integrated Access 1..n LANGUAGES Executives CRM OTHER QoS Channel Surf LOADER, INFORMATICA, STREAMING Multi - structured QoS, logs Structured Web log for immediate analysis INFORMATICA, SQL Master Reference Transaction Common Summary & Derived Values Events & Interactions SQL needed for AA Logical Structures (e.g., Views) Physical Structures Direct Access to Hadoop MATH &STATS &STATS MINING MINING BUSINESS INTELLIGENCE APPLICATIONS Operational Systems Customers Partners Frontline Workers Analysts Scientists Languages VOD/Web Discovery Environment 1..n Discovery and Labs ANALYTIC TOOLS Engineers USERS

52 The End 52 15/06/14 Teradata Confidential