Använd SAS för att bearbeta och analysera ditt data i Hadoop

Size: px
Start display at page:

Download "Använd SAS för att bearbeta och analysera ditt data i Hadoop"

Transcription

1 make connections share ideas be inspired Använd SAS för att bearbeta och analysera ditt data i Hadoop Mikael Turvall

2 Arkitektur SAS VISUAL ANALYTICS and SAS VISUAL STATISTICS SAS IN-MEMORY STATISTICS FOR HADOOP BLADE ENVIRONMENT MPP DATASTORE WEB-BASED CLIENT SAS VA/VS SAS Studio METADATA SERVER (Optional) MID-TIER WORKSPACE SERVER IN-MEMORY STORE SAS LASR ANALYTIC SERVER Hadoop Cloudera Hortonworks SAS Embedded Process Hadoop Teradata Pivotal Oracle RDBMS Nonrelational Click Stream PC Files Other

3 Varför? Hadoop som en platform för data Hadoop som kärnan i nästa generations analysplatform EVALUATE / MONITOR RESULTS IDENTIFY / FORMULATE PROBLEM DATA PREPARATION DEPLOY MODEL DATA EXPLORATION VALIDATE MODEL BUILD MODEL TRANSFORM & SELECT

4 DEPLOY & MONITOR Från data till beslut SAS/ACCESS SAS Data Management SAS Federation Server SAS Data Loader for Hadoop MANAGE DATA DATA EXPLORE SAS Visual Analytics SAS In-memory Statistics for Hadoop TEXT SAS Scoring Accelerator for Hadoop SAS Code Accelerator for Hadoop DEVELOP MODELS SAS HPA Products SAS Visual Statistics SAS In-memory Statistics for Hadoop SAS Enterprise Miner

5 Kom igång snabbt Möjligheter Transparent access till Hadoop-tabeller i vanliga SAS-library Man kan programmera i SAS SQL och SAS datasteg som vanligt Man kan hantera Hadoop från SAS: Native HDFS kommandon MapReduce, Pig, och HiveQL Fördelar Man behöver inte vara expert på Hadoopspecifik syntax Byta till Hadoop är lika enkelt som att byta ett libname Befintliga SAS program, rapproter, etc. kan återanvändas Många olika sätt att accessa data ger IT olika möjligheter att utnyttja kapaciteten MAN KAN BÖRJA IDAG

6 Var får jag tag i Hadoop?

7 SAS/ACCESS to Hadoop HADOOP SAS SERVER Hive QL Flytta delar av jobbet in i Hadoop

8 Komma igång med Hadoop libname elefant hadoop PORT=10000 SERVER=sascldserv02 USER=hadoop PASSWORD= hadoop" ;

9 Hadoop Filename Statement FILENAME hdpfile1 hadoop "/user/hadoop/gutenberg/pg20417.txt" cfg="c:\users\hadoop_config.xml" user='hadoop' ; Definiera en fileref DATA my_analysis_data; INFILE hdpfile1 ; INPUT ; RUN; Använd den som vanligt OBS! Flytta inte över ALL data i till en SAS-tabell

10 Hadoop File Reader SAS 9.4 kan läsa icke-hive -filer som tabeller Filformatformat Delimited CSV XML JSON (experimental) Binary files Multipla filer i en katalog

11 Hadoop File Reader libname HDP hadoop user=hadoop pw=hadoop config = '/home/sasinst/hadoop_config.xml hdfs_tempdir = '/user/hadoop/tmp hdfs_metadir = '/user/hadoop/metadata hdfs_permdir = '/user/hadoop/dataload' ; proc hdmd name=hdp.pipedata_dept format=delimited sep = ' DATA_FILE='pipedata_dept.txt' ; COLUMN col1 int; COLUMN col2 char(15); run; proc print data=hdp.pipedata_dept; run; Definiera ett libname Specificera filformatet Använd den som vanligt

12 DI Studio Access data in Hadoop Transform data inside Hadoop using HiveQL Creating new data in Hadoop

13 SPDE Traditionellt filsystem libname spdlib spde /path ; proc print data=spdlib.mytab; run; SPDE Open/read/close mytab.mdf Open/read/close mytab.dpf1 Open/read/close mytab.dpf2 t k i o e mytab.mdf mytab.dpf1 mytab.dpf2

14 SPDE - Hadoop HDFS libname spdlib spde /path hdfshost=default; proc print data=spdlib.mytab; run; Get data block locations Namenode Get data Datanode SPDE Open/read/close mytab.mdf Open/read/close mytab.dpf1 Open/read/close mytab.dpf2 H D F S C l i e n t Get data Get data M1 D1 Datanode D2 Datanode D1 D2

15 Nästa steg - SAS-jobb i Hadoop SAS SERVER SAS Data Step & DS2 HADOOP SAS Data Loader for Hadoop SAS Code Accelerator for Hadoop SAS Scoring Accelerator for Hadoop

16 SAS Data Director SAS Data Loader for Hadoop User Name What directive do you want to perform? Show: All Directives Saved Directives Open a previously created directive to run, view, or edit. Schedule a Directive to Run Schedule a directive to run at specified dates and times Chain Directives Together Run a number of directives in a specific order. Copy Data for Visualization Copy data from Hadoop and load it into LASR for visualization. Existing data in the target table will be replaced. Copy Data to Hadoop Copy data from a source and load it into Hadoop. Existing data in the target file will be replaced. Join Tables in Hadoop Create a table in Hadoop from multiple tables. Pivot a Table in Hadoop Transpose the columns of a table in Hadoop. Transform Data in Hadoop Transform the data in an Hadoop data file. 1 Click Verify Mailing Address Check the validity of the mailing address data in a table. Profile Data Create a report profiling the data in a table. Generate Business Rules Analyze data in a table and generate business rules. Send Data for Remediation Select data to send to the remediation queue for further action.

17 DEPLOY & MONITOR Från data till beslut SAS/ACCESS SAS Data Management SAS Federation Server SAS Data Loader for Hadoop MANAGE DATA DATA EXPLORE SAS Visual Analytics SAS In-memory Statistics for Hadoop TEXT SAS Scoring Accelerator for Hadoop SAS Code Accelerator for Hadoop DEVELOP MODELS SAS HPA Products SAS Visual Statistics SAS In-memory Statistics for Hadoop SAS Enterprise Miner

18 make connections share ideas be inspired

Paper SAS033-2014 Techniques in Processing Data on Hadoop

Paper SAS033-2014 Techniques in Processing Data on Hadoop Paper SAS033-2014 Techniques in Processing Data on Hadoop Donna De Capite, SAS Institute Inc., Cary, NC ABSTRACT Before you can analyze your big data, you need to prepare the data for analysis. This paper

More information

WHAT S NEW IN SAS 9.4

WHAT S NEW IN SAS 9.4 WHAT S NEW IN SAS 9.4 PLATFORM, HPA & SAS GRID COMPUTING MICHAEL GODDARD CHIEF ARCHITECT SAS INSTITUTE, NEW ZEALAND SAS 9.4 WHAT S NEW IN THE PLATFORM Platform update SAS Grid Computing update Hadoop support

More information

QUEST meeting Big Data Analytics

QUEST meeting Big Data Analytics QUEST meeting Big Data Analytics Peter Hughes Business Solutions Consultant SAS Australia/New Zealand Copyright 2015, SAS Institute Inc. All rights reserved. Big Data Analytics WHERE WE ARE NOW 2005 2007

More information

Hadoop & SAS Data Loader for Hadoop

Hadoop & SAS Data Loader for Hadoop Turning Data into Value Hadoop & SAS Data Loader for Hadoop Sebastiaan Schaap Frederik Vandenberghe Agenda What s Hadoop SAS Data management: Traditional In-Database In-Memory The Hadoop analytics lifecycle

More information

Hortonworks & SAS. Analytics everywhere. Page 1. Hortonworks Inc. 2011 2014. All Rights Reserved

Hortonworks & SAS. Analytics everywhere. Page 1. Hortonworks Inc. 2011 2014. All Rights Reserved Hortonworks & SAS Analytics everywhere. Page 1 A change in focus. A shift in Advertising From mass branding A shift in Financial Services From Educated Investing A shift in Healthcare From mass treatment

More information

ANALYTICS MODERNIZATION TRENDS, APPROACHES, AND USE CASES. Copyright 2013, SAS Institute Inc. All rights reserved.

ANALYTICS MODERNIZATION TRENDS, APPROACHES, AND USE CASES. Copyright 2013, SAS Institute Inc. All rights reserved. ANALYTICS MODERNIZATION TRENDS, APPROACHES, AND USE CASES STUNNING FACT Making the Modern World: Materials and Dematerialization - Vaclav Smil Trends in Platforms Hadoop Microsoft PDW COST PER TERABYTE

More information

Gør dine big data klar til analyse på en nem måde med Hadoop og SAS Data Loader for Hadoop. Jens Dahl Mikkelsen SAS Institute

Gør dine big data klar til analyse på en nem måde med Hadoop og SAS Data Loader for Hadoop. Jens Dahl Mikkelsen SAS Institute Gør dine big data klar til analyse på en nem måde med Hadoop og SAS Data Loader for Hadoop Jens Dahl Mikkelsen SAS Institute Indhold Udfordringer for analytikeren Hvordan kan SAS Data Loader for Hadoop

More information

SAS Visual Analytics: Arkitektur, data flow og administration

SAS Visual Analytics: Arkitektur, data flow og administration make connections share ideas be inspired SAS Visual Analytics: Arkitektur, data flow og administration Jens Dahl Mikkelsen, SAS Institute Agenda SAS Visual Analytics-komponenter Blade server-miljø Arkitektur

More information

and Hadoop Technology

and Hadoop Technology SAS and Hadoop Technology Overview SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2015. SAS and Hadoop Technology: Overview. Cary, NC: SAS Institute

More information

DATA VISUALIZATION: CONVERTING INFORMATION TO DECISIONS DAVID FRONING, PRINCIPAL PRODUCT MANAGER

DATA VISUALIZATION: CONVERTING INFORMATION TO DECISIONS DAVID FRONING, PRINCIPAL PRODUCT MANAGER DATA VISUALIZATION: CONVERTING INFORMATION TO DECISIONS DAVID FRONING, PRINCIPAL PRODUCT MANAGER SAS WHO WE ARE World leader in analytics Founded in 1976 400 offices world-wide Used at 65,000 sites in

More information

Introduktion till SAS 9 Plattformen Helikopterkursen

Introduktion till SAS 9 Plattformen Helikopterkursen Introduktion till SAS 9 Plattformen Helikopterkursen Kursens mål: Denna kurs/workshop ger dig en samlad överblick över den nye SAS 9 Intelligenta Plattformen. Denna dag är en bra start för att förstå SAS

More information

Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d. DATA MANAGEMENT FOR ANALYTICS

Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d. DATA MANAGEMENT FOR ANALYTICS DATA MANAGEMENT FOR ANALYTICS WHAT IS ANALYTICS? A VERY BROAD TERM OFTEN CONFUSED Descriptive What happened? When? Why? Advanced What will happen? When? Why? How do we benefit? What actions should I take?

More information

Bringing the Power of SAS to Hadoop. White Paper

Bringing the Power of SAS to Hadoop. White Paper White Paper Bringing the Power of SAS to Hadoop Combine SAS World-Class Analytic Strength with Hadoop s Low-Cost, Distributed Data Storage to Uncover Hidden Opportunities Contents Introduction... 1 What

More information

EMC Federation Big Data Solutions. Copyright 2015 EMC Corporation. All rights reserved.

EMC Federation Big Data Solutions. Copyright 2015 EMC Corporation. All rights reserved. EMC Federation Big Data Solutions 1 Introduction to data analytics Federation offering 2 Traditional Analytics! Traditional type of data analysis, sometimes called Business Intelligence! Type of analytics

More information

SAS 9.3 Intelligence Platform

SAS 9.3 Intelligence Platform SAS 9.3 Intelligence Platform Data Administration Guide Second Edition SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2012. SAS 9.3 Intelligence

More information

9.4 SPD Engine: Storing Data in the Hadoop Distributed File System

9.4 SPD Engine: Storing Data in the Hadoop Distributed File System SAS 9.4 SPD Engine: Storing Data in the Hadoop Distributed File System Third Edition SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2015. SAS 9.4

More information

IBM BigInsights Has Potential If It Lives Up To Its Promise. InfoSphere BigInsights A Closer Look

IBM BigInsights Has Potential If It Lives Up To Its Promise. InfoSphere BigInsights A Closer Look IBM BigInsights Has Potential If It Lives Up To Its Promise By Prakash Sukumar, Principal Consultant at iolap, Inc. IBM released Hadoop-based InfoSphere BigInsights in May 2013. There are already Hadoop-based

More information

Constructing a Data Lake: Hadoop and Oracle Database United!

Constructing a Data Lake: Hadoop and Oracle Database United! Constructing a Data Lake: Hadoop and Oracle Database United! Sharon Sophia Stephen Big Data PreSales Consultant February 21, 2015 Safe Harbor The following is intended to outline our general product direction.

More information

Data processing goes big

Data processing goes big Test report: Integration Big Data Edition Data processing goes big Dr. Götz Güttich Integration is a powerful set of tools to access, transform, move and synchronize data. With more than 450 connectors,

More information

Hadoop Job Oriented Training Agenda

Hadoop Job Oriented Training Agenda 1 Hadoop Job Oriented Training Agenda Kapil CK hdpguru@gmail.com Module 1 M o d u l e 1 Understanding Hadoop This module covers an overview of big data, Hadoop, and the Hortonworks Data Platform. 1.1 Module

More information

What does SAS Data Management do? Why is SAS Data Management important? For whom is SAS Data Management designed? Key Benefits

What does SAS Data Management do? Why is SAS Data Management important? For whom is SAS Data Management designed? Key Benefits Fact Sheet What does SAS Data Management do? SAS Data Management helps transform, integrate, govern and secure data while improving its overall quality and reliability. Why is SAS Data Management important?

More information

In-Memory Analytics for Big Data

In-Memory Analytics for Big Data In-Memory Analytics for Big Data Game-changing technology for faster, better insights WHITE PAPER SAS White Paper Table of Contents Introduction: A New Breed of Analytics... 1 SAS In-Memory Overview...

More information

Document Type: Best Practice

Document Type: Best Practice Global Architecture and Technology Enablement Practice Hadoop with Kerberos Deployment Considerations Document Type: Best Practice Note: The content of this paper refers exclusively to the second maintenance

More information

Building & Optimizing Enterprise-class Hadoop with Open Architectures Prem Jain NetApp

Building & Optimizing Enterprise-class Hadoop with Open Architectures Prem Jain NetApp Building & Optimizing Enterprise-class Hadoop with Open Architectures Prem Jain NetApp Introduction to Hadoop Comes from Internet companies Emerging big data storage and analytics platform HDFS and MapReduce

More information

Collaborative Big Data Analytics. Copyright 2012 EMC Corporation. All rights reserved.

Collaborative Big Data Analytics. Copyright 2012 EMC Corporation. All rights reserved. Collaborative Big Data Analytics 1 Big Data Is Less About Size, And More About Freedom TechCrunch!!!!!!!!! Total data: bigger than big data 451 Group Findings: Big Data Is More Extreme Than Volume Gartner!!!!!!!!!!!!!!!

More information

9.4 Hadoop Configuration Guide for Base SAS. and SAS/ACCESS

9.4 Hadoop Configuration Guide for Base SAS. and SAS/ACCESS SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS Second Edition SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2015. SAS 9.4 Hadoop

More information

Bringing the Power of SAS to Hadoop

Bringing the Power of SAS to Hadoop Bringing the Power of SAS to Hadoop Combine SAS World-Class Analytic Strength with Hadoop s Low-Cost, High-Performance Data Storage and Processing to Get Better Answers, Faster WHITE PAPER SAS White Paper

More information

Tips and Techniques for Efficiently Updating and Loading Data into SAS Visual Analytics

Tips and Techniques for Efficiently Updating and Loading Data into SAS Visual Analytics Paper SAS1905-2015 Tips and Techniques for Efficiently Updating and Loading Data into SAS Visual Analytics Kerri L. Rivers and Christopher Redpath, SAS Institute Inc., Cary, NC ABSTRACT So you have big

More information

GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION

GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION Syed Rasheed Solution Manager Red Hat Corp. Kenny Peeples Technical Manager Red Hat Corp. Kimberly Palko Product Manager Red Hat Corp.

More information

Microsoft + SOA = Sant? Joakim Linghall Principal System Engineer SOA and Business Process joakiml@microsoft.com

Microsoft + SOA = Sant? Joakim Linghall Principal System Engineer SOA and Business Process joakiml@microsoft.com Microsoft + SOA = Sant? Joakim Linghall Principal System Engineer SOA and Business Process joakiml@microsoft.com Agenda Real World SOA En plattform för SOA ESB SOA Governance Exempel Lite om framtiden

More information

Qsoft Inc www.qsoft-inc.com

Qsoft Inc www.qsoft-inc.com Big Data & Hadoop Qsoft Inc www.qsoft-inc.com Course Topics 1 2 3 4 5 6 Week 1: Introduction to Big Data, Hadoop Architecture and HDFS Week 2: Setting up Hadoop Cluster Week 3: MapReduce Part 1 Week 4:

More information

Architecting the Future of Big Data

Architecting the Future of Big Data Hive ODBC Driver User Guide Revised: July 22, 2014 2012-2014 Hortonworks Inc. All Rights Reserved. Parts of this Program and Documentation include proprietary software and content that is copyrighted and

More information

SAS Data Integration SAS Business Intelligence

SAS Data Integration SAS Business Intelligence Kursöversikt 2010 SAS Education Providing knowledge through global training and certification SAS Data Integration SAS Business Intelligence Specialkurser SAS Forum 2010 Kontaktinformation Stora Frösunda

More information

Books-by-Users Web Development with SAS by Example (Third Edition) Frederick E. Pratter

Books-by-Users Web Development with SAS by Example (Third Edition) Frederick E. Pratter Books-by-Users Web Development with SAS by Example (Third Edition) Frederick E. Pratter Click Tom to Kari, edit Master Statistics subtitle style 07/06/12 Come out of the desert of ignorance to the OASUS

More information

The SAS Software installed and referred to throughout is: SAS 9.4M2 SAS High Performance Analytics 2.8 SAS Visual Analytics 6.4

The SAS Software installed and referred to throughout is: SAS 9.4M2 SAS High Performance Analytics 2.8 SAS Visual Analytics 6.4 Deploying SAS High Performance Analytics (HPA) and Visual Analytics on the Oracle Big Data Appliance and Oracle Exadata Paul Kent, SAS, VP Big Data Maureen Chew, Oracle, Principal Software Engineer Gary

More information

Cloudera Manager Training: Hands-On Exercises

Cloudera Manager Training: Hands-On Exercises 201408 Cloudera Manager Training: Hands-On Exercises General Notes... 2 In- Class Preparation: Accessing Your Cluster... 3 Self- Study Preparation: Creating Your Cluster... 4 Hands- On Exercise: Working

More information

Comprehensive Analytics on the Hortonworks Data Platform

Comprehensive Analytics on the Hortonworks Data Platform Comprehensive Analytics on the Hortonworks Data Platform We do Hadoop. Page 1 Page 2 Back to 2005 Page 3 Vertical Scaling Page 4 Vertical Scaling Page 5 Vertical Scaling Page 6 Horizontal Scaling Page

More information

SAS In-Database. Forum Analytique d'affaires SAS 1 Déc. 2010. Ronald Allard SAS Montréal. Copyright 2010 SAS Institute Inc. All rights reserved.

SAS In-Database. Forum Analytique d'affaires SAS 1 Déc. 2010. Ronald Allard SAS Montréal. Copyright 2010 SAS Institute Inc. All rights reserved. SAS In-Database Forum Analytique d'affaires SAS 1 Déc. 2010 Ronald Allard SAS Montréal Copyright 2010 SAS Institute Inc. All rights reserved. Agenda Défis des entreprises Qu est-ce que SAS In-Database?

More information

Hadoop Evolution In Organizations. Mark Vervuurt Cluster Data Science & Analytics

Hadoop Evolution In Organizations. Mark Vervuurt Cluster Data Science & Analytics In Organizations Mark Vervuurt Cluster Data Science & Analytics AGENDA 1. Yellow Elephant 2. Data Ingestion & Complex Event Processing 3. SQL on Hadoop 4. NoSQL 5. InMemory 6. Data Science & Machine Learning

More information

Integrating VoltDB with Hadoop

Integrating VoltDB with Hadoop The NewSQL database you ll never outgrow Integrating with Hadoop Hadoop is an open source framework for managing and manipulating massive volumes of data. is an database for handling high velocity data.

More information

The Inside Scoop on Hadoop

The Inside Scoop on Hadoop The Inside Scoop on Hadoop Orion Gebremedhin National Solutions Director BI & Big Data, Neudesic LLC. VTSP Microsoft Corp. Orion.Gebremedhin@Neudesic.COM B-orgebr@Microsoft.com @OrionGM The Inside Scoop

More information

Nyheter i SAS9.4 för programmerare

Nyheter i SAS9.4 för programmerare Nyheter i SAS9.4 för programmerare Georgios Karagiannis, Technical Support Copyright 2010 SAS Institute Inc. All rights reserved. PROC PRINT labels proc print data=sashelp.cars label grandtotal_label='total

More information

Hadoop Ecosystem B Y R A H I M A.

Hadoop Ecosystem B Y R A H I M A. Hadoop Ecosystem B Y R A H I M A. History of Hadoop Hadoop was created by Doug Cutting, the creator of Apache Lucene, the widely used text search library. Hadoop has its origins in Apache Nutch, an open

More information

SAP and Hortonworks Reference Architecture

SAP and Hortonworks Reference Architecture SAP and Hortonworks Reference Architecture Hortonworks. We Do Hadoop. June Page 1 2014 Hortonworks Inc. 2011 2014. All Rights Reserved A Modern Data Architecture With SAP DATA SYSTEMS APPLICATIO NS Statistical

More information

EMC Greenplum Driving the Future of Data Warehousing and Analytics. Tools and Technologies for Big Data

EMC Greenplum Driving the Future of Data Warehousing and Analytics. Tools and Technologies for Big Data EMC Greenplum Driving the Future of Data Warehousing and Analytics Tools and Technologies for Big Data Steven Hillion V.P. Analytics EMC Data Computing Division 1 Big Data Size: The Volume Of Data Continues

More information

Polybase for SQL Server 2016

Polybase for SQL Server 2016 Polybase for SQL Server 2016 Lukasz Grala Architect Data Platform & BI Solutions MVP SQL Server Łukasz Grala MVP SQL Server MCT MCSE Architekt i trener - Data Platform & Business Intelligence Solutions

More information

White Paper. How Streaming Data Analytics Enables Real-Time Decisions

White Paper. How Streaming Data Analytics Enables Real-Time Decisions White Paper How Streaming Data Analytics Enables Real-Time Decisions Contents Introduction... 1 What Is Streaming Analytics?... 1 How Does SAS Event Stream Processing Work?... 2 Overview...2 Event Stream

More information

Introduction to Big data. Why Big data? Case Studies. Introduction to Hadoop. Understanding Features of Hadoop. Hadoop Architecture.

Introduction to Big data. Why Big data? Case Studies. Introduction to Hadoop. Understanding Features of Hadoop. Hadoop Architecture. Big Data Hadoop Administration and Developer Course This course is designed to understand and implement the concepts of Big data and Hadoop. This will cover right from setting up Hadoop environment in

More information

9.4 Intelligence. SAS Platform. Overview Second Edition. SAS Documentation

9.4 Intelligence. SAS Platform. Overview Second Edition. SAS Documentation SAS Platform Overview Second Edition 9.4 Intelligence SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2016. SAS 9.4 Intelligence Platform: Overview,

More information

Big Data and the Analytic Race. Copyright 2012, SAS Institute Inc. All rights reserved.

Big Data and the Analytic Race. Copyright 2012, SAS Institute Inc. All rights reserved. Big Data and the Analytic Race What is Big Data? Big Data When volume, velocity and variety of data exceeds an organization s storage or compute capacity for accurate and timely decision-making The Data

More information

Native Connectivity to Big Data Sources in MSTR 10

Native Connectivity to Big Data Sources in MSTR 10 Native Connectivity to Big Data Sources in MSTR 10 Bring All Relevant Data to Decision Makers Support for More Big Data Sources Optimized Access to Your Entire Big Data Ecosystem as If It Were a Single

More information

SAS Data Loader 2.1 for Hadoop

SAS Data Loader 2.1 for Hadoop SAS Data Loader 2.1 for Hadoop Installation and Configuration Guide SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2014. SAS Data Loader 2.1: Installation

More information

Infomatics. Big-Data and Hadoop Developer Training with Oracle WDP

Infomatics. Big-Data and Hadoop Developer Training with Oracle WDP Big-Data and Hadoop Developer Training with Oracle WDP What is this course about? Big Data is a collection of large and complex data sets that cannot be processed using regular database management tools

More information

Bringing Big Data to People

Bringing Big Data to People Bringing Big Data to People Microsoft s modern data platform SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform Everyone should have access to the data they need. Process

More information

From Relational to Hadoop Part 1: Introduction to Hadoop. Gwen Shapira, Cloudera and Danil Zburivsky, Pythian

From Relational to Hadoop Part 1: Introduction to Hadoop. Gwen Shapira, Cloudera and Danil Zburivsky, Pythian From Relational to Hadoop Part 1: Introduction to Hadoop Gwen Shapira, Cloudera and Danil Zburivsky, Pythian Tutorial Logistics 2 Got VM? 3 Grab a USB USB contains: Cloudera QuickStart VM Slides Exercises

More information

ANALYTICS IN BIG DATA ERA

ANALYTICS IN BIG DATA ERA ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY, DISCOVER RELATIONSHIPS AND CLASSIFY HUGE AMOUNT OF DATA MAURIZIO SALUSTI SAS Copyr i g ht 2012, SAS Ins titut

More information

MySQL and Hadoop. Percona Live 2014 Chris Schneider

MySQL and Hadoop. Percona Live 2014 Chris Schneider MySQL and Hadoop Percona Live 2014 Chris Schneider About Me Chris Schneider, Database Architect @ Groupon Spent the last 10 years building MySQL architecture for multiple companies Worked with Hadoop for

More information

Creating a universe on Hive with Hortonworks HDP 2.0

Creating a universe on Hive with Hortonworks HDP 2.0 Creating a universe on Hive with Hortonworks HDP 2.0 Learn how to create an SAP BusinessObjects Universe on top of Apache Hive 2 using the Hortonworks HDP 2.0 distribution Author(s): Company: Ajay Singh

More information

Big Data and Hadoop with components like Flume, Pig, Hive and Jaql

Big Data and Hadoop with components like Flume, Pig, Hive and Jaql Abstract- Today data is increasing in volume, variety and velocity. To manage this data, we have to use databases with massively parallel software running on tens, hundreds, or more than thousands of servers.

More information

Readme10_054.doc page 1 of 7

Readme10_054.doc page 1 of 7 Readme10_054.doc page 1 of 7 Date of production: 2007-12-03 News in 10_054 Hardware 1) New thyristor module DASD 145, 600 V - 500 A 2) Improved speed control with incremental encoder at very low speed

More information

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect

The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect The evolution of database technology (II) Huibert Aalbers Senior Certified Executive IT Architect IT Insight podcast This podcast belongs to the IT Insight series You can subscribe to the podcast through

More information

Stinger Initiative: Introduction

Stinger Initiative: Introduction Stinger Initiative: Introduction Interactive Query on Hadoop Chris Harris E-Mail : charris@hortonworks.com Twitter : cj_harris5 Page 1 The World of Data is Changing Data Explosion 1 Zettabyte (ZB) = 1

More information

What's New in SAS Data Management

What's New in SAS Data Management Paper SAS034-2014 What's New in SAS Data Management Nancy Rausch, SAS Institute Inc., Cary, NC; Mike Frost, SAS Institute Inc., Cary, NC, Mike Ames, SAS Institute Inc., Cary ABSTRACT The latest releases

More information

Lofan Abrams Data Services for Big Data Session # 2987

Lofan Abrams Data Services for Big Data Session # 2987 Lofan Abrams Data Services for Big Data Session # 2987 Big Data Are you ready for blast-off? Big Data, for better or worse: 90% of world s data generated over last two years. ScienceDaily, ScienceDaily

More information

Hadoop Introduction. Olivier Renault Solution Engineer - Hortonworks

Hadoop Introduction. Olivier Renault Solution Engineer - Hortonworks Hadoop Introduction Olivier Renault Solution Engineer - Hortonworks Hortonworks A Brief History of Apache Hadoop Apache Project Established Yahoo! begins to Operate at scale Hortonworks Data Platform 2013

More information

Oracle Big Data SQL Technical Update

Oracle Big Data SQL Technical Update Oracle Big Data SQL Technical Update Jean-Pierre Dijcks Oracle Redwood City, CA, USA Keywords: Big Data, Hadoop, NoSQL Databases, Relational Databases, SQL, Security, Performance Introduction This technical

More information

SAS 9.4 In-Database Products

SAS 9.4 In-Database Products SAS 9.4 In-Database Products Administrator s Guide Fifth Edition SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2015. SAS 9.4 In-Database Products:

More information

Oracle Big Data Handbook

Oracle Big Data Handbook ORACLG Oracle Press Oracle Big Data Handbook Tom Plunkett Brian Macdonald Bruce Nelson Helen Sun Khader Mohiuddin Debra L. Harding David Segleau Gokula Mishra Mark F. Hornick Robert Stackowiak Keith Laker

More information

Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015

Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015 Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015 We Do Hadoop Fall 2014 Page 1 HDP delivers a comprehensive data management platform GOVERNANCE Hortonworks Data Platform

More information

A Tour of the Zoo the Hadoop Ecosystem Prafulla Wani

A Tour of the Zoo the Hadoop Ecosystem Prafulla Wani A Tour of the Zoo the Hadoop Ecosystem Prafulla Wani Technical Architect - Big Data Syntel Agenda Welcome to the Zoo! Evolution Timeline Traditional BI/DW Architecture Where Hadoop Fits In 2 Welcome to

More information

Big Data Introduction

Big Data Introduction Big Data Introduction Ralf Lange Global ISV & OEM Sales 1 Copyright 2012, Oracle and/or its affiliates. All rights Conventional infrastructure 2 Copyright 2012, Oracle and/or its affiliates. All rights

More information

Teradata s Big Data Technology Strategy & Roadmap

Teradata s Big Data Technology Strategy & Roadmap Teradata s Big Data Technology Strategy & Roadmap Artur Borycki, Director International Solutions Marketing 18 March 2014 Agenda > Introduction and level-set > Enabling the Logical Data Warehouse > Any

More information

SAS Enterprise Data Integration Server - A Complete Solution Designed To Meet the Full Spectrum of Enterprise Data Integration Needs

SAS Enterprise Data Integration Server - A Complete Solution Designed To Meet the Full Spectrum of Enterprise Data Integration Needs Database Systems Journal vol. III, no. 1/2012 41 SAS Enterprise Data Integration Server - A Complete Solution Designed To Meet the Full Spectrum of Enterprise Data Integration Needs 1 Silvia BOLOHAN, 2

More information

Nyheter i SAS Data Management med SAS versjon 9.4

Nyheter i SAS Data Management med SAS versjon 9.4 make connections share ideas be inspired Nyheter i SAS Data Management med SAS versjon 9.4 Terje Vatle Nordic CoE, Data Management C o p y r i g h t 2 0 1 3, S A S I n s t i t u t e I n c. A l l r i g

More information

Big Data Operations Guide for Cloudera Manager v5.x Hadoop

Big Data Operations Guide for Cloudera Manager v5.x Hadoop Big Data Operations Guide for Cloudera Manager v5.x Hadoop Logging into the Enterprise Cloudera Manager 1. On the server where you have installed 'Cloudera Manager', make sure that the server is running,

More information

Access to Relational Databases Using SAS. Frederick Pratter, Destiny Corp.

Access to Relational Databases Using SAS. Frederick Pratter, Destiny Corp. Paper TF-21 Access to Relational Databases Using SAS ABSTRACT Frederick Pratter, Destiny Corp. SAS software currently provides many of the features of a database management system, including database views

More information

Jag valde att använda Net-EPP_client.php från centralnic för att komma igång.

Jag valde att använda Net-EPP_client.php från centralnic för att komma igång. EPP och PHP Det finns flera olika klienter där ute för att hantera epp. Net_EPP_client.php phpsrs Hanterar bara EPP kommunikationen. Enkel http://labs.centralnic.com/net_epp_client.php Mer komplett Klarar

More information

Nyheder i SAS Data Management med SAS version 9.4 Jens Dahl Mikkelsen Nordic CoE, Information Management

Nyheder i SAS Data Management med SAS version 9.4 Jens Dahl Mikkelsen Nordic CoE, Information Management make connections share ideas be inspired Nyheder i SAS Data Management med SAS version 9.4 Jens Dahl Mikkelsen Nordic CoE, Information Management Indhold Nye pakker nye muligheder Nyheder med SAS 9.4-baseret

More information

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Highly competitive enterprises are increasingly finding ways to maximize and accelerate

More information

Scalable Forensics with TSK and Hadoop. Jon Stewart

Scalable Forensics with TSK and Hadoop. Jon Stewart Scalable Forensics with TSK and Hadoop Jon Stewart CPU Clock Speed Hard Drive Capacity The Problem CPU clock speed stopped doubling Hard drive capacity kept doubling Multicore CPUs to the rescue!...but

More information

The Future of Big Data SAS Automotive Roundtable Los Angeles, CA 5 March 2015 Mike Olson Chief Strategy Officer, Cofounder @mikeolson

The Future of Big Data SAS Automotive Roundtable Los Angeles, CA 5 March 2015 Mike Olson Chief Strategy Officer, Cofounder @mikeolson The Future of Big Data SAS Automotive Roundtable Los Angeles, CA 5 March 2015 Mike Olson Chief Strategy Officer, Cofounder @mikeolson 1 A New Platform for Pervasive Analytics Multiple big data opportunities

More information

PRTK. Password Recovery ToolKit EFS (Encrypting File System) http://en.wikipedia.org/wiki/encrypting_file_system

PRTK. Password Recovery ToolKit EFS (Encrypting File System) http://en.wikipedia.org/wiki/encrypting_file_system PRTK Password Recovery ToolKit EFS (Encrypting File System) http://en.wikipedia.org/wiki/encrypting_file_system PRTK Overview - Interface Manage Profiles... Dictionary Tools... Right or double click to

More information

SAS and Teradata Partnership

SAS and Teradata Partnership SAS and Teradata Partnership Ed Swain Senior Industry Consultant Energy & Resources Ed.Swain@teradata.com 1 Innovation and Leadership Teradata SAS Magic Quadrant for Data Warehouse Database Management

More information

Enhance your Analytics using Logical Data Warehouse and Data Virtualization thru SAP HANA smart data access SESSION CODE: 0210

Enhance your Analytics using Logical Data Warehouse and Data Virtualization thru SAP HANA smart data access SESSION CODE: 0210 Enhance your Analytics using Logical Data Warehouse and Data Virtualization thru SAP HANA smart data access Balaji Krishna, Product Management SAP HANA Platform. SAP Labs @balajivkrishna SESSION CODE:

More information

June 2015. JMS and Hadoop Agent. Automic Workload Automation

June 2015. JMS and Hadoop Agent. Automic Workload Automation June 2015 JMS and Hadoop Agent Automic Workload Automation + Hadoop Agent Demonstration Structure of Automic Hadoop Connection Hadoop use cases Demonstration + Feature Introduction + JMS Agent Demonstration

More information

SAS. 9.4 Guide to Software Updates. SAS Documentation

SAS. 9.4 Guide to Software Updates. SAS Documentation SAS 9.4 Guide to Software Updates SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2013. SAS 9.4 Guide to Software Updates. Cary, NC: SAS Institute

More information

Ange om en aktivitet har medfört att en tjänsteresa har utförts med flyg under 2013, och i sådana fall antal gånger.

Ange om en aktivitet har medfört att en tjänsteresa har utförts med flyg under 2013, och i sådana fall antal gånger. Institutionen för lingvistik - Survey of travel at SU for 2013 Answer Count: 16 Ange om en aktivitet har medfört att en tjänsteresa har utförts med flyg under 2013, och i sådana fall antal gånger. Specify

More information

BIG DATA: FROM HYPE TO REALITY. Leandro Ruiz Presales Partner for C&LA Teradata

BIG DATA: FROM HYPE TO REALITY. Leandro Ruiz Presales Partner for C&LA Teradata BIG DATA: FROM HYPE TO REALITY Leandro Ruiz Presales Partner for C&LA Teradata Evolution in The Use of Information Action s ACTIVATING MAKE it happen! Insights OPERATIONALIZING WHAT IS happening now? PREDICTING

More information

Self-service BI for big data applications using Apache Drill

Self-service BI for big data applications using Apache Drill Self-service BI for big data applications using Apache Drill 2015 MapR Technologies 2015 MapR Technologies 1 Data Is Doubling Every Two Years Unstructured data will account for more than 80% of the data

More information

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics

More information

MySQL and Hadoop: Big Data Integration. Shubhangi Garg & Neha Kumari MySQL Engineering

MySQL and Hadoop: Big Data Integration. Shubhangi Garg & Neha Kumari MySQL Engineering MySQL and Hadoop: Big Data Integration Shubhangi Garg & Neha Kumari MySQL Engineering 1Copyright 2013, Oracle and/or its affiliates. All rights reserved. Agenda Design rationale Implementation Installation

More information

Automated distribution of SAS results Jacques Pagé, Les Services Conseils HARDY, Quebec, Qc

Automated distribution of SAS results Jacques Pagé, Les Services Conseils HARDY, Quebec, Qc Paper 039-29 Automated distribution of SAS results Jacques Pagé, Les Services Conseils HARDY, Quebec, Qc ABSTRACT This paper highlights the programmable aspects of SAS results distribution using electronic

More information

ABSTRACT INTRODUCTION SAS AND EXCEL CAPABILITIES SAS AND EXCEL STRUCTURES

ABSTRACT INTRODUCTION SAS AND EXCEL CAPABILITIES SAS AND EXCEL STRUCTURES Paper 85-2010 Choosing the Right Tool from Your SAS and Microsoft Excel Tool Belt Steven First and Jennifer First, Systems Seminar Consultants, Madison, Wisconsin ABSTRACT There are over a dozen ways to

More information

Red Hat Enterprise Linux OpenStack Platform 7 OpenStack Data Processing

Red Hat Enterprise Linux OpenStack Platform 7 OpenStack Data Processing Red Hat Enterprise Linux OpenStack Platform 7 OpenStack Data Processing Manually provisioning and scaling Hadoop clusters in Red Hat OpenStack OpenStack Documentation Team Red Hat Enterprise Linux OpenStack

More information

Financial, Telco, Retail, & Manufacturing: Hadoop Business Services for Industries

Financial, Telco, Retail, & Manufacturing: Hadoop Business Services for Industries Financial, Telco, Retail, & Manufacturing: Hadoop Business Services for Industries Ho Wing Leong, ASEAN 1 Cloudera company snapshot Founded Company Employees Today World Class Support Mission CriQcal 2008,

More information

SAS LASR Analytic Server 2.4

SAS LASR Analytic Server 2.4 SAS LASR Analytic Server 2.4 Reference Guide SAS Documentation The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2014. SAS LASR Analytic Server 2.4: Reference Guide.

More information

SAS ANALYTIC SOLUTIONS RUNNING ON A HADOOP CLUSTER USING YARN JAMES KOCHUBA. Copyright 2015, SAS Institute Inc. All rights reserved.

SAS ANALYTIC SOLUTIONS RUNNING ON A HADOOP CLUSTER USING YARN JAMES KOCHUBA. Copyright 2015, SAS Institute Inc. All rights reserved. SAS ANALYTIC SOLUTIONS RUNNING ON A HADOO CLUSTR USING YARN JAMS KOCHUBA MARKT LADR IN DATA & ANALYTICS Great laces to Work Awards 15 COUNTRIS 2 MULTINATIONAL SAS Industry Average Revenue Reinvested in

More information

Big Data Open Source Stack vs. Traditional Stack for BI and Analytics

Big Data Open Source Stack vs. Traditional Stack for BI and Analytics Big Data Open Source Stack vs. Traditional Stack for BI and Analytics Part I By Sam Poozhikala, Vice President Customer Solutions at StratApps Inc. 4/4/2014 You may contact Sam Poozhikala at spoozhikala@stratapps.com.

More information

Connecting Hadoop with Oracle Database

Connecting Hadoop with Oracle Database Connecting Hadoop with Oracle Database Sharon Stephen Senior Curriculum Developer Server Technologies Curriculum The following is intended to outline our general product direction.

More information

Improving Your Relationship with SAS Enterprise Guide

Improving Your Relationship with SAS Enterprise Guide Paper BI06-2013 Improving Your Relationship with SAS Enterprise Guide Jennifer Bjurstrom, SAS Institute Inc. ABSTRACT SAS Enterprise Guide has proven to be a very beneficial tool for both novice and experienced

More information