Encontro de Utilizadores Esri Desafios de Big Data SAS / Esri Orador: Luis Bettencourt Moniz : Mário Correia SAS

Transcription

1 Encontro de Utilizadores Esri 2013 Desafios de Big Data SAS / Esri Orador: Luis Bettencourt Moniz : Mário Correia SAS

2 O DESAFIO DE BIG DATA - SAS / ESRI LISBOA, 2013/JUN/06 LUÍS BETTENCOURT MONIZ DIRECTOR DE MARKETING MÁRIO CORREIA DIRECTOR DE ALIANÇAS Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

3 Índice SAS Positioning for Big Data & Analytics SAS High-Performance Analytics SAS Visual Analytics SAS & ESRI Referências Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

4 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d. SAS positioning for BIG DATA and Analytics SAS HIGH-PERFORMANCE ANALYTICS

5 BIG DATA INOVAÇÂO

6 BIG DATA CONSENSO

7 Big data WHAT IS IT? Data that exceeds the processing capacity of conventional database systems.

8 Analytics ESTABLISHING DIFFERENTIATION PROACTIVE

9 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d. Market positioning

10 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

11 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

12 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

13 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

14 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

15 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

16 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

17 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

18 REACTIVE PROACTIVE ANALYTIC CAPABILITY Capabilit DATA SIZE AND ANALYTIC COMPETENCE ANALYTICS y Segment PROACTIVE Optimization Predictive Modeling REACTIVE Alerts OLAP ation Ad Hoc Reports Standard Reports Forecasting Statistical Analysis LARGE DATA SIZE BIG DATA Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

19 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d. HOW DO WE DO IT?

20 HOW DO WE DO IT? HIGH-PERFORMANCE ANALYTICS ALL IN A SINGLE, SEAMLESS FRAMEWORK Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

21 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

22 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

23 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

24 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

25 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

26 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

27 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

28 Sas HIGH-PERFOrMANCE ANALYTICS KEY TECHNOLOGY COMPONENTS Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

29 SAS HIGH- PERFORMANCE ANALYTICS KEY COMPONENTS

30 SAS HIGH- PERFORMANCE ANALYTICS SAS GRID COMPUTING

31 SAS HIGH- PERFORMANCE ANALYTICS SAS IN-DATABASE

32 SAS HIGH- PERFORMANCE ANALYTICS SAS IN-MEMORY ANALYTICS

33 IN-MEMORY ANALYTICS ENGINE

34 SAS IN-MEMORY ANALYTICS SAS VISUAL ANALYTICS Central Entry Point Integration Role-based Views DATA PREPARATION / ENV MANAGER EXPLORER DESIGNER WEB / MOBILE BI Monitor SAS LASR Analytic server Load and join data Create calculated columns Perform ad-hoc analysis and data discovery Create dashboard style reports for web or mobile Native ios application that delivers interactive reports created in the designer SAS LASR ANALYTIC SERVER

35 ideias SAS VISUAL ANALYTICS

36 Trends in Business Intelligence Big Data gets BIGGER! The rise in volume (amount of data), velocity (speed of data) and variety (range of data) gives way to new architectures that no longer only collect and store but actually use data. The challenge however is that Big data, as opposed to its name, is really many amounts of small data ranging from tweets, sales reports to mail messages. Therefore performance is key word. Look for technology solutions like datawarehouse appliances, in memory analytics, columnar storage and smart software solutions s sent every second: 2,9M Tweets per day Data stored in 2013, in Europe: 50M People, devices, cars, etc. > connected devices > bytes

37 Trends in Business Intelligence Google fast, Apple easy: Do IT yourself! Just like at home, business users are expecting an engine that searches all available data (structured and unstructured, internal and external) to quickly find answers. Navigating through the results to find patterns, trends could be improved with advanced visualizations. The result is a consumerization of enterprise BI. The corporate BI App Store is (virtually) just around the corner.

38 Trends in Business Intelligence Go mobile! of BI will be consumed trough Mobile (2013) Gartner Research

39 Trends in Business Intelligence Analytical talent will become scarce The McKinsey Global Institute released a study in 2011 predicting that by 2018, the US would face a shortage of up to 1.5 million managers and analysts with the know-how to use the analysis of big data to make effective decisions. In 2012, despite the soft job environment, we ll start to see tightness in the market for analytical skills and demand for tools to help make up the difference.

40 SAS DELIVERS A SINGLE SOLUTION FOR FASTER, SMARTER DECISIONS VISUAL Central Entry Point HUB Role-based Views ANALYTIC S DATA BUILDER ADMINISTRATOR EXPLORER DESIGNER WEB/ MOBILE BI Join data from multiple sources Create calculated and derived columns Load data Monitor SAS LASR Analytic server Load/unload data Manage security Perform ad-hoc analysis and data discovery Apply advanced analytics Create dashboard style reports for web or mobile Native ios and Android applications that delivers interactive reports SAS LASR ANALYTIC SERVER

41 SAS VIEWER visual analytics Visualize reports previously created Multiple data sources Interactions and prompts Hierarchy navigation Leverage existing SAS security Export data to Excel and CSV/TSV document formats Collaboration via Commenting

42 SAS MOBILE visual analytics Native apps for ipad and Android Leverage existing SAS security Highly visual and interactive Collaboration via comments Offline capabilities Security focused with support for Device encryption Remote wipe Black and white listing SSL connections

43 SAS visual analytics DIFFERENTIATORS and efficient cost-effective growth Explore all data and fuel insight discovery for competitive advantage INFORMATION MANAGEMENT CAPABILITIES Data access and integration able to support large volumes of data Upload local spreadsheets ADVANCED ANALYTICS Forecasting Correlations Regressions What-If Scenarios Decision-Trees Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d. INTUITIVE INTERFACE AND EASE OF DATA EXPLORATION

44 The Greatest Value Of A Picture Is When It Forces Us To Notice What We Never Expected To See. John W. Tukey, Exploratory Data Analysis 1977 Copyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d.

45 SAS VIEWER visual analytics

46 SAS OUTUBRO: INTEGRAÇÃO COM ARCGIS SERVER visual analytics

47 SINGULARIDAD E: uma só interpretação

48 SAS Bridge for ESRI 3.5 SAS and ESRI have jointly produced the SAS Bridge for ESRI, which links SAS and ESRI software. SAS Bridge for ESRI combines the power of SAS with the spatial analysis and cartographic capabilities of ESRI's ArcGIS suite. With the depth and breadth of both SAS and ESRI, customers are better equipped to explore, understand, analyze and deliver sound spatially-

49 Integration Overview SAS / ESRI SAS Bridge for ESRI It allows ESRI users to: Read SAS Data Export ESRI data to SAS datasets & access SAS metadata Execute stored processes Develop customized applications New capacities: Remote access to SAS servers (with SAS Integration Technologies) Geometry export Raster export The export of graphics & data It s basically a Bridge from ESRI clients to SAS (including SAS Visual Analytics) ESRI s ArcMap Desktop Client Exporting ArcGIS data to a SAS Dataset

50 SAS Web OLAP Viewer 3.1

51 SAS Enterprise Guide

52 SAS / ESRI Joint Focus Areas Key Industries Industries that are heavy users of both SAS and ESRI technology include: Public Sector Academics Retail Financial Services Telecommunications Utilities Oil & Gas

53 SAS & ESRI some Case Copenhagen Studies University These insights can help governments and businesses alike focus their investments more effectively: whether for building hospitals, setting up bank branches where they're most needed, or choosing the most profitable placements for advertising. Benefits: "Even though we take existing knowledge as our point of departure, GIS and business intelligence have not previously been combined in this way, so we are treading new ground. It takes practice to set the right parameters. When these are in place, however, we will certainly get interesting results. Professor Hans Oluf Hansen Department of Economy, Copenhagen University US Census Bureau Challenge: Analyze spatial data for K-12 school populations in the United States, translating into intelligence needed for good public policy that promotes enhancements in education. SAS and the SAS Bridge for ESRI help me understand and produce relevant, high-quality educational demographics that can be used to inform and improve education in the US. Doug Geverdt - Project Manager, Statistician and Demographer

54 SAS & ESRI some Case Studies SAS & ESRI helps North Carolina find a cheaper way to build roads Benefits: Shaves up to $500,000 off project costs and 20 percent off time. planning Every time we impact a wetland, we have to restore a wetland. Every time we impact a stream, we have to restore a stream. So getting good data is important not only for environmental, but for cost-saving reasons.'' Morgan Weatherford - Environmental Program Consultant Also referenceable: Aarhus Kommune, Denmark General Government Services (Mar2010) ASL Monza e Brianza, Italy Health Care Providers (Nov2011) Cablevision Systems Corporation, USA Media (Jul2011) Intelligence Community, USA Intelligence (Jul2011) M-I L.L.C., USA Mining-Oil & Gas (Sep2011) United States Dept of Veterans Affairs, USA General Government Services (Feb2012)

55 Referências SAS (n/ exaustivo )

56 ers/directory/esri/

57 Contactos Luís Bettencourt Moniz Director de Marketing Mário Correia Director de Parcerias Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.

58 Obrigado! Copyr i g ht 2013, SAS Ins titut e Inc. All rights res er ve d.