Big Data + Big Analytics Transforming the way you do business

Transcription

1 Big Data + Big Analytics Transforming the way you do business Bryan Harris Chief Technology Officer VSTI A SAS Company 1

2 AGENDA Lets get Real Beyond the Buzzwords Who is SAS? Our PerspecDve of Big Data and AnalyDcs Applying SAS Big AnalyDcs for the AFPOA Why SAS for AFPOA? 2

3 LETS GET REAL BEYOND THE BUZZWORDS Big Data VirtualizaDon Mobile Social Media Data IntegraDon In- Memory AnalyDcs Cloud CompuDng PredicDve AnalyDcs Text AnalyDcs Real- Time AnalyDcs Business Intelligence Map Reduce 3

4 LETS GET REAL BEYOND THE BUZZWORDS Big Data Watch out for this guy but don t be this guy 4

5 Who is SAS? 5

6 SAS Leader in Business Analy5cs Largest privately held so;ware company in the world 2010 Revenue: $2.43 Billion 35 Years of Consecu5ve Growth 24% reinvestment in R&D for ,000 deployments worldwide 12,000 employees 90 of the top 100 of Fortune Global 500 Life Sciences: 6% Manufacturing: 5.5% Retail: 4.5% Communications: 7% Education: 3% Services: 11% Energy & Utilities: 3% Other: 1% All 15 U.S. Departments and 90% of U.S. Government: 15% Federal Agencies All 50 U.S. State Governments Government agencies in 80 countries Financial Services: 42% 6

7 SAS Business AnalyDcs Framework Data Integra5on Data Management Pla]orm (DMP) SAS Data Access Plug- in s Analy5cs SAS BASE SAS Enterprise Miner/Text Miner (EM/TM) SAS Enterprise Content CategorizaDon (ECC) SAS Social Network Analysis (SNA) SAS Enterprise Guide/JMP (EG/JMP) Repor5ng SAS Enterprise Business Intelligence (EBI) Business Solu5ons SAS Fraud Framework SAS Customer Intelligence SAS IT Resource Management (ITRM) All tools generate SAS Code which enables customer flexibility and extensibility 7

8 Our perspecdve of Big Data and AnalyDcs from 50,000+ customers worldwide 8

9 OUR PERSPECTIVE Big Data (Noun) When volume, velocity and variety of data exceeds an organization s storage or compute capacity for accurate and timely decision-making! Big Data is RELATIVE not ABSOLUTE" 9

10 OUR PERSPECTIVE Analy5cs Successes are driven by business needs!... not technology!! Should span both structured and unstructured data! 10

11 ANALYTICS: FINDING VALUE IN THE VASTNESS OF BIG DATA VOLUME VARIETY VELOCITY VALUE

12 OUR PERSPECTIVE: AnalyDc proficiency and where are you heading What is the best outcome? Op5miza5on CORPORATE What will happened next? What if these trends condnue? Why is this happening? Sta5s5cal Analysis Forecas5ng Predic5ve Modeling Aler5ng What acdons are needed? DEPARTMENTAL Standard Repor5ng Ad Hoc Query and Repor5ng Query Drilldown Where exactly is the problem? How many, how oien, and where? What happened? REACTIVE Copyright 2011, SAS Institute Inc. All rights reserved. PROACTIVE 12

13 Big Data is Transforming IT Typical Disparate IT Environments Tomorrow s Cloud Environment Dept A Dept B Dept C Dept A Dept B Dept C Only SAS delivers a unified soludon spanning both environments Analy5c Services Distributed Compute Nodes Job Mgmt In- Memory Servers Servers Servers Servers Distributed Storage Nodes In- Database Data Data Data Data Partnerships with Database Vendors (GreenPlum, Oracle, Teradata, Netezza, etc. for in- database SAS integra5on) 13

14 OUR PERSPECTIVE: Relevant Large- Scale implementadons of SAS today Headquarters Land Forces U.K. EUMIS Business Problem HQ of Bri5sh Army lacked control over its manpower planning process and the ability to forecast long- term resource demands. Inability to provide the right people at the right 5me at the right cost. SAS Approach Sophis5cated data integra5on of disparate personnel data across the Bri5sh Army Real- 5me enterprise repor5ng capabili5es to glean insight into the current environment Analy5cs capabili5es to mine personnel data and detect pajerns and trends Expected Benefits Streamlines manpower commitments while improving the delivery of key technical skills to the frontline Reduc5on of annual costs by $65 million 14

15 OUR PERSPECTIVE: Relevant Large- Scale implementadons of SAS today Department of Veterans Affairs Business Problem Past History of data exposures/pa5ent privacy issues Inability to deliver 5mely benefits Hundreds of researchers using disparate tool across the VA Poor performance on large data SAS Approach SAS Grid Compu5ng leveraging commodity hardware Unparalleled data integra5on Enterprise wide tools for shared sta5s5cal and analy5c environment Expected Benefits Improves analysis and delivery of benefits Increased data security Centralized data management 15

16 Applying SAS Big AnalyDcs for the AFPOA 16

17 ADVANCED ANALYTICS FOR BIG DATA CUSTOMER CHALLENGE Quickly profile customer behavior in real- 5me Bejer targe5ng of customer offers Analyze and gain insight on 2.5 petabytes of data We ve been helping our clients reach the right people with the right messages for 25 years, but with the predictive capabilities we have with SAS, we re able to do it with more precision than anyone else in the market. Eric Williams, Executive VP and CIO Executive VP and CIO Catalina Marketing SAS ANSWER Increase coupon redemp5on rate from 10 % to 25% Reduced model scoring from 4.5 hours to 60 seconds POTENTIAL AFPOA APPLICATION Profile Air Force personnel interac5ons and aggregate demand of systems, services, and content in real- 5me to support fact- based decision making of resource alloca5on STATISTICS 17

18 ADVANCED ANALYTICS FOR BIG DATA CUSTOMER CHALLENGE Reduce incidence of fraud Lower overall costs Significantly improve purchasing security SAS ANSWER Significantly lower incidence of fraud across tens of millions of debit and credit card accounts. Ability to score all transac5ons in real- 5me SAS is committed to ensuring that we continue to have a leading-edge anti-fraud solution. We are very pleased with the results. 13 DATA MINING Derek Wylde Head of Group Fraud Risk, Global Security and Fraud Risk HSBC POTENTIAL AFPOA APPLICATION Improve purchasing security while reducing fraud within the Air Force PCI Recurring Payment Processing System 18

19 ADVANCED ANALYTICS FOR BIG DATA FORECASTING Leveraging historical data to drive bejer insight into decision- making for the future CUSTOMER CHALLENGE Quickly assess risk exposures Perform stress- tes5ng against market swings Forecast exposures by counterpar5es / instrument type / desks / sectors Market risk solu5on that simulates market states to derive the value at risk POTENTIAL AFPOA APPLICATION SAS ANSWER Rapidly respond to crisis and adjust your posi5ons accordingly Recalculate en5re risk porpolio in minutes vs. hours Allocate the right Air Force personnel, at the right place, at the right 5me through sophis5cated modeling and forecas5ng techniques that include what if scenarios, seasonal adjustments, and hierarchical dependencies 19

20 ADVANCED ANALYTICS FOR BIG DATA CUSTOMER CHALLENGE Redact Personally Iden5fiable Informa5on (PII) in Unstructured Documents & Content Meet compliance and regulatory requirement Reduce liability for PII leaks SAS ANSWER Search and redact PII for compliance Manage huge volume of unstructured content TEXT ANALYTICS Finding treasures in unstructured data like social media or survey tools that could uncover insights about consumer sendment POTENTIAL AFPOA APPLICATION Ci5 redacts PII in over 20TB of unstructured content with over 90% accuracy leveraging an automated process compared with 2% accuracy using a manual approach Improve quality of content and interacdons of Total Force Service Center through sendment and concept analysis of customer service representadve (CSR) communicadons, transcripts, user comments, survey data, and social media 20

21 ADVANCED ANALYTICS FOR BIG DATA CUSTOMER CHALLENGE Op5mize clearance price sesng at SKU s per store level What, When, Which items to Markdown? 270 Million combina5ons for price point SAS ANSWER Op5mized analy5c solu5on that handles big data (3 Terabytes) In- memory, distributed processing Reduced processing 5me from 93% from 30 hours to 2 hours POTENTIAL AFPOA APPLICATION Leverage SAS ITRM (IT Resource Management) to maximize the alloca5on and u5liza5on of resources migrated into cloud environments through the analy5cs of aggregate usage and demand trends across AFPOA enterprise- wide IT assets. OPTIMIZATION Analyze massive amounts of data in order to accurately iden5fy areas likely to produce the most profitable results 21

22 ADVANCED ANALYTICS FOR BIG DATA FORECASTING Leveraging historical data to drive bejer insight into decision- making for the future TEXT ANALYTICS Finding treasures in unstructured data like social media or survey tools that could uncover insights about consumer sen5ment INFORMATION MANAGEMENT DATA MINING Mine transac5on databases for personnel service and content needs STATISTICS OPTIMIZATION Analyze massive amounts of data in order to accurately iden5fy areas likely to produce the most cost effec5ve and valuable results 22

23 Why SAS for AFPOA? 23

24 WHY SAS for AFPOA FLEXIBILITY Feature Why it Majers Analy5cs automa5cally exposed as RESTful and SOAP Web Services Seamless integra5on with AFPOA enterprise architecture and workflow All tools are built on a 4 th Genera5on SAS Programming Language Enables AFPOA to more easily adapt SAS Analy5cs to changing mission needs Unified run5me across compu5ng environments Enables AFPOA to easily evolve SAS analy5cs from a single server to cloud compu5ng environments 24

25 WHY SAS for AFPOA? SCALABILITY Feature Why it Majers In- database Analy5cs Lowers AFPOA storage costs by minimizing the movement and duplica5on of enterprise data In- Memory Analy5cs Increases AFPOA predic5ve modeling accuracy through rapid and granular modeling of all data NO SAMPLING Distributed Compu5ng Improves u5liza5on of AFPOA IT investments through massively parallel processing (MPP) 25

26 WHY SAS for AFPOA? ANALYTIC EXPERTISE Feature Why it Majers 35 Years of Analy5c Leadership Leverage the latest analy5c techniques from industry pioneers Best Prac5ces from broad industry adop5on Minimize delivery 5me to customers by leveraging the industry lessons learned from over 50,000 deployments Analy5c Community and Ecosystem Enables AFPOA to evolve analy5c exper5se through a vibrant and diverse analy5c community 26

27 Thank you! If you are interested in hearing more about SAS/ VSTI and how we address Big Data with AnalyDcs soludons, please contact: Gail Bamford Industry MarkeDng Manager for Defense & Intelligence SAS InsDtute x51715