The Data Reservoir: Architecture, Best Practices and Governance
|
|
- Frederick Wright
- 7 years ago
- Views:
Transcription
1 The Reservoir: Architecture, Best Practices and Governance Jo Ramos, Distinguished Engineer, Chief Architect for Information Integration & Governance 2015 IBM Corporation
2 Agenda for Today How to become a data driven analytics organization Modern Architecture Considerations The Reservoir & Governance 1
3 Three major shifts in our industry is becoming the world s new natural resource Social, mobile and access to data are changing how individuals are understood and engaged The emergence of cloud is transforming IT and business processes into digital services 500 million DVDs worth of data is generated daily 80% of individuals are willing to trade their information for a personalized offering 85% of new software is being built for cloud 1 trillion connected objects and devices by % of millennials say social and user-generated content has an influence on what they buy 25% of the world's applications will be available in the cloud by % of the world s data is unstructured 5 minutes: response time users expect once they have contacted a company via social media 72% of developers say cloud-based services or APIs are central to the applications they are designing
4 Monetization Drivers volumes variety Real-time execution Cost of data storage BI & Analytics visibility Increasing value of data Underutilized resource
5 driven analytics platform capabilities move from information to insights and from reporting to action Cognitive: What did I learn, what s best? Real-Time Decision Management: What action should I take? What is the Next Best Action? High Prediction / Simulation: What will happen? Uses data to forecast based on complex algorithms or rules; forecasting of customers buying behavior. Technological complexity Evaluation: Why did it happen? Thoroughly analyzes data to support important decisions / understand root causes for unusual observations; evaluation of campaign responses to understand changes in customer behavior. Mining: Why did it happen? Looks for patterns in the data to explain a not yet understood observation; understand why certain customers show a certain behavioral pattern. Low Low Business value / impact High Monitoring: What is happening now?looks for trigger information in the data indicating need for action; monitoring live campaigns and making optimization decisions as necessary. Reporting: What happened? Slices and dices data to create transparency on campaign performance and financial or quality outcomes.
6 Multi-structured Mashups provide the Greatest Enterprise Value Systems of Record Structured data from operational systems 20% of all data generated Systems of Insight Diverse data types that combine structured and unstructured data for business insight Systems of Engagement that connects companies with their customers, partners and employees 80% of all data generated Structured Small Clearly formatted Quantitative Objective Logical Puzzle Repeatable linear Warehouses Transaction data ERP Electronic Health Records Mainframe OLTP System Advanced Analytics Context Accumulation Enterprise Integration Hadoop, Streams, Spark Audio Documents Images RFID s Sensors Social Video Unstructured Big Language based Qualitative Subjective Intuitive Mystery Exploratory dynamic Web Logs Traditional Sources New Sources
7 DATA DRIVEN ARCHITECTURE
8 A growing data demand and organizational tensions Lines of Business IT Organization Agility Access Freedom Any kinds of data Powerful Analysis & Visualization Knowledge Worker CDO Security Privacy Regulatory Compliance Standards Application Developer Scientists seeking data for new analytics models. Marketer seeking data for new campaigns. Fraud investigator seeking data to understand the details of suspicious activity.
9 Modern Architectures: What to aim for We need IT solutions that are like Legos Agile, flexible, adaptive, efficient Able to give fast responses to business needs Taking advantage of cloud, mobile, social, localization, Big IT should not be like pouring cement Rigid, hardcoded business processes Monolithic Expensive to change Out of sync with business needs
10 Modern Architecture What to aim for Simplification of the IT environment Eliminate redundancies Reduce cost Decouple systems Decouple transactions Fast, easy reuse Faster timeto-market Explore opportunities React to problems Generate insights from information in real time Use insights to improve customer experience, anticipate facts 9
11 Modern Architecture Enables better Customer Engagement Social Profiles Preferences Activities Sensors Geolocation Movement Events Internet of Things Transactional Customer info Transaction history Product rules Analytics Next Best Action Expert systems Future trends Big Processes Tasks & milestones Integration Monitoring & SLAs Smart Channels Mobile & Web SoLoMo Context-enriched Context-Aware Experiences Personalized services Real-time Intelligence Moments of Truth Opportunistic offers 10
12 Analytics Lifecycle Search & Survey (understand what data is available) Online Collaboration Workspace Analytics Discovery (application development) Deploy & Consume (application & workflow) IT - Ope rati ons
13 The Reservoir Built to extract value from the data. Managed, Trusted and Governed
14 Big Lakes or Swamps? As we bring data together, are we creating a data swamp? No one is sure of the origin or purity of data. No one can find the data they need. No one knows what data is present and if it is being adequately protected. How do we build trust in big data? Need trust both to share and to consume data. Need understanding of quality, origin and ownership of data. Need classification of data to govern and protect it. Need timely, reliable data feeds and results. All built on secure and reliable infrastructure.
15 IBM s Lake Lake Services Lake Repositories Information Management and Governance Fabric Lake IBM s Lake = Efficient Management, Governance, Protection and Access.
16 Users supported by the Lake Analytics Teams Information Curator Governance, Risk and Compliance Team Enterprise IT Systems of Record Systems of Engagement Lake Services Lake Repositories Line of Business Teams New Sources Systems of Automation Other Lakes Information Management and Governance Fabric Lake (System of Insight) Lake Operations
17 The Lake Subsystems (Services) Analytics Teams Information Curator Governance, Risk and Compliance Team Enterprise IT Systems of Record Self-Service Access Catalogue Systems of Engagement New Sources Enterprise IT Exchange Lake Repositories Self- Service Access Line of Business Teams Systems of Automation Other Lakes Information Management and Governance Fabric Lake (System of Insight) Lake Operations
18 Considerations for a well-managed and governed data lake 9 Access to raw data to develop new production analytics. 5 Curation of all data to define meaning and classifications Business-led 6 information governance and management 4 Effective interchange of data and insight with other systems. 2 Catalog of data, ownership, meaning and permitted usage 10 Moderated, viewbased self-service access to data and analytics for line of business. 3 No direct access to repositories 8 -centric Security 7 Active monitoring and management of data 1 Multiple repositories organized based on source and usage; hosted on appropriate data platforms for workload.
19 View from the user community - fraud Detect and prevent fraud Develop new fraud models Conform to regulations Investigate Fraud Case
20 repositories support multiple zones Raw Interaction Catalog Interfaces Descriptive Enterprise IT Interaction Deposited Historical Harvested Context Lake Repositories View-based Interaction Published Information Integration & Governance Lake
21 Big data needs a variety of repositories for cost, access and performance reasons Raw Interaction Catalog Interfaces Descriptive CATALOG SEARCH INDEX INFORMATION VIEWS Enterprise IT Interaction Deposited Historical Harvested Context OPERATIONAL LOG AUDIT HISTORY DATA DATA INFORMATION WAREHOUSE CONTENT ASSET HUB HUB DEEP DATA ACTIVITY CODE HUB HUB Lake Repositories View-based Interaction Published EXPORT AREA OBJECT CACHE DATA MARTS Information Integration & Governance Lake
22 lake logical architecture Decision Model Analytics Tools Management Information Curator Governance, Risk and Compliance Team Enterprise IT System of Record Applications Systems of Engagement New Sources Third Party Feeds Third Party APIs Internal Sources Systems of Automation Other Systems Of Other Insight Lakes Enterprise Service Bus Deploy Real-time Decision Models Events to Evaluate Notifications Information Service Calls Out In Deploy Real-time Decision Models Enterprise IT Interaction APIs Continuous Analytics STREAMING ANALYTICS EVENT CORRELATION Publishing Feeds Ingestion INFORMATION BROKER BROKER CODE HUB Access SAND BOXES Information Service Calls Descriptive Deposited Historical Harvested Context Published STAGINGAREAS Deposit Secure Access CATALOG OPERATIONAL HISTORY INFORMATION WAREHOUSE CONTENT HUB OPERATIONAL GOVERNANCE HUB EXPORT AREA Deploy Decision Models Raw Interaction SEARCH INDEX LOG DATA ASSET HUB OBJECT CACHE Lake INFORMATION VIEWS DEEP DATA ACTIVITY OFFLINE ARCHIVE HUB AUDIT DATA DATA MARTS Information Integration & Governance Understand Information Sources Secure Access CODE HUB MONITOR Lake Repositories Advertise Information Source Catalog Interfaces View-based Interaction Secure Access Search SAND WORKFLOW Feedback BOXES Access Refine GUARDS Understand Compliance Understand Information Sources Search Requests Curation Interaction Information Service Calls Deposit Access Report Requests Management Report Compliance Line of Business Applications Analytical Insight Applications Simple, ad hoc Discovery and Analysis Reporting Consumers of Insight Lake Operations
23 Differing user perspectives Provision Sand Boxes. Sand Box Search for, locate and download data and related artifacts. Define governance policies, rules and classifications. Monitor compliance. Information Governance Catalogue View lineage (business and technical) and perform impact analysis. Add additional insight into data sources through automated analysis. Develop data management models and implementations. Curation of Metadata about Stores, Models, Definitions Stores Stores Stores
24 Governance Rules Defined for each classification for each situation Sensitive information masked here Personal information masked here
25 Integrated Metadata Lineage (Traceability) Where does this data come from? Why is this data incorrect? Why is this data incomplete? Can I trust this value? Impact Analysis Where is this element used? What happens if I change this? Optimization Where is the redundancy? How can I make this run more efficiently? Understanding What does this mean? How is this used? Control Why is this parameter set to this value? Who made this change? I can change this to meet new business requirements
26 Secure access to the data lake s data The data lake s security is assured with this combination of business processes and technical mechanisms. curation for security and protection access approval by subject area owner Well defined access points centric security access Isolated repositories Access monitoring and logging Security analytics and investigation Security audit and review ADMINISTRATION AT RUNTIME REVIEW
27 Building a data lake The first step in creating the lake is to establish the following: The information integration and governance components, The staging areas for integration, The catalog, The common data standards. The build out of the lake then proceeds iteratively based on the following processes: Governance of a data lake subject area. Managing an information source. Managing an information view. Enabling analytics. Maintaining the data lake infrastructure.
28 z zz z z z z Questions?
29 Thank You
The Data Reservoir as an enabler of differentiating Analytics initiatives
Mandy Chessell CBE FREng CEng FBCS Distinguished Engineer, Master Inventor Chief Architect, Solutions The Reservoir as an enabler of differentiating Analytics initiatives 3 rd March 2015 Agenda Changing
More informationThe Data Reservoir. 10 th September 2014. Mandy Chessell FREng CEng FBCS Dis4nguished Engineer, Master Inventor Chief Architect, Informa4on Solu4ons
Mandy Chessell FREng CEng FBCS Dis4nguished Engineer, Master Inventor Chief Architect, Solu4ons The Reservoir 10 th September 2014 A growing demand Business Teams want Open access to more informa4on More
More informationBringing Strategy to Life Using an Intelligent Data Platform to Become Data Ready. Informatica Government Summit April 23, 2015
Bringing Strategy to Life Using an Intelligent Platform to Become Ready Informatica Government Summit April 23, 2015 Informatica Solutions Overview Power the -Ready Enterprise Government Imperatives Improve
More informationGanzheitliches Datenmanagement
Ganzheitliches Datenmanagement für Hadoop Michael Kohs, Senior Sales Consultant @mikchaos The Problem with Big Data Projects in 2016 Relational, Mainframe Documents and Emails Data Modeler Data Scientist
More informationExploiting Data at Rest and Data in Motion with a Big Data Platform
Exploiting Data at Rest and Data in Motion with a Big Data Platform Sarah Brader, sarah_brader@uk.ibm.com What is Big Data? Where does it come from? 12+ TBs of tweet data every day 30 billion RFID tags
More informationThe Future of Business Analytics is Now! 2013 IBM Corporation
The Future of Business Analytics is Now! 1 The pressures on organizations are at a point where analytics has evolved from a business initiative to a BUSINESS IMPERATIVE More organization are using analytics
More informationOptimized for the Industrial Internet: GE s Industrial Data Lake Platform
Optimized for the Industrial Internet: GE s Industrial Lake Platform Agenda Opportunity Solution Challenges Result GE Lake 2 GESoftware.com @GESoftware #IndustrialInternet Big opportunities with Industrial
More informationIndustry Impact of Big Data in the Cloud: An IBM Perspective
Industry Impact of Big Data in the Cloud: An IBM Perspective Inhi Cho Suh IBM Software Group, Information Management Vice President, Product Management and Strategy email: inhicho@us.ibm.com twitter: @inhicho
More informationHow the oil and gas industry can gain value from Big Data?
How the oil and gas industry can gain value from Big Data? Arild Kristensen Nordic Sales Manager, Big Data Analytics arild.kristensen@no.ibm.com, tlf. +4790532591 April 25, 2013 2013 IBM Corporation Dilbert
More informationCapitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes
Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Highly competitive enterprises are increasingly finding ways to maximize and accelerate
More informationData Governance for Regulated Industries
Data Governance for Regulated Industries Amir Halfon CTO, Worldwide Financial Service Agenda Components of Data Governance Challenges Solutions and Case Studies Q&A SLIDE: 2 Data Governance Considerations
More informationBuilding Confidence in Big Data Innovations in Information Integration & Governance for Big Data
Building Confidence in Big Data Innovations in Information Integration & Governance for Big Data IBM Software Group Important Disclaimer THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL
More informationDatenverwaltung im Wandel - Building an Enterprise Data Hub with
Datenverwaltung im Wandel - Building an Enterprise Data Hub with Cloudera Bernard Doering Regional Director, Central EMEA, Cloudera Cloudera Your Hadoop Experts Founded 2008, by former employees of Employees
More informationAddressing Risk Data Aggregation and Risk Reporting Ben Sharma, CEO. Big Data Everywhere Conference, NYC November 2015
Addressing Risk Data Aggregation and Risk Reporting Ben Sharma, CEO Big Data Everywhere Conference, NYC November 2015 Agenda 1. Challenges with Risk Data Aggregation and Risk Reporting (RDARR) 2. How a
More informationBig Data & Analytics. The. Deal. About. Jacob Büchler jbuechler@dk.ibm.com Cand. Polit. IBM Denmark, Solution Exec. 2013 IBM Corporation
The Big Data & Analytics Deal About Jacob Büchler jbuechler@dk.ibm.com Cand. Polit. IBM Denmark, Solution Exec. 1 Big Data is All Data from Everywhere Big Data Is Becoming The Next Natural Resource We
More informationIBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!
The Bloor Group IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS VENDOR PROFILE The IBM Big Data Landscape IBM can legitimately claim to have been involved in Big Data and to have a much broader
More informationCustomer Cloud Architecture for Big Data and Analytics, Version 1.1
Customer Cloud Architecture for Big Data and Analytics, Version 1.1 Executive Overview Using analytics reveals patterns, trends and associations in data that help an organization understand the behavior
More informationThe Enterprise Data Hub and The Modern Information Architecture
The Enterprise Data Hub and The Modern Information Architecture Dr. Amr Awadallah CTO & Co-Founder, Cloudera Twitter: @awadallah 1 2013 Cloudera, Inc. All rights reserved. Cloudera Overview The Leader
More informationIntegrating a Big Data Platform into Government:
Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government
More informationData Wrangling: From the Wild to the Lake
Data Wrangling: From the Wild to the Lake Ignacio Terrizzano Peter Schwarz Mary Roth John Colino IBM Research - Almaden 48 hours of video is uploaded to YouTube every minute Walmart processes million transactions
More informationCustomer Cloud Architecture for Big Data and Analytics
Customer Cloud Architecture for Big Data and Analytics Executive Overview Using analytics reveals patterns, trends and associations in data that help an organization understand the behavior of the people
More informationBIG DATA STRATEGY. Rama Kattunga Chair at American institute of Big Data Professionals. Building Big Data Strategy For Your Organization
BIG DATA STRATEGY Rama Kattunga Chair at American institute of Big Data Professionals Building Big Data Strategy For Your Organization In this session What is Big Data? Prepare your organization Building
More informationEnd to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ
End to End Solution to Accelerate Data Warehouse Optimization Franco Flore Alliance Sales Director - APJ Big Data Is Driving Key Business Initiatives Increase profitability, innovation, customer satisfaction,
More informationDemystifying Big Data Government Agencies & The Big Data Phenomenon
Demystifying Big Data Government Agencies & The Big Data Phenomenon Today s Discussion If you only remember four things 1 Intensifying business challenges coupled with an explosion in data have pushed
More informationTE's Analytics on Hadoop and SAP HANA Using SAP Vora
TE's Analytics on Hadoop and SAP HANA Using SAP Vora Naveen Narra Senior Manager TE Connectivity Santha Kumar Rajendran Enterprise Data Architect TE Balaji Krishna - Director, SAP HANA Product Mgmt. -
More informationSmarter Analytics. Barbara Cain. Driving Value from Big Data
Smarter Analytics Driving Value from Big Data Barbara Cain Vice President Product Management - Business Intelligence and Advanced Analytics Business Analytics IBM Software Group 1 Agenda for today 1 Big
More informationData Governance in the Hadoop Data Lake. Michael Lang May 2015
Data Governance in the Hadoop Data Lake Michael Lang May 2015 Introduction Product Manager for Teradata Loom Joined Teradata as part of acquisition of Revelytix, original developer of Loom VP of Sales
More informationAre You Big Data Ready?
ACS 2015 Annual Canberra Conference Are You Big Data Ready? Vladimir Videnovic Business Solutions Director Oracle Big Data and Analytics Introduction Introduction What is Big Data? If you can't explain
More informationDeploying Big Data to the Cloud: Roadmap for Success
Deploying Big Data to the Cloud: Roadmap for Success James Kobielus Chair, CSCC Big Data in the Cloud Working Group IBM Big Data Evangelist. IBM Data Magazine, Editor-in- Chief. IBM Senior Program Director,
More informationOptimized for the Industrial Internet: GE s Industrial Data Lake Platform
Optimized for the Industrial Internet: GE s Industrial Lake Platform Agenda The Opportunity The Solution The Challenges The Results Solutions for Industrial Internet, deep domain expertise 2 GESoftware.com
More informationHow to avoid building a data swamp
How to avoid building a data swamp Case studies in Hadoop data management and governance Mark Donsky, Product Management, Cloudera Naren Korenu, Engineering, Cloudera 1 Abstract DELETE How can you make
More informationIRMAC SAS INFORMATION MANAGEMENT, TRANSFORMING AN ANALYTICS CULTURE. Copyright 2012, SAS Institute Inc. All rights reserved.
IRMAC SAS INFORMATION MANAGEMENT, TRANSFORMING AN ANALYTICS CULTURE ABOUT THE PRESENTER Marc has been with SAS for 10 years and leads the information management practice for canada. Marc s area of specialty
More informationHow To Create A Data Science System
Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Richard Breakiron Senior Director, Cyber Solutions Rbreakiron@vion.com Office: 571-353-6127 / Cell: 803-443-8002
More informationAccelerate your Big Data Strategy. Execute faster with Capgemini and Cloudera s Enterprise Data Hub Accelerator
Accelerate your Big Data Strategy Execute faster with Capgemini and Cloudera s Enterprise Data Hub Accelerator Enterprise Data Hub Accelerator enables you to get started rapidly and cost-effectively with
More informationBig Data Analytics Platform @ Nokia
Big Data Analytics Platform @ Nokia 1 Selecting the Right Tool for the Right Workload Yekesa Kosuru Nokia Location & Commerce Strata + Hadoop World NY - Oct 25, 2012 Agenda Big Data Analytics Platform
More informationData Governance in the Hadoop Data Lake. Kiran Kamreddy May 2015
Data Governance in the Hadoop Data Lake Kiran Kamreddy May 2015 One Data Lake: Many Definitions A centralized repository of raw data into which many data-producing streams flow and from which downstream
More informationTransforming Industries with Data & Analytics
Chris Howard FBCS CITP Technical Lead, Big Data & Analytics IBM Executive IT Specialist Transforming Industries with Data & Analytics 2 We are making a new future for our clients, our industry and our
More informationTransitioning to a Data Driven Enterprise - What is A Data Strategy and Why Do You Need One?
Transitioning to a Data Driven Enterprise - What is A Data Strategy and Why Do You Need One? Mike Ferguson Managing Director Intelligent Business Strategies Information Builders Data Strategy Workshop
More informationHow to Run a Successful Big Data POC in 6 Weeks
Executive Summary How to Run a Successful Big Data POC in 6 Weeks A Practical Workbook to Deploy Your First Proof of Concept and Avoid Early Failure Executive Summary As big data technologies move into
More informationDansk IT Big Data i de største danske banker
Dansk IT Big Data i de største danske banker How can we realize the benefits Presentation 7/4-2016 Jens Chr. Ipsen, head of Information Management & Data Warehouse The essence of Danske Bank Vision To
More informationIBM Software Enabling business agility through real-time process visibility
IBM Software Enabling business agility through real-time process visibility IBM Business Monitor 2 Enabling business agility through real-time process visibility Highlights Understand the big picture of
More informationIBM 2010 校 园 蓝 色 加 油 站 之. 商 业 流 程 分 析 与 优 化 - Business Process Management and Optimization. Please input BU name. Hua Cheng chenghua@cn.ibm.
Please input BU name IBM 2010 校 园 蓝 色 加 油 站 之 商 业 流 程 分 析 与 优 化 - Business Process Management and Optimization Hua Cheng chenghua@cn.ibm.com Agenda Why BPM What is BPM What is BAM How BAM helps optimization
More informationTurn your information into a competitive advantage
INDLÆG 03 Data Driven Business Value Turn your information into a competitive advantage Jonas Linders 04.10.2015 (dato) CGI Group Inc. 2015 Jonas Linders Education Role Industries M.Sc Informatics Experience
More informationIBM Big Data in Government
IBM Big in Government Turning big data into smarter decisions Deepak Mohapatra Sr. Consultant Government IBM Software Group dmohapatra@us.ibm.com The Big Paradigm Shift 2 Big Creates A Challenge And an
More informationGetting Started Practical Input For Your Roadmap
Getting Started Practical Input For Your Roadmap Mike Ferguson Managing Director, Intelligent Business Strategies BA4ALL Big Data & Analytics Insight Conference Stockholm, May 2015 About Mike Ferguson
More informationData Virtualization for Agile Business Intelligence Systems and Virtual MDM. To View This Presentation as a Video Click Here
Data Virtualization for Agile Business Intelligence Systems and Virtual MDM To View This Presentation as a Video Click Here Agenda Data Virtualization New Capabilities New Challenges in Data Integration
More informationBig Data Use Case Deep Dive 5 Game Changing Use Cases for Big Data
Big Data Use Case Deep Dive 5 Game Changing Use Cases for Big Data Disruptive forces impact long standing business models across industries Pressure to do more with less Shift of power to the consumer
More informationIBM Data Warehousing and Analytics Portfolio Summary
IBM Information Management IBM Data Warehousing and Analytics Portfolio Summary Information Management Mike McCarthy IBM Corporation mmccart1@us.ibm.com IBM Information Management Portfolio Current Data
More informationUnleashing the Power of Business Intelligence
Unleashing the Power of Business Intelligence FTA Technology Conference 2010 August 3, 2010 Susan Terry, Teradata Agenda Business Intelligence Value Drivers > Integrated Data > Information Delivery > Performance
More informationKlarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance
Klarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance IBM s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice
More informationHow to Leverage Big Data in the Cloud to Gain Competitive Advantage
How to Leverage Big Data in the Cloud to Gain Competitive Advantage James Kobielus, IBM Big Data Evangelist Editor-in-Chief, IBM Data Magazine Senior Program Director, Product Marketing, Big Data Analytics
More informationVIEWPOINT. High Performance Analytics. Industry Context and Trends
VIEWPOINT High Performance Analytics Industry Context and Trends In the digital age of social media and connected devices, enterprises have a plethora of data that they can mine, to discover hidden correlations
More informationHadoop Data Hubs and BI. Supporting the migration from siloed reporting and BI to centralized services with Hadoop
Hadoop Data Hubs and BI Supporting the migration from siloed reporting and BI to centralized services with Hadoop John Allen October 2014 Introduction John Allen; computer scientist Background in data
More informationLuncheon Webinar Series May 13, 2013
Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration
More informationHow To Use Big Data For Business
Big Data Maturity - The Photo and The Movie Mike Ferguson Managing Director, Intelligent Business Strategies BA4ALL Big Data & Analytics Insight Conference Stockholm, May 2015 About Mike Ferguson Mike
More informationChapter 6 Basics of Data Integration. Fundamentals of Business Analytics RN Prasad and Seema Acharya
Chapter 6 Basics of Data Integration Fundamentals of Business Analytics Learning Objectives and Learning Outcomes Learning Objectives 1. Concepts of data integration 2. Needs and advantages of using data
More informationBusiness Data Authority: A data organization for strategic advantage
Business Data Authority: A data organization for strategic advantage Collibra Data Governance Software Company Reference Customers Business Data Growth and Challenge TREND Exploding volume, velocity and
More informationIBM Software Delivering trusted information for the modern data warehouse
Delivering trusted information for the modern data warehouse Make information integration and governance a best practice in the big data era Contents 2 Introduction In ever-changing business environments,
More informationHDP Hadoop From concept to deployment.
HDP Hadoop From concept to deployment. Ankur Gupta Senior Solutions Engineer Rackspace: Page 41 27 th Jan 2015 Where are you in your Hadoop Journey? A. Researching our options B. Currently evaluating some
More informationThis Symposium brought to you by www.ttcus.com
This Symposium brought to you by www.ttcus.com Linkedin/Group: Technology Training Corporation @Techtrain Technology Training Corporation www.ttcus.com Big Data Analytics as a Service (BDAaaS) Big Data
More informationJOURNAL OF OBJECT TECHNOLOGY
JOURNAL OF OBJECT TECHNOLOGY Online at www.jot.fm. Published by ETH Zurich, Chair of Software Engineering JOT, 2008 Vol. 7, No. 8, November-December 2008 What s Your Information Agenda? Mahesh H. Dodani,
More informationBIG DATA WITHIN THE LARGE ENTERPRISE 9/19/2013. Navigating Implementation and Governance
BIG DATA WITHIN THE LARGE ENTERPRISE 9/19/2013 Navigating Implementation and Governance Purpose of Today s Talk John Adler - Data Management Group Madina Kassengaliyeva - Think Big Analytics Growing data
More informationEnd Small Thinking about Big Data
CITO Research End Small Thinking about Big Data SPONSORED BY TERADATA Introduction It is time to end small thinking about big data. Instead of thinking about how to apply the insights of big data to business
More informationIBM Software IBM Business Process Management Suite. Increase business agility with the IBM Business Process Management Suite
IBM Software IBM Business Process Management Suite Increase business agility with the IBM Business Process Management Suite 2 Increase business agility with the IBM Business Process Management Suite We
More informationBusiness Intelligence and Analytics: Leveraging Information for Value Creation and Competitive Advantage
PRACTICES REPORT BEST PRACTICES SURVEY: AGGREGATE FINDINGS REPORT Business Intelligence and Analytics: Leveraging Information for Value Creation and Competitive Advantage April 2007 Table of Contents Program
More informationData Integration Checklist
The need for data integration tools exists in every company, small to large. Whether it is extracting data that exists in spreadsheets, packaged applications, databases, sensor networks or social media
More informationINTELLIGENT BUSINESS STRATEGIES WHITE PAPER
INTELLIGENT BUSINESS STRATEGIES WHITE PAPER Improving Access to Data for Successful Business Intelligence Part 2: Supporting Multiple Analytical Workloads in a Changing Analytical Landscape By Mike Ferguson
More information5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK
5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK CUSTOMER JOURNEY Technology is radically transforming the customer journey. Today s customers are more empowered and connected
More informationPatterns of Information Management
PATTERNS OF MANAGEMENT Patterns of Information Management Making the right choices for your organization s information Summary of Patterns Mandy Chessell and Harald Smith Copyright 2011, 2012 by Mandy
More informationBIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES
BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES Relational vs. Non-Relational Architecture Relational Non-Relational Rational Predictable Traditional Agile Flexible Modern 2 Agenda Big Data
More informationBig Data lisää älyä tiedosta
2011 Tieto Corporation Big Data lisää älyä tiedosta ebusiness Forum 21.5.2013 Ilkka Korkiakoski VP Financial Services Agenda Megatrends and needs for Big Data What is the value of Big Data? Use scenarios
More informationBuilding a Data Quality Scorecard for Operational Data Governance
Building a Data Quality Scorecard for Operational Data Governance A White Paper by David Loshin WHITE PAPER Table of Contents Introduction.... 1 Establishing Business Objectives.... 1 Business Drivers...
More informationMaking Sense of Big Data in Insurance
Making Sense of Big Data in Insurance Amir Halfon, CTO, Financial Services, MarkLogic Corporation BIG DATA?.. SLIDE: 2 The Evolution of Data Management For your application data! Application- and hardware-specific
More informationIBM BPM Solutions Addressing the Enterprise Business Process Management
IBM BPM Solutions Addressing the Enterprise Business Process Management Cristina Morariu, IBM Agenda Business Process Management IBM Featured products for BPM IBM Business Process Manager IBM Case Manager
More informationMDM and Data Warehousing Complement Each Other
Master Management MDM and Warehousing Complement Each Other Greater business value from both 2011 IBM Corporation Executive Summary Master Management (MDM) and Warehousing (DW) complement each other There
More informationIT Workload Automation: Control Big Data Management Costs with Cisco Tidal Enterprise Scheduler
White Paper IT Workload Automation: Control Big Data Management Costs with Cisco Tidal Enterprise Scheduler What You Will Learn Big data environments are pushing the performance limits of business processing
More informationBig Data for Banking. Kaleem Chaudhry Senior Director, Sales Consulting, ASEAN. Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Big Data for Banking Kaleem Chaudhry Senior Director, Sales Consulting, ASEAN Big Data in Financial Services Key Business Goals: Looking beyond the credit bureau report to assess consumer credit worthiness
More informationBusiness Intelligence for the Chief Data Officer
Aug 20, 2014 DAMA - CHICAGO Business Intelligence for the Chief Data Officer Don Soulsby Sandhill Consultants Who we are: Sandhill Consultants Sandhill is a global company servicing the data, process modeling
More informationSafe Harbor Statement
Defining a Roadmap to Big Data Success Robert Stackowiak, Oracle Vice President, Big Data 17 November 2015 Safe Harbor Statement The following is intended to outline our general product direction. It is
More informationBig Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth
MAKING BIG DATA COME ALIVE Big Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth Steve Gonzales, Principal Manager steve.gonzales@thinkbiganalytics.com
More informationThe Future of Data Management
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class
More informationDATA VISUALIZATION: CONVERTING INFORMATION TO DECISIONS DAVID FRONING, PRINCIPAL PRODUCT MANAGER
DATA VISUALIZATION: CONVERTING INFORMATION TO DECISIONS DAVID FRONING, PRINCIPAL PRODUCT MANAGER SAS WHO WE ARE World leader in analytics Founded in 1976 400 offices world-wide Used at 65,000 sites in
More informationThe Big Data Revolution: welcome to the Cognitive Era.
The Big Data Revolution: welcome to the Cognitive Era. Yves Eychenne, Cloud Advisor, IBM Email: yves.eychenne@fr.ibm.com @yeychenne 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION Agenda Big Data and
More informationENTERPRISE BI AND DATA DISCOVERY, FINALLY
Enterprise-caliber Cloud BI ENTERPRISE BI AND DATA DISCOVERY, FINALLY Southard Jones, Vice President, Product Strategy 1 AGENDA Market Trends Cloud BI Market Surveys Visualization, Data Discovery, & Self-Service
More informationBruhati Technologies. About us. ISO 9001:2008 certified. Technology fit for Business
Bruhati Technologies ISO 9001:2008 certified Technology fit for Business About us 1 Strong, agile and adaptive Leadership Geared up technologies for and fast moving long lasting With sound understanding
More informationBig Data and New Paradigms in Information Management. Vladimir Videnovic Institute for Information Management
Big Data and New Paradigms in Information Management Vladimir Videnovic Institute for Information Management 2 "I am certainly not an advocate for frequent and untried changes laws and institutions must
More informationwww.pwc.com Implementation of Big Data and Analytics Projects with Big Data Discovery and BICS March 2015
www.pwc.com Implementation of Big Data and Analytics Projects with Big Data Discovery and BICS Agenda Big Data Discovery Oracle Business Intelligence Cloud Services (BICS) Use Cases How to start and our
More informationGet Ready for Big Data with IBM System z
Get Ready for Big Data with IBM System z Product strategy SHARE 2012, Anaheim Mark Simmonds System z Information Management Product Marketing Disclaimer IBM s statements regarding its plans, directions,
More informationTraditional BI vs. Business Data Lake A comparison
Traditional BI vs. Business Data Lake A comparison The need for new thinking around data storage and analysis Traditional Business Intelligence (BI) systems provide various levels and kinds of analyses
More informationThree Open Blueprints For Big Data Success
White Paper: Three Open Blueprints For Big Data Success Featuring Pentaho s Open Data Integration Platform Inside: Leverage open framework and open source Kickstart your efforts with repeatable blueprints
More informationBeyond Lambda - how to get from logical to physical. Artur Borycki, Director International Technology & Innovations
Beyond Lambda - how to get from logical to physical Artur Borycki, Director International Technology & Innovations Simplification & Efficiency Teradata believe in the principles of self-service, automation
More informationData Refinery with Big Data Aspects
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data
More informationBig Data and Big Data Governance
The First Step in Information Big Data and Big Data Governance Kelle O Neal kelle@firstsanfranciscopartners.com 15-25- 9661 @1stsanfrancisco www.firstsanfranciscopartners.com Table of Contents Big Data
More informationIBM Big Data Platform
IBM Big Data Platform Turning big data into smarter decisions Stefan Söderlund. IBM kundarkitekt, Försvarsmakten Sesam vår-seminarie Big Data, Bigga byte kräver Pigga Hertz! May 16, 2013 By 2015, 80% of
More informationApril 2016 JPoint Moscow, Russia. How to Apply Big Data Analytics and Machine Learning to Real Time Processing. Kai Wähner. kwaehner@tibco.
April 2016 JPoint Moscow, Russia How to Apply Big Data Analytics and Machine Learning to Real Time Processing Kai Wähner kwaehner@tibco.com @KaiWaehner www.kai-waehner.de LinkedIn / Xing Please connect!
More informationThe Future of Data Management with Hadoop and the Enterprise Data Hub
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah Cofounder & CTO, Cloudera, Inc. Twitter: @awadallah 1 2 Cloudera Snapshot Founded 2008, by former employees of Employees
More informationWhitepaper Data Governance Roadmap for IT Executives Valeh Nazemoff
Whitepaper Data Governance Roadmap for IT Executives Valeh Nazemoff The Challenge IT Executives are challenged with issues around data, compliancy, regulation and making confident decisions on their business
More informationCisco IT Hadoop Journey
Cisco IT Hadoop Journey Srini Desikan, Program Manager IT 2015 MapR Technologies 1 Agenda Hadoop Platform Timeline Key Decisions / Lessons Learnt Data Lake Hadoop s place in IT Data Platforms Use Cases
More information