Big Data for Good or Evil Lessons from the NSA PRISM Scandal

Size: px
Start display at page:

Download "Big Data for Good or Evil Lessons from the NSA PRISM Scandal"

Transcription

1 Big Data for Good or Evil Lessons from the NSA PRISM Scandal Jason Bloomberg About Jason Bloomberg President of ZapThink, a Dovel Technologies Company One of the original Managing Partners of ZapThink LLC Acquired by Dovel Technologies in August 2011 Global thought leader in the areas of Cloud Computing, EA, & SOA Created the Licensed ZapThink Architect (LZA) SOA course & associated credential Run LZA course & Enterprise Cloud Computing course around the world Analyst for GigaOM and blogger for DevX New book, The Agile Architecture Revolution, is now available! 2 1

2 What are Big Data? Datasets whose size is beyond the ability of typical database software tools to capture, store, manage & analyze Big Data Technology Landscape 4 2

3 Today s Big Data are Tomorrow s Small Data? Definition intentionally subjective & moving definition of how big a dataset must be No fixed threshold As technology advances, size of datasets that qualify will increase 5 What about yesterday s data? Big Data May Include Historical Data If the amount of data doubles every two years, then half your data are always over two years old 6 3

4 Big Data Crisis Point Quantity & complexity of information The Big Data crisis point Ability to deal with quantity & complexity of information Time 7 Parkinson s Law (Big Data Corollary) Quantity of data will always expand to exceed available capacity for storing & processing it 8 4

5 If Someone Can Collect Big Data, then Someone Will Corollary to Parkinson s Law in action If you re not collecting Big Data, then someone else is The easier it is to collect Big Data, the more important it is to govern them 9 You must govern your metadata Metadata may even contain most of the business value Not just technical value Metadata governance at least as important as data governance Metadata may be Big Data as Well 10 5

6 Govern the Data You Don t Want Big Data analytics focuses on finding the nuggets of gold in the dross The data you don t want must still be governed, secured, & managed As Big Data sets grow, governing the dross is increasingly challenging 11 Not just valuable but dangerous Personally identifiable information Risk of false positives Big Data Results May be Dangerous Nuggets of Uranium, not Gold 12 6

7 Big Data Used to Mislead According to the figures published by a major tech provider, the Internet carries 1,826 Petabytes of information per day. In its foreign intelligence mission, NSA touches about 1.6% of that. However, of the 1.6% of the data, only 0.025% is actually selected for review. The net effect is that NSA analysts look at % of the world s traffic in conducting their mission that s less than one part in a million. Put another way, if a standard basketball court represented the global communications environment, NSA s total collection would be represented by an area smaller than a dime on that basketball court. NSA 13 In Other Words 7.5 terabytes of analytical results to process manually every day Would be equivalent of Call Detail Records for 5 million calls every day per person on the planet! 14 7

8 Wrong Conclusion? NSA spies on data in the US, so Keep your data out of the US, right? Assumes: Your country isn t spying on you too! Your country isn t working with the NSA! The NSA can t spy on data outside the US! What are your Big Data policies? 15 Governance the Old Way Information Problem Tools Policies for using the tools Governance 16 8

9 Today s Data Governance (simplified) Our data are unclean! Great! Here are policies & processes for how to manage data quality using our tool. Let s use this data quality tool. 17 Governance the New Way Information Problem Tools Policies for using the tools Meta-policies for dealing with governance Next-generation governance tools Best practice approach to Big Data Crisis 18 9

10 Meta Thinking Meta-requirement Requirement that applies to other requirements E.g., Business Agility requirement Meta-methodology Methodology for creating or modifying methodologies Following the Agile principle responding to change over following a plan even if the plan is to follow Agile Meta-policy Policy for how to perform governance 19 Dealing with Change Meta thinking doesn t look at something Meta thinking means looking at how something changes Meta thinking is typically manual Always includes people 20 10

11 Avoiding Hall of Mirrors Problem Meta-policy: how to we automate policy enforcement? Meta-meta-policy: how to we automate metapolicy enforcement? Answer: we don t (yet)! 21 Big Data Governance (even more simplified), part 1 We have too much information! Great! Here are policies & processes for how to use the Big Data tool. Let s use this Big Data tool. Uhh, our Big Data got too big for the tool

12 Big Data Governance, part 2 Dang. Here s our policy for how to deal with ever-increasing quantities of data. Huh? We need a way to manage policies for dealing with ongoing Big Data challenges 23 Especially if central challenge is data quality Big Data sets tend to be unclean Structured, semi-structured, & unstructured Good and bad mixed together The move from traditional analytics to Big Data analytics is a move to poorer levels of data quality Big Data Analytics Tools May be Governance Tools 24 12

13 Not just governance of technology Governance with technology Largely automated Proactive Inherently iterative Not your Parents Governance! Agile 25 Governance Leads to Empowerment The more powerful the tools, the more important it is that people know how to use them properly IT should empower the people in the organization 26 13

14 SOA Governance (Supposedly) Works this Way! SOA Policy Security Policies, Routing Policies, etc. Registry/ Repository Policies for handling governance in the reg/rep ESB Meta-policy 27 Cloud shifts IT provisioning & management to the user Cloud automates previously manual tasks Greater risk of mucking things up How Cloud Changes the Equation Increased need for governance 28 14

15 Next Generation Governance 29 the Key to the Big Data Explosion 30 15

16 Big Data will always be too big Big Data challenge will always be changing Next-generation data governance tools must drive business agility Our Tools are Only as Good as our Architecture Tools will always fall short without architecture that supports and drives change 31 Book Giveaway! Jason Bloomberg President ZapThink, a Dovel Technologies 16

Big Data for Good or Evil Lessons from the NSA PRISM Scandal

Big Data for Good or Evil Lessons from the NSA PRISM Scandal Big Data for Good or Evil Lessons from the NSA PRISM Scandal Jason Bloomberg Chief Evangelist jason@enterpriseweb.com @theebizwizard Copyright 2014, EnterpriseWeb LLC EnterpriseWeb is a Registered Trademark

More information

Governance: The Key to Agile Architecture

Governance: The Key to Agile Architecture Governance: The Key to Agile Architecture Jason Bloomberg, President ZapThink, A Dovel Technologies Company About Jason Bloomberg President of ZapThink, a Dovel Technologies Company One of the original

More information

Topic Change Governance for the Agile Enterprise a Service Oriented Architecture (SOA) Perspective

Topic Change Governance for the Agile Enterprise a Service Oriented Architecture (SOA) Perspective Topic Change Governance for the Agile Enterprise a Service Oriented Architecture (SOA) Perspective Document White Paper Author(s) Kelly A. Shaw, Ph.D. Research Analyst, Serena Software Brent Carlson, VP

More information

The Agile Architecture Revolution. How Cloud Computing, REST-Based SOA, and Mobile Computing Are Changing Enterprise IT. Wiley CIO

The Agile Architecture Revolution. How Cloud Computing, REST-Based SOA, and Mobile Computing Are Changing Enterprise IT. Wiley CIO Brochure More information from http://www.researchandmarkets.com/reports/2329791/ The Agile Architecture Revolution. How Cloud Computing, REST-Based SOA, and Mobile Computing Are Changing Enterprise IT.

More information

JOURNAL OF OBJECT TECHNOLOGY

JOURNAL OF OBJECT TECHNOLOGY JOURNAL OF OBJECT TECHNOLOGY Online at www.jot.fm. Published by ETH Zurich, Chair of Software Engineering JOT, 2008 Vol. 7, No. 8, November-December 2008 What s Your Information Agenda? Mahesh H. Dodani,

More information

We are Big Data A Sonian Whitepaper

We are Big Data A Sonian Whitepaper EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed

More information

Testing Web Services Today and Tomorrow

Testing Web Services Today and Tomorrow Copyright Rational Software 2002 http://www.therationaledge.com/content/oct_02/m_webtesting_jb.jsp Testing Web Services Today and Tomorrow by Jason Bloomberg Senior Analyst ZapThink LLC With all the attention

More information

Silver Level Intellyx Influence Subscription

Silver Level Intellyx Influence Subscription Proposal and Contract Silver Level Intellyx Influence Subscription Summary Intellyx is the leading advisory, analysis, and thought leadership firm focused on architecting business agility in the enterprise.

More information

Cloud First Does Not Have to Mean Cloud Exclusively. Digital Government Institute s Cloud Computing & Data Center Conference, September 2014

Cloud First Does Not Have to Mean Cloud Exclusively. Digital Government Institute s Cloud Computing & Data Center Conference, September 2014 Cloud First Does Not Have to Mean Cloud Exclusively Digital Government Institute s Cloud Computing & Data Center Conference, September 2014 Am I part of a cloud first organization? Am I part of a cloud

More information

Business white paper. Lower risk and cost with proactive information governance

Business white paper. Lower risk and cost with proactive information governance Business white paper Lower risk and cost with proactive information governance Table of contents 3 Executive summary 4 Information governance: the new business imperative 4 A perfect storm of information

More information

Operations Management for Virtual and Cloud Infrastructures: A Best Practices Guide

Operations Management for Virtual and Cloud Infrastructures: A Best Practices Guide Operations Management for Virtual and Cloud Infrastructures: A Best Practices Guide Introduction Performance Management: Holistic Visibility and Awareness Over the last ten years, virtualization has become

More information

Independent process platform

Independent process platform Independent process platform Megatrend in infrastructure software Dr. Wolfram Jost CTO February 22, 2012 2 Agenda Positioning BPE Strategy Cloud Strategy Data Management Strategy ETS goes Mobile Each layer

More information

THE AGILE ARCHITECTURE REVOLUTION

THE AGILE ARCHITECTURE REVOLUTION THE AGILE ARCHITECTURE REVOLUTION WILEY CIO SERIES Founded in 1807, John Wiley & Sons is the oldest independent publishing company in the United States. With offices in North America, Europe, Asia, and

More information

Five best practices for deploying a successful service-oriented architecture

Five best practices for deploying a successful service-oriented architecture IBM Global Services April 2008 Five best practices for deploying a successful service-oriented architecture Leveraging lessons learned from the IBM Academy of Technology Executive Summary Today s innovative

More information

Service Oriented Architecture and the DBA Kathy Komer Aetna Inc. New England DB2 Users Group. Tuesday June 12 1:00-2:15

Service Oriented Architecture and the DBA Kathy Komer Aetna Inc. New England DB2 Users Group. Tuesday June 12 1:00-2:15 Service Oriented Architecture and the DBA Kathy Komer Aetna Inc. New England DB2 Users Group Tuesday June 12 1:00-2:15 Service Oriented Architecture and the DBA What is Service Oriented Architecture (SOA)

More information

E-Discovery Roundtable: The State of Information Governance and Advanced Analytics

E-Discovery Roundtable: The State of Information Governance and Advanced Analytics white paper E-Discovery Roundtable: The State of Information Governance and Advanced Analytics Mindseye TABLE OF CONTENTS 2 4 4 4 7 7 8 Introduction Unstructured Corporate Data: Managing Volume and Complexity

More information

Why Data Management Matters Right Now

Why Data Management Matters Right Now Why Data Management Matters Right Now Why Data Management Matters Right Now Chapter 1: The Exponential Growth of Data Chapter 2: Data Retention Policies and Compliance Chapter 3: Accessing your Data Chapter

More information

Project Academy Series

Project Academy Series Project Academy Series Enterprise Architecture (EA) Basic Concepts, Guidance, and Success Stories Subbarao Mupparaju State Chief Enterprise Architect Ben Word Chief Enterprise Architect Ed Wiebe Chief

More information

Customer Cloud Architecture for Mobile. http://cloud-council.org/resource-hub.htm#customer-cloud-architecture-for-mobile

Customer Cloud Architecture for Mobile. http://cloud-council.org/resource-hub.htm#customer-cloud-architecture-for-mobile Customer Cloud Architecture for Mobile http://cloud-council.org/resource-hub.htm#customer-cloud-architecture-for-mobile June, 2015 1 Presenters Heather Kreger CTO International Standards, IBM US SC38 mirror

More information

Next-Generation Data Virtualization Fast and Direct Data Access, More Reuse, and Better Agility and Data Governance for BI, MDM, and SOA

Next-Generation Data Virtualization Fast and Direct Data Access, More Reuse, and Better Agility and Data Governance for BI, MDM, and SOA white paper Next-Generation Data Virtualization Fast and Direct Data Access, More Reuse, and Better Agility and Data Governance for BI, MDM, and SOA Executive Summary It s 9:00 a.m. and the CEO of a leading

More information

What s New with Informatica Data Services & PowerCenter Data Virtualization Edition

What s New with Informatica Data Services & PowerCenter Data Virtualization Edition 1 What s New with Informatica Data Services & PowerCenter Data Virtualization Edition Kevin Brady, Integration Team Lead Bonneville Power Wei Zheng, Product Management Informatica Ash Parikh, Product Marketing

More information

Data as a Service Virtualization with Enzo Unified

Data as a Service Virtualization with Enzo Unified Data as a Service Virtualization with Enzo Unified White Paper by Blue Syntax Abstract: This white paper explains how companies can benefit from a Data as a Service virtualization layer and build a data

More information

SOA, Cloud Computing & Semantic Web Technology: Understanding How They Can Work Together. Thomas Erl, Arcitura Education Inc. & SOA Systems Inc.

SOA, Cloud Computing & Semantic Web Technology: Understanding How They Can Work Together. Thomas Erl, Arcitura Education Inc. & SOA Systems Inc. SOA, Cloud Computing & Semantic Web Technology: Understanding How They Can Work Together Thomas Erl, Arcitura Education Inc. & SOA Systems Inc. Overview SOA + Cloud Computing SOA + Semantic Web Technology

More information

Federal Enterprise Architecture and Service-Oriented Architecture

Federal Enterprise Architecture and Service-Oriented Architecture Federal Enterprise Architecture and Service-Oriented Architecture Concepts and Synergies Melvin Greer Chief Strategist, SOA / Cloud Computing Certified Enterprise Architect Copyright August 19, 2010 2010

More information

What to Look for When Selecting a Master Data Management Solution

What to Look for When Selecting a Master Data Management Solution What to Look for When Selecting a Master Data Management Solution What to Look for When Selecting a Master Data Management Solution Table of Contents Business Drivers of MDM... 3 Next-Generation MDM...

More information

Data Center Network Evolution: Increase the Value of IT in Your Organization

Data Center Network Evolution: Increase the Value of IT in Your Organization White Paper Data Center Network Evolution: Increase the Value of IT in Your Organization What You Will Learn New operating demands and technology trends are changing the role of IT and introducing new

More information

7 Things to Consider Before Implementing a "Big Data" Solution

7 Things to Consider Before Implementing a Big Data Solution White Paper 7 Things to Consider Before Implementing a "Big Data" Solution Power Your Business with Big Data Solutions 7 Things to Consider Before Implementing a "Big Data" Solution P a g e 2 Introduction

More information

Cloud-Era File Sharing and Collaboration

Cloud-Era File Sharing and Collaboration Cloud-Era File Sharing and Collaboration Maginatics Cloud Storage Platform Perspective 2012 Neovise, LLC. All Rights Reserved. Report Published July 29, 2014 Introduction Distributed file systems have

More information

3 MUST-HAVES IN PUBLIC SECTOR INFORMATION GOVERNANCE

3 MUST-HAVES IN PUBLIC SECTOR INFORMATION GOVERNANCE EXECUTIVE SUMMARY Information governance incorporates the policies, controls and information lifecycle management processes organizations and government agencies utilize to control cost and risk. With

More information

Argyle Conversations. by Argyle Executive Forum SM Streamlining the. ediscovery Process

Argyle Conversations. by Argyle Executive Forum SM Streamlining the. ediscovery Process Argyle Conversations by Argyle Executive Forum SM Streamlining the ediscovery Process Joe Garber, VP, information governance, HP Autonomy, on the cost- and time-saving benefits of information governance

More information

Introduction to BPM. Dr. Setrag Khoshafian. Chief Evangelist & VP of BPM Technology

Introduction to BPM. Dr. Setrag Khoshafian. Chief Evangelist & VP of BPM Technology Introduction to BPM Dr. Setrag Khoshafian Chief Evangelist & VP of BPM Technology Agenda: Business Transformation Through BPM Suite The Vision: Realizing the Adaptive Enterprise What is a BPM Suite? How

More information

JBOSS ENTERPRISE SOA PLATFORM AND JBOSS ENTERPRISE DATA SERVICES PLATFORM VALUE PROPOSITION AND DIFFERENTIATION

JBOSS ENTERPRISE SOA PLATFORM AND JBOSS ENTERPRISE DATA SERVICES PLATFORM VALUE PROPOSITION AND DIFFERENTIATION JBOSS ENTERPRISE SOA PLATFORM AND JBOSS ENTERPRISE DATA SERVICES PLATFORM VALUE PROPOSITION AND DIFFERENTIATION Service-oriented architecture (SOA) gives enterprises the ability to identify and respond

More information

How ediscovery Technology Can Accelerate Information Governance for Corporations

How ediscovery Technology Can Accelerate Information Governance for Corporations Nuix Insight Paper How ediscovery Technology Can Accelerate Information Governance for Corporations With risk management and operational efficiencies becoming strategic priorities for both private and

More information

Reaching Customers Across Multiple Channels

Reaching Customers Across Multiple Channels Leading Provider of Cloud-Based Customer Experience Solutions Relies on Integrated, Modular WSO2 Middleware to Speed the Delivery of Services that Enhance User Engagement Businesses recognize that brand

More information

Software defined networking. Your path to an agile hybrid cloud network

Software defined networking. Your path to an agile hybrid cloud network Software defined networking Your path to an agile hybrid cloud network Is your enterprise network ready for the latest business and consumer trends? Cloud How easily can your users connect to cloud resources?

More information

Building a Scalable Big Data Infrastructure for Dynamic Workflows

Building a Scalable Big Data Infrastructure for Dynamic Workflows Building a Scalable Big Data Infrastructure for Dynamic Workflows INTRODUCTION Organizations of all types and sizes are looking to big data to help them make faster, more intelligent decisions. Many efforts

More information

IBM i2 Enterprise Insight Analysis for Cyber Analysis

IBM i2 Enterprise Insight Analysis for Cyber Analysis IBM i2 Enterprise Insight Analysis for Cyber Analysis Protect your organization with cyber intelligence Highlights Quickly identify threats, threat actors and hidden connections with multidimensional analytics

More information

Solving the Security Puzzle

Solving the Security Puzzle Solving the Security Puzzle How Government Agencies Can Mitigate Today s Threats Abstract The federal government is in the midst of a massive IT revolution. The rapid adoption of mobile, cloud and Big

More information

Cisco, Big Data and the Internet of Everything. Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center

Cisco, Big Data and the Internet of Everything. Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center Cisco, Big Data and the Internet of Everything Paul Davies, Big Data Sales Solution Leader, EMEAR Data Center BILLIONS OF DEVICES Increasingly Everything will be Connected to Everything The Internet of

More information

A Comprehensive Solution for API Management

A Comprehensive Solution for API Management An Oracle White Paper March 2015 A Comprehensive Solution for API Management Executive Summary... 3 What is API Management?... 4 Defining an API Management Strategy... 5 API Management Solutions from Oracle...

More information

BPM and Rules Technical Update. Sunil Aggarwal, WebSphere BPM Leader UK&I

BPM and Rules Technical Update. Sunil Aggarwal, WebSphere BPM Leader UK&I BPM and Rules Technical Update Sunil Aggarwal, WebSphere BPM Leader UK&I 1 2 IBM BPM Overview 3 Change, complexity and uncertainty have become the new normal Escalating expectations require visibility

More information

Effective Data Integration - where to begin. Bryte Systems

Effective Data Integration - where to begin. Bryte Systems Effective Data Integration - where to begin Bryte Systems making data work Bryte Systems specialises is providing innovative and cutting-edge data integration and data access solutions and products to

More information

HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica

HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica So What s the market s definition of Big Data? Datasets whose volume, velocity, variety

More information

BUILT-IN BUSINESS INTELLIGENCE

BUILT-IN BUSINESS INTELLIGENCE BUILT-IN BUSINESS INTELLIGENCE A study conducted by IFS North America JULY 2014 CURRENT STATE OF BUSINESS INTELLIGENCE BASED ON A SURVEY OF 174 EXECUTIVES METHODOLOGY IFS North America and Advantage Business

More information

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage If every image made and every word written from the earliest stirring of civilization

More information

Test Data Management in the New Era of Computing

Test Data Management in the New Era of Computing Test Data Management in the New Era of Computing Vinod Khader IBM InfoSphere Optim Development Agenda Changing Business Environment and Data Management Challenges What is Test Data Management Best Practices

More information

MarkLogic Enterprise Data Layer

MarkLogic Enterprise Data Layer MarkLogic Enterprise Data Layer MarkLogic Enterprise Data Layer MarkLogic Enterprise Data Layer September 2011 September 2011 September 2011 Table of Contents Executive Summary... 3 An Enterprise Data

More information

Data Growth Presents Challenges And Opportunities

Data Growth Presents Challenges And Opportunities A Custom Technology Adoption Profile Commissioned By AT&T August 2012 Introduction Today s CIO faces many challenges. Businesses are craving data as they look to remain competitive, and scour external

More information

Forward Thinking for Tomorrow s Projects Requirements for Business Analytics

Forward Thinking for Tomorrow s Projects Requirements for Business Analytics Seilevel Whitepaper Forward Thinking for Tomorrow s Projects Requirements for Business Analytics By: Joy Beatty, VP of Research & Development & Karl Wiegers, Founder Process Impact We are seeing a change

More information

What is Application Lifecycle Management?

What is Application Lifecycle Management? What is Application Lifecycle Management? David Chappell Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Defining application lifecycle management (ALM) isn t easy. Different people

More information

WHITEPAPER BIG DATA GOVERNANCE. How To Avoid The Pitfalls of Big Data Governance? www.analytixds.com

WHITEPAPER BIG DATA GOVERNANCE. How To Avoid The Pitfalls of Big Data Governance? www.analytixds.com BIG DATA GOVERNANCE How To Avoid The Pitfalls of Big Data Governance? of The need to provide answers quickly... 3 You can t measure what you don t manage... 3 Aligning the overall architecture with the

More information

Agilità per perseguire nuovi modelli di business e creare nuovo valore nel mercato delle utilities. Cristina Viscontino SoftwareAG Solution Architect

Agilità per perseguire nuovi modelli di business e creare nuovo valore nel mercato delle utilities. Cristina Viscontino SoftwareAG Solution Architect Agilità per perseguire nuovi modelli di business e creare nuovo valore nel mercato delle utilities Cristina Viscontino SoftwareAG Solution Architect Software AG Agilità per perseguire nuovi modelli di

More information

ECM Migration Without Disrupting Your Business: Seven Steps to Effectively Move Your Documents

ECM Migration Without Disrupting Your Business: Seven Steps to Effectively Move Your Documents ECM Migration Without Disrupting Your Business: Seven Steps to Effectively Move Your Documents A White Paper by Zia Consulting, Inc. Planning your ECM migration is just as important as selecting and implementing

More information

Klarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance

Klarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance Klarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance IBM s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice

More information

A Hurwitz white paper. Inventing the Future. Judith Hurwitz President and CEO. Sponsored by Hitachi

A Hurwitz white paper. Inventing the Future. Judith Hurwitz President and CEO. Sponsored by Hitachi Judith Hurwitz President and CEO Sponsored by Hitachi Introduction Only a few years ago, the greatest concern for businesses was being able to link traditional IT with the requirements of business units.

More information

III Big Data Technologies

III Big Data Technologies III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

IBM Software IBM Business Process Management Suite. Increase business agility with the IBM Business Process Management Suite

IBM Software IBM Business Process Management Suite. Increase business agility with the IBM Business Process Management Suite IBM Software IBM Business Process Management Suite Increase business agility with the IBM Business Process Management Suite 2 Increase business agility with the IBM Business Process Management Suite We

More information

zapnote Analyst: Jason Bloomberg

zapnote Analyst: Jason Bloomberg zapthink zapnote ZAPTHINK ZAPNOTE Doc. ID: ZTZN-1210 Released: Feb. 2, 2007 HYFINITY ENABLING RICH, COMPOSITE WEB APPLICATIONS Analyst: Jason Bloomberg Abstract Web application development is becoming

More information

Service Governance and Virtualization For SOA

Service Governance and Virtualization For SOA Service Governance and Virtualization For SOA Frank Cohen Email: fcohen@pushtotest.com Brian Bartel Email: bbartel@pushtotest.com November 7, 2006 Table of Contents Introduction 3 Design-Time Software

More information

Case Study EPA. Agency-Wide Governance of Reusable Components

Case Study EPA. Agency-Wide Governance of Reusable Components Case Study EPA Agency-Wide Governance of Reusable Components Lico Galindo, PMP IT Specialist Data Standards Branch Office of Environmental Information Case Study EPA: Agency-Wide Governance of Reusable

More information

BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS

BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS BUILDING A SCALABLE BIG DATA INFRASTRUCTURE FOR DYNAMIC WORKFLOWS ESSENTIALS Executive Summary Big Data is placing new demands on IT infrastructures. The challenge is how to meet growing performance demands

More information

The Way to SOA Concept, Architectural Components and Organization

The Way to SOA Concept, Architectural Components and Organization The Way to SOA Concept, Architectural Components and Organization Eric Scholz Director Product Management Software AG Seite 1 Goals of business and IT Business Goals Increase business agility Support new

More information

INTELLIGENT BUSINESS STRATEGIES WHITE PAPER

INTELLIGENT BUSINESS STRATEGIES WHITE PAPER INTELLIGENT BUSINESS STRATEGIES WHITE PAPER Improving Access to Data for Successful Business Intelligence Part 1: Meeting Today s Business Requirements in an Increasingly Complex Environment By Mike Ferguson

More information

An Enterprise Architect s Guide to API Integration for ESB and SOA

An Enterprise Architect s Guide to API Integration for ESB and SOA An Enterprise Architect s Guide to API Integration for ESB and SOA The New Digital Imperative While some are still adjusting to the idea, you re well aware that we re living in an application economy.

More information

Real World Application and Usage of IBM Advanced Analytics Technology

Real World Application and Usage of IBM Advanced Analytics Technology Real World Application and Usage of IBM Advanced Analytics Technology Anthony J. Young Pre-Sales Architect for IBM Advanced Analytics February 21, 2014 Welcome Anthony J. Young Lives in Austin, TX Focused

More information

Increasing the Effectiveness and Efficiency of SOA through Governance

<Insert Picture Here> Increasing the Effectiveness and Efficiency of SOA through Governance Increasing the Effectiveness and Efficiency of SOA through Governance Enrique Martín MW Presales Manager. Oracle Agenda Challenges Solved with SOA Governance Oracle s SOA Governance:

More information

Self-Service in the world of Data Integration

Self-Service in the world of Data Integration Self-Service in the world of Data Integration April 2011 San Francisco DAMA Meeting Diby Malakar Director Product Management 1 Agenda Introduction Business Problem Lean and Agile Data Integration Self-Service

More information

VARONIS WHITEPAPER. Mastering the Information Explosion

VARONIS WHITEPAPER. Mastering the Information Explosion VARONIS WHITEPAPER CONTENTS INTRODUCTION 3 UNSTRUCTURED DATA 4 80% of Your Data is Unstructured 4 Unstructured Data Growth Is Exponential 4 A Greater Portion of it Needs to be Managed and Secured 4 Complexity

More information

SOA: The missing link between Enterprise Architecture and Solution Architecture

SOA: The missing link between Enterprise Architecture and Solution Architecture SOA: The missing link between Enterprise Architecture and Solution Architecture Jaidip Banerjee and Sohel Aziz Enterprise Architecture (EA) is increasingly being acknowledged as the way to maximize existing

More information

SERVICE ORIENTED ARCHITECTURE

SERVICE ORIENTED ARCHITECTURE SERVICE ORIENTED ARCHITECTURE Introduction SOA provides an enterprise architecture that supports building connected enterprise applications to provide solutions to business problems. SOA facilitates the

More information

RED HAT AND HORTONWORKS: OPEN MODERN DATA ARCHITECTURE FOR THE ENTERPRISE

RED HAT AND HORTONWORKS: OPEN MODERN DATA ARCHITECTURE FOR THE ENTERPRISE WHITEPAPER RED HAT AND HORTONWORKS: OPEN MODERN DATA ARCHITECTURE FOR THE ENTERPRISE A Hortonworks and Red Hat whitepaper INTRODUCTION WHAT IS HADOOP? Apache Hadoop is an opensource technology born out

More information

North Highland Data and Analytics. Data Governance Considerations for Big Data Analytics

North Highland Data and Analytics. Data Governance Considerations for Big Data Analytics North Highland and Analytics Governance Considerations for Big Analytics Agenda Traditional BI/Analytics vs. Big Analytics Types of Requiring Governance Key Considerations Information Framework Organizational

More information

How to Run a Successful Big Data POC in 6 Weeks

How to Run a Successful Big Data POC in 6 Weeks Executive Summary How to Run a Successful Big Data POC in 6 Weeks A Practical Workbook to Deploy Your First Proof of Concept and Avoid Early Failure Executive Summary As big data technologies move into

More information

Third Platform Apps & EMC: Redefining IT & Helping Our Customers Lead The Way. Name

Third Platform Apps & EMC: Redefining IT & Helping Our Customers Lead The Way. Name 1 Third Platform Apps & EMC: Redefining IT & Helping Our Customers Lead The Way Name 2 3 Home, Driving & Work 3 rd Platform A Definition Four Interdependent Trends: Social Interaction, Mobility, Cloud,

More information

BIG DATA THE NEW OPPORTUNITY

BIG DATA THE NEW OPPORTUNITY Feature Biswajit Mohapatra is an IBM Certified Consultant and a global integrated delivery leader for IBM s AMS business application modernization (BAM) practice. He is IBM India s competency head for

More information

Tap into Big Data at the Speed of Business

Tap into Big Data at the Speed of Business SAP Brief SAP Technology SAP Sybase IQ Objectives Tap into Big Data at the Speed of Business A simpler, more affordable approach to Big Data analytics A simpler, more affordable approach to Big Data analytics

More information

The Business in Business Intelligence. Bryan Eargle Database Development and Administration IT Services Division

The Business in Business Intelligence. Bryan Eargle Database Development and Administration IT Services Division The Business in Business Intelligence Bryan Eargle Database Development and Administration IT Services Division Defining Business Intelligence (BI) Agenda Goals Identify data assets Transform data and

More information

Bringing agility to Business Intelligence Metadata as key to Agile Data Warehousing. 1 P a g e. www.analytixds.com

Bringing agility to Business Intelligence Metadata as key to Agile Data Warehousing. 1 P a g e. www.analytixds.com Bringing agility to Business Intelligence Metadata as key to Agile Data Warehousing 1 P a g e Table of Contents What is the key to agility in Data Warehousing?... 3 The need to address requirements completely....

More information

Open Source Innovation Conference

Open Source Innovation Conference Open Source Innovation Conference Open Source as Competitive Advantage Joe Dickman Senior Vice President, Vizuri Applied Engineering Management Corporation Agenda Introductions Use of Open Source Technologies

More information

Beyond the Data Lake

Beyond the Data Lake WHITE PAPER Beyond the Data Lake Managing Big Data for Value Creation In this white paper 1 The Data Lake Fallacy 2 Moving Beyond Data Lakes 3 A Big Data Warehouse Supports Strategy, Value Creation Beyond

More information

Enterprise IT Architectures BPM (Business Process Management)

Enterprise IT Architectures BPM (Business Process Management) Dr. Hans-Peter Hoidn Executive Architect, IBM Distinguished IT Architect (Opengroup) Enterprise IT Architectures BPM (Business Process Management) Introduction 2 Agenda of this Part Business Process Management

More information

OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT

OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT WHITEPAPER OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT A top-tier global bank s end-of-day risk analysis jobs didn t complete in time for the next start of trading day. To solve

More information

As SOA momentum is picking up in the

As SOA momentum is picking up in the SETLabs Briefings VOL 5 NO 1 Jan - Mar 2007 SOA Technology Competency Center By Shreyas Kamat Organizational need to manage SOA transformation effectively has bolstered the growth of SOA TCC concept As

More information

Informatica PowerCenter Data Virtualization Edition

Informatica PowerCenter Data Virtualization Edition Data Sheet Informatica PowerCenter Data Virtualization Edition Benefits Rapidly deliver new critical data and reports across applications and warehouses Access, merge, profile, transform, cleanse data

More information

VMware vcenter Log Insight Delivers Immediate Value to IT Operations. The Value of VMware vcenter Log Insight : The Customer Perspective

VMware vcenter Log Insight Delivers Immediate Value to IT Operations. The Value of VMware vcenter Log Insight : The Customer Perspective VMware vcenter Log Insight Delivers Immediate Value to IT Operations VMware vcenter Log Insight VMware vcenter Log Insight delivers a powerful real-time log management for VMware environments, with machine

More information

EMC ADVERTISING ANALYTICS SERVICE FOR MEDIA & ENTERTAINMENT

EMC ADVERTISING ANALYTICS SERVICE FOR MEDIA & ENTERTAINMENT EMC ADVERTISING ANALYTICS SERVICE FOR MEDIA & ENTERTAINMENT Leveraging analytics for actionable insight ESSENTIALS Put your Big Data to work for you Pick the best-fit, priority business opportunity and

More information

FTA Technology 2009 IT Modernization and Business Rules Extraction

FTA Technology 2009 IT Modernization and Business Rules Extraction FTA Technology 2009 IT Modernization and Business Rules Extraction August 5th, 2009 _experience the commitment TM Agenda IT Modernization Business Rules Extraction Automation Tools for BRE BRE Cost and

More information

Improved SOA Portfolio Management with Enterprise Architecture and webmethods

Improved SOA Portfolio Management with Enterprise Architecture and webmethods Improved SOA Portfolio Management with Enterprise Architecture and webmethods Patrick Buech Product Management, Enterprise Architecture Management Sumeet Bhatia Senior Director, Enterprise Architecture

More information

!!!!! BIG DATA IN A DAY!

!!!!! BIG DATA IN A DAY! BIG DATA IN A DAY December 2, 2013 Underwritten by Copyright 2013 The Big Data Group, LLC. All Rights Reserved. All trademarks and registered trademarks are the property of their respective holders. EXECUTIVE

More information

Open Group SOA Governance. San Diego 2009

Open Group SOA Governance. San Diego 2009 Open Group SOA Governance San Diego 2009 SOA Governance Aspects A comprehensive view of SOA Governance includes: People Organizational structures Roles & Responsibilities Processes Governing processes

More information

Moving Towards Extended Information Management (within Ecosystems)

Moving Towards Extended Information Management (within Ecosystems) Moving Towards Extended Information Management (within Ecosystems) Juha Kauhanen September 2015 Introduction and key concepts As the economy and the society overall connects ever more deeply and intricately,

More information

Accenture Human Capital Services for SuccessFactors

Accenture Human Capital Services for SuccessFactors Accenture Human Capital Services for SuccessFactors Workforce and talent management have never been so critical to business value. To achieve high performance, global enterprises are seeking measurable

More information

One View Of Customer Data & Marketing Data

One View Of Customer Data & Marketing Data One View Of Customer Data & Marketing Data Ian Kenealy, Head of Customer Data & Analytics, RSA spoke to the CX Network and shared his thoughts on all things customer, data and analytics! Can you briefly

More information

BPM and SOA require robust and scalable information systems

BPM and SOA require robust and scalable information systems BPM and SOA require robust and scalable information systems Smart work in the smart enterprise Authors: Claus Torp Jensen, STSM and Chief Architect for SOA-BPM-EA Technical Strategy Rob High, Jr., IBM

More information

Accelerate BI Initiatives With Self-Service Data Discovery And Integration

Accelerate BI Initiatives With Self-Service Data Discovery And Integration A Custom Technology Adoption Profile Commissioned By Attivio June 2015 Accelerate BI Initiatives With Self-Service Data Discovery And Integration Introduction The rapid advancement of technology has ushered

More information

Data Discovery, Analytics, and the Enterprise Data Hub

Data Discovery, Analytics, and the Enterprise Data Hub Data Discovery, Analytics, and the Enterprise Data Hub Version: 101 Table of Contents Summary 3 Used Data and Limitations of Legacy Analytic Architecture 3 The Meaning of Data Discovery & Analytics 4 Machine

More information

A BUSINESS CASE FOR BEHAVIORAL ANALYTICS. White Paper

A BUSINESS CASE FOR BEHAVIORAL ANALYTICS. White Paper A BUSINESS CASE FOR BEHAVIORAL ANALYTICS White Paper Introduction What is Behavioral 1 In a world in which web applications and websites are becoming ever more diverse and complicated, running them effectively

More information

SOA Adoption Challenges

SOA Adoption Challenges Introduction Raju Alluri SOA adoption is evolutionary rather than revolutionary. It is a journey and not an end state. There are many challenges in the SOA journey. First and foremost, the challenge is

More information

Is Your Big Data Solution Production-Ready?

Is Your Big Data Solution Production-Ready? A Custom Technology Adoption Profile Commissioned By CenturyLink Technology Solutions January 2014 Is Your Big Data Solution Production-Ready? 1 Introduction This CenturyLink Technology Solutions (formerly

More information

Achieving Business Agility Through An Agile Data Center

Achieving Business Agility Through An Agile Data Center Achieving Business Agility Through An Agile Data Center Overview: Enable the Agile Data Center Business Agility Is Your End Goal In today s world, customers expect or even demand instant gratification

More information