Transforming Government with Big Data and Analytics
|
|
- Joan Ashlyn Jenkins
- 8 years ago
- Views:
Transcription
1 Transforming Government with Big Data and Analytics Deepak Mohapatra Sr. Consultant IBM Software Group April 29 th
2 Big Data Creates A Challenge And an Opportunity Yet requires a shift in thinking and an evolution of approach All perspectives Past (historical, aggregated) Present (real-time) Future (predictive) All people All departments Experts and non-experts Executives and employees Partners and customers All decisions Major and minor Strategic and tactical Routine and exceptions Manual and automated From structured, linear, repeatable, IT-driven, information delivery To creative, dynamic, iterative, business-driven analytics environment Data Media Content Machine Social All information analytics is moving closer to the data
3 Big Data Creates A Challenge And an Opportunity What If You Could...(Four Key Paradigm Shifts) BIG DATA TRADITIONAL & ANALYTICS APPROACH BIG DATA TRADITIONAL & ANALYTICS APPROACH All available information All Analyzed available information analyzed Small amount of carefully organized Large information amount of messy information Analyze small Analyze subsets of information all information Leverage more of the data being captured Carefully Analyze cleanse information as is, before any cleanse analysis as needed Reduce effort required to leverage data BIG DATA TRADITIONAL & ANALYTICS APPROACH BIG DATA TRADITIONAL & ANALYTICS APPROACH APPROACH Data Hypothesis Data Exploration Question Analysis Data Repository Analysis Insight Answer Insight Correlation Data Insight Start with Explore hypothesis all data and and test against identify selected correlations data Data leads the way and sometimes correlations are good enough Analyze Analyze data data after in it s motion been processed as it s and landed generated, in a warehouse in real-time or mart Leverage data as it is captured
4 Big Data Creates A Challenge And an Opportunity Harnessing Big Data For Analytics BIG DATA TRADITIONAL & ANALYTICS APPROACH APPROACH BIG DATA TRADITIONAL & ANALYTICS APPROACH APPROACH What What will has happened and what and why should you do Predict and decide the best action the realm embedded of the specialist in everything Intuitive analytics for everyone BIG DATA TRADITIONAL & ANALYTICS APPROACH APPROACH BIG DATA TRADITIONAL & ANALYTICS APPROACH Pre-programmed Learn to sense analysis and predict using on structured all types data of information Cognitive computing Scheduled Real-time Analytics as and when you need it
5 Leading The Way Government Agencies Harnessing The Value of Big Data Improved Public Safety And Mass Casualty Incident Management 60X Acceleration in Active Wild Fire behavioral analysis, with greater accuracy Smarter Cities Reduced traffic congestion, shorter travel times, enhance emergency services Maritime Emergency Management Early and accurate detection and notification of marine resource adverse events Insider Threat Perpetual credentialing and vetting across branches and bases Smarter Water 5 $120M in savings, reduction in reportable incidents
6 Leading The Way Government Agencies Harnessing The Value of Big Data National Border & Security State of The Art covert surveillance system based on Streams platform Smarter Social Services: Smarter Health Care Analytics Optimized Neo-Natal care through early detection, prevention, testing hypotheses Warfighter Care Greatly reduced frequency and severity of Traumatic Brain Injury Smarter Energy: Wind Infrastructure Optimized wind turbine energy production with longer life span and reduced maintenance Smarter HealthCare Analytics High performance analytics across a vast volume of data to spot hidden trends and relationships with Netezza
7 Leading The Way Government Agencies Harnessing The Value of Big Data Smarter Energy Enhanced collaboration across the electrical grid for greater demand and maintenance efficiency Smarter Resource Management: Watershed Intelligence Early and accurate detection and notification of events effecting watershed Smarter Social Services In Four Hours Identified $140M in Improper Payments Social Media Analytics Efficiently read, process and analyze large volumes of political debate-related, public feedback in real-time Optimized Healthcare Outcomes Asian Health Bureau Significantly improved Healthcare outcomes through automated image analysis & Information Sharing
8 Leading the Way City of Boston 8
9 Leading the Way Naval & Maritime Threat Intelligence 9
10 What We Have Learned A Deliberate Approach Is Required These experiences reveal a great irony -- that while the impact of Big Data will be transformational, the path to effectively harnessing it is not. The journey is evolutionary versus revolutionary, incremental and iterative Demystifying Big Data, TechAmerica Report, October Start with a clear business requirement, 2. Explore the Art of the Possible and define a discrete set of high value use cases. 3. Discover & Assess - Take inventory and understand your data assets, and assess your current against what is required to support your inijal use cases. 4. Select & Plan your inijal project 5. Deploy & Manage Deploy capabilijes to support the inijal use case
11 Major Capabilities 11
12 Next Generation Analytics Reference Architecture Open Architecture/ Multiple Entry Points Internal Databases Real-time Analytics Zone Content Repositories External Federated Data Data Ingestion & Integration Zone Landing Zone (Hadoop) Data Warehouse & Marts Zone Analytics, Visualization and Consumption Social Media Analytics Appliances Information Governance, Security and Business Continuity 12
13 Next Generation Architecture Zones Data in Mo)on Data at Rest Streams Data Integration Zone Stream Processing Data Integration Data Federation Data Quality Federation Real-time Analytics Zone Video/Audio Text Mining Network/Sensor Entity Analytics Predictive Landing Zone (Hadoop) Raw Data Structured Data Unstructured Data Text Analytics Data Mining Entity Analytics Machine Learning Data Warehouse & Marts Zone Structured Data Discovery Deep Reflection Operational Predictive Matching and Link Analysis Identity Resolution Matching and Linking Network Analysis Stewardship Reference Data Predictive Analytics Computational Statistics Business Intelligence Data Exploration & Visualization Collaboration Social Networking Inspectors Investigators Researchers Administrators Others Data in Many Forms Information Governance, Security & Business Continuity 13
14 Next Generation Architecture Zones with IBM Products Mapped Data in Mo)on Data at Rest Data in Many Forms 14 Streams Data Integration Zone Stream Processing Data Integration Data Federation Data Quality Federation Information Server InfoSphere Streams Real-time Analytics Zone Video/Audio Text Mining Network/Sensor Entity Analytics Predictive Landing Zone (Hadoop) Raw Data Structured Data Unstructured Data Text Analytics Data Mining Entity Analytics Machine Learning InfoSphere BigInsights, SPSS Data Warehouse & Marts Zone Structured Data Discovery Deep Reflection Operational Predictive Matching and Link Analysis Information Governance, Security & Business Continuity Optim, Guardium PureData for Analytics (Netezza) Identity Resolution Matching and Linking Network Analysis Stewardship Reference Data MDM, SPSS Predictive Analytics Computational Statistics Business Intelligence Data Exploration & Visualization SPSS Modeler SPSS Statistics Cognos Collaboration Social Networking Inspectors Investigators Researchers Administrators Others Data Explorer, i2 Analyst Notebook
15 Analytics and Visualization 15
16 Law Enforcement increasingly uses analytics to drive investigative and operational improvements to meet business challenges Analytic Technique Critical Business Question Competitive Advantage Stochastic Optimization Optimization Predictive modeling Forecasting Simulation Alerts Query/drill down Ad hoc reporting Standard Reporting Degree of Complexity How can we achieve the best outcome including the effects of variability? How can we achieve the best outcome? What will happen next if? What if these trends continue? What could happen.? What actions are needed? What exactly is the problem? How many, how often, where? What happened? Advanced Analytics Prescriptive and Predictive Support new business models and opportunities Operational Analytics Support ongoing business operations Meet compliance requirements Based on: Competing on Analytics, Davenport and Harris,
17 Analytics disciplines are powerful force multipliers and critical for success Structured data and unstructured content - made consumable and accessible appropriately Who is who? Who knows who? What is the nature of their relationship? How are persons, objects, locations and events connected? Entity Analytics What is happening? How many, how often, where? What exactly is the problem? What actions are needed? Descriptive Analytics What could happen? Simulation What if these trends continue? Forecasting What will happen next if? Predictive Modeling Predictive Analytics How can we achieve the best outcome? Optimization How can we achieve the best outcome and address variability? Stochastic Optimization Prescriptive Analytics Extracting insight, concepts and relationships from unstructured volumes Content Analytics Insights and intelligence from streaming data sources and the internet Web/Social Analytics 17
18 Data Integration Zone 18
19 The IBM Solution: IBM Information Server Delivering information you can trust IBM Information Server Unified Deployment Understand Cleanse Transform Deliver Discover, model, and govern information structure and content Standardize, merge, and correct information Combine and restructure information for new uses Synchronize, virtualize and move information for in-line delivery Unified Metadata Management Parallel Processing Rich Connectivity to Applications, Data, and Content 19
20 Managing the Information Lifecycle IBM Information Server Design Understand WHAT IS REQUIRED? WHAT ASSETS EXIST? WHAT IS MY QUALITY? Plan Discover Analyze WHAT IS THE SOLUTION? Define DATA INTEGRATION SOURCE SYSTEMS HOW CAN THIS SOLUTION BE BUILT? Develop WAREHOUSE MASTER DATA Govern WHAT IS THE INFRASTRUCTURE? IS MY INFORMATION STILL TRUSTED? Deploy Monitor HOW CAN EFFICIENCY BE IMPROVED? Optimize IS MY INFORMATION WELL MANAGED? Manage DATAMARTS DATA INTEGRATION OLAP REPORTS BUSINESS INTELLIGENCE REPORT LINEAGE Business Users 20 Subject Ma9er Experts Architects Data Analysts Developers Stewards
21 Warehousing and Marts Zone (Structured Data) 21
22 Recommended Warehousing Strategy Transactional Sources Information Integration Zone Data Warehouse and Marts Zone Other Sources Atomic Warehouse Mart-1 Power Users Landing Zone Traditional structured data analytics Data model to enable data integration processes Data value monitoring of thresholds and alerting Business intelligence reporting, slice-n-dice, dashboards, and scorecards Atomic: Detailed Historical Validated, Clean, Standardized Mart-2. Mart-n Marts: Aggregated Purpose-built Re-creatable Consumption focused Targeted User Communities E=Extract; T=Transform; L=Load 22
23 PureData System for Analytics (PDA) the Data Warehousing Appliance Simplify Move analytics into the Data Warehouse Integrate the server, storage and database into one optimized package Move complex analytics into the database Integrated, high performance analytics within the data warehouse Analytics Database Storage Server 23
24 Integrated by Design In-Database Analytics 2.0 Transformations Mathematical Geospatial Predictive Statistics Time Series Data Mining ü No data movement ü Analyze deep and wide data ü High performance, parallel computation 24
25 Spend Less Time Managing and More Time Innovating ü Easy Administration Portal ü No software installation ü No indexes and tuning ü No storage administration Simplicity and Ease of Administration No dbspace/tablespace sizing and configuration No redo/physical/logical log sizing and configuration No page/block sizing and configuration for tables No extent sizing and configuration for tables No Temp space allocation and monitoring No RAID level decisions for dbspaces No logical volume creations of files No integration of OS kernel recommendations No maintenance of OS recommended patch levels No JAD sessions to configure host/network/storage Data Experts, not Database Experts 25
26 Landing Zone for Structured and Unstructured 26
27 What is Hadoop? Apache Hadoop = free, open source framework for data-intensive applications Inspired by Google technologies (MapReduce, GFS) Well-suited to batch-oriented, read-intensive applications Originally built to address scalability problems of Nutch, an open source Web search technology Enables applications to work with thousands of nodes and petabytes of data in a highly parallel, cost effective manner CPU + disks of commodity box = Hadoop node Boxes can be combined into clusters New nodes can be added as needed without changing Data formats How data is loaded How jobs are written 27
28 From Getting Starting to Enterprise Deployment: Enterprise class Different BigInsights Editions For Varying Needs PureData for Hadoop - Appliance simplicity Enterprise Edition Sold by # of terabytes managed Quick Start Edition New for V2.1. Free. Non-production only Basic Edition Free download - Jaql - Integrated install Apache Hadoop 28 - Accelerators - Performance Optimization - Visualization Capabilities - Pre-built applications - Text analytics - Spreadsheet-style tool - RDBMS, warehouse connectivity - Administrative tools, security - - Eclipse development tools - - Enterprise Integration - - Integrated web console... PureData System for Hadoop brings BigInsights As an appliance form factor to the market Breadth of capabilities
29 BigInsights Enterprise Edition Open Source IBM Optional IBM and partner offerings Infrastructure Integrated installer Text compression Analytics and discovery Text processing engine and library BigSheets Enhanced security Indexing Accelerator for social data analysis Accelerator for machine data analysis Big SQL Oozie Lucene Apps Web Crawler Boardreader Distrib file copy... Jaql HBase ZooKeeper DB export DB import Ad hoc query Pig Hive Machine learning Data processing MapReduce Administrative and development tools Web console Monitor cluster health, jobs, etc. Add / remove nodes Start / stop services Inspect job status Inspect workflow status Deploy applications Launch apps / jobs Work with distrib file system Work with spreadsheet interface Support REST-based API... Adaptive MapReduce Flexible scheduler GPFS FPO HCatalog HDFS Eclipse tools Connectivity and Integration JDBC Sqoop DB2 Netezza Streams R Text analytics MapReduce programming Jaql, Hive, Pig development BigSheets plug-in development Oozie workflow generation Flume Data Explorer Guardium DataStage Cognos BI 29
30 BigSheets - Spreadsheet-style Analysis on Hadoop Web-based analysis and visualization of big data Familiar paradigm designed for business users Spreadsheet-like interface Define and manage long running data collection jobs Analyze content of the text on the pages that have been retrieved 30
31 Big SQL standard SQL access into Hadoop (BigInsights) Standard SQL syntax and data types Joins, unions, aggregates, etc. VARCHAR, decimal, TIMESTAMP, JDBC/ODBC drivers Prepared statements Cancel support Database metadata API support Secure socket connections (SSL) Optimization MapReduce parallelism or Local access for low-latency queries Varied storage mechanisms appropriate for Hadoop ecosystem Integration Eclipse tools DB2, Netezza, Teradata (via LOAD) Cognos Business Intelligence IBM 2013 Corporation IBM Corporation
32 BigInsights and Text Analytics Distills structured info from unstructured text Sentiment analysis Consumer behavior Illegal or suspicious activities Parses text and detects meaning with annotators Understands the context in which the text is analyzed Unstructured text (document, , etc) Football World Cup 2010, one team distinguished themselves well, losing to the eventual champions 1-0 in the Final. Early in the second half, Netherlands striker, Arjen Robben, had a breakaway, but the keeper for Spain, Iker Casillas made the save. Winger Andres Iniesta scored for Spain for the win. Features pre-built extractors for names, addresses, phone numbers, etc. Built-in support for English, Spanish, French, German, Portuguese, Dutch, Japanese, 32 Chinese Classification and Insight
33 Hadoop Appliance for the Landing Zone From custom and complex To organized simplicity Visualization HDFS HCatalog MapReduce Simplify the building, deploying and management of a Hadoop cluster Pig Hive Designed to Development Tools Speed the time-to-value for Hadoop and unstructured data Maximize the overall analytic ecosystem Provide enterprise security and platform management System for Hadoop 33
34 Search and Exploration 34
35 Data Explorer Discover, Explore, Understand Data Explorer allows in- place analysis and correla)on of Big Data assets Web RSS Feed Social Media Content Mgt Unstructured Data Systems Enterprise Unstructured Sources Unstructured Databases Data Warehouses SCM SOA, ESB, Web Service Enterprise Systems & Structured Data Stores Structured 35
36 Data Explorer Search Architecture with High Performance Index Publish Search Results User Profiles Display Templates, robust transformation, XML feed Clustering Engine Subscriptions Content Integration Query transformation & federation RSS/License Feeds Federated Sources Knowledge Base Thesauri Acronyms Ontology Support Semantic Processing Search Engine Web Results Content, Document, Record Mgt. Systems Databases RSS/License Feeds Collaboration Systems and Archives Internet (Web) CRM Systems File Systems 36
37 InfoSphere Data Explorer provides real-time access and fusion of big data for unlocking greater insight Scalability Can analyze trillions of records, leveraging a resilient infrastructure with enterpriseclass features Extreme capacity to analyze all types of Big Data assets Structured, Unstructured, Semi-Structured, Social Media, Web Content, Legacy applications, Enterprise Systems (Siebel, SAP, SharePoint) and more Security Integrated technology to align with existing Big Data governance models Security profiles of the underlying systems are respected so that users can only see and can analyze information for which they are authorized Accuracy / Relevancy Provides the highest level of accuracy & relevancy for analyzing Big Data assets Unique position-based index technology helps users quickly locate, reveal & explore Big Data content relationships Integration Leave data in place to creating a virtual single repository for Big Data exploration & discovery Ability to connect to CRMs, ERPs, ECMs, Web Content, Twitter, Facebook and thousands more assets 37
38 Access across many sources Dynamic categorization Expertise location Leveraging Structured and unstructured content Highly relevant, personalized results Refinements based on structured information Tagging and collaboration Virtual folders for organizing content 38
39 Governance and Organization 39
40 Optimizing Information Governance with Information Server Enterprise Data Models Exchange Data Structures Services Oriented Architecture (SOA) Data Architect Link Information Services Director Populate Deploy Common Enterprise Vocabulary Search and Profile Source Data Map Sources to Target Model Transform and Cleanse Business Glossary Information Analyzer FastTrack DataStage and QualityStage Share Share Share Share 40 Metadata Server and Metadata Workbench Active Cross-Platform Administration, Management and Reporting
41 Information Governance Dashboard to Visualize and Control Governance Innovation Indicators for policies and KPIs Rapid creation of tailored dashboards Value Immediate insight into governance policy status Interception of issues when they start, right at the source Usage Raises data confidence with visual governance status 41
42 Big Data Privacy and Security Protect a Wider Variety of Sources Innovation Data activity monitoring of more NoSQL, Hadoop, and Relational Systems Masking of sensitive data used in Hadoop Agile Governance Value Protection is a pre-requisite for the fundamental assumption of big data sharing data for new insight Automation enables protection without inhibiting speed InfoSphere Guardium InfoSphere Optim Usage Ensures sensitive data is protected and secure 42
43 IBM s Data Governance Unified Process 1) Define Business Problem 2) Obtain Executive Sponsorship 3) Conduct Maturity Assessment 4) Build Roadmap 5) Establish Organizational Blueprint 6) Build Data Dictionary 7) Understand Data 8) Create Metadata Repository 9) Define Metrics 10.1) Appoint Data Stewards 10.2) Manage Data Quality 10.3) Implement Master Data Management Master Data Governance 11) Govern Analytics 12) Manage Security & Privacy 13) Manage Lifecycle of Information 14) Measure Results 43
44 You should consider creating an Analytics Center of Excellence (ACE) Capture and disseminate best practices Advise and consult on projects Promote user adoption Maintain the Analytics Architecture Maintain consistent toolset ACE helps with Maximizes the quality, efficiency and application of analytics across all lines of business, resulting in greater confidence and consistency in decisionmaking Leads to a higher success rate for business analytics deployments, delivering more value at less cost and in less time Drives end user adoption, leading to a smoother path to improved outcomes Provides a formal organizational structure, enabling your organization to strike the right balance between agility and sound management in deploying analytics technologies Eliminates the gap between Business and IT, improving time-to-market and responsiveness to change ACE 44
45 THINK Deepak Mohapatra Sr. Consultant IBM Software Group 45
IBM Big Data in Government
IBM Big in Government Turning big data into smarter decisions Deepak Mohapatra Sr. Consultant Government IBM Software Group dmohapatra@us.ibm.com The Big Paradigm Shift 2 Big Creates A Challenge And an
More informationIBM Big Data Platform
IBM Big Data Platform Turning big data into smarter decisions Stefan Söderlund. IBM kundarkitekt, Försvarsmakten Sesam vår-seminarie Big Data, Bigga byte kräver Pigga Hertz! May 16, 2013 By 2015, 80% of
More informationDemystifying Big Data Government Agencies & The Big Data Phenomenon
Demystifying Big Data Government Agencies & The Big Data Phenomenon Today s Discussion If you only remember four things 1 Intensifying business challenges coupled with an explosion in data have pushed
More informationIBM Big Data Platform
Mike Winer IBM Information Management IBM Big Data Platform The big data opportunity Extracting insight from an immense volume, variety and velocity of data, in a timely and cost-effective manner. Variety:
More informationBuilding Confidence in Big Data Innovations in Information Integration & Governance for Big Data
Building Confidence in Big Data Innovations in Information Integration & Governance for Big Data IBM Software Group Important Disclaimer THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL
More informationBig Data and Data Quality - Mutually Exclusive?
Session 11929 Big Data and Data Quality - Mutually Exclusive? Tom Deutsch tdeutsch@us.ibm.com Program Director, Big Data August 9, 2012 Abstract It is popular to think that Big Data technologies are so
More informationIBM InfoSphere BigInsights Enterprise Edition
IBM InfoSphere BigInsights Enterprise Edition Efficiently manage and mine big data for valuable insights Highlights Advanced analytics for structured, semi-structured and unstructured data Professional-grade
More informationIBM BigInsights for Apache Hadoop
IBM BigInsights for Apache Hadoop Efficiently manage and mine big data for valuable insights Highlights: Enterprise-ready Apache Hadoop based platform for data processing, warehousing and analytics Advanced
More informationLuncheon Webinar Series May 13, 2013
Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration
More informationExploiting Data at Rest and Data in Motion with a Big Data Platform
Exploiting Data at Rest and Data in Motion with a Big Data Platform Sarah Brader, sarah_brader@uk.ibm.com What is Big Data? Where does it come from? 12+ TBs of tweet data every day 30 billion RFID tags
More informationIBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!
The Bloor Group IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS VENDOR PROFILE The IBM Big Data Landscape IBM can legitimately claim to have been involved in Big Data and to have a much broader
More informationA Tour of the Zoo the Hadoop Ecosystem Prafulla Wani
A Tour of the Zoo the Hadoop Ecosystem Prafulla Wani Technical Architect - Big Data Syntel Agenda Welcome to the Zoo! Evolution Timeline Traditional BI/DW Architecture Where Hadoop Fits In 2 Welcome to
More informationHow the oil and gas industry can gain value from Big Data?
How the oil and gas industry can gain value from Big Data? Arild Kristensen Nordic Sales Manager, Big Data Analytics arild.kristensen@no.ibm.com, tlf. +4790532591 April 25, 2013 2013 IBM Corporation Dilbert
More informationBig Data and Trusted Information
Dr. Oliver Adamczak Big Data and Trusted Information CAS Single Point of Truth 7. Mai 2012 The Hype Big Data: The next frontier for innovation, competition and productivity McKinsey Global Institute 2012
More informationIBM Data Warehousing and Analytics Portfolio Summary
IBM Information Management IBM Data Warehousing and Analytics Portfolio Summary Information Management Mike McCarthy IBM Corporation mmccart1@us.ibm.com IBM Information Management Portfolio Current Data
More informationThe Future of Data Management
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class
More informationBig Data Analytics. Copyright 2011 EMC Corporation. All rights reserved.
Big Data Analytics 1 Priority Discussion Topics What are the most compelling business drivers behind big data analytics? Do you have or expect to have data scientists on your staff, and what will be their
More informationIBM Solution Framework for Lifecycle Management of Research Data. 2008 IBM Corporation
IBM Solution Framework for Lifecycle Management of Research Data Aspects of Lifecycle Management Research Utilization of research paper Usage history Metadata enrichment Usage Pattern / Citation Collaboration
More informationEvolving Solutions Disruptive Technology Series Modern Data Warehouse
Evolving Solutions Disruptive Technology Series Modern Data Warehouse Presenter Kumar Kannankutty Big Data Platform Technical Sales Leader Host - Michael Downs, Solution Architect, Evolving Solutions www.evolvingsol.com
More informationHDP Hadoop From concept to deployment.
HDP Hadoop From concept to deployment. Ankur Gupta Senior Solutions Engineer Rackspace: Page 41 27 th Jan 2015 Where are you in your Hadoop Journey? A. Researching our options B. Currently evaluating some
More informationCapitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes
Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Highly competitive enterprises are increasingly finding ways to maximize and accelerate
More informationBIG DATA TRENDS AND TECHNOLOGIES
BIG DATA TRENDS AND TECHNOLOGIES THE WORLD OF DATA IS CHANGING Cloud WHAT IS BIG DATA? Big data are datasets that grow so large that they become awkward to work with using onhand database management tools.
More informationBIG Data Analytics Move to Competitive Advantage
BIG Data Analytics Move to Competitive Advantage where is technology heading today Standardization Open Source Automation Scalability Cloud Computing Mobility Smartphones/ tablets Internet of Things Wireless
More informationBIG DATA: FROM HYPE TO REALITY. Leandro Ruiz Presales Partner for C&LA Teradata
BIG DATA: FROM HYPE TO REALITY Leandro Ruiz Presales Partner for C&LA Teradata Evolution in The Use of Information Action s ACTIVATING MAKE it happen! Insights OPERATIONALIZING WHAT IS happening now? PREDICTING
More informationwww.ducenit.com Analance Data Integration Technical Whitepaper
Analance Data Integration Technical Whitepaper Executive Summary Business Intelligence is a thriving discipline in the marvelous era of computing in which we live. It s the process of analyzing and exploring
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationDriving Better Marketing Results with Big Data and Analytics David Corrigan, IBM, Director of Product Marketing
Driving Better Marketing Results with Big Data and Analytics David Corrigan, IBM, Director of Product Marketing Optimizing Marketing with Big Data and Analytics Leverage Social Media Datacentric Marketing
More informationIBM BigInsights Has Potential If It Lives Up To Its Promise. InfoSphere BigInsights A Closer Look
IBM BigInsights Has Potential If It Lives Up To Its Promise By Prakash Sukumar, Principal Consultant at iolap, Inc. IBM released Hadoop-based InfoSphere BigInsights in May 2013. There are already Hadoop-based
More informationKlarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance
Klarna Tech Talk: Mind the Data! Jeff Pollock InfoSphere Information Integration & Governance IBM s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice
More informationData Integration Checklist
The need for data integration tools exists in every company, small to large. Whether it is extracting data that exists in spreadsheets, packaged applications, databases, sensor networks or social media
More informationManaging Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database
Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica
More informationRaul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada
What is big data? Raul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada 1 2011 IBM Corporation Agenda The world is changing What
More informationwww.sryas.com Analance Data Integration Technical Whitepaper
Analance Data Integration Technical Whitepaper Executive Summary Business Intelligence is a thriving discipline in the marvelous era of computing in which we live. It s the process of analyzing and exploring
More informationThe Future of Business Analytics is Now! 2013 IBM Corporation
The Future of Business Analytics is Now! 1 The pressures on organizations are at a point where analytics has evolved from a business initiative to a BUSINESS IMPERATIVE More organization are using analytics
More informationORACLE DATA INTEGRATOR ENTERPRISE EDITION
ORACLE DATA INTEGRATOR ENTERPRISE EDITION ORACLE DATA INTEGRATOR ENTERPRISE EDITION KEY FEATURES Out-of-box integration with databases, ERPs, CRMs, B2B systems, flat files, XML data, LDAP, JDBC, ODBC Knowledge
More informationThe Future of Data Management with Hadoop and the Enterprise Data Hub
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah Cofounder & CTO, Cloudera, Inc. Twitter: @awadallah 1 2 Cloudera Snapshot Founded 2008, by former employees of Employees
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationThe Data Reservoir as an enabler of differentiating Analytics initiatives
Mandy Chessell CBE FREng CEng FBCS Distinguished Engineer, Master Inventor Chief Architect, Solutions The Reservoir as an enabler of differentiating Analytics initiatives 3 rd March 2015 Agenda Changing
More informationBig Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies
Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies Big Data: Global Digital Data Growth Growing leaps and bounds by 40+% Year over Year! 2009 =.8 Zetabytes =.08
More informationImplement Hadoop jobs to extract business value from large and varied data sets
Hadoop Development for Big Data Solutions: Hands-On You Will Learn How To: Implement Hadoop jobs to extract business value from large and varied data sets Write, customize and deploy MapReduce jobs to
More informationEnd to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ
End to End Solution to Accelerate Data Warehouse Optimization Franco Flore Alliance Sales Director - APJ Big Data Is Driving Key Business Initiatives Increase profitability, innovation, customer satisfaction,
More informationIntroducing the Reimagined Power BI Platform. Jen Underwood, Microsoft
Introducing the Reimagined Power BI Platform Jen Underwood, Microsoft Thank You Sponsors Empower users with new insights through familiar tools while balancing the need for IT to monitor and manage user
More informationApache Hadoop: The Big Data Refinery
Architecting the Future of Big Data Whitepaper Apache Hadoop: The Big Data Refinery Introduction Big data has become an extremely popular term, due to the well-documented explosion in the amount of data
More informationBig Data Strategies with IMS
Big Data Strategies with IMS #16103 Richard Tran IMS Development richtran@us.ibm.com Insert Custom Session QR if Desired. Agenda Big Data in an Information Driven economy Why start with System z IMS strategies
More informationArchitecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing
Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics
More informationGanzheitliches Datenmanagement
Ganzheitliches Datenmanagement für Hadoop Michael Kohs, Senior Sales Consultant @mikchaos The Problem with Big Data Projects in 2016 Relational, Mainframe Documents and Emails Data Modeler Data Scientist
More informationBig Data for Government Symposium http://www.ttcus.com
Big Data for Government Symposium http://www.ttcus.com @TECHTrain Linkedin/Groups: Technology Training Big Data and Smart Cities i Dr. Jane L. Snowdon Chief Innovation Officer, IBM Federal IBM Research:
More informationPoslovni slučajevi upotrebe IBM Netezze
Poslovni slučajevi upotrebe IBM Netezze data at the Speed and with Simplicity businesses need 25. ožujak 2015. vedran.travica@hr.ibm.com Agenda A. IBM PureData for Analytics Netezza B. Scenarij 1.: Novi
More informationIBM InfoSphere Guardium Data Activity Monitor for Hadoop-based systems
IBM InfoSphere Guardium Data Activity Monitor for Hadoop-based systems Proactively address regulatory compliance requirements and protect sensitive data in real time Highlights Monitor and audit data activity
More informationORACLE BUSINESS INTELLIGENCE SUITE ENTERPRISE EDITION PLUS
Oracle Fusion editions of Oracle's Hyperion performance management products are currently available only on Microsoft Windows server platforms. The following is intended to outline our general product
More informationReal World Use of BIG DATA. Tim Brown Information Management Technical Pre-Sales Aruna Kolluru Information Management Technical Pre-Sales 04/2013
Real World Use of BIG DATA Tim Brown Information Management Technical Pre-Sales Aruna Kolluru Information Management Technical Pre-Sales 04/2013 Building a smarter planet Gaining Insight from your Information
More informationBIG DATA TECHNOLOGY. Hadoop Ecosystem
BIG DATA TECHNOLOGY Hadoop Ecosystem Agenda Background What is Big Data Solution Objective Introduction to Hadoop Hadoop Ecosystem Hybrid EDW Model Predictive Analysis using Hadoop Conclusion What is Big
More informationORACLE DATA INTEGRATOR ENTERPRISE EDITION
ORACLE DATA INTEGRATOR ENTERPRISE EDITION Oracle Data Integrator Enterprise Edition 12c delivers high-performance data movement and transformation among enterprise platforms with its open and integrated
More informationData processing goes big
Test report: Integration Big Data Edition Data processing goes big Dr. Götz Güttich Integration is a powerful set of tools to access, transform, move and synchronize data. With more than 450 connectors,
More informationIBM Cognos Performance Management Solutions for Oracle
IBM Cognos Performance Management Solutions for Oracle Gain more value from your Oracle technology investments Highlights Deliver the power of predictive analytics across the organization Address diverse
More informationHow To Create A Data Science System
Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Richard Breakiron Senior Director, Cyber Solutions Rbreakiron@vion.com Office: 571-353-6127 / Cell: 803-443-8002
More informationHow Cisco IT Built Big Data Platform to Transform Data Management
Cisco IT Case Study August 2013 Big Data Analytics How Cisco IT Built Big Data Platform to Transform Data Management EXECUTIVE SUMMARY CHALLENGE Unlock the business value of large data sets, including
More informationORACLE BUSINESS INTELLIGENCE SUITE ENTERPRISE EDITION PLUS
ORACLE BUSINESS INTELLIGENCE SUITE ENTERPRISE EDITION PLUS PRODUCT FACTS & FEATURES KEY FEATURES Comprehensive, best-of-breed capabilities 100 percent thin client interface Intelligence across multiple
More informationDatabricks. A Primer
Databricks A Primer Who is Databricks? Databricks was founded by the team behind Apache Spark, the most active open source project in the big data ecosystem today. Our mission at Databricks is to dramatically
More informationIBM Big Data HW Platform
IBM Big Data HW Platform Turning big data into smarter decisions Mujdat Timurcin IT Architect IBM Turk mujdat@tr.ibm.com September 29, 2013 Big data is a hot topic because technology makes it possible
More informationBig Data & Analytics for Semiconductor Manufacturing
Big Data & Analytics for Semiconductor Manufacturing 半 導 体 生 産 におけるビッグデータ 活 用 Ryuichiro Hattori 服 部 隆 一 郎 Intelligent SCM and MFG solution Leader Global CoC (Center of Competence) Electronics team General
More informationData Lake In Action: Real-time, Closed Looped Analytics On Hadoop
1 Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop 2 Pivotal s Full Approach It s More Than Just Hadoop Pivotal Data Labs 3 Why Pivotal Exists First Movers Solve the Big Data Utility Gap
More informationIII JORNADAS DE DATA MINING
III JORNADAS DE DATA MINING EN EL MARCO DE LA MAESTRÍA EN DATA MINING DE LA UNIVERSIDAD AUSTRAL PRESENTACIÓN TECNOLÓGICA IBM Alan Schcolnik, Cognos Technical Sales Team Leader, IBM Software Group. IAE
More informationNative Connectivity to Big Data Sources in MSTR 10
Native Connectivity to Big Data Sources in MSTR 10 Bring All Relevant Data to Decision Makers Support for More Big Data Sources Optimized Access to Your Entire Big Data Ecosystem as If It Were a Single
More informationDatabricks. A Primer
Databricks A Primer Who is Databricks? Databricks vision is to empower anyone to easily build and deploy advanced analytics solutions. The company was founded by the team who created Apache Spark, a powerful
More informationIntel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software. SC13, November, 2013
Intel HPC Distribution for Apache Hadoop* Software including Intel Enterprise Edition for Lustre* Software SC13, November, 2013 Agenda Abstract Opportunity: HPC Adoption of Big Data Analytics on Apache
More informationBAO & Big Data Overview Applied to Real-time Campaign GSE. Joel Viale Telecom Solutions Lab Solution Architect. Telecom Solutions Lab
BAO & Big Data Overview Applied to Real-time Campaign GSE Joel Viale Telecom Solutions Lab Solution Architect Agenda BAO & Big Data - Overview Customer use-cases Live Prototypes: Streams for Real-time
More informationMDM and Data Warehousing Complement Each Other
Master Management MDM and Warehousing Complement Each Other Greater business value from both 2011 IBM Corporation Executive Summary Master Management (MDM) and Warehousing (DW) complement each other There
More informationAgile Business Intelligence Data Lake Architecture
Agile Business Intelligence Data Lake Architecture TABLE OF CONTENTS Introduction... 2 Data Lake Architecture... 2 Step 1 Extract From Source Data... 5 Step 2 Register And Catalogue Data Sets... 5 Step
More informationGAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION
GAIN BETTER INSIGHT FROM BIG DATA USING JBOSS DATA VIRTUALIZATION Syed Rasheed Solution Manager Red Hat Corp. Kenny Peeples Technical Manager Red Hat Corp. Kimberly Palko Product Manager Red Hat Corp.
More informationBig Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth
MAKING BIG DATA COME ALIVE Big Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth Steve Gonzales, Principal Manager steve.gonzales@thinkbiganalytics.com
More informationBeyond the Single View with IBM InfoSphere
Ian Bowring MDM & Information Integration Sales Leader, NE Europe Beyond the Single View with IBM InfoSphere We are at a pivotal point with our information intensive projects 10-40% of each initiative
More informationIBM Analytics. Just the facts: Four critical concepts for planning the logical data warehouse
IBM Analytics Just the facts: Four critical concepts for planning the logical data warehouse 1 2 3 4 5 6 Introduction Complexity Speed is businessfriendly Cost reduction is crucial Analytics: The key to
More informationBig Data & Analytics. The. Deal. About. Jacob Büchler jbuechler@dk.ibm.com Cand. Polit. IBM Denmark, Solution Exec. 2013 IBM Corporation
The Big Data & Analytics Deal About Jacob Büchler jbuechler@dk.ibm.com Cand. Polit. IBM Denmark, Solution Exec. 1 Big Data is All Data from Everywhere Big Data Is Becoming The Next Natural Resource We
More informationSolve your toughest challenges with data mining
IBM Software IBM SPSS Modeler Solve your toughest challenges with data mining Use predictive intelligence to make good decisions faster Solve your toughest challenges with data mining Imagine if you could
More informationIBM Analytical Decision Management
IBM Analytical Decision Management Deliver better outcomes in real time, every time Highlights Organizations of all types can maximize outcomes with IBM Analytical Decision Management, which enables you
More informationWhat's New in SAS Data Management
Paper SAS034-2014 What's New in SAS Data Management Nancy Rausch, SAS Institute Inc., Cary, NC; Mike Frost, SAS Institute Inc., Cary, NC, Mike Ames, SAS Institute Inc., Cary ABSTRACT The latest releases
More informationBringing Strategy to Life Using an Intelligent Data Platform to Become Data Ready. Informatica Government Summit April 23, 2015
Bringing Strategy to Life Using an Intelligent Platform to Become Ready Informatica Government Summit April 23, 2015 Informatica Solutions Overview Power the -Ready Enterprise Government Imperatives Improve
More informationDeploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture
Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture Apps and data source extensions with APIs Future white label, embed or integrate Power BI Deploy Intelligent
More informationANALYTICS CENTER LEARNING PROGRAM
Overview of Curriculum ANALYTICS CENTER LEARNING PROGRAM The following courses are offered by Analytics Center as part of its learning program: Course Duration Prerequisites 1- Math and Theory 101 - Fundamentals
More informationThe Next Wave of Data Management. Is Big Data The New Normal?
The Next Wave of Data Management Is Big Data The New Normal? Table of Contents Introduction 3 Separating Reality and Hype 3 Why Are Firms Making IT Investments In Big Data? 4 Trends In Data Management
More informationBig Data and Advanced Analytics Applications and Capabilities Steven Hagan, Vice President, Server Technologies
Big Data and Advanced Analytics Applications and Capabilities Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights Big Data, Advanced Analytics:
More informationIntroduction to Hadoop HDFS and Ecosystems. Slides credits: Cloudera Academic Partners Program & Prof. De Liu, MSBA 6330 Harvesting Big Data
Introduction to Hadoop HDFS and Ecosystems ANSHUL MITTAL Slides credits: Cloudera Academic Partners Program & Prof. De Liu, MSBA 6330 Harvesting Big Data Topics The goal of this presentation is to give
More informationBig Data Analytics Platform @ Nokia
Big Data Analytics Platform @ Nokia 1 Selecting the Right Tool for the Right Workload Yekesa Kosuru Nokia Location & Commerce Strata + Hadoop World NY - Oct 25, 2012 Agenda Big Data Analytics Platform
More informationHDP Enabling the Modern Data Architecture
HDP Enabling the Modern Data Architecture Herb Cunitz President, Hortonworks Page 1 Hortonworks enables adoption of Apache Hadoop through HDP (Hortonworks Data Platform) Founded in 2011 Original 24 architects,
More informationBig Data, Integration and Governance: Ask the Experts
Big, Integration and Governance: Ask the Experts January 29, 2013 1 The fourth dimension of Big : Veracity handling data in doubt Volume Velocity Variety Veracity* at Rest Terabytes to exabytes of existing
More informationComprehensive Analytics on the Hortonworks Data Platform
Comprehensive Analytics on the Hortonworks Data Platform We do Hadoop. Page 1 Page 2 Back to 2005 Page 3 Vertical Scaling Page 4 Vertical Scaling Page 5 Vertical Scaling Page 6 Horizontal Scaling Page
More informationW H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract
W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the
More informationJOURNAL OF OBJECT TECHNOLOGY
JOURNAL OF OBJECT TECHNOLOGY Online at www.jot.fm. Published by ETH Zurich, Chair of Software Engineering JOT, 2008 Vol. 7, No. 8, November-December 2008 What s Your Information Agenda? Mahesh H. Dodani,
More informationBig Data Management and Security
Big Data Management and Security Audit Concerns and Business Risks Tami Frankenfield Sr. Director, Analytics and Enterprise Data Mercury Insurance What is Big Data? Velocity + Volume + Variety = Value
More informationBIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES
BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES Relational vs. Non-Relational Architecture Relational Non-Relational Rational Predictable Traditional Agile Flexible Modern 2 Agenda Big Data
More informationRoadmap Talend : découvrez les futures fonctionnalités de Talend
Roadmap Talend : découvrez les futures fonctionnalités de Talend Cédric Carbone Talend Connect 9 octobre 2014 Talend 2014 1 Connecting the Data-Driven Enterprise Talend 2014 2 Agenda Agenda Why a Unified
More informationBy Makesh Kannaiyan makesh.k@sonata-software.com 8/27/2011 1
Integration between SAP BusinessObjects and Netweaver By Makesh Kannaiyan makesh.k@sonata-software.com 8/27/2011 1 Agenda Evolution of BO Business Intelligence suite Integration Integration after 4.0 release
More informationCollaborative Big Data Analytics. Copyright 2012 EMC Corporation. All rights reserved.
Collaborative Big Data Analytics 1 Big Data Is Less About Size, And More About Freedom TechCrunch!!!!!!!!! Total data: bigger than big data 451 Group Findings: Big Data Is More Extreme Than Volume Gartner!!!!!!!!!!!!!!!
More informationData Governance in the Hadoop Data Lake. Kiran Kamreddy May 2015
Data Governance in the Hadoop Data Lake Kiran Kamreddy May 2015 One Data Lake: Many Definitions A centralized repository of raw data into which many data-producing streams flow and from which downstream
More informationANALYTICS STRATEGY: creating a roadmap for success
ANALYTICS STRATEGY: creating a roadmap for success Companies in the capital and commodity markets are looking at analytics for opportunities to improve revenue and cost savings. Yet, many firms are struggling
More informationP4.1 Reference Architectures for Enterprise Big Data Use Cases Romeo Kienzler, Data Scientist, Advisory Architect, IBM Germany, Austria, Switzerland
P4.1 Reference Architectures for Enterprise Big Data Use Cases Romeo Kienzler, Data Scientist, Advisory Architect, IBM Germany, Austria, Switzerland IBM Center of Excellence for Data Science, Cognitive
More informationYour Data, Any Place, Any Time. Microsoft SQL Server 2008 provides a trusted, productive, and intelligent data platform that enables you to:
Your Data, Any Place, Any Time. Microsoft SQL Server 2008 provides a trusted, productive, and intelligent data platform that enables you to: Run your most demanding mission-critical applications. Reduce
More informationArchitecting for the Internet of Things & Big Data
Architecting for the Internet of Things & Big Data Robert Stackowiak, Oracle North America, VP Information Architecture & Big Data September 29, 2014 Safe Harbor Statement The following is intended to
More information