Active Data Warehousing With ADABAS SQL GATEWAY



Similar documents
Managing DMV Pictures & Signatures with Adabas Large Object (LOB) Fields Image storage on the mainframe

Data Masking for Adabas. Becky Albin Chief IT Architect

Accelerate Data Loading for Big Data Analytics Attunity Click-2-Load for HP Vertica

What s next for Adabas and Natural. Blair Harding Lead Pre-Sales Consultant Software AG

10 Biggest Causes of Data Management Overlooked by an Overload

Enterprise Information Integration (EII) A Technical Ally of EAI and ETL Author Bipin Chandra Joshi Integration Architect Infosys Technologies Ltd

Data Warehouse Center Administration Guide

An Evaluation of No-Cost Business Intelligence Tools. Claire Walsh

Attunity Integration Suite

replication solution Using CDC and Data Replication October 19, 2010

enterprise professional expertise distilled

CA Repository for z/os r7.2

IMS Users Group. The Right Change SQL-Based Middleware. Mike McKee CONNX Solutions.

<Insert Picture Here> Move to Oracle Database with Oracle SQL Developer Migrations

Oracle Database Gateways. An Oracle White Paper July 2007

A roadmap to enterprise data integration.

Software AG ADABAS Update

What is Data Virtualization? Rick F. van der Lans, R20/Consultancy

UltraQuest Cloud Server. White Paper Version 1.0

Implementing efficient system i data integration within your SOA. The Right Time for Real-Time

Adabas und Natural für das Digitale Unternehmen

MDM and Data Warehousing Complement Each Other

Real-time Data Replication

ORACLE BUSINESS INTELLIGENCE SUITE ENTERPRISE EDITION PLUS

By Makesh Kannaiyan 8/27/2011 1

Enterprise Data Solutions Product Strategy and Vision Process-driven IT Modernization, Natural and Adabas

ORACLE BUSINESS INTELLIGENCE SUITE ENTERPRISE EDITION PLUS

Getting Real Real Time Data Integration Patterns and Architectures

Chapter 5. Learning Objectives. DW Development and ETL

Oracle OLAP What's All This About?

ENZO UNIFIED SOLVES THE CHALLENGES OF REAL-TIME DATA INTEGRATION

An Oracle White Paper March Best Practices for Real-Time Data Warehousing

ENABLING OPERATIONAL BI

Legacy Data Migration: DIY Might Leave You DOA

TIBCO Live Datamart: Push-Based Real-Time Analytics

Enable BI, Reporting, and ETL Integration with Your App

IBM Cognos 8 Business Intelligence Reporting Meet all your reporting requirements

Efficient and Real Time Data Integration With Change Data Capture

Understanding Data Warehouse Needs Session #1568 Trends, Issues and Capabilities

Shadowbase Data Replication VNUG - May 26, Dick Davis, Sales Manager Shadowbase Products Group Gravic, Inc.

data express DATA SHEET OVERVIEW

Optimize for Infrastructure Moving from reactive to proactive IT infrastructure management

KPiSync. By Larry McGhaw, Chief Technology Officer

OWB Users, Enter The New ODI World

Decoding the Big Data Deluge a Virtual Approach. Dan Luongo, Global Lead, Field Solution Engineering Data Virtualization Business Unit, Cisco

Enterprise Application Integration

SAP Analytics Roadmap for Small and Midsize Companies. Kevin Chan, Director, Solutions SAP

SQL Server 2016 BI Any Data, Anytime, Anywhere. Phua Chiu Kiang PCK CONSULTING MVP (Data Platform)

The ESB and Microsoft BI

<Insert Picture Here> Oracle BI Standard Edition One The Right BI Foundation for the Emerging Enterprise

Cloud Ready Data: Speeding Your Journey to the Cloud

Gain control of your applications. Derek Britton, Product Management Dennis Voorhees, Systems Engineer

Bussiness Intelligence and Data Warehouse. Tomas Bartos CIS 764, Kansas State University

IBM Optim. The ROI of an Archiving Project. Michael Mittman Optim Products IBM Software Group IBM Corporation

Metadata Application Understanding Software Migration

EDI Modernization Case Studies and Best Practices

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture

IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!

HP Shadowbase Solutions Overview

ENTERPRISE EDITION ORACLE DATA SHEET KEY FEATURES AND BENEFITS ORACLE DATA INTEGRATOR

Business Intelligence In SAP Environments

Process-Driven IT Modernization Strategy. Tim Ward

Kai Wähner. The Next-Generation BPM for a Big Data World: Intelligent Business Process Management Suites (ibpms)

Service Oriented Data Management

XpoLog Competitive Comparison Sheet

Evaluation Checklist Data Warehouse Automation

Federal Supply Schedule - GS-35F-0419L

SAS Enterprise Data Integration Server - A Complete Solution Designed To Meet the Full Spectrum of Enterprise Data Integration Needs

Consolidate by Migrating Your Databases to Oracle Database 11g. Fred Louis Enterprise Architect

A Scalable Data Transformation Framework using the Hadoop Ecosystem

Building Cubes and Analyzing Data using Oracle OLAP 11g

INVESTOR PRESENTATION. First Quarter 2014

Conventional BI Solutions Are No Longer Sufficient

Data Warehousing. Read chapter 13 of Riguzzi et al Sistemi Informativi. Slides derived from those by Hector Garcia-Molina

Chapter 6 Basics of Data Integration. Fundamentals of Business Analytics RN Prasad and Seema Acharya

Sai Phanindra. Summary. Experience. SQL Server, SQL DBA and MSBI SQL School saiphanindrait@gmail.com

Outline. Data Warehousing. What is a Warehouse? What is a Warehouse?

Oracle Architecture, Concepts & Facilities

<Insert Picture Here> Real-Time Data Integration for BI and Data Warehousing

Integrating Netezza into your existing IT landscape

Enterprise Data Integration The Foundation for Business Insight

Modernize your applications using Cloud technologies

Enterprise Integration Architectures for the Financial Services and Insurance Industries

Foundations of Business Intelligence: Databases and Information Management

Published by: PIONEER RESEARCH & DEVELOPMENT GROUP ( 28

EII - ETL - EAI What, Why, and How!

QAD Business Intelligence

Virtual Operational Data Store (VODS) A Syncordant White Paper

Shadowbase Data Replication Solutions. William Holenstein Senior Manager of Product Delivery Shadowbase Products Group

Welcome. Changes and Choices

Innovate and Grow: SAP and Teradata

Clustered Database Reporting Solution utilizing Tivoli

Transcription:

Active Data Warehousing With ADABAS SQL GATEWAY ADABAS SQL GW is Non a Sacrificial Gateway to ADABAS! Nikolai Chmatov Manager, Tactical Solution, Market Product & Services October 16, 2012 nikolai.chmatov@rbc.com +1 416-955-2326

Table of Contents Slide 3 Slide 4 Slide 5 Slide 6 Slides 7-8 Slides 9-17 Slides 18-19 What was Before? What was the Target? Active Data Warehousing vs Traditional Data Warehousing Business Value of Data Freshness WHY the ADABAS SQL GATEWAY? HOW was it done? What Else? D E M O

What was Before? WHY Active Data Warehousing? WHY with ADABAS SQL GATEWAY? Traditional Data Warehousing (TDW) Traditional Data Warehousing is an integrated & logically consistent store of detailed data used to aid the decision making process. Little to no interaction with customer or supplier channels Primarily batch data feeds (one way data flow) Variety of the predefined non customizable reports Operational and/or Transactional System (s) ADABAS Batch Traditional Data Warehouse

What was the Target? WHY Active Data Warehousing? WHY with ADABAS SQL GATEWAY? Active Data Warehousing (ADW) Active Data Warehousing is traditional DW plus very current detailed data (combined with historical data) for strategic, tactical and eventdriven business decision making. Timely updated (Real Time/Good Time) Pre-designed triggers and queries to detect significant events Event-based Notification Service (ENS) Ability to use bi-directional data flows Decision Assistance (via analytic applications). Tracking of tactical decision and actual result. @ Operational and/or Transactional System (s) ADABAS Batch Continuous - Initiate external Process - Update Database - Notify Ops. (e-mail) Active Data Warehouse ENS

Active Data Warehousing vs Traditional Data Warehousing Strategic Decision Making Active data warehousing moves all analysis into the database to answer complex business questions quickly and with scalability... Businesses need to perform analysis for planning, forecasting, profiling, fraud detection, trending, and pattern analysis to identify the proper action based on business drivers. Tactical Decision Making Active data warehousing is also about to supplying information to front-line decision makers... Businesses need repeatable, consistent execution of data-driven decision by all constituencies, regardless of their numbers.

Business Value of Data Freshness What is the relationship of data freshness to business value? Consider the following Value-Time Curve. Value business event The real situation may be more complex, as shown in the following figure. action taken Value business event data stored Information delivered Time Action Taken action distance Time

WHY the ADABAS SQL GATEWAY? Oracle CDC Adapters (Adabas & VSAM) Pros - Publish-and-Subscribe Model Cons - CDC adapters are integrated by the Oracle Application Server - Too many components and platforms TIBCO Object Service Broker (Adapters for Adabas & VSAM) Pros Good for stabile process (TDW but not ADW) Cons TIBCO Object Service Broker s rules engine is an external process written in assembler, COBOL, PL1/1, CICS, C, etc - SDKs are available for use with 3rd generation programming languages including Java, C, and C++. - These adapters provide performance by capturing changes directly from the database logs. iway Software's Intelligent Adapter (Connectors for Adabas & VSAM) Pros Third-party products can also access the adapter via iway connectors, including ODBC, OLE DB, JDBC Cons All dictionaries are on Mainframe side and any changes in data definition will required re-compiling entire dictionary and re-link it with the Connector. SOFTWARE AG/CONNEX ADABAS SQL Gateway Pros imports Predict data dictionaries or Natural DDMs or/and imports Adabas metadata directly from Dynamic DDL and FDT into a CONNX Data Dictionary file (CDD). creates virtual tables to represent MU and PEs single metadata model that efficiently spans all enterprise data sources Third-party products can also access ADABAS data via ODBC, OLE DB, JDBC Cons Poor user interface

What was Before? Regular or Traditional Data Warehousing Daily (overnight) data refreshing Predefine queries & reports Mainly distribution via e-mails or via DW Front-End Very minimal ability of ad hoc queries & reporting Business requirements Operates with real data on a real-time or good time base with the core business applications Be able to create ad hoc queries & reports Be able to monitor data or/and event changes Be able to run all existing reports Be able to capture some particular data events Be able to update data on certain conditions

Classical Data/Knowledge Pyramid Act Visualize Distribute Analyze Assign Context Gather

HOW was it done? Operational and/or Transactional System (s) ADABAS Batch Traditional Data Warehouse Oracle & PowerBuilder

HOW was it done? Operational and/or Transactional System (s) Batch ADABAS MS Windows Server 2003 ADABAS SQL GW IBM iseries Access Oracle Call Interface MS SQL Server Views & Historical tables Creation of Composite Entity Traditional Data Warehouse Oracle & PowerBuilder

HOW was it done? ADABAS Database defined at MS SQL Level as a Linked Server

HOW was it done? ADABAS Database defined at MS SQL Level as a Linked Server Starting from MS SQL Server 2005 we can use CONNX OLE DB Provider driver directly when SQL 2000 can work only with MS OLE DB provider for ODBC

HOW was it done? ADABAS Database defined at MS SQL Level as a Linked Server Starting from MS SQL Server 2005 we can use CONNX OLE DB Provider driver directly when SQL 2000 can work only with MS OLE DB provider for ODBC Make sure that you ve got a right Server Options

HOW was it done? ADABAS Database defined at MS SQL Level as a Linked Server Starting from MS SQL Server 2005 we can use CONNX OLE DB Provider driver directly when SQL 2000 can work only with MS OLE DB provider for ODBC Make sure that you ve got a right Server Options Do not forget Security!

HOW was it done? ADABAS Database defined at MS SQL Level as a Linked Server Starting from MS SQL Server 2005 we can use CONNX OLE DB Provider driver directly when SQL 2000 can work only with MS OLE DB provider for ODBC Make sure that you ve got a right Server Options Do not forget Security! And at the end, after all of the above ADABAS Database can be accessed as a regular SQL View or Table from any SQL-based tool.

HOW was it done?

What Else?

What Else?

D E M O

There are so many ways of doing it There are so many stories telling how But in fact - the right way is the way which is working! Questions??? Nikolai Chmatov Manager, Tactical Solution, Market Product & Services October 15, 2012 nikolai.chmatov@rbc.com +1 416-918-3466

Time Slot Tuesday, 10/16 11:15 12:00 Tuesday, 10/16 1:30 2:15 Adabas and Natural Track Presentations Managing DMV Pictures & Signatures with Adabas Large Object (LOB) Fields State of South Dakota Adabas and Natural Sessions for Process World 2012 Active Data Warehousing Made Easy with Adabas SQL Gateway Royal Bank of Canada Tuesday, 10/16 2:30 3:15 Tuesday, 10/16 3:30 4:15 Tuesday, 10/16 4:30 5:15 Wednesday, 10/17 11:15 12:00 Achieve Significant Quality Improvements by using Better Test Data with Data Masking for Adabas Pennsylvania State University What s next for Adabas and Natural? The Strategic Direction Software AG Case Study FSCJ: College Inventory Management using a Mobile Application Adabas Replication: How we do it at NYC DoITT New York City Department of Information Technology Wednesday, 10/17 1:30-2:15 Wednesday, 10/17 2:30-3:15 EntireX Broker Centralizes Drivers License Management State-Wide State of Virginia Natural Remote Data Collector (RDC); Monitoring and much more State of Washington Retirement System