Data Integration Extravaganza

Transcription

1 EPM Suite (Hyperion) Data Integration Extravaganza

2 Technologies Hyperion Application Link (HAL) Data Integration Management (DIM) Oracle Data Integrator (ODI) Enterprise Performance Management Architect (EPMA) Financial Data Quality Management (FDM) ERP Integrator (ERPi) Data Relationship Management (DRM) Essbase Integration Services (EIS) Essbase Studio (EAS) Outline Load Utility DATAEXPORT Command MaxL Windows Batch Scripting Essbase SQL Loader Essbase Analytics Link (EAL) for HFM

3 Background Hal Hyperion tool for loading data and metadata to Hyperion Essbase, Financial Management, and Planning No longer supported by Oracle

4 Hal Common Uses Loading data (text, relational) to Essbase, Planning Extracting outline information

5 Hal

6 Use Case Hal Company wants to move GL data from a relational data source and use it to update the outline in Planning

7 DIM Data Integration Management Based on Informatica PowerCenter ETL tool similar to ODI

8 DIM Can load data and metadata to Essbase, Planning, HFM, Performance Scorecard Can process large volumes of data

9 DIM

10 DIM

11 DIM Use Case(s): IT driven process passing large volumes of data at high speeds Complex mapping logic is required Multiple workflows

12 ODI Oracle Data Integrator Very flexible tool Knowledge modules for interacting with systems (Essbase, Planning, SQL Server, Oracle, Flat file, etc.) Design custom workflows

13 ODI Can load data and metadata to Essbase, Planning, HFM, etc. Can load data warehouses, ERP systems and most databases Strategic data integration tool from Oracle

14 ODI

15 Use Case ODI Upstream data is in relational databases accessible via JDBC driver, wants to combine data from a file coming in via FTP and use that to load to a Hyperion cube, and send an out on failure.

16 EPMA Can manage metadata and hierarchies with graphical interface Dimension Library centralizes data for different dimensions i Can move data with Data Synchronization Interface Tables

17 EPMA Manage Essbase, Planning, HFM in one place Mostly deals with metadata Provides validation functionality Provides limited data mapping / integration Provides Application Library

18 EPMA

19 EPMA Use Case Administrator already uses EPMA, deploys metadata to various applications Ad hoc data sync across environments Quickly build a new application for a specific purpose by using metadata and data from existing applications

20 EPMA

21 EPMA

22 FDM Financial Data Quality Management Load data to HFM, Essbase and Planning from flat files SQL based, business driven Highly customizable with VB Script Self-service or automated data loading Allows drill back from target systems

23 FDM

24 FDM Use Case Enable SME s to map their own data Real time validation & verification SOX Compliance & Certification Industrial strength ETL not required

25 FDM

26 ERPi New in Pulls directly from source ERPs Load metadata to HFM, Planning and Essbase Combined with FDM, loads data to HFM, Planning or Essbase Facilitates user drill back and write-back to source ERP from HFR or Smart View

27 ERPi

28 Use Case ERPi Enhance functionality of existing FDM With supported source ERPs, create robust 2-way data flow for reporting and analysis. Provide access to detail with out replicating across applications. Push downstream data to all systems

29 ERPi

30 DRM Data Relationship Management For managing metadata only (no cube data) Advanced features for versioning, pushing to source systems, pushing to Hyperion

31 DRM Very robust metadata management tool Can manage and deploy data for Hyperion and non-hyperion systems Does not process data Formerly known as MDM (Razza)

32 DRM

33 DRM Use Case Hierarchies for dimensions in cube(s) are sourced from external system Multiple cubes need same hierarchies Keep all Hyperion products in sync Centralize and reduce metadata maintenance Segregate metadata management from system administration

34 FDM explicit mapping in DRM DRM

35 DRM - API

36 Essbase Integration Services

37 Essbase Integration Services Used to model cubes from relational data sources Can be used to build/update outline and load data Supports complex SQL if needed Very fast if used properly

38 Essbase Integration Services Pros Very flexible Rich dimension building capabilities without having to mess around with load rules Cons Once model is setup, you re married to it You need to really think to get it right

39 Essbase Integration Services

40 Essbase Integration Services Use Case Data and metadata already exist in a SQL database, and now the business would like to build multiple l cubes to provide analysis capabilities and possibly drill-thru

41 Essbase Studio

42 Essbase Studio Used to design cubes from relational data sources, OBIEE, EPMA apps & text t file Used for light-weight data modeling Evolution of EIS Common Metadata Repository Lineage Tracking Limited EAS functionality provided

43 Essbase Studio

44 Pros Essbase Studio Very flexible Enables true artifact reusability Introspection is very cool Drill through (RDBMS, URL, HFM, Java, etc.) Cons Not your father s Application Manager Not your father s EAS

45 Outline Load Utility Can load data and metadata Create a load file in text (CSV) Complex command line options OutlineLoad [-f:passwordfile][/s:server] /A:application /U:userName [/M] [/E:outputFileName] [/I:inputFileName/D[U]:loadDimensionName /DA:attributeDimensionName:baseDimensionName] [/TR] [/N] [[/R] [/U]] [/C] [/F] [/K] [/X:exceptionFileName] [L:logFileName] [/DX:HSP_Rates][/DS:HSP_SMARTLISTS] [/8][/?]

46 Outline Load Utility Pros No ETL required Perform batch outline updates to Planning Can load data as well Cons Arcane syntax Practical limitations (Volume)

47 Outline Load Utility

48 Use Case Outline Load Utility Company uses Planning to do yearly forecast of employee salaries. HR provides a spreadsheet with employee data and salary basis data Outline load utility can be used periodically to update the employee members in the Planning outline and load up their base data

49 DataExport Historically, an Essbase CDF (custom defined d function) used to export data to text t file or relational data source Is now native functionality (no need to setup CDF, which can be tricky) Useful for calling from MaxL (in place of report script) Can provide export capability to users by giving them access to a calc script

50 DataExport Pros Can be easier and more flexible than report scripts Cons Can only export data (no metadata) Use Case Exporting data to be used to load another Exporting data to be used to load another cube

51 DataExport

52 Use Case DataExport Data exists in cube but not necessarily easily accessible from other SQL sources, and wish to generate a text file with a certain subset of data (addressable with FIX)

53 MaxL Used to automate Essbase administrative tasks Replaced harder to read ESSCMD Can do almost everything to a server/application/cube/user that can be done in EAS

54 MaxL set MY_NAME = "ProcessCube"; login $ESSUSER identified by $ESSPW on $ESSSERVER; spool stdout on to "$LOGPATH\\$CONTEXT $LOGPATH\\$CONTEXT.$MY_NAME.$1.stdout.txt $MY NAME $1 txt"; spool stderr on to "$LOGPATH\\$CONTEXT.$MY_NAME.$1.stderr.txt"; alter database $1.$2 reset data; import database $1.$2 data connect as $SQLUSER identified by $SQLPW using server rules_file 'LdQVSOS' on error write to "$LOGPATH\\$CONTEXT $LOGPATH\\$CONTEXT.$MY_NAME.$1.error.txt $MY NAME $1 txt"; execute aggregate process on database $1.$2 stopping when total_size exceeds $3; spool off; logout; exit;

55 Use Case MaxL Data/metadata available in text file or relational data source, want to automate on the server or work in to existing i automation Perl Module

56 Batch Scripting

57 Batch Scripting Simple batch files used to perform a sequence of ftasks Lends itself very easily to automating and scheduling for recurring tasks Can glue together other data integration tools: MaxL, ODI, outline load, etc.

58 Batch Scripting Pros Very easy to implement Not limited to Hyperion products Cons Large scripts can become unwieldy and hard to test Many scripts are not good at dealing with an error in the middle of processing Custom code not supported

59 Batch Scripting Use case Weekly close process consists of a series of repetitive steps Generate text file from another system Copy text file Load data to Essbase Calc cube A simple batch file and MaxL script can be A simple batch file and MaxL script can be created and scheduled to automate this

60 Essbase SQL Used as the data source in a load rule Primarily used for data loading Also useful for dimension building Very useful if you want to skip putting data in a text file Can serve as a stepping stone to using EIS, ODI, Studio, etc. Useful in conjunction with automation

61 EAL for HFM

62 EAL for HFM HFM User Essbase User

63 Questions

64 Todd Rebner Managing Partner 8803 Brecksville Rd., Suite / Brecksville, Ohio Cell: (330) / efax: (440) trebner@advancedepm.com