EPM Suite (Hyperion) Data Integration Extravaganza
Technologies Hyperion Application Link (HAL) Data Integration Management (DIM) Oracle Data Integrator (ODI) Enterprise Performance Management Architect (EPMA) Financial Data Quality Management (FDM) ERP Integrator (ERPi) Data Relationship Management (DRM) Essbase Integration Services (EIS) Essbase Studio (EAS) Outline Load Utility DATAEXPORT Command MaxL Windows Batch Scripting Essbase SQL Loader Essbase Analytics Link (EAL) for HFM
Background Hal Hyperion tool for loading data and metadata to Hyperion Essbase, Financial Management, and Planning No longer supported by Oracle
Hal Common Uses Loading data (text, relational) to Essbase, Planning Extracting outline information
Hal
Use Case Hal Company wants to move GL data from a relational data source and use it to update the outline in Planning
DIM Data Integration Management Based on Informatica PowerCenter ETL tool similar to ODI
DIM Can load data and metadata to Essbase, Planning, HFM, Performance Scorecard Can process large volumes of data
DIM
DIM
DIM Use Case(s): IT driven process passing large volumes of data at high speeds Complex mapping logic is required Multiple workflows
ODI Oracle Data Integrator Very flexible tool Knowledge modules for interacting with systems (Essbase, Planning, SQL Server, Oracle, Flat file, etc.) Design custom workflows
ODI Can load data and metadata to Essbase, Planning, HFM, etc. Can load data warehouses, ERP systems and most databases Strategic data integration tool from Oracle
ODI
Use Case ODI Upstream data is in relational databases accessible via JDBC driver, wants to combine data from a file coming in via FTP and use that to load to a Hyperion cube, and send an email out on failure.
EPMA Can manage metadata and hierarchies with graphical interface Dimension Library centralizes data for different dimensions i Can move data with Data Synchronization Interface Tables
EPMA Manage Essbase, Planning, HFM in one place Mostly deals with metadata Provides validation functionality Provides limited data mapping / integration Provides Application Library
EPMA
EPMA Use Case Administrator already uses EPMA, deploys metadata to various applications Ad hoc data sync across environments Quickly build a new application for a specific purpose by using metadata and data from existing applications
EPMA
EPMA
FDM Financial Data Quality Management Load data to HFM, Essbase and Planning from flat files SQL based, business driven Highly customizable with VB Script Self-service or automated data loading Allows drill back from target systems
FDM
FDM Use Case Enable SME s to map their own data Real time validation & verification SOX Compliance & Certification Industrial strength ETL not required
FDM
ERPi New in 11.1.1.3 Pulls directly from source ERPs Load metadata to HFM, Planning and Essbase Combined with FDM, loads data to HFM, Planning or Essbase Facilitates user drill back and write-back to source ERP from HFR or Smart View
ERPi
Use Case ERPi Enhance functionality of existing FDM With supported source ERPs, create robust 2-way data flow for reporting and analysis. Provide access to detail with out replicating across applications. Push downstream data to all systems
ERPi
DRM Data Relationship Management For managing metadata only (no cube data) Advanced features for versioning, pushing to source systems, pushing to Hyperion
DRM Very robust metadata management tool Can manage and deploy data for Hyperion and non-hyperion systems Does not process data Formerly known as MDM (Razza)
DRM
DRM Use Case Hierarchies for dimensions in cube(s) are sourced from external system Multiple cubes need same hierarchies Keep all Hyperion products in sync Centralize and reduce metadata maintenance Segregate metadata management from system administration
FDM explicit mapping in DRM DRM
DRM - API
Essbase Integration Services
Essbase Integration Services Used to model cubes from relational data sources Can be used to build/update outline and load data Supports complex SQL if needed Very fast if used properly
Essbase Integration Services Pros Very flexible Rich dimension building capabilities without having to mess around with load rules Cons Once model is setup, you re married to it You need to really think to get it right
Essbase Integration Services
Essbase Integration Services Use Case Data and metadata already exist in a SQL database, and now the business would like to build multiple l cubes to provide analysis capabilities and possibly drill-thru
Essbase Studio
Essbase Studio Used to design cubes from relational data sources, OBIEE, EPMA apps & text t file Used for light-weight data modeling Evolution of EIS Common Metadata Repository Lineage Tracking Limited EAS functionality provided
Essbase Studio
Pros Essbase Studio Very flexible Enables true artifact reusability Introspection is very cool Drill through (RDBMS, URL, HFM, Java, etc.) Cons Not your father s Application Manager Not your father s EAS
Outline Load Utility Can load data and metadata Create a load file in text (CSV) Complex command line options OutlineLoad [-f:passwordfile][/s:server] /A:application /U:userName [/M] [/E:outputFileName] [/I:inputFileName/D[U]:loadDimensionName /DA:attributeDimensionName:baseDimensionName] [/TR] [/N] [[/R] [/U]] [/C] [/F] [/K] [/X:exceptionFileName] [L:logFileName] [/DX:HSP_Rates][/DS:HSP_SMARTLISTS] [/8][/?]
Outline Load Utility Pros No ETL required Perform batch outline updates to Planning Can load data as well Cons Arcane syntax Practical limitations (Volume)
Outline Load Utility
Use Case Outline Load Utility Company uses Planning to do yearly forecast of employee salaries. HR provides a spreadsheet with employee data and salary basis data Outline load utility can be used periodically to update the employee members in the Planning outline and load up their base data
DataExport Historically, an Essbase CDF (custom defined d function) used to export data to text t file or relational data source Is now native functionality (no need to setup CDF, which can be tricky) Useful for calling from MaxL (in place of report script) Can provide export capability to users by giving them access to a calc script
DataExport Pros Can be easier and more flexible than report scripts Cons Can only export data (no metadata) Use Case Exporting data to be used to load another Exporting data to be used to load another cube
DataExport
Use Case DataExport Data exists in cube but not necessarily easily accessible from other SQL sources, and wish to generate a text file with a certain subset of data (addressable with FIX)
MaxL Used to automate Essbase administrative tasks Replaced harder to read ESSCMD Can do almost everything to a server/application/cube/user that can be done in EAS
MaxL set MY_NAME = "ProcessCube"; login $ESSUSER identified by $ESSPW on $ESSSERVER; spool stdout on to "$LOGPATH\\$CONTEXT $LOGPATH\\$CONTEXT.$MY_NAME.$1.stdout.txt $MY NAME $1 txt"; spool stderr on to "$LOGPATH\\$CONTEXT.$MY_NAME.$1.stderr.txt"; alter database $1.$2 reset data; import database $1.$2 data connect as $SQLUSER identified by $SQLPW using server rules_file 'LdQVSOS' on error write to "$LOGPATH\\$CONTEXT $LOGPATH\\$CONTEXT.$MY_NAME.$1.error.txt $MY NAME $1 txt"; execute aggregate process on database $1.$2 stopping when total_size exceeds $3; spool off; logout; exit;
Use Case MaxL Data/metadata available in text file or relational data source, want to automate on the server or work in to existing i automation Perl Module
Batch Scripting
Batch Scripting Simple batch files used to perform a sequence of ftasks Lends itself very easily to automating and scheduling for recurring tasks Can glue together other data integration tools: MaxL, ODI, outline load, etc.
Batch Scripting Pros Very easy to implement Not limited to Hyperion products Cons Large scripts can become unwieldy and hard to test Many scripts are not good at dealing with an error in the middle of processing Custom code not supported
Batch Scripting Use case Weekly close process consists of a series of repetitive steps Generate text file from another system Copy text file Load data to Essbase Calc cube A simple batch file and MaxL script can be A simple batch file and MaxL script can be created and scheduled to automate this
Essbase SQL Used as the data source in a load rule Primarily used for data loading Also useful for dimension building Very useful if you want to skip putting data in a text file Can serve as a stepping stone to using EIS, ODI, Studio, etc. Useful in conjunction with automation
EAL for HFM
EAL for HFM HFM User Essbase User
Questions
Todd Rebner Managing Partner 8803 Brecksville Rd., Suite 7-198 / Brecksville, Ohio 44141 Cell: (330) 212-3097 / efax: (440) 201-7486 trebner@advancedepm.com www.advancedepm.com