Informatica Cloud Fundamentals. Informatica Cloud Services Student Guide

Transcription

1 Informatica Cloud Fundamentals Informatica Cloud Services Student Guide

3 Course Logistics Each module will include: Lecture Demo(s) Hands-on Lab(s)

4 Course Audience Possible Roles: Business Analysts Developers IT Managers This course assumes basic familiarity with Salesforce.com (SFDC)

5 Introductions Instructor Tell us about you! Relative experience Current/upcoming projects How do you expect to benefit from this course?

6 Course Objectives Module 0 Course Overview Module 1 Informatica Cloud Overview Lab 1 Logging In Lab 2 - Creating a View Module 2 - Informatica Secure Agent and Architecture Lab 1 Installing the Agent Module 3 Creating Connections Lab 1 - Creating a Salesforce.com Connection Lab 2 Creating a Flat File Connection Module 4 Data Synchronization and Monitoring Tasks Lab 1 Building a Data Synchronization Task

7 Course Agenda Day 2: Morning Module 5 Cloud Mapping Designer, Pt. 1 Lab 1 Creating a Simple Mapping using a Source, Filter and Multiple Targets

8 Course Materials Lab Guide (PDF) Contains step-by-step instructions for all labs Need local copy for doing labs Student Guide (PDF) Contains all slides For your reference

9 Course Resources / Applications Informatica Cloud Application Training Org (login to be provided) Salesforce Developer Account Training Web Site For downloading files, viewing database tables, etc. URL in Lab Guide

10 Training Environment Training Server (ReadyTech) Oracle Training Org SQL Server Informatica Agent Student01 Student02... Student n

11 Training Environment Student Machine Developer Account or Sandbox CSV Files Informatica Agent Training Org Student01 Student02... Student n

12 Student Logins Student Name Login Student Number Password: tba

13 Student Logins Student Name Login Student Number Password: tba

14 Student Logins Student Name Login Student Number password: tba 14

16 Module Objectives After completing this module, you will be able to: Explain the purpose of Informatica Cloud List and define all Informatica Cloud Applications Understand when to use each applications Define terms used in Informatica Cloud Log in to and navigate the Informatica Cloud application Edit your user preferences Create views

17 Informatica Cloud Allows business users to: Integrate data across cloud-based applications and onpremise systems and databases

18 Informatica Cloud Allows business users to: Integrate data across cloud-based applications and onpremise systems and databases Addresses specific business processes: Importing/migrating data Leads Legacy -> Salesforce Object synchronization Accounts Contacts Process integrations Opportunity to Order Data Replication and Archiving

19 Object Synchronization Account and Contact Synchronization Salesforce (Master System) Billing System Oracle DB Add new records Accounts/Contacts Update existing records Customers

20 Process Synchronization Opportunity to Order Process Salesforce Create New Order ERP SFDC Closed/Won Opportunities New Order Line Items Sales Orders

21 Process Synchronization Opportunity to Order Process Salesforce ERP SFDC Update Order Status Closed/Won Opportunities Sales Orders

22 Data Replication and Archiving Data Warehousing and Reporting Salesforce Data Warehouse or Off-Line Database Reports

23 Data Replication and Archiving Automatic Data Backup or Archival Salesforce Backup Database ERP or Other Application Data Archival Files

24 Informatica Cloud Apps Data Synchronization Contact Validation Data Replication Data Masking Mapping Configuration Data Assessment

25 Informatica Cloud Editions

26 Informatica Cloud Editions Professional Basic Advanced Premium Run up to 100 integration tasks/day Run unlimited tasks/day Data Replication Service Delegated Administration Unlimited rows/day Real-time (outbound messaging for Salesforce) Data Quality Service Restricted Use PowerCenter Multiple Source objects Multiple users REST API PowerExchange for CRM Connector Lookups Event-based scheduling One Dev/Test Sandbox PowerExchange for Web Services Connector 1 Secure Agent External scheduler support Limited to 1 user Salesforce Bulk API support Fine grained access controls Real Time Interoperability between Informatica Cloud and PowerCenter

27 Informatica Cloud - Key Terms Term Source Target Task Definition Where data is moving from Where data is moving to What you will create in Informatica Cloud Can be of type: Data Synchronization Data Replication Contact Validation Data Assessment Data Masking Connection Contains information used to connect to an on-premise or cloud application (Salesforce.com, databases, CSV files, etc.) Org An Informatica Cloud organization, generally one per company

28 Other Resources Documentation Online help and PDF User Guide Community Site Trust Site Global Customer Support

29 Informatica Cloud Documentation Online Help Printable User Guide Release Notes

30 Informatica Cloud Community Site community.informatica.com

31 Informatica Cloud Trust Site trust.informaticacloud.com

32 Informatica Global Support Submit a support request Live chat with a support representative

33 User Preferences User Details (Password, Name, Title, Phone, , Time Zone) Default List Views

34 Custom Views Display a subset of objects based on parameters Can be created for : Connections Task Flows All types of tasks Can be private or public

35 Instructor Demo Your instructor will now demonstrate how to: Log in Navigation Overview Sidebar buttons Create a Custom View Update User Preferences

36 Summary This module showed you how to: Explain the purposes of Informatica Cloud List and define the Informatica Cloud applications Provide real-world examples of how each application might be used Define common terms used in Informatica Cloud Edit user preferences and define views

37 Lab 1: Logging In In this lab you will Log in to the Informatica Cloud Training org (using your assigned student ID) Access the Informatica Cloud online help Search the online help

38 Lab 2: Creating a View In this lab you will Create a custom view for data synchronization tasks Set the new view to be your default

40 Module Objectives After completing this module, you will be able to: Understand the Informatica Cloud Services architecture Explain the purpose of the Informatica Secure Agent Design an agent architecture for your business Install the agent

41 Informatica Cloud Architecture Informatica Cloud Services ICS Repository Internet Machine with Web Browser / Internet Access Internal

42 Informatica Cloud Architecture Informatica Cloud Services Administration and Design Configuration and Maintenance (HTTPS) ICS Repository Internet Machine with Web Browser / Internet Access Internal

43 Informatica Cloud Architecture ICS Repository ICS Repository stores: Source and Target metadata Data mappings Connection information (encrypted) Schedules Logging and Monitoring information

44 What is the Informatica Cloud Secure Agent? Lightweight, self-upgrading program that runs inside your network Runs all tasks (your application data is not staged in the cloud) Enables secure communication across the firewall between your organization and Informatica Cloud

45 More about the Secure Agent Available for Windows and Linux platforms Run-time version of PowerCenter execution component Can have multiple agents installed within your network One agent per machine

46 Informatica Cloud Architecture Metadata (Schema changes, Schedule information) - HTTPS Informatica Cloud Secure Agent Informatica Cloud Administration and Design Configuration and Maintenance (HTTPS) ICS Repository Internet Machine with Web Browser / Internet Access Internal

47 Architecture Review Salesforce Business Data (HTTPS/SOAP) Informatica Cloud Secure Agent nax.salesforce.com Metadata (Schema changes, Schedule information) - HTTPS Informatica Cloud Local Files and/or Databases Administration and Design Configuration and Maintenance (HTTPS) ICS Repository Machine with Web Browser / Internet Access

48 Informatica Secure Agent Architecture One Informatica Cloud Secure Agent per machine Agent is tied to an Informatica Cloud org on installation You can install multiple agents within a single Informatica Cloud org Machine A Machine B

49 Notes on Multiple Agents Typically this is done while setting up your system In Production system, there is almost always ONE agent You may decide to use additional agents: If you want separate agent machines with different controls/permissions for different businesses/user groups For Failover purposes If you want additional processing power (running 6+ tasks concurrently) Additional agent REQUIRES additional license fee

50 Instructor Demo: Installing/Renaming the Agent Your instructor will now demonstrate how to: Install the agent Verify that agent is up and running Rename the agent

51 Troubleshooting the Agent If agent status shows as Inactive, communication with the Informatica Cloud Servers may be blocked by: Windows Firewall Virus Scanner Content Filter If your company uses a Proxy Server, enter the following Settings: Proxy Server Proxy Port # Proxy User ID (if necessary) Proxy Password (if necessary) Visit Community site for more specific information

52 Instructor Demo: Starting/Stopping the Agent and Configuring Proxy Server Settings Your instructor will now demonstrate how to: Access the Agent Console Enter Proxy Server Settings

53 Agent Log File

54 Running Agent as Local/Network User Agent inherits access privileges of user used to install Secure agent must have permission to access directories on Windows May require configuring a login for Windows service

55 Summary This module showed you how to: Design an agent architecture for your business Install the Secure Agent View the Agent log file

56 Lab 1: Installing the Agent Business Scenario: You will be sourcing data from some CSV files that you ll download to your local machine. In order to access these files, you ll need to install the agent on your machine. In this lab, you will: Install the Informatica secure agent. Troubleshoot installation (if necessary)

58 Module Objectives After completing this module, you will be able to: Understand what a connection is Understand the types of connectivity in Informatica Cloud Understand the various connection types and what information is required Create a connection Edit a connection Delete a connection

59 Types of Connectivity There are two types of connectivity in Informatica Cloud: Native Connections Add-On Connectors

60 Connectivity Examples Native Salesforce Flat File FTP/SFTP SQL Server Oracle MySQL ODBC MS Access SAP Web Service Microsoft Dynamics CRM Add-On Amazon Redshift Avature Box Eloqua Chatter Concur Netsuite Great Plains Work Day Marketo Zuora

61 What is a Connection? An Informatica Cloud object Defines a connection to a cloud or on-premise application, database, or file Used to define the sources and targets (endpoints) for tasks

62 Native Connection Types Flat File FTP/SFTP SQL Server (versions 2000, 2005, 2008 and 2012) MS Access Oracle MySQL (version 5.0.x) ODBC Salesforce SAP Web Service Microsoft Dynamics CRM

63 Salesforce Connections Securely read data from or write data to Salesforce sources or targets Can be used in any type of task Requires Security Token or Trusted IP Range

64 Salesforce Security Token Automatically generated key, used for API access to Salesforce Obtained by changing resetting the security token (via the Salesforce UI) Sent via (to address on the user s Salesforce record) Must be added to your Salesforce.com connection in Informatica Cloud

65 Salesforce Trusted IP Range You may want to avoid using security token Alternative is to add Informatica Cloud Servers and any agent machine(s) IP addresses to Salesforce org Check online help or community site for step-by-step directions and IP numbers

66 Best Practice: Create Salesforce Integration User Best practice to use a dedicated data integration user license User specified in Informatica Cloud connection listed on Salesforce records in Record Owner/Last Modified By fields Other features (discussed later) can be used to set Record Owner

67 Salesforce Service URL Change to test.salesforce.com for accessing a Sandbox

68 Flat File Connections Stores information required to create, access, and store flat files Points to a single folder/directory Includes settings for Date Format and Code Page

69 ODBC Connections Use when Informatica Cloud does not provide native support for your database Available for some applications Example: QuickBooks Stands for Open Database Connectivity Standard interface for accessing DBMS Uses ODBC driver as translation layer

70 FTP/SFTP Connections (Secure) File Transfer Protocol Allows you to extract data from, or load data to, a file on a remote machine Must define remote and local directory File structures must match Local file also used for data preview Commonly used in B2B scenarios Collect data from many different partners to process Write data to file on partner machine

71 Creating a Connection Can be done from Configure: Connections page or when creating a task Available to entire organization Agent must be installed first Connection (except for SaaS application) is tied to agent

72 Instructor Demo: Managing Connections Your instructor will now demonstrate how to: Viewing list of connections Edit/copying/deleting a connection Creating a connection and setting connection properties

73 Using Add-On Connectors Review documentation (Community Site) To use: Add connector to Informatica Cloud org (requires additional endpoint license) Create a connection Use in a task

74 Instructor Demo: Accessing Add-On Connectors Your instructor will now demonstrate how to: Show connectors on Administration > Connectors page Review documentation on community site:

75 Summary This module showed you how to: Understand the types of connections that are available in Informatica Cloud Create a connection Edit a connection Delete a connection

76 Lab 1: Creating a Salesforce Connection Business Scenario: You need to connect to a new Salesforce instance. In order to do this from Informatica Cloud, you ll need API-level access, and must therefore reset your security token. In this lab, you will: Reset your Salesforce security token. Create a Salesforce connection.

77 Lab 2: Creating a Flat File Connection Business Scenario: You have several files that contain data to be loaded into Salesforce. You need to create an Informatica Cloud connection to access these files. In this lab, you will: Create a folder on the agent machine. Create a Flat File connection that points to this folder.

79 Module Objectives After completing this module, you will be able to: Explain the purpose of the data synchronization app Build, test, and run a data synchronization task Use the Activity Log to review and debug errors Understand the types of log files that are available Locate all log files

80 Data Synchronization Overview Synchronizes data between source and target Examples: Read leads from file and write to Salesforce Find new account records in ERP system and insert them into Salesforce Find modified contact records in Salesforce and update them in your ERP system

81 Data Synchronization Operations A data synchronization task performs one of the following operations: Insert Update Upsert (Update or Insert) Delete

82 Operation: Insert All source rows are inserted into target Ideal Use: One-time or initial data load Risk of duplicate records in the target

83 Operation: Insert SOURCE A D E F

84 Operation: Insert SOURCE A D E F TARGET A B C D

85 Operation: Insert SOURCE TARGET END RESULT Duplicate Records A D E F A B C D A A B C D D E F

86 Operation: Update Updates rows in the target that exist in the source If a row in the source does not exist in the target, that row fails

87 Operation: Update SOURCE A 1 D 1 E F

88 Operation: Update SOURCE A 1 D 1 E F TARGET A 2 B C D 2

89 Operation: Update SOURCE TARGET END RESULT A 1 A 2 A 1 D 1 E B C B C E & F are not in the target F D 2 D 1

90 Operation: Upsert (Update or Insert) Updates all rows in the target that exist in the source Inserts all new source rows in to the target Not supported for flat file target

91 Operation: Delete Deletes all rows from target that exist in the source

92 Configuring a Data Synchronization Task: Source Supported sources: Single flat file Database table Salesforce object Saved Query Up to five related database tables or Salesforce objects

93 Configuring a Data Synchronization Task: Target Supported targets: Single flat file Database table Salesforce object

94 Salesforce Archived/Deleted Rows Option For Salesforce sources only Option to include archived and deleted rows For insert and update operations, includes deleted and archived Salesforce data

95 Mapping Fields Fields with similar names are automatically matched Drag and drop source to target fields Map fields with compatible data types (or use field expression to convert) Always validate the mapping!

96 Field Information The following icons display on the field mapping page: Primary Key indicates that field is primary key for object External ID indicated that field is external ID for object (Salesforce.com only) Non-null indicates that field cannot contain a null value, and (sometimes) must be populated on insert

97 Important Note about Agents Only one agent per task For SaaS -> SaaS connection, you must specify agent (Step 6 of wizard Agent Details section)

98 Refresh Fields Use Refresh Fields button in Field Mapping: If you have changed the task source or target If you have added/removed fields from the source or target Always validate mapping

99 Monitoring Running Tasks Activity Monitor Automatically displays when a task starts Provides details about jobs that are currently running Refreshes every 5 seconds Can be used to stop a task

100 Verifying Task Results - Activity Log Displays log entries for all completed tasks Provides details about all jobs Refreshes every 5 seconds

101 Activity Log Task Status Status Success Description The job ran successfully without errors Failed An error caused the job to fail No row were moved from source -> target Warning The job completed but some rows failed Review the Error Rows file to identify failed rows and review error messages Click to preview Error Rows file

102 Instructor Demo: Build Data Synchronization Task Your instructor will now demonstrate how to: Create a data synchronization task using the Insert operation. Load data from a CSV file into Salesforce. Review task status in the Activity Log. View Job Details page.

103 Informatica Cloud Log Files Error Rows Session Log Success Files

104 Log File Storage Informatica Cloud stores up to 10 log files per task When task is run for 11th time, log is overwritten

105 Where Error Row Files are Stored Agent Installation Directory Directory where error row files are stored

106 Log File Naming Convention

107 Instructor Demo: Using the Activity Log Instructor will show you how to: View an Error Rows preview file from the activity log and use it to debug a task. Locate task ID. View Task Details page.

108 Summary This module showed you how to: Create, configure and run a data synchronization task Use the Activity Monitor and Activity Log to validate results Debug task and row-level errors Locate all Success, Session, and Error Row log files

109 Lab 1: Building a Data Synchronization Task Business Scenario: You have a CSV file that contains a list of customers. You wish to import these into Salesforce as accounts. In this lab, you will: Build and configure a data synchronization task. Run the task and validate results in Salesforce.

111 Module Objectives After completing this module, you will be able to: Identify business use cases for the Cloud Mapping Designer Use the Mapping Designer to build a mapping Understand the transformations that are available Validate and test a mapping 111

112 What is the Cloud Mapping Designer? Easy-to-use, web-based interface for building mappings Allows creation of flexible mappings to address more advanced use cases Additional logic (such as aggregation) Specific ordering of logic Multiple Sources and Targets Elements of mapping can be parameterized allowing creation of reusable templates 112

113 What is a Mapping? Describes the flow of data from source to target Add transformation shapes to perform data transformation tasks Includes field rules which define the fields coming into the transformation Links visually represent how data flows through mapping 113

114 Mapping Lifecycle 1 Design a Mapping Must contain at least 1 source and 1 target Optional parameters for connections, objects, and transformations 2 Run and Test the Mapping Verify that mapping works If parameters, will be prompted for values Create 1 or more Mapping Configuration Tasks 3 Assign to schedule Specify parameter values 114

115 Mapping Designer Terminology Term Canvas Shapes Mapping Parameterized Mapping Definition Area where mapping is built Represent sources/targets and data transformations, can be dragged onto canvas End to end integration built using the Cloud Mapping Designer Mapping that contains one or more parameters (equivalent to an Integration Template ) Mapping Configuration Task Deploy Automatically generated wizard that allows users to configure a mapping to run (with or without parameters) Apply changes made to a mapping across all the dependent mapping configuration tasks 115

116 Best Practices: Naming Conventions Mapping name can contain alphanumeric characters and _ (underscores) Consider using naming conventions for: Transformation names Field Names Can use Velocity Methodology as a guide Prepares you to better leverage future functionality around repository searching, etc. 116

117 Naming Conventions - Examples Shape/Transformation Source Target Joiner Filter Expression Lookup Example SO_Salesforce TG_HighValueOrders JNR_OrdersAccounts FIL_HighValue EXP_OrderTotal LKP_ProductSKU 117

118 What is a Transformation? A mapping object that modifies or passes data Can be active or passive Active transformations: Can change the number of rows that pass through Example: Filter Passive transformations: Does not change the number of rows that pass through 118

119 Source Transformation Reads data from a source Active transformation Defines connection and object(s) Connection type controls advanced options Add or remove fields 119

120 Target Transformation Defines the target connection and object for mapping Additional options depend on connection type Support for one or more targets in a mapping Some connection types support multiple target objects 120

121 Filter Transformation Filters data out of data flow based on the filter condition: Returns TRUE or FALSE If TRUE, passes the row to rest of data flow If FALSE, the row is dropped Can include multiple conditions Must be linked to from single transformation For best performance, place close to mapping source(s) Active transformation 121

122 Filter Condition IF x => y Expression that returns TRUE or FALSE Create one or more simple filter conditions: Includes field name, operator and value Case sensitive Support for operators: =, <, >, <=, >=,!= Evaluated in order, using AND logical operator Use advanced filter condition to define complex condition 122

123 Mapping Validation Mapping is validated when saved Validation Panel Allows you to validate at any time Displays any error details Displays a list of transformations 123

124 Running a Mapping Performs a test run of a valid mapping Allows you to validate results of mapping before creating a mapping configuration task Runs a temporary Mapping Configuration Task If there are parameters, the wizard displays (you must provide values) 124

125 Instructor Demo: Using the Mapping Designer Your instructor will now demonstrate how to: Create a new mapping. Use the Mapping Designer interface. Add source, target, and Filter shapes to the mapping. Run the Mapping Verify results 125

126 Best Practices and Browser Support Cloud Mapping Designer currently works best in Chrome If using IE, use version 10+ (issue with IE9 and earlier versions) Firefox also certified Use Save and Continue to save your work often! 126

127 Summary This module showed you how to: Use the Mapping Designer to build a mapping Use the mapping shape/transformations: Source, Target, Filter 127

128 Lab 1: Creating a Simple Mapping Using a Source, Filter, and Multiple Targets Business Scenario: You need to extract opportunity data from Salesforce to two separate files (dynamically, based on probability %). This cannot be accomplished using the Data Synchronization app. In this lab, you will: Build a mapping using the Mapping Designer Use source, target and filter Run a mapping and verify results 128