Aster-Informatica Connector User s Guide

Transcription

1 Aster-Informatica Connector User s Guide Connector version AC5.11 for Aster Database 5.10 Product ID: B K August 2, 2013 Contents Aster-Informatica Connector User s Guide... 1 Contents... 1 Preface... 4 System Requirements... 5 Operating Systems... 5 Installation... 5 Install the Connector on the Informatica Server (Windows 32- or 64-bit)... 5 Install the Connector and ODBC Driver on the Informatica Server (Linux or Solaris)... 6 Install Aster-Informatica Connector Client (Windows Only)... 7 Register the Aster Database Plug-in... 9 Upgrading the Aster-Informatica Connector Add and Use Aster Database tables for Informatica Sources and Targets Import a Table from Aster Database into Informatica Source Import a Table from Aster Database into Informatica Target Edit Schema and Table Name Using Informatica to create Aster connections in Workflow Manager Relational Connection Application Connection (Export) Loader Connection Troubleshooting Aster-Informatica Connections Edit a Relational Connection Edit an Application (Export) Connection Edit a Loader Connection SQ Property Page Override a Query at the Session Level Changing the default path for source or target files Best Practices Setting Informatica Parameters for Performance Notes on Handling Certain Datatypes Numeric Data Numeric/Decimal Datatype Precision UTF8 Data Time and Timestamp Data Limit on Transferring Time Values in the Distant Past or Future Exporting NaN values from Aster decimal/numeric data types when high precision mode of Informatica is enabled Export NaN/+-Infinity value of double/real/timestamp datatype from Aster to MS SQL Server Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 1

2 Notices Copyright Information: The product or products described in this book are licensed products of Teradata Corporation or its affiliates. Teradata, Aster, Aster Data, ncluster, SQL-MapReduce, Aprimo, BYNET, DBC/1012, DecisionCast, DecisionFlow, DecisionPoint, Eye logo design, InfoWise, Meta Warehouse, MyCommerce, SeeChain, SeeCommerce, SeeRisk, Teradata Decision Experts, Teradata Source Experts, WebAnalyst, "More Data. Big Insights," and "You ve Never Seen Your Business Like This Before" are trademarks or registered trademarks of Teradata Corporation or its affiliates. Adaptec and SCSISelect are trademarks or registered trademarks of Adaptec, Inc. AMD Opteron and Opteron are trademarks of Advanced Micro Devices, Inc. BakBone and NetVault are trademarks or registered trademarks of BakBone Software, Inc. EMC, PowerPath, SRDF, and Symmetrix are registered trademarks of EMC Corporation. GoldenGate is a trademark of GoldenGate Software, Inc. Hewlett-Packard and HP are registered trademarks of Hewlett-Packard Company. Intel, Pentium, and XEON are registered trademarks of Intel Corporation. IBM, CICS, RACF, Tivoli, and z/os are registered trademarks of International Business Machines Corporation. Linux is a registered trademark of Linus Torvalds. LSI and Engenio are registered trademarks of LSI Corporation. Microsoft, Active Directory, Windows, Windows NT, and Windows Server are registered trademarks of Microsoft Corporation in the United States and other countries. MicroStrategy is a registered trademark of MicroStrategy Incorporated. Novell and SUSE are registered trademarks of Novell, Inc., in the United States and other countries. QLogic and SANbox are trademarks or registered trademarks of QLogic Corporation. RedHat is a registered trademark of Red Hat, Inc. SAS and SAS/C are trademarks or registered trademarks of SAS Institute Inc. SPARC is a registered trademark of SPARC International, Inc. Sun Microsystems, Solaris, Sun, and Sun Java are trademarks or registered trademarks of Sun Microsystems, Inc., in the United States and other countries. Symantec, NetBackup, and VERITAS are trademarks or registered trademarks of Symantec Corporation or its affiliates in the United States and other countries. Ubuntu and Canonical are registered trademarks of Canonical Ltd. Unicode is a collective membership mark and a service mark of Unicode, Inc. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product and company names mentioned herein may be the trademarks of their respective owners. THE INFORMATION CONTAINED IN THIS DOCUMENT IS PROVIDED ON AN AS-IS BASIS, WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF IMPLIED WARRANTIES, SO THE ABOVE EXCLUSION MAY NOT APPLY TO YOU. IN NO EVENT WILL TERADATA CORPORATION BE LIABLE FOR ANY INDIRECT, DIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, INCLUDING LOST PROFITS OR LOST SAVINGS, EVEN IF EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. The information contained in this document may contain references or cross-references to features, functions, products, or services that are not announced or available in your country. Such references do not imply that Teradata Corporation intends to announce such features, functions, products, or services in your country. Please consult your local Teradata Corporation representative for those features, functions, products, or services available in your country. Information contained in this document may contain technical inaccuracies or typographical errors. Information may be changed or updated without notice. Teradata Corporation may also make improvements or changes in the products or services described in this information at any time without notice. If you d like to help maintain the quality of our product documentation, Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 2

3 please send us your comments on the accuracy, clarity, organization, and usefulness of this document. You can send your comments to lists.teradata.com. Any comments or materials (collectively referred to as Feedback ) sent to Teradata Corporation will be deemed non-confidential. Teradata Corporation will have no obligation of any kind with respect to Feedback and will be free to use, reproduce, disclose, exhibit, display, transform, create derivative works of, and distribute the Feedback and derivative works thereof without limitation on a royalty-free basis. Further, Teradata Corporation will be free to use any ideas, concepts, know-how, or techniques contained in such Feedback for any purpose whatsoever, including developing, manufacturing, or marketing products or services incorporating Feedback. Copyright 2013 by Teradata Corporation. All Rights Reserved. Contacting Technical Support For assistance and updated documentation, contact Teradata Global Technical Support (GTS): Support Portal: International: US Customers: Toll Free Number: 877-MyT-Data Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 3

4 Preface About this guide Assumed audience and the content of this guide This guide provides a general overview of the Aster-Informatica Connector as well as specific information for installing and integrating this product into your Informatica environment. This guide assumes that the people responsible for integrating Aster Database with Informatica are experienced users of the various Informatica applications including the PowerCenter Repository Manager, Designer, and Workflow Manager. It does not explain basic operation of the Informatica applications. For questions about the Informatica applications, consult the Informatica documentation or Informatica technical support. This guide does not explain the operation of the Aster Database product. For specific questions about Aster Database, consult the Aster Database documentation. About versions Informatica versions Aster Database versions This integration supports Informatica PowerCenter 8.6.1, 9.0.1, and only. This integration supports Aster Database version 5.10 only. Datatype support This integration supports all datatypes supported by Aster, but be aware of the datatype limitations explained in the section Notes on Handling Certain Datatypes. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 4

5 System Requirements Aster-Informatica Connector Server should be configured on an Informatica Server 32/64 bit machine, with version Informatica PowerCenter 8.6.1, 9.0.1, or Aster-Informatica Connector Client should be configured on an Informatica Client machine, with version Informatica PowerCenter 8.6.1, 9.0.1, or For Linux or Solaris: The installer will search for the.../server/bin' and '.../server/infa_shared' directories at the given installation path. Upon failure to locate these directories, the installer will abort without updating the system. Operating Systems Win 2003 Server 64-bit, Win XP 32-bit Red Hat Linux bit and 64-bit Solaris bit Sparc and x86 Installation The Aster-Informatica Connector is installed in three distinct steps: 1. Install the Aster Connector on the Informatica Server (Windows, Linux or Solaris). 2. Install the Aster Connector and the Aster Database ODBC driver on the Informatica Client (Windows only). 3. Register the Aster Connector Plug-in through the PowerCenter Administrative Console. If any of the above steps are skipped, the integration will not work properly. Install the Connector on the Informatica Server (Windows 32- or 64-bit) This section shows you how to install the Aster-Informatica Connector on the Informatica Server running on a Windows 32- or 64-bit platform. 1. Download the Aster Client package for your operating system to the Windows machine that hosts the Informatica Server. 2. Unzip the package. The individual client installers will be located in the extracted directory:../stage/home/beehive/clients-<your_os>/ 3. Copy ncluster_loader.exe and ncluster_export.exe to a directory of your choice, and modify the PATH environment variable on Windows to point to their location. 4. Find the installer zip file for the correct version of Informatica. o For Informatica 8.6.1: AsterConnector8.6.1_INFA8.6.1 windows_x zip Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 5

6 o For Informatica 9.0.1: AsterConnector9.0.0_INFA9.0.0 windows_x zip o For Informatica 9.1.0: AsterConnector9.1.0_INFA9.1.0 windows_x zip o For Informatica 9.5.0: AsterConnector9.5.0_INFA9.5.0 windows_x zip 5. Unzip the Informatica installer file. The.msi installer files can be found in the extracted directory:..\stage\clients-infa_connector-<your_os>\ 6. Double click on the Informatica installer file for your platform to begin the connector installation. If prompted, click Run to verify that you want to run the installer. 7. Read the Welcome message and click on Next to proceed. 8. The License Agreement screen will show the license and maintenance agreement information. Read it and click the I Agree radio button. Click Next. 9. The Select Installation Folder screen will display the default Informatica installation path. It is recommended that you should keep this path. If you think this is not the correct path, browse to the desired directory. If installing for Informatica 9.0.1, the default installation path should be "C:\Informatica\9.0.1\". If installing for Informatica 9.1.0, the default installation path should be "C:\Informatica\9.1.0\". 10. The Confirm Installation screen will ask for confirmation. Click on Install. 11. The Installing Informatica Connector Server dialog box will appear. Wait until it completes. 12. After successful installation, the Installation Complete screen will appear. 13. Click the Close button to complete the installation. Install the Connector and ODBC Driver on the Informatica Server (Linux or Solaris) This section shows you how to install the Aster-Informatica Connector and the Aster Database ODBC driver on Informatica Server running on a Solaris x86 32-bit platform. 1. Download the Aster Client package for your operating system to the Solaris machine that hosts the Informatica Server. 2. Extract and unzip the package. Run following commands to extract the installation files: $ gunzip AsterClients <your_os> tar.gz $ tar -xvf AsterClients <your_os> tar 3. The individual client installers will be located in the extracted directory:../stage/home/beehive/clients-<your_os>/ Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 6

7 4. Move the executables ncluster_loader and ncluster_export to the desired directory, set permissions to make them executable, and modify the PATH environment variable to point to their location. 5. Find the installer package for the correct version of Informatica for your platform: o For Informatica 8.6.1: AsterConnector8.6.1_INFA8.6.1 <your_os> tar.gz o For Informatica 9.0.1: AsterConnector9.0.0_INFA9.0.0 <your_os> tar.gz o For Informatica 9.1.0: AsterConnector9.1.0_INFA9.1.0 <your_os> tar.gz o For Informatica 9.5.0: AsterConnector9.5.0_INFA9.5.0 <your_os> tar.gz 6. Extract the files and navigate down to the directory with the installer file installer.sh, which will be something like the following, substituting your OS and Informatica version:../stage/clients-infa_connector-<your_os>/<your_infa_version>/ 7. Run the following command to begin installation: $./installer.sh 8. Read the welcome message and type y to proceed, or n to abort the installation 9. Read the instructions to view the license agreement and hit Enter. 10. The license file will display. Press the down arrow key to scroll. 11. The License Agreement screen will show the license and maintenance agreement information. Read it carefully, and then press q to quit the agreement. 12. If you agree with license information type y to continue. Otherwise, type n to abort the installation. 13. The next screen will ask for confirmation. Type y to proceed or n to abort the installation. 14. The next screen will ask for the installation path. Accept the default or provide your own path. 15. Enter the path and hit Enter. Note: The installer will search for the '.../server/bin' and '../server/infa_shared' directories at the given installation path. Upon failure to locate these directories, the installer will abort without updating the system. 16. After successful installation, the Installation Complete screen will appear. Install Aster-Informatica Connector Client (Windows Only) 1. Find the installer package file for the correct version of Informatica. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 7

8 o For Informatica 8.6.1: AsterConnector8.6.1_INFA8.6.1 <your_os> zip o For Informatica 9.0.1: AsterConnector9.0.0_INFA9.0.0 <your_os> zip o For Informatica 9.1.0: AsterConnector9.1.0_INFA9.1.0 <your_os> zip o For Informatica 9.5.0: AsterConnector9.5.0_INFA9.5.0 <your_os> zip 2. Unzip the Informatica installer file. The.msi installer files can be found in the extracted directory:..\stage\clients-infa_connector-<your_os>\ 3. Double click on the Informatica installer file for your platform to begin the connector installation. If prompted, click Run to verify that you want to run the installer. 4. Read the Welcome message and click on Next to proceed. 5. The License Agreement screen will show the license and maintenance agreement information. Read it and click the I Agree radio button. Click Next. 6. The Select Installation Folder screen will display the default Informatica installation path. It is recommended that you use this path. If you think this is not the correct path, browse to the desired directory. 7. The Confirm Installation screen will ask for confirmation. Click on Install. 8. The Installing Informatica Connector Server dialog box will appear. Wait until it completes. 9. After successful installation, the Installation Complete screen will appear. 10. Click the Close button to complete the installation. 17. Navigate to the directory where the installer is located. 18. Double click on the msi to begin the installation 19. Read the Welcome Message and click on <Next> to proceed or <Cancel> to abort the installation. Next, install the Aster ODBC driver 1. Double click on nclusterodbcinstaller_x64.msi to begin the driver installation. Note that the ODBC driver is available for both 32-bit and 64-bit architectures. Choose the installer that matches your system architecture. This example shows installation on a 64- bit machine. 2. The Welcome dialog box will open. 3. Read the Welcome Message and click on Next to proceed, or Cancel to abort the installation 4. On the Select Installation Folder screen, select the path where you would like to install the ODBC driver. In addition, specify whether Everyone or Just me should have access to the driver. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 8

9 5. Click Next to confirm that you are ready to install the driver. 6. Click Close to complete the installation. Register the Aster Database Plug-in How to register a plug-in Make sure that Informatica Client and Aster Database Connector are successfully installed on the Client system. After successful installation of Informatica, the user will get access to the Informatica Administration Console page. The sample URL of Informatica Admin Console is: Use the following steps to register the Aster Database plug-in: 1. Navigate to Administration Console page. 2. Connect to the desired Repository Service. 3. Click on the Properties tab. 4. Click the Edit button of General Properties. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 9

10 5. Change the operating mode to be exclusive. 6. Click on Plug-Ins tab. 7. Browse to and Select Aster ncluster Plugin.xml The path of this xml file is generally where the Informatica Client is installed. For example: C:\Informatica\9.0.1\clients\PowerCenterClient\client\Aster ncluster\ 8. Click on Register. 9. After registration, change the operating mode to normal Note: Beginning with Informatica 9.0.1, the layout of the Plug-Ins tab has changed slightly. If you have trouble locating where to register the Aster plug-in, refer to the Informatica documentation. Image: Informatica Plug-In Tab Upgrading the Aster-Informatica Connector To upgrade your Aster-Informatica Connector, uninstall the old version and install the new version. Add and Use Aster Database tables for Informatica Sources and Targets After you ve installed the Aster-Informatica Connector software, there are still other steps necessary before you can use and run Informatica processes that use this product. Read this chapter to learn how to use Informatica Source and Targets for Aster Database. Refer to the appropriate sections for information about setting up and using a source and target. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 10

11 Import a Table from Aster Database into Informatica Source Import Aster Table into Informatica Source Make sure that Informatica and Aster-Informatica Connector are successfully installed on the specified system and the plug-in is registered in Informatica Administrator Console. Also, the Aster Database ODBC driver should be installed on the Informatica Client. Steps to follow: 1. Navigate to the Informatica Designer. 2. Connect to the desired Repository. 3. Click on the Source Analyzer icon. 4. Navigate to menu Sources Import from Aster ncluster 5. Choose ncluster ODBC data source. 6. Enter valid Username. 7. Enter valid Password. 8. Click on Connect button. 9. Expand tables by clicking + sign 10. Select tables which need to be imported in source 11. Click the OK button after selection. 12. Check imported tables under Repository folder Sources Aster Data. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 11

12 Import a Table from Aster Database into Informatica Target Import Aster Table into Informatica Target Make sure that Informatica and Aster Informatica Connector are successfully installed on specified system and plug-in is registered in Informatica admin Console. Also ncluster ODBC driver must be installed on the Informatica Client system. Steps to follow: 1. Navigate to Informatica Designer. 2. Connect to the desired Repository. 3. Click the Target Designer icon. 4. Navigate to the menu Targets Import from Aster ncluster. 5. Choose ncluster ODBC as the data source. 6. Enter a valid Username. 7. Enter a valid Password. 8. Click the Connect button. 9. Expand the tables by clicking the + sign. 10. Select the tables to be imported into the target. 11. Click the OK button after selecting the tables. 12. Check the imported tables under Repository folder Targets. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 12

13 Edit Schema and Table Name Beginning with Aster Informatica release 5.11, you can view and edit the schema name for the Source and Target tables in the Informatica Edit Tables window: Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 13

14 Using Informatica to create Aster connections in Workflow Manager The next section will explain about different connection creations within Informatica for Aster Database. There are three types of connections which supports Aster Database 1. Relational Connection 2. Application Connection (Export) 3. Loader Connection Check the details of each connection in the sections below: Relational Connection How to create a Make sure that Informatica and Aster below Informatica Connector Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 14

15 Relational Connection in Informatica are successfully installed on the specified system and the plug-in is registered in Informatica Administrator Console. Steps to follow: 1. Navigate to the Informatica Workflow Manager. 2. Connect to the desired Repository. 3. Click on Connections > Relational. 4. Select Type as Aster Database. 5. Click on the New button. 6. Enter the Name of a Relational Connection. 7. Enter a valid Username. 8. Enter a valid Password. 9. Enter a valid connect string. 10. Enter values in attributes, as required. 11. Click the OK button. 12. The relational connection has been created and is ready to use. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 15

16 Application Connection (Export) How to create an Export Connection in Informatica Make sure that Informatica and Aster-Informatica Connector are successfully installed on the specified system and the plug-in is registered in the Informatica Administrator Console. Steps to follow: 1. Navigate to Informatica Workflow Manager. 2. Connect to the desired Repository. 3. Click on connections Application. 4. Select Type as Aster ncluster Export. 5. Click on the New button. 6. Enter the Name of an Application (Export) Connection. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 16

17 Loader Connection 7. Enter a valid Username. 8. Enter a valid Password. 9. Enter values in attributes, as required. 10. Click the OK button. 11. The application (export) connection has been created and is ready to use. How to create a Loader Connection in Informatica Make sure that Informatica and the Aster-Informatica Connector are successfully installed on the specified system and the plug-in is registered in the Informatica Administrator Console. Steps to follow: 1. Navigate to the Informatica Workflow Manager. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 17

18 2. Connect to the desired Repository. 3. Click on Connections > Loader. 4. Select Type as Aster ncluster Loader 5. Click the New button. 6. Enter the Name of the Loader Connection. 7. Enter a valid Username. 8. Enter a valid Password. 9. Enter values in attributes, as required. 10. Click the OK button. 11. The Loader Connection has been created and is ready to use. Note: The Loader Connection works differently on Informatica Server instances on Solaris and Windows. This is due to a difference in the way a connection is implemented on the two platforms. In turn, this has implications on the amount of local storage, which needs to be allocated to the load process associated with an Informatica session object. System administrators should keep this difference in mind when allocating local storage to an Informatica Server. The Solaris implementation of Loader makes use of named pipes, an operating system level feature, to do target loading. Informatica server uses named pipes, underlying the session and associated loader connection, to stream transformed data from the server directly into the Aster Database target during the load process. The Windows implementation, on the other hand, uses the ncluster_loader utility to do target loading. In this implementation, Informatica server reads data from the source, performs transformations, and persists rows of data on local storage before transporting it to the Aster Database target. The commit size parameter setting of the Informatica session object determines how many rows of data are persisted. While running an Informatica session, after reaching this threshold, the Informatica server invokes the ncluster_loader utility. The Loader utility moves the data from the Informatica server onto the target Aster Database instance. After successful completion of Loader, the server begins to process the next batch of data until all the source records are processed. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 18

19 Troubleshooting Aster-Informatica Connections If you can t get something to work properly within the Aster-Informatica Connector, this section may help you correct the problem. This section deals mostly with issues within Aster- Informatica Connector for Informatica itself. At times, issues may actually be caused by your Informatica applications. Be sure to consult the Informatica PowerCenter documentation as well. Edit a Relational Connection Change Relational Connection Settings These steps show how to change the relational connection settings. You must have already created a Relational Connection for Aster Database in order to use them. Steps for creating the connection are provided earlier in the document. Steps to follow: 1. Navigate to the Informatica Workflow Manager. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 19

20 2. Connect to the Repository. 3. Navigate to the session. 4. Right Click Edit session. 5. Open the Mappings tab. 6. Click on the table name below Sources in the left side panel. 7. Select Aster ncluster Reader. 8. Select Connection Type as Relational. 9. Select the Aster ncluster Relational Connection which you have already created. 10. This will create a Relational source connection. Now we will create a Target Relational Connection: 11. Click on the table name below the Target in the left side panel. 12. Select Aster ncluster Reader. 13. Select Connection Type as Relational. 14. Select the Aster ncluster Relational Connection which you have already created. 15. This will create a Relational target connection. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 20

21 Edit an Application (Export) Connection How to Change an Application (Export) Connection These steps show how to change the Application (Export) Connection settings. You must have already created an Application (Export) Connection for Aster Database in order to use them. Steps for creating the Application (Export) Connection are provided earlier in the document. Steps to follow: 1. Navigate to the Informatica Workflow Manager. 2. Connect to the repository. 3. Navigate to the session. 4. Right Click Edit session. 5. Open the Mappings tab. 6. Click on the table name below Sources in the left side panel. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 21

22 7. Select Aster ncluster File Reader. 8. Select Connection Type as Application. 9. Select the Aster ncluster Application Connection which you have already created. 10. Enter the Input File Directory Name. This directory name path should be on the server where Informatica Server is installed. Make sure you supply the correct path for both Windows as well as Unix systems. 11. Enter the Input File Name. Make sure to enter this value. This file will get automatically deleted after successful execution of workflow and upon failure as well. 12. Click on the OK button. 13. Save the session. This will create an Export connection. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 22

23 Edit a Loader Connection How to Change a Loader Connection These steps show how to change the Loader Connection settings. You must have already created a Loader Connection for Aster Database in order to use them. Steps for creating the Loader Connection are provided earlier in the document. Steps to follow: 1. Navigate to the Informatica Workflow Manager. 2. Connect to the repository. 3. Navigate to the session. 4. Right Click Edit session. 5. Open the Mappings tab. 6. Click on the table name below Targets in the left side panel. 7. Select Aster ncluster File Writer. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 23

24 8. Select Connection Type as Loader. 9. Select the Aster ncluster Loader Connection which you have already created. 10. Enter the Output File Directory Name. This directory name path should be on the server where Informatica Server is installed. Make sure you supply the correct path for both Windows as well as Unix systems. 11. Enter the Output File Name. Make sure to enter this value. This file will get automatically deleted after successful execution of workflow and upon failure as well. 12. Click the OK button. 13. Save the session. This will create a Loader connection. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 24

25 SQ Property Page How to set values in SQ properties page These steps will guide user for setting values of the SQ property page. Steps to follow: 1. Navigate to the Informatica Mapping Designer. 2. Connect to the repository. 3. Navigate to the required mapping which has Aster ncluster sources. 4. Right Click Edit Application source qualifier. 5. Navigate to the SQ Properties tab. As per mapping logic, enter the conditions in SQ properties Here you may write a join condition, filter condition, select distinct values and select number of sorted ports. 7. Click the OK button. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 25

26 8. Save the mapping. Override a Query at the Session Level How to override a query You can create a custom query at the mapping level. But if you want to override those queries, you can do that by using this feature. Steps to follow: 1. Navigate to the Informatica Workflow Manager. 2. Connect to the repository. 3. Navigate to the session. 4. Right Click Edit session. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 26

27 5. Open the Mappings tab. 6. Click on the table name below Sources in the left side panel. 7. Select Aster ncluster Reader. 8. Select Connection Type as Relational. 9. Select the Aster ncluster Relational Connection which you have created. 10. Enter the conditions in the session level properties. 11. You may write join conditions, filter conditions, select distinct values and/or select the number of sorted ports. Note: The query entered here will override the query on the SQ Properties tab. 12. Click OK. 13. Save the session. Changing the default path for source or target files By default, the Aster-Informatica connector expects source and target files to be in a particular directory. Specifically, a source file is expected to be placed in "$PMSourceFileDir\" and a target file is expected to be placed in "$PMTargetFileDir\". In order to load files from/to a different directory: Go to the Task Developer tool in the PowerCenter Workflow Manager Right click on the task in question and select "Edit". Select the "Mapping" Tab and, o For a source file, change the value of the "Source File Directory" property of the File Reader. o For a target file, change the value of the "Output File Directory" property of the File Writer. Best Practices Setting Informatica Parameters for Performance For optimal performance, set the following Informatica parameters to be as large as possible: Commit Interval DTM Buffer Size Buffer Block Size Note that when the Commit Interval is set to a value larger than the total row count of the table, the setting will not affect the performance for that table. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 27

28 Notes on Handling Certain Datatypes Numeric Data By default, the Aster Informatica Connector treats numeric datatypes as doubles. As a result, any numeric value with a precision exceeding 15 digits will not be properly transferred. In order to load or export numeric values with precisions greater than 15 digits, go to the Task Developer tool in the PowerCenter Workflow Manager, right click on the task in question, and select Edit. Then select the Properties tab and make sure the property Enable High Precision is checked. Numeric/Decimal Datatype Precision The maximum supported precision for numeric/decimal data types in Informatica is 28 while it is unlimited in Aster. Hence, when exporting from or importing to an Aster field with precision exceeding 28, the user may get a "Requested conversion is not supported" error. In order to resolve this issue, the user will need to use the Source Analyzer or Target Designer tools of PowerCenter Designer to specify a precision not larger than 28 for a field that had precision exceeding 28 in Aster. Notice that any number with precision exceeding 28 will lose its precision during the transfer. UTF8 Data By default, Informatica reads and transfers CSV files as ASCII data. To load UTF-8 data, you must make sure both the source and the target are set with the correct code page. Do this by making the following settings in Informatica. For Aster Database, select UTF-8 (instead of the default MS Windows Latin1) in the Connection setting of the Relational or Application:loader/exporter menu in Workflow Manager. For a CSV file source or target definition, follow these steps: 1. In the Source Analyzer, double-click the title bar of the source definition (i.e. doubleclick the title bar of the table containing the field list). 2. To add options to a target definition, go to the Target Designer and double-click the title bar of the target definition. The Edit Tables dialog box appears. 3. In the Table Tab, click the Advanced button to edit the flat file properties. 4. Select UTF8 in the code page property. 5. Uncheck both of the following: a. Treat Multiple Delimiters as One; and b. Treat Consecutive Delimiters as One To make sure your changes to the code page have taken effect, check the session log in the Workflow Monitor. You should see something similar to this: :13:32 : INFO : (3384 READER_1_1_1) : (IS Intg_infa9) : node01_infa9_ecowin2008 : FR_3118 : source [SQ_utf81] code page: [UTF-8 encoding of Unicode] Time and Timestamp Data In Aster Database, for the time datatype, the maximum precision is 6 digits of sub second precision (i.e. the precision extends to microseconds). For data transferred through the Aster- Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 28

29 Informatica Connector, the maximum precision is reduced to 3 digits of sub second precision (milliseconds). For example, an Aster-stored value 12:29: becomes '12:29:59.001' when transferred via the Aster-Informatica Connector. The loss of precision is a result of the way time is represented in Informatica and a result of the JDBC datatype used in the Connector. On one hand, in Informatica, the datatype time_without_time_zone is mapped to ODBC SQL_TIME, which has a maximum of 3 digits of sub second precision. On the other hand, the Aster-Informatica Connector uses JDBC's Time datatype to export the Time value. The JDBC Time datatype also has a maximum of 3 digits of sub second precision. Thus the Connector truncates values with greater than millisecond precision. Workaround In order to export or import microsecond time/timestamp values using the Aster-Informatica Connector, please use the following workaround: 1. In the Source Analyzer of PowerCenter Designer: a. Double click on the table to get to Edit Tables. b. Click on the Columns tab c. For the time field, change its type to varchar and its precision to 15. For timestamp field change to varchar and set its precision to 26. d. Save the repository. 2. In the Target Designer of PowerCenter Designer, do the same as step 1 for the Target field. Limit on Transferring Time Values in the Distant Past or Future Due to the limitation of Informatica SDK, time/timestamp values that are either way in the past or the future get transferred wrongly (e.g. values like ' :29: ' gets converted to ' :29: ', :00:00.000==> :00:00, :00:00.000==> :00:00). We have identified the cause for this as Infa SDK's bug in handling getlong and setlong functions based on the following note in Informatica Corporation PowerCenter Version SP5 Release Notes March Workaround CR 92842: Cannot use getlong or setlong APIs for values higher than maximum integer and smaller than maximum long value in a Java Custom transformation: The getlong and setlong APIs in the InputBuffer interface for a Java Custom transformation do not return the correct values. The values are not correct if the values returned by the APIs are larger than the maximum Java integer value but smaller than the maximum Java long value. In order to export/import time/timestamp values in the distant past or future using Aster connector, please use the following workaround: 1. In the Source Analyzer of PowerCenter Designer: a. Double click on the table to get to Edit Tables. b. Click on the Columns tab c. For the time field, change its type to varchar and its precision to 15. For timestamp field change to varchar and set its precision to 26. d. Save the repository. 2. In target Designer of PowerCenter Designer, do the same as step 1 for the target field. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 29

30 Exporting NaN values from Aster decimal/numeric data types when high precision mode of Informatica is enabled The Informatica connector uses a double to store Aster decimal values without high precision mode and a decimal (treated as BigDecimal in Java API) in high precision mode. Only double allows NaN values while INFA decimals (like BigDecimal in Java) do not. But Aster allows NaN values for both its double and decimal types. When high precision is disabled, NaN is exported correctly since INFA uses double to store it. But when high precision is enabled, there is no equivalent representation for NaN in Java's BigDecimal as well as INFA's decimal. Since there is no correct way to export NaN values when High Precision is enabled and since we did not want to silently replace them with null or any other value, the Informatica connector gives a data conversion error and allows the user to provide a replacement value for NaN values when Aster is a source and High Precision has to be used. The user can provide "null" or any other valid number as a replacement. The default behavior is throwing an exception when NaN values are encountered. The exception looks like the following: [ERROR] Reading data failed [Cannot convert NaN Values.] for Aster_nCluster type [NUMERIC]. Then the user can go to PowerCenter Workflow Manager->Task Developer->Edit Task- >Mapping->Sources and give the replacement value (e.g. the value 'null' without the quotes or 0) in the property "NaN Replacement for High Precision"). Export NaN/+-Infinity value of double/real/timestamp datatype from Aster to MS SQL Server Problem: Export double/real/timestamp data from Aster to SQLServer, if double/real data have the special values infinity/-infinity/nan or timestamp data has special values infinity/- infinity, the migration result is different between INFA server on Windows and LINUX: If INFA server (9.0.1/9.1.0) is installed in Windows, the data except above special values can be exported to SQLServer successfully. If INFA server(9.0.1/9.1.0) is installed in Linux, all data including common values can NOT be exported to SQLServer, although in INFA monitor the status will be shown as Succeed. Analysis: The values NaN, +/- infinity are considered bad values for an SQL server float field for both the windows and Red Hat sessions. And, in Windows case, Informatica uses Microsoft OLE DB Provide for SQL Server to load the data to SQL Server and it succeeds to load the rows with valid values excluding the rows with the bad values. But for the Red Hat case, Informatica uses a legacy SQL Server ODBC driver which employs a different loading mechanism called Tabular Data Stream (TDS) protocol which appears to behave differently in the presence of invalid data values. In any case, this issue has to do with the differing way SQL server handles data loading from Windows and Linux sources in the presence of invalid values and we cannot solve it. Workaround: The user must remove the rows with NaN, +/- INF values from the source table and make sure the data loads properly. Aster-Informatica Connector AC5.11 for Aster Database 5.10 Page 30