Creating DTS Packages

Transcription

1 Tech Note 212 Using DTS to Transfer Historical Data from InSQL to Other Systems All Tech Notes and KBCD documents and software are provided "as is" without warranty of any kind. See the Terms of Use for more information. Topic#: Created: April 25, 2001 Microsoft SQL Server 7.0 introduces several powerful features; one of the most useful is Data Transformation Services (DTS). Typically, InSQL developers often need to move data from the history tables to different storage systems (Data Warehousing servers, ERP systems, etc.) that happen to be other than the MS SQL Server machines. This document provides a demonstration on how to retrieve values from InSQL AnalogHistory table and transfer them to a remote Oracle 8 server periodically. Creating DTS Packages In order to perform such a transfer, the main step is to create a DTS Package within the MSSQL Server. The following steps describe the procedure: 1. Open the MSSQL Server Enterprise Manager and navigate to the Runtime database. 2. Expand the "Data Transformation Services" folder and right- click on the "Local Packages" item of the popup menu (Figure 1). The DTS Package Editor appears, ready to create a new chart for the transformation. The key elements for the transformation are the two servers that will perform the operation. The MSSQL OLE DB Provider will be the source connection, while the destination will be the Microsoft ODBC Driver for Oracle. 1/7

2 FIGURE 1: THE LOCAL PACKAGES IN THE DATA TRANSFORMATION SERVICES FOLDER 3. Locate the connection objects that have to be dragged into the Editor (Figures 2 and 3). As soon as you drag the MSSQL connection, a dialog box appears. The following information has to be entered. New connection: "Our InSQL Server" Data Source: "MS OLE DB Provider for SQL Server" Server: "[Machine Name]" Use SQL authentication with the "sa" account Use SQL authentication with the "sa" account Database: "Runtime" The destination will be the Oracle server with the following settings: New connection: "Our Remote Oracle" Data Source: "MS ODBC Driver for Oracle" The server settings are the ones defined in your Net8 configuration 2/7

3 FIGURE 2: THE MS ODBC DRIVER FOR ORACLE Note: Ask your DB Administrator for details on how to set the connection. FIGURE 3: THE FINAL DIAGRAM WITH THE ORACLE SETTING PROPERTIES Moving Data from the Source to the Destination 3/7

4 The core functionality of the DTS package will be to move a selected range of data from the source to the destination. The following steps describe how to add this feature. 1. Select both server icons by keeping the key pressed, clicking on each server. 2. Then from the menu "Workflow," choose the function "Add Transform." An arrow connecting the two icons will appear on your diagram, indicating that a transformation is going to be performed by the package. 3. Right- click on the arrow and select the Properties item. 4. Enter the information as shown in Figure 4. FIGURE 4: SOURCE INFORMATION IN THE DATA TRANSFORMATION PROPERTIES DIALOG BOX The SQL statement needs to be entered manually, since InSQL does not follow the traditional relational logic. The information filled in will define the set of values to be transferred to the destination. The MS OLE DB Provider is used in order to write the statement following the OLE DB syntax. For the history tables, the predefined views (i.e., v_analoghistory) are used. For the wide tables, the OPENQUERY statement has to be used (see also Tech Note 193). 5. Press the Parse Query button to validate your statement before proceeding. 6. Go to the Destination tab, where you will define the target table that will contain the result set of your query. 4/7

5 You can either choose to create a new table or use an existing one. If you decide to create a new table (recommended), the wizard will format the fields accordingly. Figure 5 shows the sample table creation settings. FIGURE 5: THE TABLE CREATION SETTINGS 7. To generate the layouts of the Source and the Destination Tables, go to the Transformation tab. Most of the time you will be required to link the fields manually. 8. To manually link the fields, click on the Source field and on the Destination field to highlight them, then click on the New button. The link will appear between the fields (Figure 6). Usually, there is no need to access the Advanced tab. 5/7

6 FIGURE 6: THE LINK BETWEEN THE SOURCE AND DESTINATION TABLES Note: Refer to the SQL Server documentation for the advanced features of DTS. 9. Click the OK button. Your diagram will be completed. Testing and Storing the DTS Package The DTS package needs to be tested to verify its functionality and stored after the testing is completed. 1. Right-click on a blank area of your DTS Package diagram. 2. Select the "Execute" function. The operation will be successfully executed if there are no mistakes made during the transfer process. 3. Store the package after it has been tested. The best choice is to save it as an SQL Server package through the "File" and "Save As" menu commands. This will allow you to schedule a periodical execution of the package itself through the SQL Server Agent. 4. Save the package within the "Local Packages" of your database. 5. Right- click on the package name and select "Schedule Package" to activate the Job Settings dialog. You might be prompted to start your SQL Server Agent in order to perform the scheduled task, but you can do it later at the second prompt. 6/7

7 Figure 7 shows a sample setting for the package. In this example, the data transfer is planned for execution once a week. Once the SQL Server Agent is started, the system will perform the procedure automatically. C. Pipero FIGURE 7: A SAMPLE SETTING FOR THE PACKAGE The Tech Note is published occasionally by Wonderware Technical Support. Publisher: Wonderware C orporation, 100 Technology Drive, Irvine C A There is also technical information on our software products at Wonderware Technical Support, our WonderFax fax-on-demand system at (949) , and the C omprehensive Support Knowledge Base. For technical support questions, send an to support@wonderware.com. back to top 2013 Wonderware C orporation. All rights reserved. Terms of Use. 7/7