AGENCY ETL User Guide v4.7 May 7, 2013

Transcription

1 AGENCY ETL User Guide v4.7 May 7, 2013

2 TABLE OF CONTENTS Introduction... 3 Agency ETL Processing... 4 Request Name... 4 Navigation Keys... 5 Request Data... 6 Request Settings... 8 Request Options Parsed Fields Download/Purge Internet Transfer Action Item Icons Page 2

3 Introduction Agency ETL is the data management tool you ll use to convert data from your back-office system into a format that Desktop Reporting can recognize and use. The menu options in Agency ETL provide the user a high level of flexibility in customizing the way data is imported into Desktop Reporting. The following topics will provide you with the necessary understanding needed to properly use the Agency ETL program: 1. Installing and Accessing Agency ETL Procedures for installing and accessing Agency ETL. 2. Agency ETL Processing - Detailed instructions on how to successfully use Agency ETL to import and/or transfer data for local or data consolidation services provided by TRX. To access, select Agency ETL Import Icon (import32.exe) The Agency ETL Import screen contains five main tabs: Request Data, Request Options, Parsed Fields, Download/Purge, and Internet Transfer. Within each tab there are various options that can be selected. An explanation of the options within each tab and how to use them follows. Requirements Minimum Requirements 1Ghz+ Processor 1GB of RAM 1GB of free disk space Internet Connection Recommended Requirements 2-3GHz Dual Core Processor 2GB of RAM 5GB of free disk space 1Mbit LAN Internet Connection Supported Operating Systems Windows Server 2003/2008 Windows XP/7 The disk space used depends on how much data is downloaded in a month. The Agency ETL connects to the back-office system on request to download the data elements required for a given date range then it disconnects. It is downloaded onto the server/workstation that Agency ETL is installed on and put into a zip file. That zip file is transferred to TRX via HTTPS (SSL Encryption) using port 443. The process can be automated through Windows Scheduled tasks at any time of the day, but the computer will need to be on during the scheduled time for it to run. Page 3

4 Agency ETL Processing Request Name The Request Name (default Sample) is provided to allow the user a means to save the way Agency ETL is configured. Multiple configuration files (settings) can be maintained by assigning a different Request Name to each. Page 4

5 Navigation Keys A set of navigation keys are located to the right of the Request Name drop down list box First Request - Moves you to the first Request Name you have saved. 2. Previous Request - Moves you to the Request Name prior to the one displayed. 3. Next Request - Moves you to the next saved Request Name. 4. Last Request - Moves you to the last Request Name in the saved list. 5. Insert Request - Allows you to create a new Request Name. A Pop-up window will appear for you to enter the name of your new request. 6. Delete Request - Deletes the Request Name listed in the Request Name window and the associated configuration. 7. Edit Request - Allows you to edit the request currently displayed. 8. Post Request - Saves the configuration changes you made to the Request Name displayed. 9. Copy Request - Copies the displayed Request Name and associated configuration. Easiest way to create a new Request configuration that differs only slightly from an already existing one. Page 5

6 Request Data Request Options Any combination of request options can be selected as appropriate. Dictionary Select the Dictionary option to download the current dictionary from the Desktop Reporting database. The dictionary is called from the Dictionary icon at the bottom of each page. Purge Select the Purge option to delete all or selected data from the Desktop Reporting tables. Data from the tables you selected under Import Options, for the Date Range and Iata Number you specify, will be deleted. Additional criteria can be specified by utilizing a purge profile (Date range can be specified under Request Settings.). Download Select the Download option if you are going to be downloading data directly from your backoffice system. This option only applies to back-office systems that allow a direct connection to data. Note: If this option is not available, you must first extract data from your back-office system into Agency ETL s Download directory (or the Import Dir folder see below). Import Select the Import option to import data into Desktop Reporting. Agency ETL will import data located in the Agency ETL Download directory or the Import Dir folder see below. Calc O&D This option recalculates origin and destination mileages (Normally left blank). This option is typically processed by itself and only applicable to the previously downloaded and imported data that resides in the local TravelTrax database. Run it after updating the local city table in the database to recalculate the extended origin and destination columns in the segment table. Archive Must be enabled to use Internet Transfer option for data consolidation services. Internet Transfer When configured and selected, the data files downloaded from your back office system are automatically forwarded to TRX data consolidation facilites via secure https post. Archive must be selected for this option to be enabled. Log Errors When checked, Agency ETL s error file is stored in the Priv directory and not displayed once the program has finished processing. Page 6

7 Request Data continued Import Options Select which data/table categories to import and/or purge along with the appropriate Desktop Reporting database (4.X vs. 5.X). Invoice Data, Transeg Data, etc. Branch Combines Customer ID and Branch # to create unique CustID. (This option is only applicable for the ADS back office system.) Fast SQL Load If applicable, improves import performance using SQL Server s Bulk Copy command (applicable to import process only). Clean Up Files Check this box if you want to empty the download working tables. This makes the download process more efficient. Note: This option does not empty the database tables. Check All Places check mark next to each Import Option category. UnCheck Removes all check marks. Page 7

8 Request Settings This will define import parameters for the specified Request Name. System Use the drop down arrow to select what type of back-office system data to import. Different Request Names may utilize different back office import systems. Note: The appropriate back-office system DLL must first be installed. TRX provides the installation software for all DLLs. IATA Number This is where you put the number that identifies your branch or agency or import source. It prevents conflicts if multiple data sources use some of the same client numbers. It can be any alpha-numeric value of up to 10 characters. Data Consolidation customers will receive a specific Iata Number from TRX Data Services. Min Rule (D/I) Number of minutes allocated between connecting flights to be considered a connection. (Default is 240 minutes for domestic and 480 minutes for International) Source Country Country of origin for imported data. Used to derive the appropriate Domestic/International indicator for the imported data. Destination Country Destination country, used to determine the converted base currency code. Enter DE to store all data in Euros (US for US dollars, etc.). Import Dir Browse and select the directory where the import files are located (Not applicable when using Download). DSN Click on the drop down and choose the ODBC data source of the destination database (Desktop Reporting - Not applicable when processing for Data Consolidation Services only). User Name A valid user name utilized to log into the destination database (Desktop Reporting - Not applicable when processing for Data Consolidation Services only). Password A valid password for the user name (Desktop Reporting - Not applicable when processing for Data Consolidation Services only). Page 8

9 Request Settings continued DB Owner This item is specific to the Desktop Reporting database installed and configured. Examples: Desktop Reporting SQL Server = DBA SQL Server = DBO Other database = (Specific for other databases) Date Del Date Delimiter. Specific for the Desktop Reporting database installed. Examples: Desktop Reporting SQL Server = left blank Other database = (Specific for other databases) Field Del Field Delimiter. Specific for the Desktop Reporting database installed. Examples: SQL Server = Other database = (Specific for other databases) Begin Date Specifies the beginning date range for the data you wish to Download and/or Purge. (See note below.) Use calendar button to right of date window to change Start Date. End Date Specifies the ending date range for the data you wish to Download and/or Purge. (See note below.) Use calendar button to right of date window to change Start Date. Note: Dates are not applicable during the import process. Import always imports all data in hand-off files. Ini File Settings This section permits users to enter specific parameters for a request name. These parameters, if required, are provided by TRX Data Services. Request Profiles Click on the drop down and choose the appropriate profile if applicable (See Download/Purge Tab) Purge Use Purge to establish unique criteria when deleting data from your local database. Download Use Download to establish unique criteria when downloading data. Page 9

10 Request Options This tab provides the ability to designate how daily car rates are derived, how the Advance Purchase Group data is calculated and Archive Options. Car Rate Calculations Use this section to convert your back-office car rate information into a daily rate that Desktop Reporting will use. The defaults are setup to convert car rate information to daily rates. Rate Type Select the Rate Types that apply to your existing data (e.g. DAILY, DAY, DY and/or MNTHLY, MY, etc.). This is information forwarded to the back office system by the computer reservation system (GDS/CRS).) Calc Type Right-click on Calc Type opposite your chosen Rate Type and select a Calc Type to apply to your Rate Type. Apply Double click in the Apply box to place a check mark for those selections that apply. For example: if you have an old Weekly category, you need to specify if you want that to be changed or not. If you select Daily as the conversion type, the Total Car cost will be: daily rate (*) number of cars (*) number of days. If you select Weekly as the conversion type, then if the number of days is >7, the daily rate will be divided by 7 and the Total Car cost will be: daily rate (*) number of days (*) number of cars. If the number of days is <=7, then the Total Car Cost will be the daily rate divided by the number of cars. The daily rate will be the daily rate divided by the number of days. Page 10

11 Days Advance Options Use Booking Date for Days Advance Select this option if you use Booking Date to determine your Days Advance Booking rather than the issue date. Use Issue Date if Blank Booking Date Use this in conjunction with Booking Date option only if Booking Date is used and may not be available. AdvPurchGrp Available advance purchase group categories. Can be user defined. LowValue Low range of advance purchase group. Coincides with the low value in the advance purchase group. HighValue High range of advance purchase group. Coincides with the high value in the advance purchase group. Archive Options This section is only enabled when Archive is checked on the main request tab. Designate the local folder where you would like to store file copies of the data forwarded to TRX for data consolidation services. Page 11

12 Parsed Fields This Tab provides a means to parse data from an existing data field, provided by your back-office system, and place it in a reserved Desktop Reporting field An example of this can be explained with the data entry Low Fare. Normally, this value resides in a field reserved for miscellaneous information like a UDID (User Defined Interface Data) or Sort field. Desktop Reporting has a Low Fare field within its data dictionary that needs to be filled with the data from the UDID field in order to be used on a report that uses Low Fare. This is accomplished by properly filling out this Tab. Destination Field The field within Desktop Reporting where the parsed data will be sent. Multiple fields may be selected. However, each field may only have one source field. Source Field The field that represents the source of the data to be parsed. Start Pos Starting position for a sub-stringed data field. End Pos Ending position for a sub-stringed data field. Length Specify the length of the data field. Start Delimiter Unique character to specify starting position of sub-stringed data. Occurrence The first, second, etc. incident of the Start Delimiter. End Delimiter Unique character to specify end of sub-stringed data field. Occurrence The first, second, etc. incident of the End Delimiter. Date Format The format you wish to use for date fields you wish to parse out to Desktop Reporting. Implied Decimal By checking this box the value you currently have in the Source Field will be divided by 100. (Select if your specified value data field requires it.) Clear Values Removes all entries from the Source Field area. Trash Can Drag items here from the Destination Field that you want to delete. Page 12

13 Parsed Field Procedure Example: (Using Low Fare example) 1. Select Dictionary at the bottom of the Agency ETL Import Manager window. Find FareCompare1 by searching either by Field # or Field Name. 2. Left-click on FareCompare1 and hold down mouse button. Drag mouse pointer to Destination Field window and release mouse button. 3. Search and find data dictionary field that contains Low Fare data. If UD01 contains Low Fare information in its data field, you would choose UD01008 which is the data field for UD Drag selected field to Source Field (Field #) window. 5. This completes the process for Low Fare, if UD01008 only contains low fare data (otherwise continue below). Source Data Contains Multiple Values (Additional Procedures): 1. If UD01008 contains more than Low Fare data, the low fare part must be sub-stringed out. 2. Use Start Pos and End Pos if the low fare part of the field always begins and ends at the same alphanumeric position (e.g. 4 positions to the left to start and 8 positions to end). 3. If this is not practical, use Start and End Delimiters. With these you must choose a unique character that always comes before the first character and after the last character of Low Fare. In addition, you must specify which occurrence of the special character is at the beginning and the end (e.g. 1, 2, 3,.). Note: End Delimiter is not required if you want all data occurring after the Start Delimiter. Page 13

14 Download/Purge These options are used when performing a download directly from your back-office or purging data previously imported into the Desktop Reporting database. Multiple profiles may be created that limit the data downloaded from the back office system or purged from the Desktop Reporting database. Download Name Select the download or purge configuration you want (by name) or create a new one by using the Navigation Keys (click the plus (+) icon. System Path Specify the path/directory of your back-office system. You can use the folder to the right of the system path window to search for the required path. Not used when connecting through ODBC. Login ID If a Login ID is required to access your back office system, you can enter it here. Password If a password is required, you can enter it here. Criteria Edits - Within the indicated fields you can specify specific selection criteria by area to be included and/or excluded during the download or purge process. (Examples are provided in Figure 1-5 above.) [CLIENT], [BRANCH] and [IATA] are reserved variables and applicable to all systems. Otherwise, a valid SQL statement must be entered here beginning with the word and. Page 14

15 Internet Transfer This tab permits users to utilize the Internet or to transfer files downloaded via Agency ETL Download. Web Transfer Options This option is only enabled if Archive and Internet Transfer are checked on the main request tab. The information stored in the URL, Username and Password edit fields are provided by TRX data consolidation services. Proxy Server Options This option is used if you company utilizes a proxy server for access to the internet. Transfer Options Future enhancement. Action Item Icons The action item icons are viewable and usable on all tabs. Help This displays the Agency ETL Help application. Dictionary Displays the Desktop Reporting/Agency ETL dictionary. Execute When you have selected all options needed for your specific Download and/or Import, the last step is to select the Execute button. This will begin the data transfer process. Exit Exits the application and closes the window. NOTE: Enter any kind of note that you need to at the bottom of the page. Page 15