Managed File Transfer

Transcription

1 Managed File Transfer

2 How do most organizations move files today? FTP Typically File Transfer Protocol (FTP) is combined with writing and maintaining homegrown code to address its limitations Limited Reliability Limited Security Limited Flexibility Limited visibility and traceability Why is FTP use so widespread? FTP is widely available Lowest common denominator Promises a quick fix repent at leisure Simple concepts low technical skills needed to get started FTP products seem free, simple, intuitive and ubiquitous Legacy File Transfer products A combination of products often used to provide silo solutions Often based on proprietary versions of FTP protocol Can t transport other forms of data besides files Developments to leverage MQ People From IT Staff to Business staff and even Security Personnel Using a combination of , fax, phone, mail, memory keys Most organizations rely on a mix of homegrown code, several legacy products and different technologies and even people! 2011 IBM Corporation

3 TOWARD AN INTEGRATED AND MANAGED FILE TRANSFER SOLUTION Client Pains Avoid restrictions of internal developments - Limited Flexibility (File Size, File Naming, etc.) - High and time consuming maintenance costs Improve file transfer reliability Improve file transfer visibility and traceability Integration with the ESB IT scenario Long Time MQ customer MQ expertise and skills already available Internally used for messaging and platform integration MQ based Solution replaces FTP and other file systems Reusing the existing MQ network => Leading to operational savings and simplification Reduces time and speeds up the delivery of the information to business processes Full control of file transfer from the MQ admins Internal File Transfer Scenario Evolved along with IT infrastructures Driven by specific business scenarios Many protocols and technologies in use Home-grown developments IBM Corporation

4 Key Themes WebSphere File Transfer Auditable Audit logs of transfers at source and target Audit data persisted to MQ queues and/or relational database. Captures time-stamped log at source and target Ease-of-Use Remote console for transfer initiation, unattended operation, scripting, scheduling, restart policies, status display Integrated with MQ Explorer configuration tooling Simplicity Small footprint, fast install No need to write code or use API to configure transfers Enabled via GUI Leverages WebSphere MQ no other technology pre-reqs Security Access to individual files subject to file system permissions Link level security (inheriting MQ SSL security) Breadth Support WebSphere MQ V6 and V7 for transfers Core Platform support (z/os, Linux (32 Bit), Solaris, AIX, HP, Windows) Good file type support (ASCII/EBCDIC, CR/LF, Flat files, z/os) Automated Transfers Transfers can be scheduled to repeat at predetermined intervals Transfers can be triggered by range of file system events e.g. new files, updated file, etc. Page IBM Corporation 4

5 WebSphere MQ providing a consolidated transport for both files and messages Traditional approaches to file transfer result in parallel infrastructures One for files typically built on FTP One for application messaging based on WebSphere MQ, or similar High degree of duplication in creating and maintaining the two infrastructures File Transfers Application Messaging File Transfer Edition reuses the MQ network for managed file transfer and yields: Operational savings and simplification Reduced administration effort Reduce cost of on-boarding, system maintenance, and customer support Reduced skills requirements and maintenance Consolidated Transport for Messages & Files Managed File Transfer provides secure, cost effective transport while providing scalability over most platforms regardless of protocol IBM Corporation

6 WebSphere Managed File Transfer Adds managed file transfer services to WebSphere MQ Enables reliable, secure and traceable file transfers File transfer capabilities Any file size (Kb, Mb, Gb, Tb ) Powerful graphical tooling Reliable delivery leveraging MQ Full logging for tracking and audit XML scripting for distributed job automation Supports many platforms (including zos and iseries) Character set conversion between platforms WebSphere MQ Managed File Transfer A B C X Y Z Consolidated managed transport for files and messages 2011 IBM Corporation 6

7 2011 IBM Corporation 7

8 Monitoring deployed agents from WMQ Explorer New Agents entry in the navigation view Agent status is displayed using a traffic light colour scheme that highlights agents which may require attention Context menu allows the user to test the connectivity to a particular agent 2011 IBM Corporation 8

9 2011 IBM Corporation 9

10 Creating File Transfers List of sources and targets is built automatically Specify directory and file name Choose advanced options Choose mode (Binary or Text with automatic conversion) Add each individual transfer to a group of transfers Choose priority of transfer Deploy file transfer to network Page IBM Corporation 10

11 2011 IBM Corporation 11

12 2011 IBM Corporation 12

13 2011 IBM Corporation 13

14 End-to-end encryption using WebSphere MQ Advanced Message Security FTE Agent svrconn channel WebSphere MQ Queue Manager sndr/rcvr channels WebSphere MQ Queue Manager FTE Agent WMQ MFT already supports transport level encryption using SSL Data is encrypted before it is sent over a channel and decrypted when it is received FTE Agent svrconn channel WebSphere A MQ M Queue S Manager sndr/rcvr channels WebSphere MQ Queue Manager A M S FTE Agent WMQ-MFT combined with WMQ AMS allows file data to be encrypted at the source system & decrypted when it reaches the destination system Reduces encryption costs Data is secure even when at rest on a queue 2011 IBM Corporation 14

15 Web based File Transfers using the Web Gateway Web-based File Transfer A RESTful API for sending files into and receiving files from a WMQ FTE network Reliable and secure file transfer option for Web users Auditable transfer and large file support Zero-footprint file transfer support without the need to provision and install code Interfaces for embedding into third party and custom user applications WMQ FTE Server WMQ FTE Network HTTP/S 2011 IBM Corporation 15

16 Not only moving files Handle the data in the files Ability to parse and transform files and process into messages, files, events, service requests etc Files Messages Files WMQ FT Network MQ, FTE, FTP, HTTP, SOAP WebSphere Message Broker Enrich, Mediate, Transform 2011 IBM Corporation 16

17 Batch Modernization Convert payloads between files and messages Enables simple conversion of payload between files and messages Helps modernize batch-oriented architectures into micro-batches and ultimately messaging Readily and rapidly connect file-based and message enabled applications 2011 IBM Corporation 17

18 Options for converting data between files & messages One file to one message One file becomes one message One file to a group of messages One message to one file The file can be split based on: Size Binary delimiter Regular expression One message becomes one file A group of messages (or all messages on the queue) to one file Optionally, a delimiter can be inserted between each message used to build the file 2011 IBM Corporation 18

19 Interacting with other File Transfer networks Support for transferring files located on FTP or SFTP servers Enables incremental modernization of FTP-based home-grown solutions Provides auditability and reliability (checkpoint restart) FTP/SFTP Fully integrated into graphical, command line and XML scripting interfaces 2011 IBM Corporation 19

20 Questions? 2011 IBM Corporation 20