IBM Message Broker Practical Examples for SOA

IBM Message Broker Practical Examples for SOA Anthony O Dowd WebSphere Message Broker Architecture and Strategy odowda@uk.ibm.com WebSphere 2011 IBM Corporation

Important Disclaimer THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED AS IS, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL HAVE THE EFFECT OF: CREATING ANY WARRANTY OR REPRESENTATION FROM IBM (OR ITS AFFILIATES OR ITS OR THEIR SUPPLIERS AND/OR LICENSORS); OR ALTERING THE TERMS AND CONDITIONS OF THE APPLICABLE LICENSE AGREEMENT GOVERNING THE USE OF IBM SOFTWARE. 2

Agenda Connectivity Overview Message Broker Usage Patterns Message Broker Processing Scenarios 3

ESB Connectivity Overview 4

ESBs Simplify Connectivity File MQ/JMS soap/http Enterprise Service Bushttp soap/jms WebSphere MQ 5

Enrich your SOA connectivity Service Enrichment Match & Route communications between services Converts between transport protocols Transforms between data formats Identifies and distributes bus events simplifying the overall architecture and reducing IT cost 6

Enterprise Service Bus Review Connects everything to everything Matches & routes communications between services Transforms between different data formats Converts between different transport protocols Distributes Business events Service Virtualization Routing Protocol and transports Transformation of interfaces Aspect Oriented Connectivity Security Management Audit 7

WebSphere Message Broker Universal Connectivity FROM anywhere, TO anywhere Simplify application connectivity for a flexible & dynamic infrastructure Protocols, Transports, Data Formats & Processing Supports a wide range of built-in transports, protocols & systems MQ, JMS 1.1, HTTP(S), SOAP, REST, File (incl. FTP & FTE), Database, TCP/IP, MQTT CICS, IMS, SAP, SEBL, PeopleSoft, JDEdwards, SCA, CORBA, email Supports a broad range of data formats Binary (C/COBOL), XML, CSV, JSON, Industry (SWIFT, EDI, HL7 ), IDOCs, User Defined Message Processors Route, Filter, Transform, Enrich, Monitor, Publish, Decompose, Sequence, Correlate, Detect Simple Programming with Patterns & Graphical Data Flows Patterns for top-down, parameterized connectivity of common use cases e.g. Service façades, Message processing, Queue2File IBM & User defined patterns for development reuse & governance Graphical data flows represent application & service connectivity Custom logic via graphical mapping, PHP, Java, ESQL, XSL & WTX Extensive Management, Performance & Scalability Extensive Administration & Systems Management facilities for developed solutions Wide range of operating system &hardware platforms supported, including virtual & WCA Hypervisor High performance transactional processing, additional vertical & horizontal scalability Deployment options include Trial, Remote Deployment, GetStarted, Enterprise 8

Processing Scenarios & Usage Patterns 9

Many Defined Patterns for MB Solutions Service Virtualization Service Enablement Gateway OR OR OR Message-based Integration Event-driven Integration File Processing 10 http://www.ibm.com/developerworks/wikis/display/esbpatterns/

Typical Customer Usage Patterns Extend the Reach of Existing Applications Connect File with Online for End-to-End Efficiency Connect Devices to the Enterprise Get the Most from Packaged Applications Distribute Database Information to Where It s Needed Make An Application Inventory and Govern processing with a Registry Provide a PEP for Secure Application Connectivity Monitor your Business Activity and Act Intelligently Develop and Reuse Solutions with Patterns 11

Extend the Reach of Existing Applications Expose existing applications without change SOAP & Web 2.0 based access to existing systems Create a gateway for routing and security INBOUND and OUTBOUND scenarios SOAP Web Services Established as Interoperability Standard SOAP support allows MB to act as WS-* façade to existing non WS-* applications Support for SOAP/HTTP and SOAP/JMS (any), includes transactions & asynchronous processing SOAP gateway functionality for WSDL-less, policy based processing in large web service networks Examples range from simple service re-direct to payload verify/sign, encrpyt/decprypt with routing Web 2.0/REST Provides Lightweight Universal Access HTTP ubiquity & REST semantic provide universal access to existing systems Popular with both XML and JSON payloads (JSON for lightweight clients) MB Outbound Scenarios enable Existing Applications to request New Services Existing application can invoke and exploit new services with existing technology WS clients provider Typical Customers US Payroll Corp. exposes MQ applications via self service SOAP interface for responsiveness & accuracy WW (US based) Airline access external web services from existing JMS/MQ reservation system US Wireless Operator expose legacy billing systems via HTTP/XML for customer self service Swedish Banking group uses gateway to authenticate, lookup, authorize & route to backend web service 12

Connect File and Online for End-to-End Efficiency Share the valuable business data in your files Create an efficient pipeline between your file data and on-line applications Control a well managed, flexible file infrastructure Streamline batch oriented and on-line processing with the MB Message Broker provides end-to-end file processing: gets stationary data moving! Typical scenarios are file to queue, database to file, file to file, file to SAP, File PubSub Comprehensive file systems support includes local files, network mounted file, FTP and SFTP Process whole-file or record-at-a-time; simple delimiters to complex COBOL, XML & user defined Timely, Intelligent, Transactional Transfers with FTE nodes FTE Input and FTE output nodes allow MB to receive and send FTE transfers Installed seamlessly as part of regular install, auto configured client name, transfer directories etc. Timely processing: file is processed once FTE agent confirms notifies of complete file transfer Add intelligence to your file processing via user specified metadata FTE s transactional underpinning & MB sequencing for once-and-once only files! 2011 Sterling C:D Integration MB and C:D MFT can now integrate seamlessly Exploits C:D specific capabilities including C:D process steps Typical Customers German Retailer uses MB & FTE for POS reporting to HQ & price list distribution to store NE US Retailer using FTE & MB to provide timely inventory updates to and from online systems 13

Connect Devices to the Enterprise Monitor remote systems and devices Provide near real-time insight about physical systems, and act Industry Observation How to we get information from everywhere, understand it, and act? Medical, Energy and Utilities, Distribution, Transport, Gaming Issues based e.g. traffic congestion, efficient energy, timely supply A Smarter Planet is full of devices Data is generated *outside* the enterprise Typically very large numbers of devices: Often concentrator technology; differentiate, integrate & forward MQTT for standards based device integration Small footprint client, embeddable, Low bandwidth cost Fragile network support for hostile environments MB to Connect Devices, Apply Intelligence Connects MQTT devices to enterprise systems Apply intelligence in near real-time; systems tend to be passive today IBM is working with Brisbane, London, Singapore and Stockholm to deploy smarter traffic systems. Stockholm has seen approximately 20 percent less traffic, a 12 percent drop in emissions and a reported 40,000 additional daily users of public transportation. Typical Customers US Medical and Technology services company monitors pacemakers for home health Swedish city congestion charging, traffic calming and pollution reduction 14

Get the Most from Packaged Applications Provide broad access to EIS systems Move information to and from packaged systems Packaged Applications Provide Best of Breed Business Function SAP for purchasing, sales, inventory SEBL for Sales, PeopleSoft for HR Oracle, JDEdwards etc Interfaces are often non standard: e.g. SAP BAPIs, IDOCs Processing and data are isolated from other applications Result: packaged apps have difficultly using/generating information for other apps Inhibits adoption of a best of breed philosophy Support for SAP, SEBL, PeopleSoft, JDEdwards inbound and outbound Connectivity built-in no extra moving parts Drive new work into its packaged application from any other supported source Can send information from packaged application to any other supported target Packaged applications can focus on what they do best and be integrated Typical customers NA Railroad uses MB for all SAP to SAP communication WW Pharmaceutical uses MB for order payment to SAP and distribution notification from SAP WW Hotel chain uses MB for SEBL customer billing and sales systems 15

Distribute Database Information to Where It s Needed! Distribute database updates to where they re needed Provide timely access to changed database information Move to near real-time data trickle from infrequent ETL extract Database Node allows tables to be treated as input source Typical scenarios include database to queue & file, or PubSub data distribution Captures database changes (Insert Update, Delete) to trigger connectivity processing Supports single and multiple tables, complex joins, and other database oriented semantics Extends existing database capabilities in MB to provide comprehensive inbound & outbound support Works with full range of broker databases including Oracle, DB2, SQL server, soliddb and more Most existing Event table and data table structures supported without database change RAD tools construct skeleton database queries to simplify user experience Power users can create sophisticated SQL routines if required or desired Fully Transactional with High Performance and Scalability Distinct event cache & data transactions minimizes contention Exploits SQL engine for full 2PC transactions 1.Table update 2.Database trigger Typical Customers German Distributor captures order updates for downstream systems notification French Food manufacturer for timely notification of database updates to SAP Uses MB SAP connectivity and database support User Table Event Table 7.Delete Event 5.Get Data 4.Read Event Database Processor 3.Polling Notification 6.Propagate Data 16

Provide a PEP for Secure Application Connectivity Provide secure access (AAA) to applications and services Understand and convert broad range of security domain identities Provide secure external access services to partners Connectivity often implies security domain change MB supports a broad variety of security tokens Userid/pw, X509, SAML, Kerberos, LTPA MB is Policy Enforcement Point (PEP) Security is enforced here, still owned by PDP Identity management, access control, authorization and authentication mechanisms (AAA) are essential Policy Decision Point (PDP) and MB work together PDP combination provides a secure infrastructure Ensures conformance to centralized security policy Many different PDP technologies supported Lightweight Directory Access Protocol (LDAP) Microsoft Active Directory, Open LDAP Tivoli Federated Identity Manager (TFIM) WS-Trust, zos SAF including RACF 17 External Partner Access to Services DP security hardened DMZ device strengths Combine network and MB functionality

Make an Application Inventory & Govern Processing Understand your application assets and control their access dynamically Dynamically change processing without redeployment Provide processing policy and governance Catalog application and service assets using a registry, e.g. WSRR Web Service and MQ Service definitions Classifications: by function, owning department Relationships: applications dependencies for lifecycle management, versioning User defined properties (metadata): Application=GOLD or Service=SILVER Use registry information in MB routing Built-in MB facilities allow access registry In memory cache for high performance Automatic change invalidation Enables policy based processing, examples Simple routing based on client metadata Dynamic WS-SecurityPolicy processing Dynamic transformation based on endpoint WSRR as critical governance point Typical Customers US automotive sales company uses MB+WSRR Timely match vehicle availability with customer request Virtual Service Service Requestor A A 2 Advertise availability of the virtual services Use metadata to implement smart mediations 3 1 Service Provider Capture metadata about services for use by Service Bus 18

Monitor Your Business and Act Intelligently Understand the business relevance of MB data Apply business rules to MB data in-flight Detect business situations and act quickly MB Connectivity Processes Events from many Sources, Targets Capture business relevant information for WebSphere Business Monitor Examples: total dollar trade value per day, orders per hour Capture business events to correlation with WebSphere Business Events Look for correlations in data, e.g. fraud, sales opportunities, CRM Audit, Repair and Replay transported events Generate Business Monitoring Events from existing connectivity Enables integration with WebSphere Monitor to display & analyze KPIs Design time and operational time event activation Notification via CEI & Publish subscribe ILOG rules engine Rule-based Decision Services render decisions on input data Most often this data comes from a variety of data sources: aggregation, transformation is required Rule-based Decision Services send outcome decisions to other systems: rule based routing Inputs Outputs Typical Customers European Motor manufacturer creates virtual system of record for audit NA Insurance company uses MB+ILOG for business decisions routing UK Retail group measures store throughput by item for real-time trending 19

Detect and Act Upon Business Events Identify a diverse range of business events and act Compose existing applications and services to create new value MB Event Capture and Process Initiation Breadth of MB connectivity enables multiple business process starting points Identify event and initiate business process e.g. message, file, web service, devices can start business process Synchronous & asynchronous invocation for short & long running transactions Multiple options with Process Server, Lombardi, FileNet Business Process MB In : Events Integration with WBE to Identify Business Event WBE allows multiple MB events to form single business event e.g. duplicates => fraud, missing event => SLA not met Business Process Connectivity Exploit range of MB connectivity to abstract and simplify BPM Process focus on WHAT rather than MB focus on WHERE, HOW concerns MB receives service request and routes, re-formats, interacts with provider Out : Evaluations, Correlations Business Process MB Web Service, SAP, MQ, File 20

IBM Healthcare Technical Architecture Portal Home/Telehealth Medical Devices Non-Trust Applications Web Services Authentication and Single Sign On Web Services Enterprise Data Warehouse Electronic Forms - Discharge Form etc Clinical Pathway Management Emergency, Oncology etc Web Services Web Services Web Services IBM Remote Medical Device Aggregator XML Integration Engine - ESB JCAPS Rhapsody egate InterSystems Hospital Medical Devices Integration Engine WebSphere Message Broker ODBC, JDBC, SQL XML, IDOC, Proprietary XML, HL72, HL73, Cache ODBC, Web Services Proprietary HL72 XML, SOAP, Web Services, ebrim HL72, HL73 ebxml ITK Proprietary Analytics and Reporting Clinical and Corporate Corporate Applications Billing Payroll - HR Clinical Applications PAS Orders Pharmacy Maternity Pathology ER Existing Hospital Integration Engine Clinical Document Sharing Electronic Master Patient Index 21

Business Relevant ESB Connectivity Industry Specific Extensions, e.g. Healthcare Built-in Patterns to solve relevant connectivity problems quickly e.g. HL7 Connectivity Domain Specific Tooling to allow users to focus on appropriate details IBM ESB for Healthcare New facilities for connecting HL7 clinical applications, with end-user operational tooling Typical scenarios include device integration, electronic forms, clinical document sharing, analytics Built-in & customizable patterns to enable rapid creation of common healthcare connectivity scenarios Clinical Applications Support New built-in input and output connectivity for generic HL7 clinical applications EPIC, Cerner (Admissions, Discharge, Demographics), JAC, Sunquest, IHE, MediTech New Patterns Explorer Healthcare category contains common connectivity patterns e.g. HL7 pattern has sequencing, duplicate detection, journaling, remainder processing built-in Exploits HL7 V2.x Common Information Model (CIM) Users can extend built-in patterns and create their own healthcare patterns Operational Tooling Provides end-user view for status and statistics Clinical application reporting and monitoring 22

Develop & Reuse Solutions with Patterns Develop connectivity solutions quickly Capture previous experience for cost reduction Ensure solutions conform to best practices Use MB s built-in Patterns to Kick-start Development Built-in patterns for Web Services, Messaging, File, SAP... Guided solutions using top-down, parameterized approach Development artefacts are generated from solution template Create your own Patterns to suit your Business needs Simple to create your own solution template User patterns! Start from an existing Message Broker solution or IBM pattern Ensure specific business: e.g. audit, notification, validation Create and Participate in Public and Private Communities Create reusable assets for sharing across your business Full check-in/out & versioning with any Library Control System Private Communities for internal sharing via Web Content tools Public communities for more widely available patterns Typical Customers Swedish partner providing patterns for low cost off-premises connectivity WW GSI using patterns for quicker time-to-value and cost reduction mqseries.net public patterns community launched Nov 2010 23 Patterns created, rated & used by mqseries.net community

Move your MB into the Cloud Provision new system instances quickly Grow your infrastructure to meet demand Easily manage multiple deployments HVE Config pattern configure deploy A new feature to simplify provisioning of your MB Initial system deploy resulting in quicker time to solution value Fix pack deploy reduces recurring maintenance cost Hypervisor Edition Packages Pre-built installed VM image for OS+HW combination Updated when new fix pack levels released Option to Deploy & Manage with WebSphere Cloudburst Appliance Repeatable configurations using patterns and scripts Base WCA Pattern for most popular configurations Script Packages configure base pattern Emergency fixes also possible Fully functional deployed configuration Interactions with MB no different to regular environments 24

Message Broker Product Roadmap IBM's plans, directions, and intent are subject to change or withdrawal Product & pre-requisites simplification Patterns & Impact Analysis Integrated MQ Pub-sub PHP support MB Explorer & advanced administration Web Services SCA Interoperability Advanced management facilities Enhanced SAP, SEBL, PSOFT support SFTP support for file nodes Hypervisor Edition V7.0 Q4 2011 Healthcare Connectivity Pack V7.0 Q1 2011 V7.0.0.3 FixPack Q2 2011 VNext (8.0) Q4 2011 Healthcare Connectivity Pack Update FixPack 1 Q2 2012 Simple & Productive Universal & Independent Industry Specific & Relevant Dynamic & Managed FixPack 2 Q4 2012 High Performing & Scalable V7.0 Nov 2009 V7.0.0.1 FixPack Q2 2010 V7.0.0.2 FixPack Q4 2010 HL7 Application connectors HL7 Connectivity Patterns Operational Management Tooling Major release Minor release 25

Message Broker Next Release Message Broker Next Release Themes & Candidate Line Items well understood and verified Early Programs started Jan 2011 will run throughout year Please contact David Hardcastle or Anthony O Dowd for more details Release Content heavily influenced by user requirements, participation and feedback Continuous rollout beyond general availability Themes for Diverse Connectivity Requirements Simple & Productive Universal & Independent Industry Specific & Relevant Managed & Dynamic High Performing & Scalable Message Broker is a key IBM connectivity technology Unparalleled range of connectivity options and capabilities Supports users range of experience & needs Industry leading performance in a broad range of scenarios 26