TIBCO Rendezvous Concepts. Software Release July 2010

Transcription

1 TIBCO Rendezvous Concepts Software Release July 2010

2 Important Information SOME TIBCO SOFTWARE EMBEDS OR BUNDLES OTHER TIBCO SOFTWARE. USE OF SUCH EMBEDDED OR BUNDLED TIBCO SOFTWARE IS SOLELY TO ENABLE THE FUNCTIONALITY (OR PROVIDE LIMITED ADD-ON FUNCTIONALITY) OF THE LICENSED TIBCO SOFTWARE. THE EMBEDDED OR BUNDLED SOFTWARE IS NOT LICENSED TO BE USED OR ACCESSED BY ANY OTHER TIBCO SOFTWARE OR FOR ANY OTHER PURPOSE. USE OF TIBCO SOFTWARE AND THIS DOCUMENT IS SUBJECT TO THE TERMS AND CONDITIONS OF A LICENSE AGREEMENT FOUND IN EITHER A SEPARATELY EXECUTED SOFTWARE LICENSE AGREEMENT, OR, IF THERE IS NO SUCH SEPARATE AGREEMENT, THE CLICKWRAP END USER LICENSE AGREEMENT WHICH IS DISPLAYED DURING DOWNLOAD OR INSTALLATION OF THE SOFTWARE (AND WHICH IS DUPLICATED IN TIBCO Rendezvous Installation) OR IF THERE IS NO SUCH SOFTWARE LICENSE AGREEMENT OR CLICKWRAP END USER LICENSE AGREEMENT, THE LICENSE(S) LOCATED IN THE LICENSE FILE(S) OF THE SOFTWARE. USE OF THIS DOCUMENT IS SUBJECT TO THOSE TERMS AND CONDITIONS, AND YOUR USE HEREOF SHALL CONSTITUTE ACCEPTANCE OF AND AN AGREEMENT TO BE BOUND BY THE SAME. This document contains confidential information that is subject to U.S. and international copyright laws and treaties. No part of this document may be reproduced in any form without the written authorization of TIBCO Software Inc. TIB, TIBCO, TIBCO Adapter, Predictive Business, Information Bus, The Power of Now, Rendezvous, TIBCO Rendezvous and Messaging Appliance are either registered trademarks or trademarks of TIBCO Software Inc. in the United States and/or other countries. EJB, Java EE, J2EE, and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other countries. All other product and company names and marks mentioned in this document are the property of their respective owners and are mentioned for identification purposes only. THIS SOFTWARE MAY BE AVAILABLE ON MULTIPLE OPERATING SYSTEMS. HOWEVER, NOT ALL OPERATING SYSTEM PLATFORMS FOR A SPECIFIC SOFTWARE VERSION ARE RELEASED AT THE SAME TIME. SEE THE README.TXT FILE FOR THE AVAILABILITY OF THIS SOFTWARE VERSION ON A SPECIFIC OPERATING SYSTEM PLATFORM. THIS DOCUMENT IS PROVIDED AS IS WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. THIS DOCUMENT COULD INCLUDE TECHNICAL INACCURACIES OR TYPOGRAPHICAL ERRORS. CHANGES ARE PERIODICALLY ADDED TO THE INFORMATION HEREIN; THESE CHANGES WILL BE INCORPORATED IN NEW EDITIONS OF THIS DOCUMENT. TIBCO SOFTWARE INC. MAY MAKE IMPROVEMENTS AND/OR CHANGES IN THE PRODUCT(S) AND/OR THE PROGRAM(S) DESCRIBED IN THIS DOCUMENT AT ANY TIME. THE CONTENTS OF THIS DOCUMENT MAY BE MODIFIED AND/OR QUALIFIED, DIRECTLY OR INDIRECTLY, BY OTHER DOCUMENTATION WHICH ACCOMPANIES THIS SOFTWARE, INCLUDING BUT NOT LIMITED TO ANY RELEASE NOTES AND "READ ME" FILES. Copyright TIBCO Software Inc. ALL RIGHTS RESERVED. TIBCO Software Inc. Confidential Information

3 iii Contents Figures xv Tables xvii New or Modified Sections xix Preface xxi Manual Organization xxii Related Documentation xxiii TIBCO Product Documentation xxiii Typographical Conventions xxv How to Contact TIBCO Customer Support xxviii Chapter 1 Product Overview Introduction to Rendezvous Software Benefits of Programming with Rendezvous Software Simplifying Distributed System Development Decoupling and Data Independence Location Transparency Architectural Emphasis on Information Sources and Destinations Reliable Delivery of Whole Messages Rendezvous Components Rendezvous Daemon Rendezvous Language Interfaces Rendezvous Functionality Developing Distributed Systems Programming Examples Platform Support Chapter 2 Architecture Rendezvous API Architecture Architectural Changes for Release PGM and TRDP

4 iv Contents Protocols and Services Identifying the Daemon Variant Security Features Performance Secure Client Connections Virtual Circuits Direct Communication Routing Daemon Subject Weights and Path Costs Batch Mode for Transports Architectural Changes for Release API Name Changes Code Migration Replacement for Sessions Hollow Session Synchronous Session Multi-Threading Changes Event Manager Contexts and Related Restrictions Listeners and Senders (Conceptual Change) Blocking Changes Sleep and Select Prompt Return Signal Events Obsolete Message Changes Unitary Messages Encrypted Fields Certified Message Delivery Changes Certified Delivery Confirmation Order Unsupported and Obsolete Advisory Messages Compatibility with Earlier Releases Datatypes rvd rvrd rva rvcache Chapter 3 Fundamentals Messages and Data Fields Wire Format Supplementary Information for Messages

5 Contents v Address Information Encoding Tag Certified Delivery Information Self-Describing Data Names and Subject-Based Addressing Subject Names Wildcard Subject Names Inbox Names Subject-Based Addressing and Message Destinations Multicast and Point-to-Point Messages Point-to-Point Messages Multicast Messages Messages Mediate Interactions Between Programs Publish/Subscribe Interactions Request/Reply Interactions Multicast Request/Reply Interactions The Rendezvous Environment Certificates and Security Certificate Encodings and Formats Obtaining Certificates Distributing Certificates Chapter 4 The Rendezvous Daemon Role of the Rendezvous Daemon The Daemon and its Client Programs Reliable Message Delivery Overview Other Features of Reliable Message Delivery Secure Daemon Chapter 5 Subject Names Subject Name Syntax Examples Special Characters in Subject Names Subject Name Performance Considerations Using Wildcards to Receive Related Subjects Distinguished Subject Names with Special Meaning Chapter 6 Data Self-Describing Data

6 vi Contents Rendezvous Datatypes Messages Message Structure Message Representation in Programs Messages are not Thread-Safe Field Names and Field Identifiers Strings and Character Encodings DateTime Format Chapter 7 Events Event System Overview Events Event Parameters Event Classes Event Driver Event Queues Maximum Events and Limit Policy Dispatch Dispatcher Threads Queue Groups and Priority Default Queue Strategies for Using Queues and Groups Callback Functions Dispatch Thread Closure Data Listener Event Semantics Listening for Messages Destroying a Listener I/O Event Semantics Operating System I/O Semantics Blocking I/O Calls Availability Timer Event Semantics Chapter 8 Transport Transport Overview Transport Scope Network Transport Parameters Service Parameter Service Groups

7 Contents vii Interaction between Service and Network Parameters Specifying the Service Specifying Direct Communication Network Parameter Constructing the Network Parameter Multicast Addressing Daemon Parameter Specifying a Local Daemon Remote Daemon Secure Daemon Sending Messages Intra-Process Transport and User Events Inbox Names Direct Communication Batch Modes for Transports Chapter 9 Virtual Circuits Virtual Circuits Overview Properties of Virtual Circuits Programming Paradigm Testing the New Connection Virtual Circuit API Chapter 10 Guidelines for Programming Avoid Sending Binary Data Buffers or Internal Structs Do Not Pass Local Values Use Self-Describing Data Establish Subject Naming Conventions Do Not Send to Wildcard Subjects Control Message Sizes Avoid Flooding the Network Beware of Network Boundaries Make Transport Parameters Flexible Verify Each Inbound Message Understand Sockets Chapter 11 Certified Message Delivery Certified Delivery Features

8 viii Contents Reliable versus Certified Message Delivery Example Applications Inappropriate Situations Decentralization Certified Message Delivery in Action Creating a CM Transport CM Correspondent Name Ledger Labeled Messages Sending a Labeled Message Receiving a Labeled Message Discovery and Registration for Certified Delivery Discovery Registration Certified Delivery Agreement Delivering a Certified Message Automatic Confirmation of Delivery Requesting Confirmation Sequencing and Retransmission Persistent Correspondents Example Anticipating a Listener Canceling Certified Delivery Disallowing Certified Delivery No Response to Registration Requests Reusable Names Ledger Storage Ledger Size Ledger File Location Relay Agent Operation Communication Protocol State Transparency Connecting and Disconnecting Delays Capacity Reply Name Substitution

9 Contents ix Chapter 12 Distributed Queue Distributed Queue Example Distributed Queue Members Certified Delivery Behavior in Queue Members Member Roles Worker and Scheduler Enforcing Identical Subscriptions Fault Tolerance versus Distributed Queues Scheduler Parameters Assigning Tasks to Workers Worker Weight Availability Task Capacity Complete Time Reassigning Tasks in Exceptional Situations Worker Exit Slow Worker Scheduler Replacement Case Studies Complete Time Mandelbrot Set Fax Confirmation Distributed Queues and Certified Listener Advisory Messages Chapter 13 Fault Tolerance Concepts Fault Tolerance Fault Tolerance versus Distributed Queues Fault Tolerance in Action Components and Operating Environment Example Fault-Tolerant Multicast Producer Advantages of Rendezvous Fault Tolerance Software Groups and Membership Group Name Active and Inactive Alternate Terminology Fault Tolerance Callback Function Active Goal Example: One Active Member Example: Several Active Members Rank and Weight Weight Values Assigning Weight

10 x Contents Rank among Members with Different Weight Ranking Members with Equal Weight Status Quo among Members with Equal Weight Adjusting Weight Heartbeats Detecting Member Failure Heartbeat Tracking Independent Confirmation Activation Interval Prepare-to-Activate Hints Requesting Hints Timing of Hints Hints Do Not Imply Subsequent Activation Passive Monitor Monitor Callback Function Monitors in Action Chapter 14 Fault Tolerance Programming Fault Tolerance Callback Actions Program Callback Functions Ensure Timely Event Processing Multiple Groups Example: Mutual Backup across a WAN Longest Service Interruption Cascading Failure Situations New Member Situations Minimizing Response Time Distribute Members Protect against Hardware Failure Protect against Network Disconnect Member File Access Copying Context Files Upgrading Versions Disabling a Member Adjusting Member Weights Example 1: Resources Example 2: Load Example 3: System Administrator

11 Contents xi Chapter 15 Developing Fault-Tolerant Programs Step 1: Choose a Group Name Number of Groups Group Name Syntax Step 2: Choose the Active Goal Step 3: Plan Program Behavior Parallel Data State Continuity Track Active Backlog Activation Preparing to Activate Deactivation Serve It Once Send it Once Step 4: Choose the Intervals First: Determine the Activation Interval Second: Determine the Heartbeat Interval Third: Determine the Preparation Interval For Monitors: Determine the Lost Interval Step 5: Program Start Sequence Chapter 16 IPM Overview of IPM Restrictions Summary of Differences Configuring IPM Default Values Implicit Configuration File from Path Explicit Configuration File Explicit Configuration Parameters in Code Parameter Configuration Precedence and Interaction Program Structure Set Parameters Open Close Chapter 17 Best Practices for Low Latency Program Design Hints Reduce Message Size Re-Use Message Objects Reduce Input/Output Avoid Feature Overhead

12 xii Contents Careful Memory Management Minimize Processing within Callbacks Examples Runtime & Environment Factors Save Cycles & Reduce Process Switching Clear the Network Limit Duplication Reliable Delivery & Latency Throughput Send Messages in Groups Appendix A System Advisory Messages Advisory Messages Advisory Summary Receiving Advisory Messages System Advisory Subject Names CLIENT.DEFUNCT CLIENT.FASTPRODUCER CLIENT.ILLEGAL_PUBLISH CLIENT.IP_MISMATCH CLIENT.NOMEMORY CLIENT.SLOWCONSUMER DATALOSS DISPATCHER.THREAD_EXITED HOST.STATUS LICENSE.EXPIRE QUEUE.LIMIT_EXCEEDED RETRANSMISSION.INBOUND.EXPECTED RETRANSMISSION.INBOUND.REQUEST_NOT_SENT RETRANSMISSION.OUTBOUND.SENT RETRANSMISSION.OUTBOUND.SUPPRESSED RVD UNREACHABLE.TRANSPORT VC.CONNECTED VC.DISCONNECTED Appendix B Certified Message Delivery (RVCM) Advisory Messages Certified Delivery and Distributed Queue Advisory Messages

13 Contents xiii RVCM Advisory Subject Names DELIVERY.CONFIRM DELIVERY.COMPLETE DELIVERY.NO_RESPONSE DELIVERY.FAILED DELIVERY.UNAVAILABLE REGISTRATION.REQUEST REGISTRATION.CERTIFIED REGISTRATION.NOT_CERTIFIED REGISTRATION.NO_RESPONSE REGISTRATION.CLOSED REGISTRATION.DISCOVERY REGISTRATION.MOVED REGISTRATION.COLLISION RELAY.CONNECTED RELAY.DISCONNECTED QUEUE.SCHEDULER.ACTIVE QUEUE.SCHEDULER.OVERFLOW Appendix C Fault Tolerance (RVFT) Advisory Messages Fault Tolerance Advisory Messages RVFT Advisory Subject Names RVFT Advisory Description Field PARAM_MISMATCH DISABLING_MEMBER TOO_MANY_ACTIVE TOO_FEW_ACTIVE Index

14 xiv Contents

15 xv Figures Figure 1 Rendezvous Operating Environment Figure 2 Point-to-Point Message Figure 3 Reliable Multicast Message Figure 4 Event-Driven Publish/Subscribe Interaction Figure 5 Demand-Driven Request/Reply Interaction Figure 6 Multicast Request/Reply Interaction Figure 7 Default Event Queue Figure 8 Prioritize Event Queues in a Group Figure 9 Remove Event Queues from a Group to Suspend Dispatch Figure 10 Listener Activation and Dispatch Figure 11 I/O Event Activation and Dispatch Figure 12 Timer Activation and Dispatch Figure 13 Direct Communication between Two Programs Figure 14 Relay Agents Figure 15 Relay Agents and Delays: Network Figure 16 Relay Agents and Delays: Timing Figure 17 Relay Agents: Reply Name Substitution Figure 18 One-of-N Delivery to a Distributed Queue Figure 19 Fault Tolerance Operating Environment Figure 20 Mutual Backup across a WAN

16 xvi Figures

17 xvii Tables Table 1 General Typographical Conventions xxv Table 2 Syntax Typographical Conventions xxvi Table 3 Programming Languages Table 4 Overview of Functionality Table 5 Architecture Summary Table 6 PGM and TRDP Communications Table 7 Self-Describing Data Table 8 Environment Calls Table 9 Secure Daemon Calls Table 10 Valid Subject Name Examples Table 11 Invalid Subject Name Examples Table 12 Characters with Special Meaning in Subject Names Table 13 Semantics of Listening to Wildcard Subjects Table 14 Invalid Wildcard Subject Examples Table 15 Distinguished Subject Names Table 16 Wire Format Datatypes Table 17 Event System Components Table 18 Event Classes Table 19 Dispatcher Threads Table 20 Listener Creation Table 21 I/O Event Creation Table 22 Timer Creation Table 23 Sending Calls Table 24 Inbox Calls Table 25 Virtual Circuit Calls Table 26 Certified Message Delivery Programming Details Table 27 Comparing Reliable and Certified Message Delivery Table 28 Centralized versus Decentralized Architecture

18 xviii Tables Table 29 CM Transport Creation Calls Table 30 CM Send Calls Table 31 Confirmation of Delivery Calls Table 32 Add Listener Calls Table 33 Close Listener Calls Table 34 Remove Listener Calls Table 35 Disallow Listener Calls Table 36 Relay Agent Connect and Disconnect Calls Table 37 Fault Tolerance Table 38 Fault Tolerance Actions Table 39 Fault Tolerance Callback Function Table 40 Set Weight Call Table 41 Fault Tolerance Interval Parameters Table 42 Summary of Difference between Ordinary Daemons and IPM Table 43 Rendezvous System Advisories Table 44 SYSTEM Advisory Subject Name Elements Table 45 Rendezvous Certified Message Delivery Advisories Table 46 RVCM Advisory Subject Name Elements Table 47 Rendezvous Fault Tolerance Advisory Messages Table 48 RVFT Advisory Subject Name Elements

19 New or Modified Sections xix New or Modified Sections IPM Best Practices for Low Latency

20 xx New or Modified Sections

21 xxi Preface This manual explains TIBCO Rendezvous software and the concepts needed to understand it and use it effectively. It is part of the documentation set for Rendezvous Software Release Topics Manual Organization, page xxii Related Documentation, page xxiii Typographical Conventions, page xxv How to Contact TIBCO Customer Support, page xxviii

22 xxii Manual Organization Manual Organization The first group of chapters introduce the basics of Rendezvous software: Chapter 1, Product Overview, page 1 is a high-level introduction to Rendezvous software. Chapter 2, Architecture, page 15 introduces architecture concepts, and explains specific architectural elements. Chapter 3, Fundamentals, page 39 discusses the details of messages and subject-based addressing. Chapter 4, The Rendezvous Daemon, page 55 introduces rvd the daemon process. Chapter 5, Subject Names, page 61 presents details of subject name syntax and semantics. The second group of chapters discuss important concepts of the Rendezvous programming architecture: Chapter 6, Data, page 69 presents details of datatypes, formats and storage issues. Chapter 7, Events, page 79 presents events, queues, dispatch, callback functions, and event semantics. Chapter 8, Transport, page 99 presents transports and their parameters. Chapter 9, Virtual Circuits, page 119 presents virtual circuits. Chapter 10, Guidelines for Programming, page 127 is a collection of rules of thumb for Rendezvous programmers. The third group of chapters present quality of service features: Chapter 11, Certified Message Delivery, page 139 Chapter 12, Distributed Queue, page 181 Chapter 13, Fault Tolerance Concepts, page 195 Chapter 14, Fault Tolerance Programming, page 213 Chapter 15, Developing Fault-Tolerant Programs, page 227

23 Preface xxiii Related Documentation This section lists documentation resources you may find useful. TIBCO Product Documentation The following documents form the Rendezvous documentation set: Read this book first. It contains basic information about Rendezvous components, principles of operation, programming constructs and techniques, advisory messages, and a glossary. All other books in the documentation set refer to concepts explained in this book. TIBCO Rendezvous C Reference Detailed descriptions of each datatype and function in the Rendezvous C API. Readers should already be familiar with the C programming language, as well as the material in. TIBCO Rendezvous C++ Reference Detailed descriptions of each class and method in the Rendezvous C++ API. The C++ API uses some datatypes and functions from the C API, so we recommend the TIBCO Rendezvous C Reference as an additional resource. Readers should already be familiar with the C++ programming language, as well as the material in. TIBCO Rendezvous Java Reference Detailed descriptions of each class and method in the Rendezvous Java language interface. Readers should already be familiar with the Java programming language, as well as the material in. TIBCO Rendezvous.NET Reference Detailed descriptions of each class and method in the Rendezvous.NET interface. Readers should already be familiar with either C# or Visual Basic.NET, as well as the material in. TIBCO Rendezvous COM Reference Detailed descriptions of each class and method in the Rendezvous COM component. Readers should already be familiar with the programming environment that uses COM and OLE automation interfaces, as well as the material in.

24 xxiv Related Documentation TIBCO Rendezvous Administration Begins with a checklist of action items for system and network administrators. This book describes the mechanics of Rendezvous licensing, network details, plus a chapter for each component of the Rendezvous software suite. Readers should have at hand for reference. TIBCO Rendezvous Configuration Tools Detailed descriptions of each Java class and method in the Rendezvous configuration API, plus a command line tool that can generate and apply XML documents representing component configurations. Readers should already be familiar with the Java programming language, as well as the material in TIBCO Rendezvous Administration. TIBCO Rendezvous Installation Includes step-by-step instructions for installing Rendezvous software on various operating system platforms. TIBCO Rendezvous Release Notes Lists new features, changes in functionality, deprecated features, migration and compatibility information, closed issues and known issues.