1 FUTURES INDUSTRY BUSINESS CONTINUITY AND DISASTER RECOVERY 2009 INDUSTRY TEST RESULTS DR VI October 2009 Compiled and Developed by Tellefsen and Company, L.L.C.
2 TABLE OF CONTENTS Page Number: I. Background 3 II. III. IV. Executive Summary 7 Overall Test Results 10 Problems Encountered 23 V. Lessons Learned 25 VI. Suggested Next Steps 29
3 I. BACKGROUND The FIA Information Technology Division conducted the first annual Disaster Recovery (DR) Test in October Starting in Q2, 2009, the FIA Business Continuity Committee began detailed preparations for this year s sixth annual industry-wide test. A Working Group was convened to discuss and agree on a date, goals, objectives, etc.
4 BACKGROUND (Cont d) Two futures Industry BC/DR symposiums were held in September in New York and Chicago. Panelists included representatives from the major exchanges and clearinghouses: CBOE Futures Exchange CME Group (CBOT, CME, NYMEX, COMEX) CME Clearing The Clearing Corp. ICE Exchanges ICE Futures US ICE Clear US International Derivatives Clearing Group Kansas City Board of Trade KCBT Clearing Corp. MEFF NASDAQ Futures Exchange Options Clearing Corp.
5 BACKGROUND (CONT D) The scope of this year s initiative was designed to test disaster recovery back-up connectivity and functionality between exchanges, clearinghouses and member firms: Test firm back-up to exchange back-up sites (DR-DR). Verify connectivity. Test round-trip communications capabilities. The symposium sessions were well attended by numerous operations managers and BC/DR representatives from various clearing and non-clearing firms. Regular Committee conference calls were held between May and October (bi-weekly and weekly).
6 BACKGROUND (Cont d) The Committee including representatives from: Clearinghouses Exchanges FCMs Clearing firms Non-clearing firms Key service providers Independent software vendors Post-test interviews with firms and survey forms were used to fine tune the results.
7 II. EXECUTIVE SUMMARY The sixth annual industry-wide disaster recovery test in the U.S. financial services sector was highly successful, largely in part to the good working relationship between exchanges and the firms. Major U.S. and international futures exchanges, clearinghouses, FCMs and clearing firms participated in this year s test: 62 FCMs, clearing firms and non-clearing firms and 210 trading participants participated - an increase over last year ~96% of firms tested successfully
8 EXECUTIVE SUMMARY (CONT D) This year s test initiative was expanded to include several domestic and international exchanges: ICE Clear Europe International Derivatives Clearing Group Exchanges and clearinghouses demonstrated that their systems, processes and procedures simultaneously worked very well, communicating from back up systems/sites.
9 EXECUTIVE SUMMARY (CONT D) Feedback from the firms, exchanges and clearing houses indicated that this was a valuable and worthwhile exercise and that the industry should continue to do more common testing in the future Firms indicated that the test helped them: Exercise their Business Continuity/Disaster Recovery plans Identify internal single points of failure Tighten up and document their business continuity procedures Better understand the need for cross-training Test connectivity with exchanges DR sites
10 III. OVERALL TEST RESULTS 12 domestic and international futures exchanges and clearinghouses, 62 clearing/non-clearing firms* and 210 trading firms participated** in the test Test participants included clearing firms, nonclearing firms and non-clearing trading participants 66% of all futures clearing firms participated Participant firms represent a significant critical mass of futures order flow and liquidity: ~74% of overall futures exchanges volume. * Some firms are common members of multiple exchanges ** Represents non-clearing trading participants
11 CBOE FUTURES EXCHANGE Tested via member firms back up connectivity to production CBOEdirect trading platform Scripted trade entry for VIX futures contracts Transmitted trades to the OCC s back up systems via MQ Transmitted regulatory data to NFA via FTP.
12 CME GROUP / CME CLEARING Tested member firms back-up connectivity to production GLOBEX trading platform via CME remote back-up site. Entered a script of orders for various products. Received ex-pit, block trade information via CME remote site portal URL. Generated trade reporting and SPAN files from 10/23 trade date. Received PCS and large trader information from member firms. Transmitted trade registry data and SPAN files via FTP.
13 THE CLEARING CORP. Tested member firms back-up connectivity to back-up clearing system Confirmed system connectivity via successful system login message no scripted trade entry PCS, ex-pit and large trader information was not accepted Previous day s clearing reports was made available for firms to retrieve Clients tested MQM, FTP and Report Distribution processes Scripted trades were sent via MQM to clients that requested them.
14 INTERNATIONAL DERIVATIVES CLEARING GROUP Used the IDEX XT trading system from the back up site. Trade orders were received by IDEX Market Operations. Trades were reported and automatically matched and executed with a trade date of Saturday, October 24, Generated trade confirmations and transmitted to firms. NFX/IDEX trades were automatically processed for clearing and settlement to the IDCH.
15 ICE FUTURES US / ICE CLEAR US Tested member firms back-up connectivity to the ICE Trader electronic trading system. Scripted order entry for Cotton and Sugar futures contracts. Trade entry via TIPS system for test trades, ex- pit, large trader and PCS information. ICE Clear produced end-of-day files: Match off files, report files and SPAN files.
16 ICE Tested member firms back-up connectivity to the ICE Exchange electronic trading system DR site. Scripted order entry for Cotton and Sugar futures contracts. Tested ICE Block and other non trading functionality from DR site. ICE Web reporting via Internet portal for deal reporting, position reports, etc. Futures trades submitted to the ICE Clear DR site.
17 ICE CLEAR EU Tested member firms back-up connectivity to the ICE Exchange electronic trading system DR site Tested ECS, AFTS, Crystal Reports, ICE Block and other non trading functionality from DR site ICE Web reporting via Internet portal for deal reporting, position reports, etc. CMs submitted Large Trader files via AFTS Futures trades submitted to the ICE Clear DR site Completed a clearing run and generated regular clearing data files - banking and delivery reports and SPAN files.
18 KANSAS CITY BOARD OF TRADE Members tested connectivity to CME GLOBEX trading system Participated in post-trade testing - generated a subset of October 23rd trades to member firms Transmitted trade confirmations from KCBT Clearing Corp. Accepted EFP, change records, PCS and large trader records.
19 MEFF Tested via the MEFF production ETS environment Simulated a failure of their London POP and successfully failed over to the backup system during the test Members entered trades and received reports Transfer files were delivered from clearing Clearing data was restricted and not sent to member firms back office systems.
20 MINNEAPOLIS GRAIN EXCHANGE Trades were entered for MGEX products into the CME GLOBEX platform and cleared by MGEX Clearing using the MGEX DR Site TREX files were generated by the MGEX DR Clearing Server and placed on the MGEX DR FTP server The MGEX DR FTP server was accessible with the same logins and passwords as the production system.
21 NASDAQ FUTURES EXCHANGE Used the NFX/XL trading system from the primary production site Orders were received at NFX/XL Help Desk Trades were automatically matched and executed with a trade date of Friday, October 23, 2009 Fill reports were generated and transmitted to firms The NFX Trade File was processed for clearing and settlement.
22 OPTIONS CLEARING CORP. OCC successfully tested from their back up site Supported FTP+, Pull/Push, NDM and MQ file connectivity IP addresses and TCP Ports were unchanged, as they were in production for this test Firms submitted file transmissions and received output files.
23 IV. PROBLEMS ENCOUNTERED A number of problems were encountered, including: MQ connectivity and message output issues Delay in starting MQ channels, could not generate MQ messages Trades were not being passed to a trade management system Incorrect IP addresses/incorrect network configuration Firewall configuration parameters Failure of a firm gateway server Member firm help desk line was not working initially Exchange web portal connectivity problems/incorrect URLs Most were resolved quickly, although some caused an unexpected delay to test progress.
24 PROBLEMS ENCOUNTERED (CONT D) Order entry problem with test script used a symbol not set up on DR trading system Incorrect SSL certificate to access order entry website Clearing house end of day processing delayed as a result of change in the trade date Some firms did not verify that their back up servers and equipment was properly functioning prior to the test.
25 V. LESSONS LEARNED The futures industry proved that it is capable of successfully orchestrating an industry-wide disaster recovery test Most problems that were encountered were rectified quickly, although some caused an unexpected delay to the restoration of full processing capabilities: Under real life situations, most problems could probably be resolved within hours or by the next business day The exchanges and clearinghouses internal support processes and procedures worked well.
26 LESSONS LEARNED (CONT D) Firms and exchanges indicated that the test helped them: Identify some internal single points of failure Tighten up and document their business continuity and system fail over procedures Better understand the need for cross-training Test connectivity to/from DR sites Pre-test connectivity testing was valuable and should be a pre-requisite for future tests
27 LESSONS LEARNED (CONT D) Firms must be aware of any environmental impact on their network fire walls caused by test requirements: Pre-register via the FIA registration portal/participate in ping testing Have proper network staffing support actively engaged during the test Be aware of any firewall impact and make changes accordingly to accommodate testing
28 LESSONS LEARNED (CONT D) A number of firms apparently did not pre-register and showed up for the test at several exchanges: They were set up and most tested successfully, however, this placed an additional demand on exchange and clearing house support staffs Participation in pre-test ping testing should be mandatory for future test initiatives
29 VI. SUGGESTED NEXT STEPS Survey firms and exchanges for input to future testing Announce the details, goals and objectives of the next DR test - Saturday October 23, 2010 Broadly market future test initiatives to firms IT, operations, trading and senior management, to ensure a wider dissemination of test information within all firms Participation in pre-test ping testing should become a pre-requisite for all firms Coordinate the October 2010 date with SIFMA Consider conducting a regional scenario outage.
FUTURES INDUSTRY BUSINESS CONTINUITY AND DISASTER RECOVERY 2013 INDUSTRY TEST RESULTS DR X October 2013 Compiled and Developed by Tellefsen and Company, L.L.C. TABLE OF CONTENTS Page Number: I. Background
FUTURES INDUSTRY BUSINESS CONTINUITY AND DISASTER RECOVERY 2014 INDUSTRY TEST RESULTS DR XI November 2014 Compiled and Developed by Tellefsen and Company, L.L.C. TABLE OF CONTENTS Page Number: I. Background
Industry-wide Disaster Recovery Test OCTOBER 9, 2004 Preliminary Results TEST OBJECTIVES In April, FIA IT Division hosted meetings with exchanges, clearing organizations and firms to determine the need
Group 2015 FIA Test Script Table of Contents Important Information... 3 Pre-Test Connectivity Certification or Ping Testing... 6 Standard Disaster Recovery Failover... 7 Test Date Trade Entry Pre-Opening...
Futures Industry Disaster Recovery Test Briefings June 6,14, 2006 DR III Prepared and Moderated by Tellefsen and Company, L.L.C. AGENDA I. Introduction and Welcome II. III. IV. Testing Goals and Objectives
Futures Industry Association Business Continuity and Disaster Recovery Test Briefings June 17, 2015 DR XII Prepared and Moderated by John Rapa, CBCP Tellefsen and Company, L.L.C. AGENDA I. Introduction
Futures Industry Disaster Recovery Test Briefings July 28, 2004 Prepared and Moderated by The AGEDA I. Introduction and Welcome II. III. IV. Progress to Date Test Goals and Objectives Review of Testing
CME Clearing Clearing Communications Requirements - General Information A. REMOTE DATA TRANSMISSION OVERVIEW The CME can accept data from and send data to several types of TCP/IP devices. This document
Technical Notice 15-007 TO: FROM: SUBJECT: Montréal Exchange Participants Head, Customer Relations MX Participation in the SIFMA, FIA and IIROC 2015 Disaster Recovery Tests DATE: August 7, 2015 The Montréal
Course 10972A: Administering the Web Server (IIS) Role of Windows Server Course Details Course Outline Module 1: Overview and Installing Internet Information Services In this module students will learn
EDGAR ELECTRONIC DATA GATHERING, ANALYSIS, AND RETRIEVAL EDGAR Public Dissemination Service New Subscriber Document Updated February 23, 2015 Table of Contents 1.0 PDS System Overview... 2 1.1 PDS Points
EDGAR ELECTRONIC DATA GATHERING, ANALYSIS, AND RETRIEVAL EDGAR Public Dissemination Service New Subscriber Document Updated Jul-01-14 Table of Contents 1.0 PDS System Overview...2 1.1 PDS Points of Contact...
MS 10972A Administering the Web Server (IIS) Role of Windows Server Description: Days: 5 Prerequisites: This course provides students with the fundamental knowledge and skills to configure and manage Internet
Course Outline 10972-Administering the Web Server (IIS) Role of Windows Server Duration: 5 days (30 hours) Target Audience: This course is intended for IT Professionals already experienced in general Windows
Course Page - Page 1 of 9 Administering the Web Server (IIS) Role of Windows Server M-10972 Length: 5 days Price: $2,795.00 Course Description This course provides students with the fundamental knowledge
25.09.2014 Espen Døvle Technical Overview N2EX Nord Pool Spot AS Tel +47 6710 9100 Fax +47 6710 9101 PO Box 121, NO-1325 Lysaker, Norway Org nr. NO 984 058 098 MVA firstname.lastname@example.org www.nordpoolspot.com
A new generation of broker. Company Overview & Capabilities Trade Execution Market Insight Institutional Product & Business Development Going beyond the status quo. Today s investor needs a new, independent
GOLD & PRECIOUS METALS PRICE OUTLOOK SYMPOSIUM 2015 Trade, Hedge & be ahead of the Precious Metals Markets with Gold & Silver Futures. Why it makes sense? HARRIET HUNNABLE JUNE 2015 CME Group exchanges
ROSS Migration/Registration Contents IQSweb V3.0.1 ROSS Connection Requirements... 2 Test Agency Network Connectivity to ROSS... 3 FIREWALL Exceptions... 3 FIREWALL Exception Justification... 4 ROSS Interface
Installing and configuring Microsoft Reporting Services Every company, big or small has to use various tools to retrieve data from their Databases. IT departments receive many different requests for data
VERSION 3.0 JUNE 2001 The Commodity Futures Modernization Act and Single Stock Futures The Financial Information Forum (FIF) was founded in 1996 to address the issues of its component groups - exchanges,
DEFINITIONS ACT OR CEA The term "Act" or CEA shall mean the Commodity Exchange Act, as amended from time to time. BLOCK TRADE A privately negotiated futures, option on futures or swaps transaction that
For 90 years, Rosenthal Collins Group, LLC (RCG ) has been a leader in providing clients with customized solutions that help them manage risk in markets worldwide. As a regulated Futures Commission Merchant
Lab 5.5.3 Developing ACLs to Implement Firewall Rule Sets All contents are Copyright 1992 2007 Cisco Systems, Inc. All rights reserved. This document is Cisco Public Information. Page 1 of 8 Device Interface
Configure Backup Server for Cisco Unified Communications Manager Document ID: 110309 Contents Introduction Prerequisites Requirements Components Used Conventions Configure a Backup Server for Cisco Unified
II. Implementation and Service Information A. Responsibilities The procedure for setup with KeyBank s standard transmission services consists of three phases: 1) communications testing, 2) applications
RL Solutions Hosting Service Level Agreement April 2012 Table of Contents I. Context and Scope... 1 II. Defined Terms... 1 III. RL Solutions Responsibilities... 2 IV. Client Responsibilities... 4 V. The
Regulatory Notice 15-43 BC/DR Testing Under Regulation SCI FINRA Files Rule with SEC for Authority to Designate Firms for Mandatory Participation in FINRA s Business Continuity/Disaster Recovery Testing,
IMF Tune Quarantine & Reporting Running SQL behind a Firewall WinDeveloper Software Ltd. 1 Basic Setup Quarantine & Reporting Web Interface must be installed on the same Windows Domain as the SQL Server
Resource Ordering and Status System User Business Resumption Plan I. INTRODUCTION This document is the disaster preparedness and recovery plan for users of the Resource Ordering and Statusing System (ROSS).
Page 1 of 6 Transferring Your Internet Services Below you will find the instructions necessary to move your web hosting, email, and DNS services to NuVox. The Basics Transferring your domain name Preparing
INTERNAL AUDIT DIVISION AUDIT REPORT Audit of the Riskmetrics system in the Investment Management Division of UNJSPF Overall results relating to the effective implementation of the Riskmetrics system were
Profile of Exchange and FCM Risk Management Practices For Direct Access Customers As of December 3, 2007 Background The term direct market access is frequently used to describe a customer accessing a market
CFTC Technology Advisory Committee Rule 1.73 The Challenges of Risk Managing Give-Ups and Bunched Orders for Futures and Options on Futures Version 2.5 October 30 th 2012 1 Clearing Member Risk Management
Select the appropriate answer from the drop down in the column, and provide a brief description in the section. 1 Do you have a member of your organization with dedicated information security duties? 2
Version 1.0 Contents 1.0 INTRODUCTION 2 1.1 PREREQUISITES 2 1.2 CONTACT INFORMATION 2 2.0 ACCESS TO CME 2 2.1 Registering for the Test Environment 2 2.2 Registering for the Production Environment 3 2.3
1800 ULEARN (853 276) www.ddls.com.au Microsoft 10972 - Administering the Web Server (IIS) Role of Windows Server Length 5 days Price $4169.00 (inc GST) Version B Overview This course provides students
DEPARTMENT OF TECHNOLOGY AND INFORMATION STATE OF DELAWARE 801 SILVER LAKE BLVD. DOVER, DELAWARE 19904 The Honorable James L. Collins, Chief Information Officer NASCIO STATE RECOGNITION AWARDS 2015 DELAWARE
Tier3 Remote Monitoring System Peace of Mind for Less Than a Cup of Coffee a Day What if You Could Turn Traditional IT Support On Its Head? Know about problems before they cause costly outages Become proactive
Futures trading is not suitable for all investors, and involves the risk of loss. Futures are a leveraged investment, and because only a percentage of a contract s value is required to trade, it is possible
Member Impacting Project Overview New Facility Migration PR20090033 Page 1 of 7 Table of Contents Table of Contents... 2 Version Control... 2 Document Purpose... 2 Executive Summary... 3 Business Impact...
Settlement System User Manual November 2011 Global Operations Education Overview The Settlement System allows member firms to view Settlement Information by Origin and Settlement Account. There are two
Course Code: M20533 Vendor: Microsoft Course Overview Duration: 5 RRP: 2,025 Implementing Microsoft Azure Infrastructure Solutions Overview This course is aimed at experienced IT Professionals who currently
Course 10972B: Administering the Web Server (IIS) Role of Windows Server Page 1 of 7 Administering the Web Server (IIS) Role of Windows Server Course 10972B: 4 days; Instructor-Led Introduction This course
Print Audit Facilities Manager Technical Overview Print Audit Facilities Manager is a powerful, easy to use tool designed to remotely collect meter reads, automate supplies fulfilment and report service
STATE OF NEVADA Department of Administration Division of Human Resource Management LASS SPEIFIATION TITLE GRADE EEO-4 ODE IT TEHNIIAN SUPERVISOR 37 7.927 SERIES ONEPT Information Technology (IT) Technicians
WHITEPAPER Using Automated, Detailed Configuration and Change Reporting to Achieve and Maintain PCI Compliance Part 4 An in-depth look at Payment Card Industry Data Security Standard Requirements 10, 11,
Summary of Requirements for CME, CBOT, NYMEX and COMEX Clearing Membership And OTC Derivatives Clearing Membership CME Clearing ( Clearing House ) is the clearing house division of Chicago Mercantile Exchange
Connecting an Android to a FortiGate with SSL VPN This recipe describes how to provide a group of remote Android users with secure, encrypted access to the network using FortiClient and SSL VPN. You must
Entrust IdentityGuard Comprehensive Entrust IdentityGuard Comprehensive is a five-day, hands-on overview of Entrust Course participants will gain experience planning, installing and configuring Entrust
SNAP WEBHOST SECURITY POLICY Should you require any technical support for the Snap survey software or any assistance with software licenses, training and Snap research services please contact us at one
Documentation for data centre migrations Data centre migrations are part of the normal life cycle of a typical enterprise. As organisations expand, many reach a point where maintaining multiple, distributed
Course 20533: Implementing Microsoft Azure Infrastructure Solutions Overview About this course This course is aimed at experienced IT Professionals who currently administer their on-premises infrastructure.
Volume 200 - Guide to Testing Services Johannesburg Stock Exchange Version 1.00 Release Date 1 October 2011 Number of Pages 13 (Including Cover Page) 1 DOCUMENT CONTROL 1.1 Table of Contents Johannesburg
10972B: Administering the Web Server (IIS) Role of Windows Server Course Details Course Code: Duration: Notes: 10972B 5 days This course syllabus should be used to determine whether the course is appropriate
ICAS4134C Provide first-level remote help desk support Release: 1 ICAS4134C Provide first-level remote help desk support Modification History Not Applicable Unit Descriptor Unit descriptor This unit defines
Job Aid: Manual Backup Servers for S8500 or S8700 Media Servers R2.0 or later Please disregard any references to the S8710 Media Server in this document. The S8700 Media Server is the currently available
GE Measurement & Control Cyber Security for NEI 08-09 Contents Cyber Security for NEI 08-09...3 Cyber Security Solution Support for NEI 08-09...3 1.0 Access Contols...4 2.0 Audit And Accountability...4
Installation and Connection Guide to the simulation environment GLOBAL VISION Hardware and Software Requirements The following hardware specification is recommended for client machines: 2 GHz Pentium class
Magnet Voice Windows PC Softphone Installation Contents 1. Introduction 3 2. Installation 3 Step 1: Install the Software on your PC 4 Step 2: Input your registration details 4 3. Connected State 6 6. Port
ADMINNATIONAL ADMINITRATOR OF EUROPEAN REGISTRY AND PK REGISTRY EUROPEAN REGISTRY DATA SHEET N 4: TRUSTED ACCOUNT LIST I. SCOPE Pursuant to Article 26 paragraph 1 of the European Union Regulation 389/2013,
Welcome to R.J. O Brien Institutional Introducing Broker Commercial Enterprise Solutions Foreign Exchange Individual Traders Asset Management OUR NAME IS ON THE DOOR. WE STAND FOR FAMILY, STEWARDSHIP AND
1 General Computer Controls Governmental Unit: University of Mississippi Financial Statement Date: June 30, 2007 Prepared by: Robin Miller and Kathy Gates Date: 6/29/2007 Description of computer systems