Delta Operations Network for Summit. Delta Operations Network. Page 1 of 16

Transcription

1 Delta Operations Network for Summit Page 1 of 16

2 Delta Operations Network for Summit A comprehensive suite of tools for monitoring and managing Calypso applications and their environments. Humans are handy. In rapidly changing environments they can be swift to react, quick to learn and resourceful in response. In repetitive circumstances, however, they can be become forgetful, tardy and error prone. They also get sick and take lunch breaks. Therefore, where possible, it is almost always better to automate the mundane and streamline the exceptional. This can be achieved by using tools to perform what can be planned, envisaged or anticipated, and reserving human intervention for dealing with the unexpected - but with the added benefit of direction and information on what remediation is required and where. This is precisely what FD s Delta Operations Network provides so that management of the Summit application, (and indeed other third-party and in-house applications), its environment and its processes are optimised. Through automation they identify issues efficiently, though the information they provide they enable them to be resolved effectively. - System Monitoring Dashboards to view the status and performance of servers, processes and engines with drilldown to view errors and their causes - Delta Rec - An automated reconciliation and regression testing tool for data across multiple systems and in multiple formats - Configuration management A utility to model, view and track configuration settings and support their maintenance in a controlled audited manner FD s Delta Operations Network for Summit enables organisations to ensure that day-to-day operations proceed as planned, exceptions are processed efficiently and the risks associated with change are minimised Delta Operations Network for Summit enable organisations to manage the full Summit lifecycle. It provides tools for defining, managing and automating the test lifecycle. It provides monitoring tools to confirm systems are operating optimally or issue alerts where they are not. It provides tools for automated reconciliation between Summit and other systems and configuration management capabilities to ensure operating environments are in sync and to specification. In combination it ensures the Summit applications and environments become, and remain, accurate, controlled and consistent. Not just Summit: Delta Operations Network is designed to interoperate across multiple applications enabling user to achieve consolidated visibility and control over multiple applications. One screen for monitoring multiple applications, One store for all test cases, One environment for managing multiple configurations. Same data, Same conditions, Same configurations, Same Results Improve Application Quality Cross-Vendor interoperability Automate test cycles Control configuration management Page 2 of 16

3 Product Overview and Why Different FD has developed Delta Operations Network for managing Summit applications and their environments. Their goal is to provide better support, swifter implementation and improved application performance. They are based on many man-years of hands-on implementations, system migrations and upgrades as well as operational support services that FD provides. The same tools are now available to its clients. Monitoring dashboards provide summary status views on servers, processes and engines with drilldown to view errors and their causes. They enable managers and support staff to view engine status, processing bottlenecks and overdue tasks. Additional performance monitoring capabilities enable developers and test managers to profile the effect of system and configuration changes and to assess capacity thresholds and degradation levels Configuration management A utility to model, view and track configuration settings and enable their import, export and amendment in a controlled audited manner. Using tools in this way removes human error by automating the creation and deployment of upgrade scripts. The utility can be extended to cover additional file types and system settings that define and control other aspects of the solution Delta Rec is an automated reconciliation and regression testing tool for data across multiple systems. It operates on a high performance kdb+ database where an XML mapping defines the data, fields, format and rules for testing and comparing results. Delta Rec is ideal for migrations and upgrades. Results are presented in Dashboards and reports enabling users to view summaries, drilldown into causes and monitor trends. When Combined with Test tools for loading trades and advancing them through their trade lifecycle it enable swifter and more accurate regression testing Test Tools Tools for creating, configuring and running test cases and comparing results with expected outcomes. Run the same test cases across multiple environments to increase test coverage without incurring additional cost. Summit tools make system implementation and support more efficient and effective. Monitoring is continuous and thorough. Its results are instant and informed helping to ensure that potential errors are forewarned and their effects forestalled. Testing is enhanced by automation that facilitates increased and repeated test coverage without incurring additional cost. Configuration can be centralised, managed and controlled Delta Operations Network provides answers to difficult questions posed by managers, auditors, and users: Are all your systems currently running? Are you confident they will continue to run efficiently? Can I look at the status of other in-house applications as well? Is our backup configuration the same as the production one? Could you prove it to internal audit? Did the upgrade you are proposing pass all test cases? Show me the results. How is performance going to be affected? Is your test coverage adequate? Can you increase it without incurring additional testing costs? We need to reassign some roles. Can you assure me the new permissions can be applied accurately and consistently - across all our environments? Using Delta Operation Network the answer to all the above is Yes Summit tools: Visibility, Control, Automation. Page 3 of 16

4 Multi-Vendor Interoperability The tools in Delta Operations Network have been developed in-house by First Derivatives and used daily in supporting multiple clients and vendor applications. As a result they have been developed with a focus on interoperability to save time and reduce costs in operations, training and hardware. Monitoring Configuring Delta Tools A consolidated platform Reconciliations Testing Multi-Vendor Visibility and Control Rather than a siloed set of tools for each solution Delta Operations Network are based on a common framework to ensure as much reuse and repeatability as possible: One screen for monitoring multiple applications, One store for all test cases, One environment for managing multiple configurations. Page 4 of 16

5 FD Summit Practice FD has over 16 years experience in providing consulting and support services to the Capital Markets. In that capacity it specialises in assisting clients in implementing, supporting, upgrading, enhancing, testing and decommissioning leading trading applications. As a result it has accumulated unparalleled experience in working with leading technologies such as FushionCapital Summit, Murex, Calypso, Wall Street and kdb+ and It makes this knowledge and expertise available to clients through its Third Party Vendor Services FD consultants provided under the Third Party Vendor Services have skills in project development and support work across a variety of roles which span business analysis, documentation, prototyping, testing, day to day issue resolution, configuration, migration and development. Our consultants are highly trained across asset classes and possess transaction knowledge and integration requirements from front office to back office and supporting systems in the middle office. Summit Specialists Experience Multiple Summit projects Extensive product knowledge Full lifeycle maintenance Applicaion maintenance is the heart of our company Best Practice processes Leadership Scalability Costs Near Shore Delta Operations Network Managed bench of highly trained consultants Strong balance sheet Commitment to growth Fixed Fee KPIs & penalties Flexibility Low Cost No Visa issues Governtment backing Testing Performance monitoring Streamlined configuration management In providing these services FD has gained an exceptional reputation for the quality of its deliverables and its people What makes us different? We specialisze in Capital Markets and Summit We invest in our business - FD recruits approximately 100 graduates each year. We invest in our people - FD has a 2 year Capital Markets Training programme. We invest in our clients and respond to market needs by building Near Shore centres of excellence. We invest in our tools - FD continues to develop its industry standard tools to reduce implementation timescales. We are agile - Resources can be allocated dynamically to meet business demand. We reduce client s TCO through our efficiencies. The Importance of Training Training is at the heart of everything we undertake at First Derivatives. For Summit services we have a state of the art Training Facility and programme through which each one of our employees proceed. Our project experience has shown that the investment in training is one certain step IT managers can take to ensure project teams possess the skills necessary to reduce failure risk, decrease costs, and increase project effectiveness. FD s training platform is a web based application which provides access to all training collateral, FAQs Trouble Shooting guides and a forum for Helpdesk Support questions. FD s unique advantage within the Capital Markets industry is that all our consultants have extensive technical and functional knowledge of leading third-party trading platforms. This enables them to understand both business and technical requirements alike and to engage meaningfully with traders, IT, management, support and testing departments to quickly understand and service their needs. In the fast-moving trading environment there is little time for on-the-job training so FD invests in advance to ensure it has experts to deal knowledgably and directly with your experts. We train our staff, you avail of their expertise. Page 5 of 16

6 Delta Rec Delta Rec is a rapidly deployable, fully automated testing and reconciliation platform providing the ability to reconcile large volumes of data from different sources in a highly scalable environment. The perceived high cost of improving systems combined with the potential risks to business operations often acts as a deterrent to adopting on new and improved technologies. Delta Rec, developed from the experience over multiple such system migrations and upgrades, is a highly sophisticated regression tool that reduces those risks and provides clients with the confidence to capitalise on new technology platforms. Delta Rec operates by importing data in various formats into a kdb+ database where an XML mapping defines what fields are read, how they are interpreted, what they should be compared with, what rules to apply and what tolerance levels to accept. Results are presented in Dashboards and in reports enabling users to view summaries, drilldown into causes and monitor trends. It has the capability of processing billions of rows of data at high performance levels. ` Delta Rec imports data from both systems, applies conversion and runs comparison checks Results show matched and unmatched records, errors and their causes, missing data and duplicates - with drilldown to detail A management summary of results for each regression test provides clear visibility into the coverage and results of the test cycles and the quality of the underlying systems Page 6 of 16

7 Delta Rec can also be used for regression testing, black box testing, new releases, parallel runs and EOD or intra-day reconciliations. For Summit upgrades Delta Rec provides particular advantages. As illustrated to the right it reconciles output files from the Reference Environment (current production) against that of the Test Environment (upgrade) in order to identify matches, breaks and duplications. Using multi-day scenario files Delta Rec builds up the workflow steps and status changes that define the trade lifecycle. Using Delta Rec organisations can automate the process of reconciling data between systems and comparing test results against expected outcomes. Key Benefits Highly Configurable & Fully customizable, easy to use dashboards Fully automated and configurable regression tests (FOBO, SWIFT etc. ) Data agnostic - full functionality regardless of data source or asset classes Can be run on a virtual environment Full range of data import mechanisms available; direct links to multiple databases, ftp sites or via file upload Can be used to test other applications from a single instance at no extra cost Page 7 of 16

8 Monitoring To ensure day-to-day operations run smoothly and to schedule, FD has developed a set of monitoring dashboards that provide high level information on the current status of prime indicators and accompanying drilldown capability. Early detection of errors or potential threshold breaches enable early intervention and resolution. Monitoring applies to the infrastructure level and to the application process level. Application Monitoring - FD tools include provides application level monitoring that enables users to view details on engine status, processing backlogs, scheduled tasks, and information on long running queries such as when started and by whom. Reports & scheduled tasks Events backlog Server performance Individual launcher status Long running queries Performance Monitoring and Stress Testing The Delta Performance Tool tracks key engine performance metrics to give developers, testers, technical analysts & system administrators insight into system dynamics and enables them to test how coding and configuration changes may affect performance. Waiting and Consumed engine queues Totals, averages, spike and drop statistics Incoming database figure and throughput processing statistics It also provides a real-time engine monitoring component to monitor live queues and provide alerts. Assess performance of Account Driver Services launched via SMT, e.g. DS, BVS Report Generation P&L Reporting (plupd) Market Data Imports launched via etoolkit Servers Imports/Exports to Summit managed by Gateway Services Stress testing capabilities enable users to run volume tests and load scenarios to establish capacity levels, performance thresholds and degradation points. Tests can focus on specific products and trade types to pinpoint causes and effects. Analyse the effect of coding and configuration changes Identify degradation levels, capacity peaks, troughs and bottlenecks Page 8 of 16

9 Infrastructure Monitoring provides screens that enable support teams to view metrics and statistics on individual servers at an infrastructure level with configurable alerts to highlight when key indicators like memory utilisation, CPU, queue depths or disk usage have exceed predefined limits. Early detection in this manner enables swift, targeted remedial action by support teams armed with the knowledge of what is wrong, where and why. Top 10 league of Memory CPU and Disk utilisation with highlights on threshold breaches or near breaches Individual server status Alerts and trends Queue depths Drilldown information enables users to view underlying data on selected servers and across selected days and dates. In this example, the alert history is displayed to view causes, recurring trends and individual occurrences. This information enables user to not only identify where remedial action is required (for example there is a recurring instance of queue depth build on a particular server) but also to verify if the remedial action taken actually addressed the problem (for example, did the added memory and disk space address the high memory utilisation rates experienced over the last week?) Greater visibility into operating status Identification of performance bottlenecks Insight into recurring trends Drilldown to causes Identification of performance bottlenecks Page 9 of 16

10 Test Tools FD has developed a number of test tools to automate and streamline the testing process helping clients to reduce cost while improving quality A Test Executor has been designed to automate test scripts in requirements-based functional testing and regression tests. It has been built by FD architects with extensive experience in Front/Middle and Back Office implementation, full project lifecycle delivery and complex trading and risk applications. The application enables users to define and categorise test cases that reflect business requirement and specify expected outcomes. Once tests have been executed and expected results are established they can be reexecuted as part of regression tests allowing you to specify and repeat the tests more cost effectively and consistently than manual execution. The FD Test Executor covers the full range of functional testing and regression testing within Summit. A Test Suite is a named collection of Test Cases for example Swaps book, Internal FX trades, FOBO Recon A Data Set is a tabular document which contains pairs of key and values and will be used together with Documents. A document is any type of text stored in the application repository to be used as a template for a trade ticket or an incoming SWIFT message or also an expected reference document. A Matrix Document is a complex structure used to store expected results and test results in journalised form for traceability Test Case are ordered collection of Test Tasks and defines the actual steps involved in the test execution,. User can drag &drop predefined Test Tasks from the test library Executor Screens are used to send a Test Suite to the Execution Service which execute the Test Cases from the Test Suite Expected Results are the reference data (or set of data) used for test validation Reduced Costs Improved QA Processes Better resource utilisation Benefits include Greater test coverage Shorter faster test cycles Few product defects Test Repeatability Greater Predictability Improved Stability Page 10 of 16

11 Configuration Management Robust and accurate processing is not based on functionality alone. It is also based on the supporting configuration that determines how the solution operates; the static data it uses, the workflow it follows, the book structure it enforces. How often has functionality been signed off in one environment only to be rejected in another upon discovery that currency setting, Standard Settlement Instructions (SSIs) or field parsings were different between versions? And from a security and internal audit perspective how is it possible to prove that users, their permissions, LEIs and other critical data have not been changed from the signed off version? To provide such control and visibility into configuration management settings and changes, FD has developed an XML based version control utility. The utility captures configuration files via export handlers and converts them to an XML model that reflects the dependencies and structures of the configuration data. The data itself is stored separately in an XML repository. Utilities are then provided for amending, upgrading and deploying configurations in a controlled, audited manner. By eliminating the human factor in reading and maintaining configurations it introduces accuracy and speed. The utility is not restricted to Summit configuration alone. It can operate on any data accessible via a Java API. By eliminating the human factor in reading and maintaining configuration it introduces accuracy and speed. It enables organisation to establish a baseline configuration across multiple systems: Development, Test, UAT, Production and Disaster Recovery. Supported Summit settings include: Company/Desk/Book Customer Static Data Trade Filters structures Gateway Mappings Settlement Instructions Account Definitions & Schemas Ccy & Ccy Pair Definitions Calendar Files Users & User/Desktop Defaults Repeatable reliable deployment and upgrade of configuration settings Full audit trail of configuration changes to enhance quality Swift, simple and controlled methodology to maintain test, development and production environments to a defined status. Easy extendable by xml description and Sink/Source Page 11 of 16

12 Performance Testing Robust and accurate processing is not based on functionality alone. It is also based on the supporting configuration A critical aspect of performance testing is to analyse areas such as Testing environments prior to deployment in both hardware and software: Test how coding and configuration changes will affect the environment Ensure hardware will perform as required, prior to going live Stress-testing to understand the maximum threshold a system can take before performance degradation The FD Performance tool provides a real-time monitoring of queues, wait times and compare these with previous values to track differences and raise alerts where deviations are significant Results from test executions can be compared to understand: How performance is changing in an environment over time How the system scales Overall system efficiency The benefits of changes in a system How processes interact with one another Real-time data is stored for additional analysis: Reviewing results to find historical system anomalies or bottlenecks Historical data can be used to create baseline indicators to feedback to realtime monitoring Create analytics to understand processing trends Page 12 of 16

13 Case Studies Background: A client approached FD for assistance in deploying a cross system, end to end, highly automated set of regression tests that could be repeated as part of a managed service. Drivers: The client was undertaking multiple version upgrades across multi-location, multi-timezone operational units having many different workflows for cross asset, front-to-back processing, using Calypso and Summit functionalities. In order to meet the milestones and reduce operational and project risks, the client looked to FD to provide a cross system solution testing within a managed service. The client required automation of their complete set of test cases using regression testing (Delta Rec) in order to reduce their testing cycles. What we did: Analysed clients manual test cases to create automated regression test packs. Generated executable test cases to populate and amend the environment, across all component systems. Extended the existing delta suite to include access to additional systems. Used Delta Rec for analysis of any breaks between the reference system environment and the latest version. Benefits: Client considerably reduced resourcing costs through use of automated technology solutions Client was able to extend FD s solutions to other trading systems within their architecture Client received an automated regression test pack for future maintenance usage Client was able to considerably reduce the timelines required to perform a multiple vendor application version upgrade simultaneously for several locations. Background: A client was required to mitigate the operational risk of running on a vendor (Misys)nonsupported version of Summit Classic (V2.6). With plans in place to implement the latest version of Summit FT (V5.5), a solution was required to minimise issues and continue providing support to Summit production until all relevant data was migrated and tested on the successfully implemented version of Summit FT. Drivers: The client faced the additional challenge of migrating and replacing a heavily customised version of Summit Classic. The Summit installation had been in place for over 10 years, and during that time a number of developers had worked on customisations with minimal documentation written to describe the customisations. With the decision made to migrate to the latest version of Summit FT, a highly experienced Summit team was provided, who understood the client s product suite, development extensions, and translate the relevant GUI extensions from Classic to FT. In addition, the client required test cases and test execution, which could be achieved within their milestones that were expected to be delivered in a timely fashion within budget. Furthermore, the client required expertise in the management of such a significant version upgrade and an experienced team capable of managing a data migration of this scale. What we did: Analysed business requirements and identified all test cases Simultaneously managed both the production and target Summit systems Developed test scripts and test data Executed all test cases Scaled resourcing based on highly aggressive milestones in order to meet delivery schedule Onsite QA guidance throughout to manage the deliverables and communications within their large organisation. Benefits: Client on target to go live with multiple projects streams QA service delivered at agreed price scales Client able to entrust the production Summit application to FD while rolling out the latest version All major customised components of the Summit installation documented and reworked. Client received numerous test cases for continuous execution and improvement for future version upgrades A fixed price servicing model was offered to scale their delivery team based on the complexity and volume of testing requirements. Page 13 of 16

14 Coming Soon Delta Operations Network is continually evolving. The tools below are already in production for other applications and are being extended to cover Summit too. Delta Sync: Testing will always be challenged by the comprehensiveness of test coverage and test data. To address the latter, FD has developed Delta Sync, an application that provides data synchronisation between environments to ensure that each version is operating on the same data and experiencing the same volume, burst and load conditions Delta Sync replicates data across systems in a controlled manner. Ideal for UAT and parallel runs to simulate real-world conditions without requiring rekeying. Greatly reduces workload and risk in system upgrades and migrations As messages are sent between applications they are also sent to a monitoring dashboard where the status is tracked and where drilldown provides detail information on each message, its content and current status. In this way users and test managers can confirm the completeness of the synchronization and swiftly investigate the errors it reveals. Delta Sync covers data ranging over trade products, user information, lifecycle events and static data including: Cross Asset Trades Legal Entities Company/Desk/Book structures Currency Definitions Calendar Files Market Data Analytics Trade Filters STP Workflows Accounting Schemas Account Postings Automated Regression Testing Automation is the key to rigorous, comprehensive and repeatable testing. And reducing cost. FD has developed a range or tools to automate test execution for requirements based testing and regression testing. Once tests have been executed and expected results are established the test can be re-executed as part of a regression test. When used in conjunction with Delta Rec, FD s reporting framework and scheduling tool it can be further configured to automate the entire regression process from start to finish: Test cases are read (or regenerated if required), loaded in to Summit, progressed through their lifecycle, evaluated, compared with expected outcomes and test results are to appropriate recipients with pass/fail statistics and reasons. Page 14 of 16

15 Near Shore Services FD offers additional cost benefits to its clients by providing its services on a Near Shore as well as on-site basis. All our services, from vendor systems management and software development to infrastructure monitoring and legal and compliance, can be delivered from our high quality service centres where robust technical infrastructures guarantee the required high levels of security, access control and resilience. A compelling feature of the FD s Near Shore approach is its operation from strategically located service centres in Europe, North America and Asia that enables us to offer our Near Shore service on a worldwide basis. The physical proximity affords swift, ad-hoc, on-site deployment of resources where required for specific tasks or projects while the cultural alignment it facilitates ensures the communication process is as streamlined and efficient as possible a critical component of any partnership engagement. This approach therefore provides the client with all the cost benefits of adopting a near shore model while still retaining the advantages of close contact, common time-zone and mobility for face-to-face interaction of on-shore or onsite arrangements as required. Cost Low cost service model Reduced recruitment, training and management overhead Eliminate costs associated with office space, training, hiring, reviews, holiday cover, sick leave, career management Our regional locations ensure a low cost base, guarantee resources in the same time zone and eliminate communication issues. In addition, our staff can be on site within 5 hours when required Capability Highly skilled multi disciplined resources: Lawyers and legal professionals who understand the markets and technology and who can assist not only in the interpretation of data and documentation but also in its sourcing and reporting Avail of industry best practices, procedures and service efficiencies Proven Infrastructure Capacity On-demand capacity giving the ability to ramp-up and ramp-down resources as required Follow-the-Sun support model across worldwide near shore centres Dedicated recruitment and training programmes to ensure continuity Provision for pandemic and other disruptive events Our resources have the elasticity to respond to changes in demand. We provide staff that are highly trained in multiple disciplines and have first-hand expertise on client sites across a variety of projects, systems and assets so that a wealth of knowledge and experience is brought to bear on each assignment. On the infrastructure side, comprehensive Disaster Recovery and Continuity of Business provisioning ensures resilience and robustness of service. VPNs over dedicated bandwidth provide highly secure and resilient access. Segregated areas with dedicated and monitored access points enforce physical security while intrusion detection and vulnerability tests provide protection against host and network attacks. Clustering and failover configurations along with Business Continuity Plans ensure resilience and high availability. To further help clients manage their costs FD offers an embassy model approach to service provision that enables them to select segregation levels appropriate to their level of risk: Gold level offers complete physical and logical separation including dedicated network, phone and power in a standalone facility, Silver offers logical separation within shared facilities while Bronze is appropriate for non-data sensitive related services where segregation is not a priority. Page 15 of 16

16 Delta Suite Delta is a powerful Big Data platform, offering capabilities in reference data management, market data management, CEP, algorithmic and high-frequency trading, FX trading, treasury risk management and exchange management surveillance. Deployed in some of the world s largest banks, exchanges and hedge funds, Delta applications are designed for Volume and Velocity low-latency, high-throughput applications delivered as a hosted service or deployed locally. FD provides a range of brochures on its products and services. For more information please contact us via our website or the numbers below Contact Us New York +1 (212) Europe +44 (28) Asia-Pacific info@firstderivatives.com This information is subject to change without notice and is offered for information purposes only. Page 16 of 16