Murex Tools. Delta Tools for Murex. Page 1 of 16

Transcription

1 Delta Tools for Murex Page 1 of 16

2 Delta Tools from First Derivatives A comprehensive suite of tools for monitoring and managing Murex applications and their environments. Humans are handy. In rapidly changing environments they can be swift to react, quick to learn and resourceful in response. In repetitive circumstances, however, they can be become forgetful, tardy and error prone. They also get sick and take lunch breaks. Therefore, where possible, it is almost always better to automate the mundane and streamline the exceptional. This can be achieved by using tools to perform what can be planned, envisaged or anticipated, and reserving human intervention for dealing with the unexpected - but with the added benefit of direction and information on what remediation is required and where. This is precisely what FD s Tools for Murex provide so that management of the Murex application, its environment and its processes are optimised. Through automation they identify issues efficiently, though the information they provide they enable them to be resolved effectively. - System Monitoring Dashboards to view the status and performance of servers, processes and engines with drilldown to view errors and their causes - Delta Rec - An automated reconciliation and regression testing tool for data across multiple systems and in multiple formats - Configuration management A utility to model, view and track configuration settings and support their maintenance in a controlled audited manner FD s Murex tools enable organisations to ensure that day-to-day operations proceed as planned, exceptions are processed efficiently and the risks associated with change are minimised Delta Tools for Murex enable organisations to manage the full Murex lifecycle. It provides tools for defining, managing and automating the test lifecycle. It provides monitoring tools to confirm systems are operating optimally or issue alerts where they are not. It provides tools for automated reconciliation between Murex and other systems and configuration management capabilities to ensure operating environments are in sync and to specification. In combination it ensures the Murex applications and environments become, and remain, accurate, controlled and consistent. Not just Murex: Delta tools are designed to interoperate across multiple vendor and in-house solutions applications enabling users to achieve consolidated visibility and control over multiple applications. One screen for monitoring multiple applications, One store for all test cases, One environment for managing multiple configurations. Same data, Same conditions, Same configurations, Same Results Improve Application Quality Cross-Vendor interoperability Automate test cycles Control configuration management. Page 2 of 16

3 Product Overview and Why Different FD has developed a suite of tools for managing Murex applications and their environments. Their goal is to provide better support, swifter implementation and improved application performance. They are based on many man-years of hands-on implementations, system migrations and upgrades as well as operational support services that FD provides. The same tools are now available to its clients. Monitoring dashboards provide summary status views on servers, processes and engines with drilldown to view errors and their causes. They enable managers and support staff to view engine status, processing bottlenecks and overdue tasks. Additional performance monitoring capabilities enable developers and test managers to profile the effect of system and configuration changes and to assess capacity thresholds and degradation levels Configuration management A utility to model, view and track configuration settings and enable their import, export and amendment in a controlled audited manner. Using tools in this way removes human error by automating the creation and deployment of upgrade scripts. The utility can be extended to cover additional file types and system settings that define and control other aspects of the solution Delta Rec is an automated reconciliation and regression testing tool for data across multiple systems. It operates on a high performance kdb+ database where an XML mapping defines the data, fields, format and rules for testing and comparing results. Delta Rec is ideal for migrations, upgrades. Results are presented in Dashboards and reports enabling users to view summaries, drilldown into causes and monitor trends. Extracts or even whole tables taken directly from the Murex datamart, can be compared directly from one version to the next and used to confirm the correct population of simulations / views. When Combined with Test tools for loading trades and advancing them through their trade lifecycle it enables swifter and more accurate regression testing Murex tools make system implementation and support more efficient and effective. Monitoring is continuous and thorough. Its results are instant and informed helping to ensure that potential errors are forewarned and their effects forestalled. Testing is enhanced by automation that facilitates increased and repeated test coverage without incurring additional cost. Configuration can be centralised, managed and controlled Murex tools provide answers to difficult questions posed by managers, auditors, and users: Are all your systems currently running? Are you confident they will continue to run efficiently? Can I look at the status of other in-house applications as well? Is our backup configuration the same as the production one? Could you prove it to internal audit? Did the upgrade you are proposing pass all test cases? Show me the results. How is performance going to be affected? Is your test coverage adequate? Can you increase it without incurring additional testing costs? We need to reassign some roles. Can you assure me the new permissions can be applied accurately and consistently - across all our environments? Using Murex tools the answer to all the above is Yes Murex tools: Visibility, Control, Automation. Page 3 of 16

4 Multi-Vendor Interoperability The Delta Tools have been developed in-house by First Derivatives and used daily in supporting multiple clients and vendor applications. As a result they have been developed with a focus on interoperability to save time and reduce costs in operations, training and hardware. Monitoring Configuring Delta Tools A consolidated platform Reconciliations Testing Multi-Vendor Visibility and Control Rather than a siloed set of tools for each solution Delta Tools are based on a common framework to ensure as much reuse and repeatability as possible: One screen for monitoring multiple applications, One store for all test cases, One environment for managing multiple configurations. Page 4 of 16

5 FD Murex Practice FD has over 16 years experience in providing consulting and support services to the Capital Markets. In that capacity it specialises in assisting clients in implementing, supporting, upgrading, enhancing, testing and decommissioning leading trading applications. As a result, it has accumulated unparalleled experience in working with leading technologies such as Murex, Calypso, Wall Street, kdb+, Summit. It makes this knowledge and expertise available to clients through its Third Party Vendors Services FD consultants provided under the Third Party Vendor Services possess skills in project, development and support work across a variety of roles which span business analysis, documentation, prototyping, testing, day to day issue resolution, configuration, migration and development. Our consultants are highly trained across asset classes and possess transaction knowledge and understanding of integration requirements from front office to back office and supporting systems in the middle office. Murex Specialists Experience Multiple Murex projects Extensive product knowledge Full lifeycle maintenance Applicaion maintenance is the heart of our company Best Practice processes Leadership Scalability Costs Near Shore Managed bench of highly trained consultants Strong balance sheet Commitment to growth Fixed Fee KPIs & penalties Flexibility Low Cost No Visa issues Governtment backing In providing these services FD has gained an exceptional reputation for the quality of its deliverables and its people Product Innovation A suite of tools to automate and contol the full product lifecycle Monitoring, and synchronisation tools Streamlined configuration management What makes us different? We specialise in Capital Markets and Murex We invest in our business - FD recruits approximately 100 graduates each year. We invest in our people - FD has a 2 year Capital Markets Training programme. We invest in our clients and respond to market needs by building Near Shore centres of excellence. We invest in our tools - FD continues to develop its industry standard tools to reduce implementation timescales. We are agile - Resources can be allocated dynamically to meet business demand. We reduce client s TCO through our efficiencies. The Importance of Training Training is at the heart of everything we undertake at First Derivatives. For Murex services we have a state of the art Training Facility and programme through which each one of our employees proceed. Our project experience has shown that the investment in training is one certain step IT managers can take to ensure project teams possess the skills necessary to reduce failure risk, decrease costs, and increase project effectiveness. FD s training platform is a web based application which provides access to all training collateral, FAQs Trouble Shooting guides and a forum for Helpdesk Support questions. FD s unique advantage within the Capital Markets industry is that all our consultants have extensive technical and functional knowledge of leading third-party trading platforms. This enables them to understand both business and technical requirements alike and to engage meaningfully with traders, IT, management, support and testing departments to quickly understand and service their needs. In the fast-moving trading environment there is little time for on-the-job training so FD invests in advance to ensure it has experts to deal knowledgably and directly with your experts. We train our staff, you avail of their expertise. Page 5 of 16

6 Delta Rec Delta Rec is a rapidly deployable, fully automated testing and reconciliation platform providing the ability to reconcile large volumes of data from different sources in a highly scalable environment. The perceived high cost of improving systems combined with the potential risks to business operations often acts as a deterrent to adopting on new and improved technologies. Delta Rec, developed from the experience over multiple such system migrations and upgrades, is a highly sophisticated regression tool that reduces those risks and provides clients with the confidence to capitalise on new technology platforms. Delta Rec operates by importing data in various formats into a kdb+ database where an XML mapping defines what fields are read, how they are interpreted, what they should be compared with, what rules to apply and what tolerance levels to accept. Results are presented in Dashboards and in reports enabling users to view summaries, drilldown into causes and monitor trends. It has the capability of processing billions of rows of data at high performance levels. Delta Rec imports data from both systems, applies conversion and runs comparison checks Results show matched and unmatched records, errors and their causes, missing data and duplicates - with drilldown to detail A management summary of results for each regression test provides clear visibility into the coverage and results of the test cycles and the quality of the underlying systems Page 6 of 16

7 Delta Rec can also be used for regression testing, black box testing, new releases, parallel runs and EOD or intra-day reconciliations. For Summit upgrades Delta Rec provides particular advantages. As illustrated to the right it reconciles output files from the Reference Environment (current production) against that of the Test Environment (upgrade) in order to identify matches, breaks and duplications. Using multi-day scenario files Delta Rec builds up the workflow steps and status changes that define the trade lifecycle. Using Delta Rec organisations can automate the process of reconciling data between systems and comparing test results against expected outcomes. Key Benefits Highly Configurable & Fully customizable, easy to use dashboards Fully automated and configurable regression tests (FOBO, SWIFT etc. ) Data agnostic - full functionality regardless of data source or asset classes Can be run on a virtual environment Full range of data import mechanisms available; direct links to multiple databases, ftp sites or via file upload Can be used to test other applications from a single instance at no extra cost Page 7 of 16

8 Delta Monitoring To ensure day-to-day operations run smoothly and to schedule, FD has developed a set of monitoring dashboards that provide high level information on the current status of prime indicators and accompanying drilldown capability. Early detection of error or potential threshold breaches enable early intervention and resolution. Monitoring applies to the infrastructure level and to the application process level. Murex is a complex, multi-layered front-to-back application for Financial Institutions that runs on large highavailability multi-server clusters and utilizes Oracle or Sybase as a back-end Database system. Application monitoring and support of such a system requires a mix of UNIX, Database and Product knowledge that is high specialized and difficult to replicate. There are existing support tools that monitor elements of the system and Middleware but none provide a complete system-wide picture. Infrastructure Monitoring provides screens that enable support teams to view metrics and statistics on individual servers at an infrastructure level with configurable alerts to highlight when key indicators like memory utilisation, CPU, queue depths or disk usage have exceed predefined limits. Early detection in this manner enables swift, targeted remedial action by support teams armed with the knowledge of what is wrong, where and why. Some High Availability solution may offer the ability to restart failed processes in a semi-intelligent manner and also help manage the process of failing over a system and its infrastructure onto the backup hardware, however because of the architecture is not Clusteraware and it requires some manual involvement from a skilled support person to transition perfectly to DR hardware. Top 10 league of Memory CPU and Disk utilisation with highlights on threshold breaches or near breaches Individual server status Alerts and trends Queue depths Drilldown information enables users to view underlying data on selected servers and across selected days and dates. In this example, the alert history is displayed to view causes, recurring trends and individual occurrences. This information enables user to not only identify where remedial action is required (for example there is a recurring instance of queue depth build on a particular server) but also to verify if the remedial action taken actually addressed the problem (for example, did the added memory and disk space address the high memory utilisation rates experienced over the last week?) Murex Monitoring: A customisable solution delivering an interface that unifies the disparate set of monitoring technologies and uses a dashboard presentation format to considerably simplify the job of the Support Team. Application Monitoring a sample Murex configuration will comprise many tasks running over multiple servers as in the configuration below. Page 8 of 16

9 Knowing what is running, what is not and how they are performing is a challenging task. FD provides application level monitoring that enables users to view details on engine status, processing backlogs, scheduled tasks, and information on long running queries such as when started and by whom Queue Monitoring Reports & scheduled tasks Server performance Individual Launcher status Long running queries Sample Processes and Launchers monitored Murexnet XML Home / XML Server Amendment Agent Launcherall MxML Exchange Launchers Hub Server Warehouse Processing Script Launcher RTBS Launcher MDCS Launcher Activity Feeders PRINTSRV MXSMC Object Repository MX Distribution MXSMCRISK REPORTSRV Deal Scanner Engine Markit Credit Page 9 of 16

10 Performance Monitoring The Delta Murex Performance Tool tracks key engine performance metrics to give developers, testers, technical analysts & system administrators insight into system dynamics. Metrics include Waiting and Consumed Launcher queues Totals, averages, spike and drop statistics Incoming database figure and throughput processing statistics It also provides a real-time launcher monitoring component to monitor live queues and provide alerts. Drill down provides further information on each process and java component as well as a graphical display of CPU and memory usage Dashboards can be configured to individual display requirements Stress testing capabilities enable users to run volume tests and load scenarios to establish capacity levels, performance thresholds and degradation points. Tests can focus on specific products and trade types to pinpoint causes and effects. Page 10 of 16

11 Configuration Management Robust and accurate processing is not based on functionality alone. It is also based on the supporting configuration that determines how the solution operates; the static data it uses, the workflow it follows, the book structure it enforces. How often has functionality been signed off in one environment only to be rejected in another upon discovery that currency setting, field parsing or Standard Settlement Instructions (SSIs) were different between versions? And from a security and internal audit perspective how is it possible to prove that users, their permissions, LEIs and other critical data have not been changed from the signed off version? To provide such control and visibility into configuration management settings and changes, FD has developed an XML based version control utility. The utility captures configuration files via export handlers and converts them to an XML model that reflects the dependencies and structures of the configuration data. The data itself is stored separately in an XML repository. Utilities are then provided for amending, upgrading and deploying configurations in a controlled, audited manner. By eliminating the human factor in reading and maintaining configurations it introduces accuracy and speed. The utility is not restricted to Murex configuration alone. It can operate on any data accessible via a Java API. By eliminating the human factor in reading and maintaining configuration it introduces accuracy and speed. It enables organisation to establish a baseline configuration across multiple systems: Development, Test, UAT, Production and Disaster Recovery. Supported Murex settings include: Books & Book attributes GOM setup & Static data Pre and Post Workflow Feeds & Feed Mappings Users & User Groups Data Filters within Views Currencies & Settings Curves & Settings Holidays & Audit settings Repeatable reliable deployment and upgrade of configuration settings Full audit trail of configuration changes to enhance quality Swift, simple and controlled methodology to maintain test, development and production environments to a defined status. Easy extendable by xml description and Sink/Source Page 11 of 16

12 Performance Testing Robust and accurate processing is not based on functionality alone. It is also based on the supporting configuration A critical aspect of performance testing is to analyse areas such as Testing environments prior to deployment in both hardware and software: Test how coding and configuration changes will affect the environment Ensure hardware will perform as required, prior to going live Stress-testing to understand the maximum threshold a system can take before performance degradation The FD Performance tool provides a real-time monitoring of queues, wait times and compare these with previous values to track differences and raise alerts where deviations are significant Results from test executions can be compared to understand: How performance is changing in an environment over time How the system scales Overall system efficiency The benefits of changes in a system How launchers interact with one another Real-time data is stored for additional analysis: Reviewing results to find historical system anomalies or bottlenecks Historical data can be used to create baseline indicators to feedback to realtime monitoring Create analytics to understand processing trends Page 12 of 16

13 Case Studies Background: A client approached FD for assistance in deploying a cross system, end to end, highly automated set of regression tests that could be repeated as part of a managed service. Drivers: The client was undertaking multiple upgrades across multi-location and multi-timezone processing units having many different workflows for cross asset front-to-back processing using Calypso and Murex functionalities. In order to meet milestones and reduce operational and project risks they looked to First Derivatives to provide a cross system solution testing within a managed service. The client required automation of their complete set of test cases using regression testing (Delta Rec) and in order to reduce their UAT cycles. What we did: Analysed clients manual test cases to create automated regression test packs. Generated executable test cases to populate and amend the environment, across all component systems. Extended the existing delta suite to include access to additional systems. Used Delta Rec for analysis of any breaks between one system environment and the latest version. Benefits: Client considerably reduced resourcing costs through use of automated technology solutions Client can extend First Derivatives solutions to other trading systems within their architecture Client received an automated regression test pack for future maintenance usage Client will be able to considerably reduce the timelines to upgrade multi processing organisations in multi locations. Background: FD had been working on an FX Murex project as a core part of the project team. The client approached FD to implement a complete QA testing process for all associated products and processes using their model for Quality Assurance services. FD proposed a fully skilled managed Murex team with onsite representation for iterative solutions. Drivers: The client faced a challenge in replacing a fully embedded in-house written system. The clientrequired a highly experienced Murex solution provider who understood their product suite and were fully trained on Murex cross asset features. The client required test cases and test execution which could be achieved within their milestones on time and on budget. In addition the client required expertise in the management of the delivery relationship between Murex and the in-house project team using the preferred Murex user story process within the MXpress installation methodology. What we did: Analysed Business requirements and identified all test cases Developed test scripts and test data Executed all test cases Scaled resourcing based on highly aggressive milestones in order to meet delivery schedule Onsite QA guidance throughout to manage the deliverables and communications within their large organisation. Benefits: Client on target to go live with multiple projects streams QA service delivered at agreed price scales Client received 1000 s of test cases for continuous execution and improvement A fixed price servicing model was offered to scale their delivery team based on the complexity and volume of testing requirements. Page 13 of 16

14 Coming Soon Tools for Murex are continually evolving. The tools below are already in production for other applications are being extended to cover Murex too. Delta Sync: Testing will always be challenged by the comprehensiveness of test coverage and test data. To address the latter, FD has developed Delta Sync, an application that provides data synchronisation between environments to ensure that each version is operating on the same data and experiencing the same volume, burst and load conditions Delta Sync replicates data across systems in a controlled manner. Ideal for UAT and parallel runs to simulate real-world conditions without requiring rekeying. Greatly reduces workload and risk in system upgrades and migrations As messages are sent between applications they are also sent to a monitoring dashboard where the status is tracked and where drilldown provides detail information on each message, its content and current status. In this way users and test managers can confirm the completeness of the synchronization and swiftly investigate the errors it reveals. Delta Sync covers data ranging over trades, user information, lifecycle events and static data including: Cross Asset Trades Trade Lifecycle events Legal Entity with all linked objects Books SDI Quote Values Curves & Currency Pairs Holidays Trade Filters Static Data Filters Workflows User Defaults / User Group allocation Delta Testing Tools: Automation is the key to rigorous, comprehensive and repeatable testing. And reducing cost. FD has developed a range or tools to automate test execution for requirements based testing and regression testing. It has been built by FD architects with extensive experience in Front/Middle and Back Office implementation, full project lifecycle delivery and complex trading and risk applications. The application enables users to define and categorise test case that reflect business requirements and specify expected outcomes. A Test Suite is a named collection of Test Cases for example Swaps book, Internal FX trades, FOBO Recon A Data Set is a tabular document which contains pairs of key and values and will be used together with Documents. A document is a template for test artefacts like trade tickets or SWIFT messages A Matrix Document is a structure used to store test results and expected results Once tests have been executed and expected results are established the test can be re-executed as part of regression test. When used in conjunction with Delta Rec it can be further configured to automate the regression process. Page 14 of 16

15 Near Shore Services FD offers additional cost benefits to its clients by providing its services on a Near Shore as well as on-site basis. All our services, from vendor systems management and software development to infrastructure monitoring and legal and compliance, can be delivered from our high quality service centres where robust technical infrastructures guarantee the required high levels of security, access control and resilience. A compelling feature of the FD s Near Shore approach is its operation from strategically located service centres in Europe, North America and Asia that enables us to offer our Near Shore service on a worldwide basis. The physical proximity affords swift, ad-hoc, on-site deployment of resources where required for specific tasks or projects while the cultural alignment it facilitates ensures the communication process is as streamlined and efficient as possible a critical component of any partnership engagement. This approach therefore provides the client with all the cost benefits of adopting a near shore model while still retaining the advantages of close contact, common time-zone and mobility for face-to-face interaction of on-shore or onsite arrangements as required. Cost Low cost service model Reduced recruitment, training and management overhead Eliminate costs associated with office space, training, hiring, reviews, holiday cover, sick leave, career management Our regional locations ensure a low cost base, guarantee resources in the same time zone and eliminate communication issues. In addition, our staff can be on site within 5 hours when required Capability Highly skilled multi disciplined resources: Lawyers and legal professionals who understand the markets and technology and who can assist not only in the interpretation of data and documentation but also in its sourcing and reporting Avail of industry best practices, procedures and service efficiencies Proven Infrastructure Capacity On-demand capacity giving the ability to ramp-up and ramp-down resources as required Follow-the-Sun support model across worldwide near shore centres Dedicated recruitment and training programmes to ensure continuity Provision for pandemic and other disruptive events Our resources have the elasticity to respond to changes in demand. We provide staff that are highly trained in multiple disciplines and have first-hand expertise on client sites across a variety of projects, systems and assets so that a wealth of knowledge and experience is brought to bear on each assignment. On the infrastructure side, comprehensive Disaster Recovery and Continuity of Business provisioning ensures resilience and robustness of service. VPNs over dedicated bandwidth provide highly secure and resilient access. Segregated areas with dedicated and monitored access points enforce physical security while intrusion detection and vulnerability tests provide protection against host and network attacks. Clustering and failover configurations along with Business Continuity Plans ensure resilience and high availability. To further help clients manage their costs FD offers an embassy model approach to service provision that enables them to select segregation levels appropriate to their level of risk: Gold level offers complete physical and logical separation including dedicated network, phone and power in a standalone facility, Silver offers logical separation within shared facilities while Bronze is appropriate for non-data sensitive related services where segregation is not a priority. Page 15 of 16

16 Delta Suite Delta is a powerful Big Data platform, offering capabilities in reference data management, market data management, CEP, algorithmic and high-frequency trading, FX trading, treasury risk management and exchange management surveillance. Deployed in some of the world s largest banks, exchanges and hedge funds, Delta applications are designed for Volume and Velocity low-latency, high-throughput applications delivered as a hosted service or deployed locally. FD provides a range of brochures on its products and services. For more information please contact us via our website or the numbers below Contact Us New York +1 (212) Europe +44 (28) Asia-Pacific [email protected] This information is subject to change without notice and is offered for information purposes only. Page 16 of 16