Going to the wire: The next generation financial risk management platform



Similar documents
Research Report: The Arista 7124FX Switch as a High Performance Trade Execution Platform

Dataflow Programming with MaxCompiler

High-performance vswitch of the user, by the user, for the user

Evaluation Report: Emulex OCe GbE and OCe GbE Adapter Comparison with Intel X710 10GbE and XL710 40GbE Adapters

Oracle SDN Performance Acceleration with Software-Defined Networking

Enabling Technologies for Distributed Computing

Enabling Technologies for Distributed and Cloud Computing

Michael Kagan.

Application Delivery Testing at 100Gbps and Beyond

D1.2 Network Load Balancing

Cisco for SAP HANA Scale-Out Solution on Cisco UCS with NetApp Storage

Unified Computing Systems

High-Density Network Flow Monitoring

News and trends in Data Warehouse Automation, Big Data and BI. Johan Hendrickx & Dirk Vermeiren

Datacenter Operating Systems

Frequently Asked Questions

Intel DPDK Boosts Server Appliance Performance White Paper

Cisco UCS and Fusion- io take Big Data workloads to extreme performance in a small footprint: A case study with Oracle NoSQL database

QoS & Traffic Management

The virtualization of SAP environments to accommodate standardization and easier management is gaining momentum in data centers.

Analyzing Full-Duplex Networks

SMB Direct for SQL Server and Private Cloud

Accelerating Microsoft Exchange Servers with I/O Caching

FNT EXPERT PAPER. // From Cable to Service AUTOR. Data Center Infrastructure Management (DCIM)

Building Enterprise-Class Storage Using 40GbE

Benefits of multi-core, time-critical, high volume, real-time data analysis for trading and risk management

TYLER JUNIOR COLLEGE School of Continuing Studies 1530 SSW Loop 323 Tyler, TX

Achieving Nanosecond Latency Between Applications with IPC Shared Memory Messaging

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Seeking Opportunities for Hardware Acceleration in Big Data Analytics

Xeon+FPGA Platform for the Data Center

Observer Probe Family

Comparing SMB Direct 3.0 performance over RoCE, InfiniBand and Ethernet. September 2014

Digitale Signalverarbeitung mit FPGA (DSF) Soft Core Prozessor NIOS II Stand Mai Jens Onno Krah

Trading and risk management: Benefits of time-critical, real-time analysis on big numerical data

LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance

Elasticsearch on Cisco Unified Computing System: Optimizing your UCS infrastructure for Elasticsearch s analytics software stack

Accelerating High-Speed Networking with Intel I/O Acceleration Technology

Demartek June Broadcom FCoE/iSCSI and IP Networking Adapter Evaluation. Introduction. Evaluation Environment

Pluribus Netvisor Solution Brief

Nexenta Performance Scaling for Speed and Cost

Accelerating I/O- Intensive Applications in IT Infrastructure with Innodisk FlexiArray Flash Appliance. Alex Ho, Product Manager Innodisk Corporation

Wire-speed Packet Capture and Transmission

The Future of Computing Cisco Unified Computing System. Markus Kunstmann Channels Systems Engineer

Data Center Network Evolution: Increase the Value of IT in Your Organization

Vormetric and SanDisk : Encryption-at-Rest for Active Data Sets

Best Practises for LabVIEW FPGA Design Flow. uk.ni.com ireland.ni.com

Lustre Networking BY PETER J. BRAAM

Brocade Solution for EMC VSPEX Server Virtualization

Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software

Cisco, Citrix, Microsoft, and NetApp Deliver Simplified High-Performance Infrastructure for Virtual Desktops

Increase Database Performance by Implementing Cirrus Data Solutions DCS SAN Caching Appliance With the Seagate Nytro Flash Accelerator Card

State of the Art Cloud Infrastructure

How To Set Up Foglight Nms For A Proof Of Concept

Business Case for BTI Intelligent Cloud Connect for Content, Co-lo and Network Providers

Performance Evaluation of VMXNET3 Virtual Network Device VMware vsphere 4 build

PRIMERGY server-based High Performance Computing solutions

10G Ethernet: The Foundation for Low-Latency, Real-Time Financial Services Applications and Other, Future Cloud Applications

Your Old Stack is Slowing You Down. Ajay Patel, Vice President, Fusion Middleware

White Paper. Innovate Telecom Services with NFV and SDN

INUVIKA OPEN VIRTUAL DESKTOP FOUNDATION SERVER

White Paper. Recording Server Virtualization

Linux NIC and iscsi Performance over 40GbE

PROPRIETARY CISCO. Cisco Cloud Essentials for EngineersV1.0. LESSON 1 Cloud Architectures. TOPIC 1 Cisco Data Center Virtualization and Consolidation

10/100/1000Mbps Ethernet MAC with Protocol Acceleration MAC-NET Core with Avalon Interface

Definition of a White Box. Benefits of White Boxes

Virtualization, SDN and NFV

APT Integrated risk management for the buy-side

Copyright 2015 EMC Corporation. All rights reserved.

Extending the Power of FPGAs. Salil Raje, Xilinx

Technical Brief. DualNet with Teaming Advanced Networking. October 2006 TB _v02

Microsoft SQL Server 2012 on Cisco UCS with iscsi-based Storage Access in VMware ESX Virtualization Environment: Performance Study

How To Speed Up A Flash Flash Storage System With The Hyperq Memory Router

Affording the Upgrade to Higher Speed & Density

White Paper. SAP NetWeaver Landscape Virtualization Management on VCE Vblock System 300 Family

Observer Probe Family

Quantum StorNext. Product Brief: Distributed LAN Client

Solving I/O Bottlenecks to Enable Superior Cloud Efficiency

Wireshark in a Multi-Core Environment Using Hardware Acceleration Presenter: Pete Sanders, Napatech Inc. Sharkfest 2009 Stanford University

Bivio 7000 Series Network Appliance Platforms

Radware ADC-VX Solution. The Agility of Virtual; The Predictability of Physical

Scaling from Datacenter to Client

Enhance Service Delivery and Accelerate Financial Applications with Consolidated Market Data

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010

Network Instruments white paper

Achieving Real-Time Business Solutions Using Graph Database Technology and High Performance Networks

COMPUTING. Centellis Virtualization Platform An open hardware and software platform for implementing virtualized applications

Scaling Objectivity Database Performance with Panasas Scale-Out NAS Storage

Hyper-converged IT drives: - TCO cost savings - data protection - amazing operational excellence

Informatica Ultra Messaging SMX Shared-Memory Transport

SDN CENTRALIZED NETWORK COMMAND AND CONTROL

Simplifying Big Data Deployments in Cloud Environments with Mellanox Interconnects and QualiSystems Orchestration Solutions

Visibility in the Modern Data Center // Solution Overview

Ericsson Introduces a Hyperscale Cloud Solution

Transcription:

Going to the wire: The next generation financial risk management platform Ari Studnitzer, MD of Platform Development, CME Group Oskar Mencer, CEO and Founder, Maxeler

CME Group CME Group is the world s leading and most diverse derivatives marketplace handling 3 billion contracts worth approximately $1 quadrillion annually, on average. We bring buyers and sellers together through our CME Globex electronic trading platform and our trading facilities in Chicago and New York. Global Products CME Group exchanges offer the widest range of global benchmark products across all major asset classes, including futures and options based on interest rates, equity indexes, foreign exchange, energy, agriculture commodities, metals, weather and real estate. Clearing CME Group operates CME Clearing, one of the world s leading central counterparty clearing providers. We are the guarantor of every transaction that happens in our markets, providing unparalleled safety and soundness for our customers. Through our CME Globex electronic trading platform, users worldwide are able to access the broadest array of the most liquid financial derivatives markets available anywhere. In addition, CME Globex offers speed of execution, transparency anonymity and market integrity. This makes up around 80% of all trades at CME. Electronic Trading 2013 CME Group. All rights reserved 2

2013 CME Group. All rights reserved 3

2013 CME Group. All rights reserved 4

2013 CME Group. All rights reserved 5

An Era of Convergence across Multiple Industries Enabled by Technology * Devices + Mobility Single Mobile Device Telephone, Video, Television, Movies, Music, Books, Infrastructure, Software, + Internet Digital Streaming Media + Internet Cloud Computing Trading Order Entry + Market Controls Enhanced Pre-Trade Risk Management Software OTC and Portfolio Margining + Hardware Central + Counterparty Clearing High Performance Computing Enhanced Post-Trade Risk Management 2013 CME Group. All rights reserved 6

Next Generation Risk Management Enables the Future of Financial Industry Convergence CME Group is uniquely positioned as a global leader in the derivatives marketplace to lead the next generation of risk management in support of enhanced market controls and the global mandates for central clearing Predictability Market Integrity Efficiency Analytics Scalability High-resolution mark to market processes Real-time, event-driven monitoring Complex computational modeling Risk management controls (Credit Controls) Increasing growth and frequency of financial market data Reduced total cost of ownership (TCO) 2013 CME Group. All rights reserved 7

How To Handle The Growing Data Trend 2013 CME Group. All rights reserved 8

FPGA Dataflow Engines (DFEs) Enable the Next Generation of Financial Risk Management Maxeler s MaxCompiler facilitates the convergence of hardware and software without the traditional tradeoffs for Advanced Risk Management Area Software Hardware Challenges Interrupts Resource Starvation Architecture Something Block Design [Insert Your Best Practice] Code complexity Skillset availability RTL Diagrams w/ Flow Control Code Entry Java VHDL/Verilog Unit Tests JUnit Simulation Test Vectors Design Debugging Java Debug Simulation Design Test Test / QA Java Hardware Allows existing software & support teams to program in hardware Supports agile, pure software SDLC Increases productivity and cost efficiency MaxCompiler Streaming Manager / Kernel Diagrams MaxJ/Java Kernel Tests Simulated DFE and MaxDebug DFE + MaxDebug Deployment Binary Flash cards / Cable 2013 CME Group. All rights reserved Binary 9

10 HW layer Three Software Layers The Multiscale Dataflow Computer decoupling the data plane and control plane Multiscale Dataflow Computing Platforms Risk Analytics Software Platform MaxIDE MaxCompiler Seismic Imaging Software Platform Trading Transactions Software Platform MaxSkins MatLab,Python,R,Excel,C/C++,Fortran Linux based MaxelerOS: Realtime communication management Controlflow Box: conventional CPUs Fast Interconnect Dataflow Box: Custom Intelligent Memory System

Software Layer for Programming Dataflow Boxes Multiscale hardware design, as simple as writing software MaxCompiler is a Dataflow Engine design library which is powered by Java It comes with a fully integrated Development Environment based on Eclipse called MaxIDE MaxSkins enable runtime integration with almost any language! CPU code Dataflow Manager DFE code 11

Computing with Multiscale Dataflow Engines (DFEs) Multiscale Dataflow Computing enables the optimization of Compute intensive applications on the bit level, the architecture level, the memory system level, and the networking level, and the storage level. 12

Risk Analytics Platform Combine Trading and Risk in a unified platform Moving risk computations from local overnight to corporation global in real-time, moving traders from looking back to looking forward. Market Data Trade Data Prop. Customer Data Real-time risk reports Wall Street Journal, Maxeler Makes Waves With Dataflow Design, American Finance Technology Award, New York, Dec 2011 13

Client input data Spot Market Random Bumps Historical Risk Analytics Platform Architecture 14 Maxeler s finance appliance accepts client input data and generates required risk management data at any and all requested levels of aggregation. Scenario analysis can be either permutative, combinatorial, adhoc or Monte Carlo. The finance appliance is fully scalable to client requirements. Maxeler s finance library provides accelerated analytics for valuation and risk management across all major asset classes Historical Markets Bump Scenarios Monte Carlo Market Scenarios Bootstrap Market Curves Pricing Engine Price Scenarios Risk Analysis Results Aggregation Client input data Market Instruments Cashflow Generator Trade Portfolio Cashflow Generator Maxeler Finance Appliance functionality and information flow Client generated risk management data is passed to client risk database for analysis

MaxelerOS Risk Analytics Platform Architecture Maxeler s risk management system provides full functionality for users to specify and drive high-level business logic. Integration with existing client data, output and reporting is via a flexible interface layer. Client specified but Maxeler risk system generated risk parameters High Level Business Logic (e.g. Scenario parameterisation) Distribution Layer (Risk Engine Framework) Scenario and Report Generation Business Logic (e.g. Curve Bumping, HVAR scenarios) Maxeler Analytics Custom Analytics Maxeler Accelerated Analytics 15

Exchanges CME, Eurex etc DFE Programming Enables Real-Time Risk Management of Trading Strategies Spot Market Random Bumps Historical TCP FIX Trading Strategy Historical Markets Market Scenarios Market Instruments Bootstrap Cashflow Generator UDP FAST Decoding Order- Book Building Bump Scenarios Monte Carlo Market Curves Pricing Engine Price Scenarios Trade Portfolio Cashflow Generator Risk Analysis Results Aggregation Maxeler Finance Appliance functionality and information flow 16

Financial Gateway Platform Maxeler provides Hardware, Software and Exchange/Trading interfaces, as well as financial data infrastructure Customers use MaxIDE and Java to write own risk management algorithms, security checks, credit checks that process at line rate Public customer: JP Morgan Equities Direct Market Access MaxCompiler enables unprecedented programmability of the dataplane. User Decision-Engine is fully programmable and executes in 3us All infrastructure (TCP/IP, feedhandlers, performance etc.) is managed by Maxeler, allowing the customer to focus on their business. 17

MaxCompiler Dataflow kernels using MaxCompiler powered by java MaxJava Code Output[ TTL ] <== Input[ TTL ] - 1; Corresponding Dataflow graph # Input Output [ TTL ] -1 18

Dataflow Description FrameData<SimpleInput> inputframe = io.frameinput("input", simpleinputtype, simplelinktype); Data Flow Kernel Input DFEVar index = inputframe["index"]; DFEStruct routingdata = mem.rommapped("routingtable", index, routinginfotype); DFEVar outputport = routingdata.get("outputport"); io.frameoutput("outa", outputport === 'A') <== inputframe; io.frameoutput("outb", outputport === 'B') <== inputframe; Out A A index Routing Table == == B Out B 19

User defined I/O routing Data Flow Engine DFELink cpuframe = addframedstreamfromcpu("cpuframe"); UDP MAC SFP1 UDPStream sfp1 = addudpstream( udp, NetworkConnection.SFP1); MAC SFP2 sfp1.gettransmitstream() <== cpuframe; EthernetStream sniff = addethernetstream("sniff", NetworkConnection.SFP2); cpuframe sfp2 addframedstreamtocpu( sfp2 ) <== sniff.getreceivestream(); PCIe 20

Mix and Match UDP MAC SFP1 Kernel A DRAM Kernel C TCP MAC SFP2 Kernel B PCIe 21

From Graphs to Hardware 1 Design your kernels with MaxCompile r.maxj Files 2 Compile Using MaxCompile r MaxJava Compiler 3 A Java Executable is Generated 6.max File Final output is generated * Fully Automated DFE Generator Executable Vendor Tools HDL Files 4 Running the Executable first Generates HDL 5 Then, It calls the Vendor tools 22

From.max to Application 1.max file generated previously 2 Convert it to a.o file.max File Maxfile Compile.o File 3 Compile application code Executable Application Standard Compiler (gcc).c Application Source Files 5 Linker produces the final output 4 MaxelerOS Libraries Link with MaxelerOS Libraries and.o File 23

Simulation Switching between the two flows is trivial.maxj Files Target a Simulation model of the Hardware Simulation Flow Hardware Flow Target Physical Hardware 24 Cycle accurate model of Hardware Total Visibility Builds in a few minutes 1000x faster than other simulations Does not require hardware No Code changes compared to hardware Software engineering methodologies.max File Incredibly Fast Just Works

Predictable and Consistent Processing Phys. Port 10GE MAC TCP/IP Kernel TCP/IP 10GE MAC Phys. Port Measurement Details: Dual passive-optical fiber taps, 50/50 50um Timestamping card on RX and TX fibers 50B payload in standard TCP/IP packets Timestamps measured after last bit of frame received TCP, IP and Ethernet checksums calculated and checked Measurements valid up to line rate 25

Maxeler Hardware Solutions CPUs plus DFEs Intel Xeon CPU cores and up to 6 DFEs with 288GB of RAM DFEs shared over Infiniband Up to 8 DFEs with 768GB of RAM and dynamic allocation of DFEs to CPU servers Low latency connectivity Intel Xeon CPUs and 1-2 DFEs with up to six 10Gbit Ethernet connections MaxWorkstation Desktop development systems MaxCloud On-demand scalable accelerated compute resource, hosted in London 26