Your Old Stack is Slowing You Down Ajay Patel, Vice President, Fusion Middleware
MORE THAN 80% OF THE TRADING APPLICATIONS IN INVESTMENT BANKS ARE WRITTEN IN JAVA AND THEY ONLY CARE ABOUT PERFORMANCE!
In a recent survey.. 71.6 percent of respondents rated latency as crucially important Of those, 13.8 percent need the lowest possible latency The other 57.8 percent indicated they don t necessarily need to be the very fastest, but being slower does impact negatively on trading profits. Source : 2011 Automated Trader Algorithmic Trading Survey
What Problems are they trying to Solve? Performance Latency (managed trade-off with throughput) Determinism Time to Market Algo Profitability Window Fast Application Development Fast Deployment Changes through re-use not re-write Sustainability Number of moving parts Integration Heterogeneous APIs Less Interfaces and Abstractions Patching and Support Optimization and Re-Optimization to achieve low latency, performance & scalability Skillset availability & specialization Difficult to instrument all moving parts and interfaces, and difficult to assess impact of performance modifications
How fast do you need to go? Sell-side Brokers Traditional buy-side Trading Firms µsec Proprietary Trading Sponsored Access Alternative Execution Services Option Pricing Prime Brokerage services Cash Equity & Derivative Market Making Futures Index Arbitrage Options Trading Statistical Arbitrage msec Direct Market Access Alternative Execution Services Algorithmic Trading Option Pricing Dark Pools Prime Brokerage services Algorithmic Trading using own OMS to reduce market impact (Insurance Funds & Mutual Funds) FX Arbitrage Fixed Income Arbitrage 10 msec FX and Fixed Income Pricing Agency Brokerage Block Trading Risk Trading Algorithmic Trading using Sell-side EMS (Insurance Funds, Mutual Funds, Pension Funds & Investment Management) Hedge Funds 100s msec Risk Management Syndication and Origination Interest Rate Derivatives Other structured products Portfolio Valuations Pension Funds Corporate Treasuries Wealth Management Weeks Workstations Workstations Workstations Source : Citihub
Messaging Infrastructure Electronic Trading in Context Venues and Counterparties Market Data Orders & Indications FEED HANDLERS TICK CAPTURE MARKET AGGREGATION & FILTERING RISK & ANALYTICS STORED DATA ALGORITHMIC TRADING SETTLEMENT Reference Policies OMS EMS Positions Pricing History SMART ORDER ROUTING FIX CONNECTIVITY 6 Copyright 2011, Oracle and/or its affiliates. All rights
Your Old Stack Was designed for flexibility Component abstraction Limited dependencies Best of breed components to maintain ultimate performance Specialized resources integrating components Rip & Replace capability Is Slowing you down!!! Takes ages to procure & deploy Has multiple APIs and Interfaces which add latency Has duplicated functionality between components Still has component lock-in because of dedicated code Costs a fortune to support and is risky in terms of patches & problem solving Takes multiple rounds of tuning to eek out the best performance 7 Copyright 2011, Oracle and/or its affiliates. All rights
Build your own? Complex, long and costly Bits from different suppliers. Need lots of expertise to put it together and not necessarily the fastest performing solution Or get it straight from the factory? Tuned to perfection Every thing working in harmony Perfectly architected One dealer to buy from, service, maintain... Puts focus back on the Trading Applications 9 Copyright 2011, Oracle and/or its affiliates. All rights
Oracle Exalogic Elastic Cloud Extreme performance for Java applications Full-featured, ready-to-deploy, high performance infrastructure for Trading Applications Engineered System with best ROI
Fundamental Value of Engineered Systems Easy, predictable 100 s of Components 1 Machine 1000 s of Hours 1 Day Copyright 2011 Oracle Corporation - Proprietary and Confidential
Oracle Extreme Java Trading Platform What is it? Engineered Infrastructure for capital markets Applications Platform to build applications; not an application Exalogic EECS, Coherence, OCEP, TimesTen, JRockit Real-Time 1. Faster Java + Faster Messaging = Lower Latency 2. Engineered system for Java Applications = better time to market 3. Engineered system with uniform patching & maintenance = sustainable platform 12 Copyright 2011, Oracle and/or its affiliates. All rights
Oracle Extreme Java Trading Platform Exalogic Engineered System OCEP TIMESTEN COHERENCE Java SE Suite - JRockit and HotSpot Exalogic Elastic Cloud Software Oracle Linux and/or Solaris Exalogic Hardware EL X2-2 Factory Assembled and Tested Optimized for Exalogic, Installed on demand
Accelerating Java Trading Apps Exalogic Engineered System Integrated Storage Shared storage for applications Clustered for HA 40 TB SAS disk 4 TB read / 72 GB write cache InfiniBand I/O Fabric and 10GbE/GbE 40 Gb/sec links; 1.2 µsec latency (MPI Ping) 10 GigE external connectivity Compute Nodes 30 compute nodes; 360 cores (2.93 GHz) 2.8 TB DRAM 960 GB SSD Flash Accelerated Fully Redundant Balanced for Performance EL X2-2 14 Copyright 2011, Oracle and/or its affiliates. All rights
Why Infiniband Networking for Trading Apps? Low Latency Features RDMA & Kernel Bypass Applications move messages, not streams of data Applications read/write directly to virtual memory addresses of remote applications Zero buffer copies between OS layers Zero Context switches 100% Deterministic Network Messaging unlike Ethernet Flow control: Unlike TCP/IP s lossy f/c, in IB the link layer will not send out data until it s sure that there is a place for the data to land - No need to wait for an ACK Large Packet Sizes (64K not 4K) Fewer Processor Interrupts Most of the work is done on the NIC (HCA) Processors freed from processing network traffic & interrupts NIC does not place bytes into an OS buffer and OS does not copy bytes into application buffers and interrupt applications Up to 12x Performance Improvement 15 Copyright 2011, Oracle and/or its affiliates. All rights
Exalogic Elastic Cloud Software Low Latency, High Performance, and Simple Management Enterprise Manager FMW and Business Applications WebLogic Exabus SDP API Exalogic Elastic Cloud Software 2.0 Exabus Coherence Exabus Java API Exalogic Control Oracle VM Tuxedo Exabus RDMA API Traffic Director Exalogic Elastic Cloud X2-2 Hardware Virtual Assembly Builder Copyright 2011 Oracle Corporation 16
Exabus - High Speed Network Virtualization Direct Memory I/O for Java and C++ Standard Hardware I/O Exabus Application Application Application Application Application Buffer Application Buffer Copy TCP IP Transport Kernel 20% Buffer Copies 40% Transport Processing 40 % Kernel Context Switches Zero Buffer Copy Direct Memory Access Kernel Bypass 4X Throughput, 6X Lower Latency 17 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
New Exabus Java and C++ APIs Next-generation of Exalogic performance optimization New C++ and Java APIs for maximum application I/O performance Messagebus API accelerates Coherence RDMA API accelerates Tuxedo SDP API accelerates WebLogic Coherence Exabus Java APIs Messagebus WebLogic Exalogic SDP Exabus RDMA (C++ API) Tuxedo Exabus InfiniBand Core Hardware and Firmware New for EECS 2.0 Exalogic EECS 1.0 Any Linux or Solaris App. TCP/IP EoIB IPoIB 18
Oracle VM 3.0 for Exalogic Native Exabus Integration with SR-IOV Secure segregation of traffic for specific VM guests Optimized I/O performance 1. Inbound traffic is sent to correct guest VM 2. Guest VM is configured to use selected dedicated virtual function on HCA 3. Subsequent traffic flows directly between guest VM and physical HCA port Guest VM Device Driver 2 Virtual Function 3 1 Guest VM Device Driver Virtual Switch Device Driver Physical Function Physical I/O Port Guest VM Device Driver OVM Server Virtual Function Exalogic HCA 19
Exalogic Elastic Cloud 2.0 Performance Even Better Performance 3.5X Web Requests/Sec. JMS Messages/sec. Enterprise Java Operations/Sec. 836,520 10X 1,979,940 5X 49,460 5X 78,840 401,070 9,560 Standard Hardware Exalogic Standard Hardware Exalogic Standard Hardware Exalogic 20 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Exalogic: Oracle s Extreme Java Trading Platform 1 2 3 4 Best performance at each layer of the stack Modular construction; Protection of existing technology investments All components designed to work together - Integrated into a comprehensive pre-optimized Engineered Solution Vertical integration hard for customers to replicate! 21 Copyright 2011, Oracle and/or its affiliates. All rights
Java SE Design Objectives Write Once Run Anywhere Optimize Java for New Application Models & New Hardware Enhance Productivity for Java Developers Enable Flexible and Smaller Deployment Through Modularization Improve Performance, Monitoring & Diagnostics Enhance Java Platform for Multiple Languages 22 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
NetBeans 7 Java SE 7 Support more JDK Roadmap JDK 7 JDK 7u2 JRE 7 on java.com JavaFX 2.0 co-install Last Public JDK 6 Update JDK 7u6 OSX JRE Port (for end-users) Improved OS integration, auto-update NetBeans.next Java SE 8 Support JavaFX 3.0 Support more 2011 2012 2013 2014 Mac OSX JDK 7 Developer Preview Java FX 2.0 Dev Preview NetBeans 7.1 JavaFX 2.0 Support JDK 7u4 OSX JDK Port (for developers) JDK 8 Windows, Linux, Solaris, OSX, Embedded Platforms Jigsaw Lambda JavaFX 3.0 Complete Oracle JVM Convergence JavaScript Interop more 23 Copyright 2011, Oracle and/or its affiliates. All rights reserved.
Extreme Java Platform for Trading Advantages 1 Performance In The Box: pre-integrated, preoptimized, pre-tested solution Exalogic Elastic Cloud Software - The Secret Sauce 2 Faster application Time To Market (reduced integration and testing efforts) 3 Sustainability (reduced risk and lower TCO)