Your Old Stack is Slowing You Down. Ajay Patel, Vice President, Fusion Middleware

Size: px

Start display at page:

Download "Your Old Stack is Slowing You Down. Ajay Patel, Vice President, Fusion Middleware"

Fay Ball
8 years ago
Views:

1 Your Old Stack is Slowing You Down Ajay Patel, Vice President, Fusion Middleware

2 MORE THAN 80% OF THE TRADING APPLICATIONS IN INVESTMENT BANKS ARE WRITTEN IN JAVA AND THEY ONLY CARE ABOUT PERFORMANCE!

3 In a recent survey percent of respondents rated latency as crucially important Of those, 13.8 percent need the lowest possible latency The other 57.8 percent indicated they don t necessarily need to be the very fastest, but being slower does impact negatively on trading profits. Source : 2011 Automated Trader Algorithmic Trading Survey

8 percent need the lowest possible latency The other 57.

4 What Problems are they trying to Solve? Performance Latency (managed trade-off with throughput) Determinism Time to Market Algo Profitability Window Fast Application Development Fast Deployment Changes through re-use not re-write Sustainability Number of moving parts Integration Heterogeneous APIs Less Interfaces and Abstractions Patching and Support Optimization and Re-Optimization to achieve low latency, performance & scalability Skillset availability & specialization Difficult to instrument all moving parts and interfaces, and difficult to assess impact of performance modifications

Deployment Changes through re-use not re-write Sustainability Number of moving parts Integration Heterogeneous APIs Less Interfaces and

5 How fast do you need to go? Sell-side Brokers Traditional buy-side Trading Firms µsec Proprietary Trading Sponsored Access Alternative Execution Services Option Pricing Prime Brokerage services Cash Equity & Derivative Market Making Futures Index Arbitrage Options Trading Statistical Arbitrage msec Direct Market Access Alternative Execution Services Algorithmic Trading Option Pricing Dark Pools Prime Brokerage services Algorithmic Trading using own OMS to reduce market impact (Insurance Funds & Mutual Funds) FX Arbitrage Fixed Income Arbitrage 10 msec FX and Fixed Income Pricing Agency Brokerage Block Trading Risk Trading Algorithmic Trading using Sell-side EMS (Insurance Funds, Mutual Funds, Pension Funds & Investment Management) Hedge Funds 100s msec Risk Management Syndication and Origination Interest Rate Derivatives Other structured products Portfolio Valuations Pension Funds Corporate Treasuries Wealth Management Weeks Workstations Workstations Workstations Source : Citihub

Making Futures Index Arbitrage Options Trading Statistical Arbitrage msec Direct Market Access Alternative Execution Services Algorithmic Trading Option Pricing Dark Pools Prime Brokerage services

6 Messaging Infrastructure Electronic Trading in Context Venues and Counterparties Market Data Orders & Indications FEED HANDLERS TICK CAPTURE MARKET AGGREGATION & FILTERING RISK & ANALYTICS STORED DATA ALGORITHMIC TRADING SETTLEMENT Reference Policies OMS EMS Positions Pricing History SMART ORDER ROUTING FIX CONNECTIVITY 6 Copyright 2011, Oracle and/or its affiliates. All rights

ANALYTICS STORED DATA ALGORITHMIC TRADING SETTLEMENT Reference Policies OMS EMS Positions

Your Old Stack Was designed for flexibility Component abstraction Limited dependencies Best of breed components to maintain ultimate performance Specialized resources integrating components Rip &

7 Your Old Stack Was designed for flexibility Component abstraction Limited dependencies Best of breed components to maintain ultimate performance Specialized resources integrating components Rip & Replace capability Is Slowing you down!!! Takes ages to procure & deploy Has multiple APIs and Interfaces which add latency Has duplicated functionality between components Still has component lock-in because of dedicated code Costs a fortune to support and is risky in terms of patches & problem solving Takes multiple rounds of tuning to eek out the best performance 7 Copyright 2011, Oracle and/or its affiliates. All rights

!! Takes ages to procure & deploy Has multiple APIs and Interfaces which add latency Has duplicated functionality between components Still has component

8 Build your own? Complex, long and costly Bits from different suppliers. Need lots of expertise to put it together and not necessarily the fastest performing solution Or get it straight from the factory? Tuned to perfection Every thing working in harmony Perfectly architected One dealer to buy from, service, maintain... Puts focus back on the Trading Applications 9 Copyright 2011, Oracle and/or its affiliates. All rights

9 Oracle Exalogic Elastic Cloud Extreme performance for Java applications Full-featured, ready-to-deploy, high performance infrastructure for Trading Applications Engineered System with best ROI

11 Oracle Extreme Java Trading Platform What is it? Engineered Infrastructure for capital markets Applications Platform to build applications; not an application Exalogic EECS, Coherence, OCEP, TimesTen, JRockit Real-Time 1. Faster Java + Faster Messaging = Lower Latency 2. Engineered system for Java Applications = better time to market 3. Engineered system with uniform patching & maintenance = sustainable platform 12 Copyright 2011, Oracle and/or its affiliates. All rights

EECS, Coherence, OCEP, TimesTen, JRockit Real-Time 1. Faster Java + Faster Messaging = Lower Latency 2.

Oracle Extreme Java Trading Platform Exalogic Engineered System OCEP TIMESTEN COHERENCE Java SE Suite - JRockit and HotSpot Exalogic Elastic

12 Oracle Extreme Java Trading Platform Exalogic Engineered System OCEP TIMESTEN COHERENCE Java SE Suite - JRockit and HotSpot Exalogic Elastic Cloud Software Oracle Linux and/or Solaris Exalogic Hardware EL X2-2 Factory Assembled and Tested Optimized for Exalogic, Installed on demand

Elastic Cloud Software Oracle Linux and/or Solaris Exalogic Hardware

Accelerating Java Trading Apps Exalogic Engineered System Integrated Storage Shared storage for applications Clustered for HA 40 TB SAS disk 4 TB read / 72 GB write cache InfiniBand I/O Fabric and

13 Accelerating Java Trading Apps Exalogic Engineered System Integrated Storage Shared storage for applications Clustered for HA 40 TB SAS disk 4 TB read / 72 GB write cache InfiniBand I/O Fabric and 10GbE/GbE 40 Gb/sec links; 1.2 µsec latency (MPI Ping) 10 GigE external connectivity Compute Nodes 30 compute nodes; 360 cores (2.93 GHz) 2.8 TB DRAM 960 GB SSD Flash Accelerated Fully Redundant Balanced for Performance EL X Copyright 2011, Oracle and/or its affiliates. All rights

2 µsec latency (MPI Ping) 10 GigE external connectivity Compute Nodes 30 compute nodes; 360 cores (2.93 GHz) 2.

14 Why Infiniband Networking for Trading Apps? Low Latency Features RDMA & Kernel Bypass Applications move messages, not streams of data Applications read/write directly to virtual memory addresses of remote applications Zero buffer copies between OS layers Zero Context switches 100% Deterministic Network Messaging unlike Ethernet Flow control: Unlike TCP/IP s lossy f/c, in IB the link layer will not send out data until it s sure that there is a place for the data to land - No need to wait for an ACK Large Packet Sizes (64K not 4K) Fewer Processor Interrupts Most of the work is done on the NIC (HCA) Processors freed from processing network traffic & interrupts NIC does not place bytes into an OS buffer and OS does not copy bytes into application buffers and interrupt applications Up to 12x Performance Improvement 15 Copyright 2011, Oracle and/or its affiliates. All rights

between OS layers Zero Context switches 100% Deterministic Network Messaging unlike Ethernet Flow control: Unlike TCP/IP s lossy f/c, in IB the link layer will not send out data until it s sure that

15 Exalogic Elastic Cloud Software Low Latency, High Performance, and Simple Management Enterprise Manager FMW and Business Applications WebLogic Exabus SDP API Exalogic Elastic Cloud Software 2.0 Exabus Coherence Exabus Java API Exalogic Control Oracle VM Tuxedo Exabus RDMA API Traffic Director Exalogic Elastic Cloud X2-2 Hardware Virtual Assembly Builder Copyright 2011 Oracle Corporation 16

0 Exabus Coherence Exabus Java API Exalogic Control Oracle VM Tuxedo Exabus RDMA API Traffic

16 Exabus - High Speed Network Virtualization Direct Memory I/O for Java and C++ Standard Hardware I/O Exabus Application Application Application Application Application Buffer Application Buffer Copy TCP IP Transport Kernel 20% Buffer Copies 40% Transport Processing 40 % Kernel Context Switches Zero Buffer Copy Direct Memory Access Kernel Bypass 4X Throughput, 6X Lower Latency 17 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

Kernel 20% Buffer Copies 40% Transport Processing 40 % Kernel Context Switches Zero Buffer Copy Direct Memory

17 New Exabus Java and C++ APIs Next-generation of Exalogic performance optimization New C++ and Java APIs for maximum application I/O performance Messagebus API accelerates Coherence RDMA API accelerates Tuxedo SDP API accelerates WebLogic Coherence Exabus Java APIs Messagebus WebLogic Exalogic SDP Exabus RDMA (C++ API) Tuxedo Exabus InfiniBand Core Hardware and Firmware New for EECS 2.0 Exalogic EECS 1.0 Any Linux or Solaris App. TCP/IP EoIB IPoIB 18

accelerates WebLogic Coherence Exabus Java APIs Messagebus WebLogic Exalogic SDP Exabus RDMA (C++ API) Tuxedo

Oracle VM 3.0 for Exalogic Native Exabus Integration with SR-IOV Secure segregation of traffic for specific VM guests Optimized I/O performance 1. Inbound traffic is sent to correct guest VM 2.

18 Oracle VM 3.0 for Exalogic Native Exabus Integration with SR-IOV Secure segregation of traffic for specific VM guests Optimized I/O performance 1. Inbound traffic is sent to correct guest VM 2. Guest VM is configured to use selected dedicated virtual function on HCA 3. Subsequent traffic flows directly between guest VM and physical HCA port Guest VM Device Driver 2 Virtual Function 3 1 Guest VM Device Driver Virtual Switch Device Driver Physical Function Physical I/O Port Guest VM Device Driver OVM Server Virtual Function Exalogic HCA 19

Inbound traffic is sent to correct guest VM 2. Guest VM is configured to use selected dedicated virtual function on HCA 3.

19 Exalogic Elastic Cloud 2.0 Performance Even Better Performance 3.5X Web Requests/Sec. JMS Messages/sec. Enterprise Java Operations/Sec. 836,520 10X 1,979,940 5X 49,460 5X 78, ,070 9,560 Standard Hardware Exalogic Standard Hardware Exalogic Standard Hardware Exalogic 20 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

836,520 10X 1,979,940 5X 49,460 5X 78,840 401,070 9,560 Standard Hardware Exalogic

Exalogic: Oracle s Extreme Java Trading Platform 1 2 3 4 Best performance at each layer of the stack Modular construction; Protection of existing technology investments All components designed to

20 Exalogic: Oracle s Extreme Java Trading Platform Best performance at each layer of the stack Modular construction; Protection of existing technology investments All components designed to work together - Integrated into a comprehensive pre-optimized Engineered Solution Vertical integration hard for customers to replicate! 21 Copyright 2011, Oracle and/or its affiliates. All rights

to work together - Integrated into a comprehensive pre-optimized Engineered Solution Vertical

21 Java SE Design Objectives Write Once Run Anywhere Optimize Java for New Application Models & New Hardware Enhance Productivity for Java Developers Enable Flexible and Smaller Deployment Through Modularization Improve Performance, Monitoring & Diagnostics Enhance Java Platform for Multiple Languages 22 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

22 NetBeans 7 Java SE 7 Support more JDK Roadmap JDK 7 JDK 7u2 JRE 7 on java.com JavaFX 2.0 co-install Last Public JDK 6 Update JDK 7u6 OSX JRE Port (for end-users) Improved OS integration, auto-update NetBeans.next Java SE 8 Support JavaFX 3.0 Support more Mac OSX JDK 7 Developer Preview Java FX 2.0 Dev Preview NetBeans 7.1 JavaFX 2.0 Support JDK 7u4 OSX JDK Port (for developers) JDK 8 Windows, Linux, Solaris, OSX, Embedded Platforms Jigsaw Lambda JavaFX 3.0 Complete Oracle JVM Convergence JavaScript Interop more 23 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

Extreme Java Platform for Trading Advantages 1 Performance In The Box: pre-integrated, preoptimized, pre-tested solution Exalogic Elastic Cloud

23 Extreme Java Platform for Trading Advantages 1 Performance In The Box: pre-integrated, preoptimized, pre-tested solution Exalogic Elastic Cloud Software - The Secret Sauce 2 Faster application Time To Market (reduced integration and testing efforts) 3 Sustainability (reduced risk and lower TCO)

<Insert Picture Here> Architekturen, Bausteine und Konzepte für Private Clouds Detlef Drewanz EMEA Server Principal Sales Consultant

<Insert Picture Here> Architekturen, Bausteine und Konzepte für Private Clouds Detlef Drewanz EMEA Server Principal Sales Consultant Architekturen, Bausteine und Konzepte für Private Clouds Detlef Drewanz EMEA Server Principal Sales Consultant The following is intended to outline our general product direction.