Tips and Tricks for Using Oracle TimesTen In-Memory Database in the Application Tier

Size: px

Start display at page:

Download "Tips and Tricks for Using Oracle TimesTen In-Memory Database in the Application Tier"

Andrea Montgomery
10 years ago
Views:

2 Tips and Tricks for Using Oracle TimesTen In-Memory Database in the Application Tier Simon Law TimesTen Product Manager, Oracle Meet The Experts: Andy Yao TimesTen Product Manager, Oracle Gagan Singh Senior Database Architect, Intel Corp Chris Jenkins Director, In-Memory Technology, Oracle September 30, 2014 Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Oracle Gagan Singh Senior Database Architect, Intel Corp Chris Jenkins Director, In-Memory

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. Copyright 2014, Oracle and/or its affiliates. All rights reserved.

It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing

Oracle Database Standalone In-Memory DB For OLTP Application Application In-Memory OLTP Caching In-Memory

4 Oracle TimesTen In-Memory Database Microseconds Response Time in Application Tier In-Memory Relational Database Extremely Fast Oracle TimesTen In-Memory Database Persistent and Recoverable Compatible with Oracle Database Standalone In-Memory DB For OLTP Application Application In-Memory OLTP Caching In-Memory Analytics Commodity Hardware Oracle Exalytics Copyright 2014, Oracle and/or its affiliates. All rights reserved.

5 Microseconds Oracle TimesTen In-Memory Database Low Latency - Microseconds Response Time Response Time Millionths of a Second 9.07 TPTBM Read and Update E GHz 1 socket, 15 cores/socket, 2 threads/core TimesTen (100M rows, 17GB) Millionths of a Second 3.58 SELECT Query UPDATE Transaction Copyright 2014, Oracle and/or its affiliates. All rights reserved.

80GHz 1 socket, 15 cores/socket, 2 threads/core TimesTen 11.2.2.7.5 (100M rows, 17GB) 4.00 2.00 0.

6 Queries Per Second Update Transactions Per Second Extreme Scalability on Modern Commodity Hardware Query Throughput Update Throughput 30,000, Million Queries per Second 1,400,000 Update Throughput Per Processor 1.3 Million Update TPS 25,000,000 25,192,607 1,200,000 20,000,000 1,000,000 15,000, ,000 10,000, , ,000 5,000, , Concurrent Processes 200, Concurrent Update Processes Intel Xeon CPU E GHz, 4 sockets, 15 cores/socket, 2 threads/core - TimesTen (100M rows, 17GB) Copyright 2014, Oracle and/or its affiliates. All rights reserved.

3 Million Update TPS 25,000,000 25,192,607 1,200,000 20,000,000 1,000,000 15,000,000 800,000 10,000,000 600,000 400,000 5,000,000 0 279,262 1 10 20 30 60 90 120

7 TimesTen: Designed for High Availability Fully persistent Checkpoints, logging, txns Real-time transactional replication High performance, parallel Multiple topologies Online upgrades Oracle Clusterware integration Automatic database switchover Automatic application failover Application Transactions Active Checkpoint files Log Files Read-only subscribers Reader Farm Disaster Recovery Application Reads on Hot Standby Standby Subscriber Subscriber Subscriber Copyright 2014, Oracle and/or its affiliates. All rights reserved.

application failover Application Transactions Active Checkpoint files Log Files Read-only subscribers Reader Farm Disaster Recovery

8 TimesTen Application-Tier Database Cache Automatic Data Synchronization Reads/Write transactions Reads/Write transactions Application Reads/Write transactions Read/Write Caching Execute transactions in TimesTen Application Application Propagate changes to the Oracle Database Automatic Data Synchronization Read-only Caching Execute transactions in the Oracle Database Refresh changes to the TimesTen Cache database Copyright 2014, Oracle and/or its affiliates. All rights reserved.

Application Propagate changes to the Oracle Database Automatic Data Synchronization Read-only Caching Execute

Real-Time Ad Serving Real-Time Applications Instantly Responsive / Highly Scalable / Always-On Mainstream 64-bit

9 Enabling The Real-Time World Authorization, Online Charging, Location-Based Services Market Data, Market Events, Order Matching, Trading Real-Time Analytics - Interactive Dashboard Data Mart, Scorecard ecommerce, Personalization, Real-Time Ad Serving Real-Time Applications Instantly Responsive / Highly Scalable / Always-On Mainstream 64-bit Processors Fast Networks Key Enabling Technology Large Capacity RAM Copyright 2014, Oracle and/or its affiliates. All rights reserved.

11 Tips and Tricks for Using Oracle TimesTen In-Memory Database in the Application Tier Gagan Singh Intel Corporation

12 Agenda Intel Database Environment Overview Pre In-Memory Cache Environment Challenges Candidate Database Details Adding TimesTen Cache Architecture Updated Design Key Features Proof of Concept TimesTen Value-add Summary Key Learnings

Adding TimesTen Cache Architecture Updated Design Key

13 Intel Environment Overview Complex integrated systems in a charged automation environment Aim is Achieve faster analysis, process improvement and reduction in test spirals under strict performance SLAs 24x7 up time Availability is key! Mixed workload DSS + OLTP

process improvement and reduction in test spirals under strict

14 Pre In-Memory Cache environment challenges Query performance for larger result set was exceeding SLA Complex Joins had performance degradation DB/Queries were already tuned using all possible options With growing object size, pinning in SGA was not feasible Moving to newer high performance hardware was a long term goal Run times for critical queries ranging between 9 to 30 min

all possible options With growing object size, pinning in SGA was not feasible Moving to newer

15 Candidate Database Details 2 Node Oracle RAC Database Windows 2003 x64 / Tier 1 SAN / 10Gb Interconnect Data Load through homegrown PL/SQL code Pin Hot objects to SGA Non Partitioned 24x7 availability + Exponential growth in DB size

Interconnect Data Load through homegrown PL/SQL code Pin Hot

16 Pre TimesTen Cache Architecture Public Network Tier 1 SAN Storage

17 TimesTen Cache Architecture TimesTen Cache (Read Only) Public Network Tier 1 SAN Storage

18 Updated Design Key Features Times Ten Version patch Read Only TimesTen Cache Only hot tables cached Data available through TimesTen with RAC Db serving as BC Custom stored procedure created for bulk delete jobs

tables cached Data available through TimesTen with RAC Db

19 TimesTen Value-Add Summary Query Performance improved with run times < 1min No change needed on application/user queries Minimal to no impact on source database Similar operational commands as Oracle RDBMS Single Vendor Support

application/user queries Minimal to no impact on source

20 Key Learnings Table Statistics need to be updated (call ttoptupdatestats) Certain Indexes might still be needed Capacity planning on disk space required for TimesTen server Plan for faster Disks on TimesTen Cache Server (checkpointing) Beware of certain RDBMS functions that are not supported (PIVOT(), LISTAGG(), and GROUP BY.. FOR ; etc) Backup-Restore procedures tested for recoverability

Disks on TimesTen Cache Server (checkpointing) Beware of certain RDBMS functions that are not

21 Thank You

23 Tips and Tricks Optimize Schema and Queries Optimize data types Native integer types versus NUMBER INLINE and NOT INLINE for VARxxx Maintain optimizer statistics Essential for good query performance Update after initial data load Update after significant changes to data Update after creating/dropping indexes Tune queries Review Query Plans Use explain <SQL> to review the query plan of target SQL Adjust indexing Index Advisor Optimize indexing Hash, Range, Bitmap Different characteristics and usage Copyright 2014, Oracle and/or its affiliates. All rights reserved.

24 Tips and Tricks Optimize Your Application Use long lived, persistent connections Reduce SQL parsing Use parameterized SQL Prepare SQL once (all APIs) Bind columns and parameters once (ODBC and OCI) Use the capabilities of SQL Don t re-invent SQL functions in application Keep transactions small Tune commit buffer size Use direct mode whenever possible Use PL/SQL to reduce client/server round trips if using C/S mode Choose database and connection character sets properly Minimize data type conversions between app and database Use API batch functionality where appropriate 256 = fast-path batch size for INSERTs Copyright 2014, Oracle and/or its affiliates. All rights reserved.

25 Tips and Tricks Optimize Database Setup and Hardware For write intensive applications Use flash or SSD storage for checkpoint and log files Separate checkpoint files and transaction logs if using HDD storage Pre-allocate checkpoint file space at database creation time Use parallelism where possible Log buffer Replication AWT cache propagation Use MemoryLock=4 or Huge Pages Optimize startup and recovery time Use flash or SSD for checkpoint files Use parallel checkpoint read feature Flash or SSD only Optimize logging I/O Log buffer size Log buffer parallelism Log flush method Copyright 2014, Oracle and/or its affiliates. All rights reserved.

26 TimesTen In-Memory Database OpenWorld Sessions Tuesday Wednesday Session / Time / Location Speed Up Your Applications with an Application-Tier In-Memory Database 3:45 PM 4:30 PM Moscone North 131 Application-Tier In-Memory Analytics: Best Practices and Use Cases 3:30 PM - 4:15 PM Moscone North 131 Session / Time / Location Tips and Tricks for Using Oracle TimesTen In-Memory Database in the Application Tier 6:00 PM 6:45 PM Moscone South 305 Visit us at the DEMOgrounds! Moscone South, Left : Booths SLD-135 and SLD-136 Copyright 2014, Oracle and/or its affiliates. All rights reserved.

<Insert Picture Here> Oracle In-Memory Database Cache Overview

<Insert Picture Here> Oracle In-Memory Database Cache Overview Oracle In-Memory Database Cache Overview Simon Law Product Manager The following is intended to outline our general product direction. It is intended for information purposes only,