Welcome to Virtual Developer Day MySQL!



Similar documents
Using MySQL for Big Data Advantage Integrate for Insight Sastry Vedantam


<Insert Picture Here> MySQL Update

MySQL and Hadoop Big Data Integration

<Insert Picture Here> MySQL in the Oracle Ecosystem

MySQL and Hadoop: Big Data Integration. Shubhangi Garg & Neha Kumari MySQL Engineering

Database Scalability and Oracle 12c

MySQL Strategy. Morten Andersen, MySQL Enterprise Sales. Copyright 2014 Oracle and/or its affiliates. All rights reserved.

Best Practices for Using MySQL in the Cloud

MySQL performance in a cloud. Mark Callaghan

MySQL: Community and Enterprise soul. Marco Carlessi - (Oracle) MySQL Senior Sales Consultant

MySQL Cluster New Features. Johan Andersson MySQL Cluster Consulting johan.andersson@sun.com

MySQL Enterprise Monitor

DBA Tutorial Kai Voigt Senior MySQL Instructor Sun Microsystems Santa Clara, April 12, 2010

MySQL Administration and Management Essentials

MySQL Enterprise Edition

OLTP Meets Bigdata, Challenges, Options, and Future Saibabu Devabhaktuni

Affordable, Scalable, Reliable OLTP in a Cloud and Big Data World: IBM DB2 purescale

MySQL Enterprise Backup

SCALABLE DATA SERVICES

MySQL CLUSTER. Scaling write operations, as well as reads, across commodity hardware. Low latency for a real-time user experience

High Availability Solutions for the MariaDB and MySQL Database

Flash Databases: High Performance and High Availability

Oracle Database 12c Plug In. Switch On. Get SMART.

Tips and Tricks for Using Oracle TimesTen In-Memory Database in the Application Tier

MySQL Reference Architectures for Massively Scalable Web Infrastructure

MySQL és Hadoop mint Big Data platform (SQL + NoSQL = MySQL Cluster?!)

<Insert Picture Here> Playing in the Same Sandbox: MySQL and Oracle

Red Hat Network Satellite Management and automation of your Red Hat Enterprise Linux environment

Linas Virbalas Continuent, Inc.

D61830GC30. MySQL for Developers. Summary. Introduction. Prerequisites. At Course completion After completing this course, students will be able to:

Tushar Joshi Turtle Networks Ltd

SQL Databases Course. by Applied Technology Research Center. This course provides training for MySQL, Oracle, SQL Server and PostgreSQL databases.

Parallel Replication for MySQL in 5 Minutes or Less

Red Hat Satellite Management and automation of your Red Hat Enterprise Linux environment

White Paper. Optimizing the Performance Of MySQL Cluster

MySQL Security: Best Practices

Top 10 Reasons why MySQL Experts Switch to SchoonerSQL - Solving the common problems users face with MySQL

Implement Hadoop jobs to extract business value from large and varied data sets

A REVIEW PAPER ON THE HADOOP DISTRIBUTED FILE SYSTEM

An Oracle White Paper July Oracle Primavera Contract Management, Business Intelligence Publisher Edition-Sizing Guide

<Insert Picture Here> Oracle In-Memory Database Cache Overview

Online Transaction Processing in SQL Server 2008

High Availability Using MySQL in the Cloud:

<Insert Picture Here> Oracle Database Directions Fred Louis Principal Sales Consultant Ohio Valley Region

How, What, and Where of Data Warehouses for MySQL

F1: A Distributed SQL Database That Scales. Presentation by: Alex Degtiar (adegtiar@cmu.edu) /21/2013

Harnessing the Power of the Microsoft Cloud for Deep Data Analytics

YouTube Vitess. Cloud-Native MySQL. Oracle OpenWorld Conference October 26, Anthony Yeh, Software Engineer, YouTube.

Real-time reporting at 10,000 inserts per second. Wesley Biggs CTO 25 October 2011 Percona Live

Performance and Scalability Overview

Synchronous multi-master clusters with MySQL: an introduction to Galera

Comparing MySQL and Postgres 9.0 Replication

Enabling Database-as-a-Service (DBaaS) within Enterprises or Cloud Offerings

Automated Data Ingestion. Bernhard Disselhoff Enterprise Sales Engineer

Cost-Effective Business Intelligence with Red Hat and Open Source

High Availability and Scalability for Online Applications with MySQL

Preview of Oracle Database 12c In-Memory Option. Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Open Source DBMS CUBRID 2008 & Community Activities. Byung Joo Chung bjchung@cubrid.com

Oracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here>

Scalable Architecture on Amazon AWS Cloud

Constructing a Data Lake: Hadoop and Oracle Database United!

Sisense. Product Highlights.

MakeMyTrip CUSTOMER SUCCESS STORY

FIFTH EDITION. Oracle Essentials. Rick Greenwald, Robert Stackowiak, and. Jonathan Stern O'REILLY" Tokyo. Koln Sebastopol. Cambridge Farnham.

MySQL Cluster Deployment Best Practices

Scaling Database Performance in Azure

Oracle Database 11g: RAC Administration Release 2

Database Administration with MySQL

Introduction. Part I: Finding Bottlenecks when Something s Wrong. Chapter 1: Performance Tuning 3

MySQL High-Availability and Scale-Out architectures

Mark Bennett. Search and the Virtual Machine

MySQL. Leveraging. Features for Availability & Scalability ABSTRACT: By Srinivasa Krishna Mamillapalli

Percona Server features for OpenStack and Trove Ops

<Insert Picture Here> MySQL Security In A Cloudy World

Oracle Public Cloud. Peter Schmidt Principal Sales Consultant Oracle Deutschland BV & CO KG

Assignment # 1 (Cloud Computing Security)

How To Scale Out Of A Nosql Database

IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud

Einsatzfelder von IBM PureData Systems und Ihre Vorteile.

Introduction 1 Performance on Hosted Server 1. Benchmarks 2. System Requirements 7 Load Balancing 7

Instant-On Enterprise

Why DBMSs Matter More than Ever in the Big Data Era

Dave Stokes MySQL Community Manager

Accelerating Enterprise Applications and Reducing TCO with SanDisk ZetaScale Software

Getting Started with Attunity CloudBeam for Azure SQL Data Warehouse BYOL

Open Source Technologies on Microsoft Azure

Accelerating Hadoop MapReduce Using an In-Memory Data Grid

Contents Introduction... 5 Deployment Considerations... 9 Deployment Architectures... 11

HP OO 10.X - SiteScope Monitoring Templates

Replicating to everything

Architectures Haute-Dispo Joffrey MICHAÏE Consultant MySQL

MySQL ENTEPRISE EDITION

Oracle Database 11 g Performance Tuning. Recipes. Sam R. Alapati Darl Kuhn Bill Padfield. Apress*

THE ATLAS DISTRIBUTED DATA MANAGEMENT SYSTEM & DATABASES

Deploy. Friction-free self-service BI solutions for everyone Scalable analytics on a modern architecture

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011

Monitoring and Diagnosing Oracle RAC Performance with Oracle Enterprise Manager

Tungsten Replicator, more open than ever!

Transcription:

Welcome to Virtual Developer Day MySQL! Keynote: Developer and DBA Guide to What s New in MySQL Andrew Morgan - MySQL Product Management @andrewmorgan www.clusterdb.com 1

Program Agenda 1:00 PM Keynote: What s New in MySQL Track 1 MySQL Essentials 1:30 PM Session: MySQL Essentials - Learn MySQL Basics in 45 Minutes Track 2 MySQL Deep Dive Session: New InnoDB Features in MySQL 5.6 2:15 PM HOL: Getting Started with MySQL Session: Profiling with MySQL Performance Schema 3:15 PM Session: MySQL Backup From Strategy to Implementation 4:00 PM HOL: Getting Started with MySQL Replication 5:00 PM Event Close MySQL and Hadoop Big Data Integration Demo: Monitoring in Action: The MySQL Enterprise Monitor 2

Session Agenda Oracle s Investment in MySQL MySQL 5.6 Features Overview MySQL Cluster 7.3 Feature Overview MySQL in Big Data More Resources 3

Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decision. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 4

World s Most Popular Open Source Database Over 15 million estimated installations Used by 9 of top 10 web sites in the world Embedded by 8 of the top 10 ISVs #1 database in the Cloud Integrated w/hadoop in 80% of Big Data platforms Facebook: 220K fans, +35% YoY Growth Twitter: 35K followers, +67% YoY Growth Numerous Awards: Linux Journal, CRN, PHP Architect... 5

Industry Leaders Rely on MySQL Web & Enterprise OEM & ISVs Cloud 6

UNMATCHED INVESTMENT InnoDB PERFORMANCE IMPROVEMENTS CLOUD WINDOWS REPLICATION EMBEDDED HUNDREDS OF EXPERTS STRATEGIC WORLD-CLASS SUPPORT MySQL CLUSTER WEB NoSQL LINUX MySQL ENTERPRISE EDITION LARGEST MySQL ENGINEERING & SUPPORT ORGANIZATION 7

DRIVING MySQL INNOVATION MySQL Enterprise Monitor 2.2 MySQL Cluster 7.1 MySQL Cluster Manager 1.0 MySQL Workbench 5.2 MySQL Database 5.5 MySQL Enterprise Backup 3.5 MySQL Enterprise Monitor 2.3 MySQL Cluster Manager 1.1 All GA! MySQL Enterprise Backup 3.7 Oracle VM Template for MySQL Enterprise Edition MySQL Enterprise Oracle Certifications MySQL Windows Installer MySQL Enterprise Security MySQL Enterprise Scalability All GA! MySQL Database 5.6 DMR* MySQL Cluster 7.2 DMR MySQL Labs! MySQL Cluster 7.2 MySQL Cluster Manager 1.2 MySQL Utilities 1.0.6 MySQL Migration Wizard MySQL Enterprise Backup 3.8 MySQL Enterprise Audit MySQL Database 5.6 MySQL Cluster 7.3 All GA! MySQL 5.7 DMR MySQL Applier for Hadoop Available Now! A BETTER MySQL ( early and often ) 2010 2011 2012-13 *Development Milestone Release 8

Oracle s Investment in MySQL Community Available to download and use under the GPL MySQL Database (Community Edition) MySQL Cluster MySQL Workbench MySQL Migration Wizard MySQL Utilities (in Python) MySQL Connectors MySQL Proxy Forums mysql.com/downloads/ 9

MySQL 5.6: Best Release Ever! IMPROVED PERFORMANCE AND SCALABILITY Scales to 48 CPU Threads Up to 230% performance gain over MySQL 5.5 IMPROVED INNODB Better transactional throughput and availability IMPROVED OPTIMIZER Better query exec times and diagnostics for query tuning and debugging IMPROVED REPLICATION Higher performance, availability and data integrity IMPROVED PERFORMANCE SCHEMA Better Instrumentation, User/Application level statistics and monitoring New! NoSQL ACCESS TO INNODB Fast, Key Value access with full ACID compliance, better developer agility 10

MySQL 5.6: Scalability Users can fully utilize latest generations of hardware and OS Scales as data volumes and users grow 11

MySQL 5.6: Scalability Users can fully utilize latest generations of hardware and OS Scales as data volumes and users grow 12

MySQL 5.6 SysBench Benchmarks MySQL 5.6 MySQL 5.5 13 Up to 151% Performance Gain

MySQL 5.6 SysBench Benchmarks MySQL 5.6 MySQL 5.5 14 Up to 234% Performance Gain

MySQL 5.6: InnoDB BETTER RESOURCE UTILIZATION Removal of legacy bottlenecks Improved threading/concurrency Optimized for Read-Only Workloads SSD Optimizations BETTER AVAILABILITY, FASTER SCALING Online DDL Operations Transportable Tablespaces Dump, Restore/Warm Buffer Pool DEVELOPER AGILITY 15 Full Text Search NoSQL, Key-value access to InnoDB

MySQL 5.6: InnoDB Online DDL Operations CREATE INDEX DROP INDEX Change AUTO_INCREMENT value for a column ADD/DROP FOREIGN KEY Rename COLUMN Change ROW FORMAT, KEY_BLOCK_SIZE for a table Change COLUMN NULL, NOT_NULL Add, drop, reorder COLUMN Adds flexible schemas, online changes, no downtime No need to consider NoSQL options 16

MySQL 5.6: InnoDB NoSQL Key Value Access to InnoDB Same app can leverage: Key-value access to InnoDB via familiar Memcached API SQL for rich queries, JOINs, FKs, etc. Fully transactional Up to 9x performance boost for updates Great for fast data ingestion in Big Data pipeline 17

MySQL 5.6: Optimizer Subquery Optimizations File sort optimizations for most web use cases - 4x better execution time 40s to 10s Index Condition Pushdown - 160x better execution time 15s to 90ms Batched Key Access and Multi Range Read - 280x better execution time 2800s to 10s Better complex query execution times ever growing data sets (Big Data!) MEM + Query Analyzer key to utilizing full benefits of 5.6 Optimizer MySQL Consultative Support provides guidance on configuration 18

MySQL 5.6: Optimizer Better Diagnostics EXPLAIN - INSERT, UPDATE, and DELETE - Structured EXPLAIN output (JSON) Optimizer Traces SET SESSION OPTIMIZER_TRACE= enabled=on ; SELECT (SELECT 1 FROM t6 WHERE d = c) AS RESULT FROM t5; SELECT * FROM information_schema.optimizer_trace; "records_estimation": [ { "database": "test", "table": "t6", "range_analysis": { "table_scan": { "records": 2, "cost": 4.5034 }, "potential_range_indices": [ { "index": "d", "usable": true, "key_parts": [ "d" ] } ], "best_covering_index_scan": { "index": "d", "cost": 1.4233, "chosen": true }, 19

MySQL 5.6: Best Replication Features Ever PERFORMANCE Multi-Threaded Slaves Binary Log Group Commit Optimized Row-Based Replication FAILOVER & RECOVERY Global Transaction Identifiers Replication Failover & Admin Utilities Crash Safe Slaves DATA INTEGRITY Replication Event Checksums 20 DEV/OPS AGILITY Time Delayed Replication Remote Binlog Backup Informational Log Events

Queries per Second MySQL 5.6: Replication Multi-Threaded Slaves Increases slave throughput, reducing lag Applies events to different databases in parallel using concurrent SQL threads 5x performance gain 300 250 200 150 100 50 0 Multi-Threaded Slave Performance 0 5 10 QPS 58.11 144.4 282.53 Worker Threads Great for systems which isolate application data using databases - Cloud, SaaS, Hosting, other multi-tenant deployments SysBench, running across 10 x schemas Oracle Linux 6.1, Oracle Sun Fire x4150 m2 Server 21

MySQL 5.6: Replication Binary Log Group Commit Increases replication throughput by increasing performance of the master Commits multiple transactions as a group to Binlog on disk Finer grained locking; reducing lock wait times Session Master Database T1 T3 T2 T4 Binary Log Group commit Better transactional throughput, less slave lag when coupled with MTS MySQL Consultative Support provides guidance on configuration 22

Transactions per Second 23 Binary Log Group Commit Performance Binlog=1 9000 8000 7000 6000 5000 4000 3000 2000 1000 0 MySQL 5.6 vs. 5.5 - Read Write (Linux) 32 64 128 Connections 180% Performance Gain MySQL 5.6 MySQL 5.5 Oracle Linux 6 Intel(R) Xeon(R) E7540 x86_64 MySQL leveraging: - 60 of 96 available CPU threads - 2 GHz, 512GB RAM

MySQL 5.6: Replication Global Transaction Ids Simple to track & compare replication across the cluster - Unique identifier for each transaction written to the Binlog Automatically start replicating correct events when promoting new master Deploy n-tier replication hierarchies Eliminates the need for complex 3 rd party solutions Master GTID=123456 GTID=123456 GTID=123456 GTID=123456 24

MySQL 5.6: Replication HA Utilities (Python) Failed Master Promoted Master Enabling self-healing replication topologies Automated failover & recovery - mysqlfailover Utility Switchover & administration - mysqlrpladmin Utility Monitoring HA Utilities Slaves Delivers HA within the core MySQL distribution - Eliminates the need for 3 rd party solutions - Allows extensibility to support variety of HA mechanisms 25

MySQL 5.6: Performance Schema New Instrumentation Statements/Stages Table and Index I/O Table locks Users/Hosts/Accounts Network I/O [mysqld] performance_schema=on New Features Show contents of Host cache New Summary tables Easier configuration - Start up defaults in my.cnf - Auto tune Reduced overhead On by default Provides user/session level stats on resource usage for Cloud-based consumption/reporting/charge back 26

MySQL 5.6: Security Major overhaul of password handling Provide alternatives to showing passwords in plain text Assess/Enforce password strength policies Enforce new password at next login Stronger password hashing Aligns MySQL user security/password policies with Oracle guidelines and most common industry SOPs 27

MySQL 5.6: New Default Settings Better out-of-the-box performance on modern architectures New fixed defaults and auto-tuning based on related parameters, host configuration Can be modified after installation (my.cnf or my.ini) All new defaults and auto-tuned settings detailed in 5.6 docs Provides better default performance/scale for most MySQL use cases 28

MySQL 5.6: Other Important Improvements TIME/TIMESTAMP/DATETIME - fractional second precision, set defaults Better Condition Handling - MySQL Diagnostic Area Statements, conditions - GET DIAGNOSTICS Improved Partitioning - Up to 8k partitions/sub-partitions per table - Explicit partition selection in queries, DML - Import/Export partitions between tables Improves ease of use for developers 29

MySQL Cluster Architecture Clients Application Layer Data Layer Management MySQL Cluster Data Nodes 30

MySQL Cluster Architecture Clients Application Layer Data Layer Management Management MySQL Cluster Data Nodes 31

MySQL Cluster Architecture Clients Application Layer Data Layer Management Management MySQL Cluster Data Nodes 32

Who s Using MySQL Cluster? 33

Foreign Key Support Connection Thread Scalability MySQL 5.6 Auto-Installer NoSQL JavaScript for node.js 34

MySQL Cluster 7.3: Auto-Installer Fast configuration Auto-discovery Workload optimized Repeatable best practices For MySQL Cluster 7.2 + 7.3 Specify Workload Deploy Auto- Discover Define Topology 35

36

Performance & Scale-Out High Availability, Self-Healing & Data Integrity Provisioning, Monitoring & Resource Management Developer Agility Security 37

MySQL in the Big Data Lifecycle BI Solutions DECIDE ACQUIRE Applier ANALYZE ORGANIZE 38

New: MySQL Applier for Hadoop Real-time streaming of events from MySQL to Hadoop Supports move towards Speed of Thought analytics Connects to the binary log, writes events to HDFS via libhdfs library Each database table mapped to a Hive data warehouse directory Enables eco-system of Hadoop tools to integrate with MySQL data See dev.mysql.com for articles Available for download now labs.mysql.com 39

MySQL Enterprise Edition Highest Levels of Security, Performance and Availability MySQL Enterprise Security MySQL Enterprise Audit Oracle Premier Lifetime Support Oracle Product Certifications/Integrations MySQL Enterprise Monitor/Query Analyzer MySQL Enterprise Scalability MySQL Enterprise High Availability MySQL Enterprise Backup MySQL Workbench 40

41 Learn More mysql.com - MySQL Products and Editions - New 5.6, Replication and HA White papers - TCO calculator - Customer use cases and success stories dev.mysql.com - Downloads, Documentation - Forums - PlanetMySQL edelivery.oracle.com - Download and evaluate all MySQL products

San Francisco, September 21-23 Additional Day of Tutorials Oracle.com/mysqlconnect 42 Graphic Section Divider Keynotes Conferences Sessions Early Bird Discount: Register Now and Save US$500! Birds-of-a-feather sessions Tutorials Hands-on Labs Exhibition Hall Demo Pods Receptions

Program Agenda 1:00 PM Keynote: What s New in MySQL Track 1 MySQL Essentials 1:30 PM Session: MySQL Essentials - Learn MySQL Basics in 45 Minutes Track 2 MySQL Deep Dive Session: New InnoDB Features in MySQL 5.6 2:15 PM HOL: Getting Started with MySQL Session: Profiling with MySQL Performance Schema 3:15 PM Session: MySQL Backup From Strategy to Implementation 4:00 PM HOL: Getting Started with MySQL Replication 5:00 PM Event Close MySQL and Hadoop Big Data Integration Demo: Monitoring in Action: The MySQL Enterprise Monitor 43