Future-Proofing MySQL for the Worldwide Data Revolution



Similar documents
Solving Large-Scale Database Administration with Tungsten

From Dolphins to Elephants: Real-Time MySQL to Hadoop Replication with Tungsten

How, What, and Where of Data Warehouses for MySQL

Parallel Replication for MySQL in 5 Minutes or Less

Database Scalability {Patterns} / Robert Treat

VMware Continuent. Benefits and Configurations TECHNICAL WHITE PAPER

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011


Deploying Database clusters in the Cloud

Tungsten Replicator, more open than ever!

Implementing the Future of PostgreSQL Clustering with Tungsten

GigaSpaces Real-Time Analytics for Big Data

High Availability Solutions for the MariaDB and MySQL Database

Replicating to everything

High Availability Using MySQL in the Cloud:

NoSQL for SQL Professionals William McKnight

Scaling Database Performance in Azure

So What s the Big Deal?

Top 10 Reasons why MySQL Experts Switch to SchoonerSQL - Solving the common problems users face with MySQL

An Oracle White Paper November Leveraging Massively Parallel Processing in an Oracle Environment for Big Data Analytics

Cloud DBMS: An Overview. Shan-Hung Wu, NetDB CS, NTHU Spring, 2015

NoSQL Databases. Polyglot Persistence

In Memory Accelerator for MongoDB

The Enterprise Data Hub and The Modern Information Architecture

F1: A Distributed SQL Database That Scales. Presentation by: Alex Degtiar (adegtiar@cmu.edu) /21/2013

How To Use Big Data For Telco (For A Telco)

The Future of PostgreSQL High Availability Robert Hodges - Continuent, Inc. Simon Riggs - 2ndQuadrant

MongoDB in the NoSQL and SQL world. Horst Rechner Berlin,

Oracle Data Integration: CON7926 Oracle Data Integration: A Crucial Ingredient for Cloud Integration

Real Time Fraud Detection With Sequence Mining on Big Data Platform. Pranab Ghosh Big Data Consultant IEEE CNSV meeting, May Santa Clara, CA

Chukwa, Hadoop subproject, 37, 131 Cloud enabled big data, 4 Codd s 12 rules, 1 Column-oriented databases, 18, 52 Compression pattern, 83 84

THE ATLAS DISTRIBUTED DATA MANAGEMENT SYSTEM & DATABASES

Flash Databases: High Performance and High Availability

Tier Architectures. Kathleen Durant CS 3200

From Spark to Ignition:

Scalable Architecture on Amazon AWS Cloud

MySQL és Hadoop mint Big Data platform (SQL + NoSQL = MySQL Cluster?!)

Foundations of Business Intelligence: Databases and Information Management

High Availability for Database Systems in Cloud Computing Environments. Ashraf Aboulnaga University of Waterloo

Preparing Your Data For Cloud

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON

Linas Virbalas Continuent, Inc.

Structured Data Storage

FIFTH EDITION. Oracle Essentials. Rick Greenwald, Robert Stackowiak, and. Jonathan Stern O'REILLY" Tokyo. Koln Sebastopol. Cambridge Farnham.

OLTP Meets Bigdata, Challenges, Options, and Future Saibabu Devabhaktuni

Apache Hadoop. Alexandru Costan

High Availability with Postgres Plus Advanced Server. An EnterpriseDB White Paper

Big Data Database Revenue and Market Forecast,

Highly available, scalable and secure data with Cassandra and DataStax Enterprise. GOTO Berlin 27 th February 2014

ScaleArc for SQL Server

The Modern Online Application for the Internet Economy: 5 Key Requirements that Ensure Success

HYPER-CONVERGED INFRASTRUCTURE STRATEGIES

Oracle s Big Data solutions. Roger Wullschleger. <Insert Picture Here>

Evaluating NoSQL for Enterprise Applications. Dirk Bartels VP Strategy & Marketing

IAN MASSINGHAM. Technical Evangelist Amazon Web Services

Using MySQL for Big Data Advantage Integrate for Insight Sastry Vedantam

Not Relational Models For The Management of Large Amount of Astronomical Data. Bruno Martino (IASI/CNR), Memmo Federici (IAPS/INAF)

Hadoop Evolution In Organizations. Mark Vervuurt Cluster Data Science & Analytics

Portable Scale-Out Benchmarks for MySQL. MySQL User Conference 2008 Robert Hodges CTO Continuent, Inc.

How To Scale Out Of A Nosql Database

On- Prem MongoDB- as- a- Service Powered by the CumuLogic DBaaS Platform

Introduction to Apache Cassandra

Technical Overview: Anatomy of the Cloudant DBaaS

Big Data Use Case. How Rackspace is using Private Cloud for Big Data. Bryan Thompson. May 8th, 2013

How Transactional Analytics is Changing the Future of Business A look at the options, use cases, and anti-patterns

Cloud Computing at Google. Architecture

Informix Dynamic Server May Availability Solutions with Informix Dynamic Server 11

The Future of Data Management

Comparing MySQL and Postgres 9.0 Replication

CASE STUDY: Oracle TimesTen In-Memory Database and Shared Disk HA Implementation at Instance level. -ORACLE TIMESTEN 11gR1

Challenges for Data Driven Systems

Harnessing the Power of the Microsoft Cloud for Deep Data Analytics

Affordable, Scalable, Reliable OLTP in a Cloud and Big Data World: IBM DB2 purescale

Datenverwaltung im Wandel - Building an Enterprise Data Hub with

NoSQL Database Options

High Availability and Scalability for Online Applications with MySQL

Hadoop and Map-Reduce. Swati Gore

Real Time Big Data Processing

Introduction to Hadoop. New York Oracle User Group Vikas Sawhney

RPO represents the data differential between the source cluster and the replicas.

Step by Step: Big Data Technology. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 August 2015

MySQL synchronous replication in practice with Galera

Putting Apache Kafka to Use!

Cloud Based Application Architectures using Smart Computing

Oracle Database 12c Plug In. Switch On. Get SMART.

Chapter 6 8/12/2015. Foundations of Business Intelligence: Databases and Information Management. Problem:

Move Data from Oracle to Hadoop and Gain New Business Insights

Increased Security, Greater Agility, Lower Costs for AWS DELPHIX FOR AMAZON WEB SERVICES WHITE PAPER

The Power of Pentaho and Hadoop in Action. Demonstrating MapReduce Performance at Scale

An Approach to Implement Map Reduce with NoSQL Databases

CitusDB Architecture for Real-Time Big Data

Transcription:

Future-Proofing MySQL for the Worldwide Data Revolution Robert Hodges, CEO.

What is Future-Proo!ng? Future-proo!ng = creating systems that last while parts change and improve MySQL is not losing out to other solutions for data management The real problem is using MySQL as a building block with other technologies that are changing rapidly 2

But Wait... Isn t MySQL Dead?? MySQL You were so open Born May 25, 1995 Died 2008, 2009, 2010, 2011, 2012,... 3

Oracle/MySQL 5.6 Replication (On the Way) Global transaction IDs Parallel slave threads Crash safe slaves Time delay replication Optimized row updates Informational log events 4

Galera Synchronous Clusters (New Arrival in 2012) Multi-master for InnoDB Synchronous replication avoids data loss Automatic cluster membership management Simple node provisioning model Based on innovative state-machine work from Fernando Pedone 5

Tungsten Async Replication (2011 Belle of the Ball) All 5.6 features including parallel replication for MySQL 5.0 onwards Optimized support for failover Backup/restore integration Programmable transaction!ltering Multi-master, fan-in, and star replication Replication to/from Oracle and batch loading of data warehouses Replication to MongoDB 6

Not Bad for a Dying Market NewSQL,'2%' NoSQL,'5%' My/NewSQL,' 5%' MySQL,'88%' (451Group) 1000" 900" 800" 700" 600" 500" 400" 300" 200" 100" 0" THE$TOTAL$MARKET$FOR$MYSQL,$NOSQL$$ AND$NEWSQL$$ Text 2011" 2012" 2013" 2014" 2015" 7

MySQL Is Part of Bigger Trends Cloud and Big Data investment dwarf the MySQL marketplace 8

21st Century CRM/Call Center Fat Client Accounting CRM Web Application CRM Web Application Call Session Data Legacy Oracle Online Transaction Processing Hadoop Analytics On-Premise Amazon Web Services Telephony Data Streams Telephony Data Streams 9

Revolutionary Challenges for MySQL Failures in unstable cloud environments Zero-downtime maintenance Rapidly growing data volumes, esp. in cloud Distributing data to geographical regions Integration between MySQL, NoSQL, commercial RDBMS Supplying real-time analytics Technology upgrade/replacement 10

The Cure for Mixed System Spaghetti Data s Encapsulated, fault-tolerant, horizontally scalable, globally accessible, integrated data 11

5 Design Patterns for Data s Fault-Tolerant DBMS-as-a-Service Horizontal DBMS Arrays Multi-Site Async Replication Real-Time Data s s 12

1. Fault-Tolerant DBMS-as-a-Service Encapsulate redundant database copies Sync and async clustering models Protect against local DBMS failure Rolling maintenance of replicas Master/ Slave Multi- Master 13

2. Horizontal DBMS Arrays Partition datasets based on RAM / storage speed / resident set size Multiple buckets per server Look-up methods for locating data in buckets Re-sharding / migration for high growth 14

3. Multi-Site Async Replication Robust protection against region/site failures Geographic distribution of data Primary/DR vs. multi-master Eventually consistent replication for SQL EU West Amazon East US East APAC Tokyo Rackspace DFW 15

4. Real-Time Data s Replicate from logs in real-time Enable apps to get data from one data source Heterogeneous transfer and transformation High performance, low application impact 16

5. s Single point of entry for applications Service catalog locates data within fabric Transparent connectivity, multiple protocols Security, auditing, performance management Application Application Stack Stack 17

Future-Proofed CRM/Call Center Data Fat Client Accounting CRM Web Application CRM Web Application Telephony Data Streams Telephony Data Streams Legacy Oracle OLTP Primary Call Session Data Hadoop Analytics OLTP DR Data Marts 18

Future-Proofed CRM/Call Center Data Fat Client Accounting CRM Web Application CRM Web Application Telephony Data Streams Telephony Data Streams Legacy Oracle OLTP Primary Call Session Data Hadoop Analytics OLTP DR Data Marts 19

MySQL Future-Proo!ng: Conclusion MySQL is doing great but the cloud and Big Data have created a new set of challenges Data s cure mixed system spaghetti and future-proof MySQL Continuent products implement fabric design patterns We are working on covering the entire Data, not just MySQL 20

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: sales@continuent.com Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.blogspot.com http://www.continuent.com/news/blogs Continuent Web Page: http://www.continuent.com Tungsten Replicator 2.0: http://code.google.com/p/tungsten-replicator.

Multiple node groups per cluster D3 D3 Application D3 Application Stack Application Stack Stack Cross-site replication Cross-site replication Locate clusters; direct write/ read traffic Primary Clusters DR Clusters 22