High-availability with Galera Cluster for MySQL



Similar documents
MySQL always-up with Galera Cluster

MySQL synchronous replication in practice with Galera

Synchronous multi-master clusters with MySQL: an introduction to Galera

Galera Replication. Synchronous Multi-Master Replication for InnoDB. ...well, why not for any other DBMS as well. Seppo Jaakola Alexey Yurchenko

High Availability Solutions for the MariaDB and MySQL Database

MySQL High-Availability and Scale-Out architectures

DBA Tutorial Kai Voigt Senior MySQL Instructor Sun Microsystems Santa Clara, April 12, 2010

How To Monitor Mysql With Zabbix

High Availability Using MySQL in the Cloud:

Percona Server features for OpenStack and Trove Ops

MySQL Administration and Management Essentials


High Availability and Scalability for Online Applications with MySQL

Monitoring Galera with MONyog

MySQL Cluster Deployment Best Practices

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011

Zero Downtime Deployments with Database Migrations. Bob Feldbauer

Top 10 Reasons why MySQL Experts Switch to SchoonerSQL - Solving the common problems users face with MySQL

MySQL és Hadoop mint Big Data platform (SQL + NoSQL = MySQL Cluster?!)

5 Percona Toolkit tools that could save your day. Stéphane Combaudon FOSDEM February 3rd, 2013

MySQL performance in a cloud. Mark Callaghan

Solving Large-Scale Database Administration with Tungsten

Tushar Joshi Turtle Networks Ltd

Load balancing MySQL with HaProxy. Peter Boros Percona 4/23/13 Santa Clara, CA

Andrew Moore Amsterdam 2015

How to evaluate which MySQL High Availability solution best suits you

How to choose High Availability solutions for MySQL MySQL UC 2010 Yves Trudeau Read by Peter Zaitsev. Percona Inc MySQLPerformanceBlog.

Who did what, when, where and how MySQL Audit Logging. Jeremy Glick & Andrew Moore 20/10/14

Using MySQL for Big Data Advantage Integrate for Insight Sastry Vedantam

SkySQL Data Suite. A New Open Source Approach to MySQL Distributed Systems. Serge Frezefond V

Portable Scale-Out Benchmarks for MySQL. MySQL User Conference 2008 Robert Hodges CTO Continuent, Inc.

Database Administration with MySQL

Overview of Databases On MacOS. Karl Kuehn Automation Engineer RethinkDB

Welcome to Virtual Developer Day MySQL!

Real-time reporting at 10,000 inserts per second. Wesley Biggs CTO 25 October 2011 Percona Live

Zero-Downtime MySQL Backups

Contents. SnapComms Data Protection Recommendations

Switch to MySQLnd Already!

High-Availability Using Open Source Software

Implementing and Managing Windows Server 2008 Clustering

Table of Contents. Overview... 1 Introduction... 2 Common Architectures Technical Challenges with Magento ChinaNetCloud's Experience...

Part 3. MySQL DBA I Exam

Not Your Grandpa s Replication

Deploying BDR. Simon Riggs CTO, 2ndQuadrant & Major Developer, PostgreSQL. February 2015

Adding Indirection Enhances Functionality

Availability Digest. MySQL Clusters Go Active/Active. December 2006

VMware Continuent. Benefits and Configurations TECHNICAL WHITE PAPER

3. PGCluster. There are two formal PGCluster Web sites.

High Availability Solutions for MySQL. Lenz Grimmer DrupalCon 2008, Szeged, Hungary

Monitoring MySQL. Kristian Köhntopp

Björn Kraus. Session Aware Full Page Caching For Magento With Varnish ESI

XtraBackup. Vadim Tkachenko CTO, Co-Founder, Percona Inc Percona Live SF Feb 2011

White Paper. Optimizing the Performance Of MySQL Cluster

Database Scalability {Patterns} / Robert Treat

Tier Architectures. Kathleen Durant CS 3200

MySQL Enterprise Backup

XtraBackup: Hot Backups and More

This guide specifies the required and supported system elements for the application.

F1: A Distributed SQL Database That Scales. Presentation by: Alex Degtiar (adegtiar@cmu.edu) /21/2013

Future-Proofing MySQL for the Worldwide Data Revolution

vtiger CRM Database UTF-8 Configuration (For MySQL)

Zend Server 4.0 Beta 2 Release Announcement What s new in Zend Server 4.0 Beta 2 Updates and Improvements Resolved Issues Installation Issues

MySQL backups: strategy, tools, recovery scenarios. Akshay Suryawanshi Roman Vynar

Guerrilla Warfare? Guerrilla Tactics - Performance Testing MS SQL Server Applications

Learn Oracle WebLogic Server 12c Administration For Middleware Administrators

Cloud Based Application Architectures using Smart Computing

MySQL Replication. openark.org

MySQL Fabric: High Availability Solution for Connector/Python

Products and Solutions

Module 14: Scalability and High Availability

MySQL/MariaDB Multi-Master Replication & Failover

SCALABLE DATA SERVICES

Getting Started with Attunity CloudBeam for Azure SQL Data Warehouse BYOL

MySQL Backup IEDR

Administering and Managing Failover Clustering

Comparing MySQL and Postgres 9.0 Replication

MySQL backup and restore best practices. Roman Vynar September 21, 2015

Architectures Haute-Dispo Joffrey MICHAÏE Consultant MySQL

Cloud DBMS: An Overview. Shan-Hung Wu, NetDB CS, NTHU Spring, 2015

Full Text Search in MySQL 5.1 New Features and HowTo

Linas Virbalas Continuent, Inc.

Cloud Computing. With MySQL and Pentaho Data Integration. Matt Casters Chief Data Integration at Pentaho Kettle project founder

Online Schema Changes for Maximizing Uptime. David Turner - Dropbox Ben Black - Tango

TestOps: Continuous Integration when infrastructure is the product. Barry Jaspan Senior Architect, Acquia Inc.

Techniques for implementing & running robust and reliable DB-centric Grid Applications

MySQL Backup and Security. Best practices on how to run MySQL on Linux in a secure way Lenz Grimmer <lenz@mysql.com>

Mind Q Systems Private Limited

Parallel Replication for MySQL in 5 Minutes or Less

MySQL. Leveraging. Features for Availability & Scalability ABSTRACT: By Srinivasa Krishna Mamillapalli

Running MySQL on CentOS Linux. Peter Zaitsev April 14, 2014

MySQL High Availability Solutions. Lenz Grimmer OpenSQL Camp St. Augustin Germany

Database Replication with MySQL and PostgreSQL

3. Where can I obtain the Service Pack 5 software?

Transcription:

High-availability with Galera Cluster for MySQL LinuxTag 2014 10. Mai 2014, Berlin by oli.sennhauser@fromdual.com 1 / 22

About FromDual GmbH FromDual provides neutral and independent: Consulting for MySQL, Galera Cluster, MariaDB and Percona Server Support for all MySQL and Galera Cluster Remote-DBA Services for all MySQL MySQL Training Open Source Business Alliance (OSBA) Member of SOUG, DOAG, /ch/open 2 / 22

High-Availability :-( Its also about maintenance... Who loves night-shifts? Who loves weekend-work? Who does regular upgrade (DB, kernel, etc.)? Who does regular reboots (after kernel upgrade)? Why are you not doing it in your office hours? 3 / 22

The Galera Cluster for MySQL 4 / 22

Maintenance time... App Load balancing (LB) Upgrade Node 1 Node 2 RAM/HW Node O/S 3 wsrep wsrep DB? wsrep Galera replication 5 / 22

Advantages / Disadvantages Based on InnoDB SE Synchronous replication No lost transaction Active-active multi-master Cluster Read and write to any cluster node (no r/w split any more!) Read scalability and higher write throughput (Flash-Cache?) Automatic node membership control Rolling Restart (Upgrade of Hardware, O/S, DB release, etc.) True parallel replication, on row level No slave lag A bit more complicated than normal MySQL, but similar complexity as M/S Replication! No original MySQL binaries Codership MySQL binaries Be aware of Hot Spots on rows: Higher probability of deadlocks 6 / 22

Quorum and split-brain What is the problem? Split-brain bad!? Galera is a pessimistic Cluster good! Quorum: FLOOR(n/2+1) more than half! 3-node Cluster (or 2+1) 7 / 22

Quorum 8 / 22

Installation and Configuration 9 / 22

Installation Galera Cluster consists of: A patched Codership MySQL (mysqld) Or MariaDB Galera Cluster Or Percona XtraDB Cluster The Galera Plugin (libgalera_smm.so) Ways of installation Packets (RPM, DEB) Binary tar-ball Patch MySQL source and compile both Download http://galeracluster.com/downloads/ 10 / 22

MySQL Configuration my.cnf [mysqld] default_storage_engine binlog_format = InnoDB = row innodb_autoinc_lock_mode = 2 # parallel applying innodb_flush_log_at_trx_commit = 0 # performance only! query_cache_size = 0 # Galera 3 experimental query_cache_type = 0 # Mutex! Consistency! 11 / 22

Galera Configuration my.cnf (conf.d/wsrep.cnf) [mysqld] # wsrep_provider = none wsrep_provider = /lib/plugin/libgalera_smm.so # wsrep_cluster_address = "gcomm://" wsrep_cluster_address = "gcomm://ip_node2,ip_node3" wsrep_cluster_name wsrep_node_name wsrep_sst_method wsrep_sst_auth = 'Galera Cluster' = 'Node A' = mysqldump = sst:secret 12 / 22

Operations 13 / 22

Initial Cluster start Start very 1 st node with: wsrep_cluster_address = "gcomm://" or mysqld_safe wsrep cluster address="gcomm://" this tells the node to be the first one! All other nodes normal: service mysqld start 14 / 22

Rolling Restart Scenario: Hardware-, O/S-, DB- and Galera-Upgrade MySQL configuration change During full operation!!! (99.999% HA, 5x9 HA) Rolling Restart Start one node after the other in a cycle New features or settings are used after Rolling Restart is completed 15 / 22

Load Balancing Connectors Connector/J PHP: MySQLnd replication and load balancing plug-in SW Load Balancer GLB, LVS/IPVS/Ldirector, HAProxy HW Load Balancer 16 / 22

Location of Load Balancing 17 / 22

Demo? 18 / 22

Online Schema Upgrade (OSU) Schema Upgrade = DDL run against the DB Change DB structure Non transactional 2 Methods: Total Order Isolation (TOI) (default) Rolling Schema Upgrade (RSU) wsrep_osu_method = {TOI RSU} 19 / 22

Online Schema Upgrade Total Order Isolation (TOI) (default) Part of the database is locked for the duration of the DDL. + Simple, predictable and guaranteed data consistency. - Locking operation Good for fast DDL operations Rolling Schema Upgrade (RSU) DDL will be only processed locally at the node. Node is desynchronized for the duration of the DDL processing. After DDL completion, delayed write sets are applied (similar to IST). DDL should be manually executed at each node. + only blocking one node at a time - potentially unsafe and may fail if new and old schema are incompatible Good for slow DDL operations 20 / 22

Wir suchen noch: Datenbank Enthusiast/in für Support / remote-dba / Beratung 21 / 22

Q & A Questions? Discussion? We have time for some face-to-face talks... FromDual provides neutral and independent: Consulting Remote-DBA Support for MySQL, Galera, Percona Server and MariaDB Training 22 / 22