MySQL 備份, 高可用及高扩展解决方案

Size: px

Start display at page:

Download "MySQL 備份, 高可用及高扩展解决方案"

Amie Small
7 years ago
Views:

1 <Insert Picture Here> MySQL 備份, 高可用及高扩展解决方案 MySQL 复制和集群杜修文 Oracle MySQL Principle Sales Consultant

2 Backup and Restore

3 Backup Strategies Comparison Method 1: Longest Backup Times Full Backups Largest Storage Space Save space with compression Easy to Recover Fastest Restore Times Method 2: Full + Incremental Backup Shortest Backup Time Reduced Storage Requirements Requires 1X production storage for copy Finer-grained Recovery Slower Restore Times First Restore Full Backup Then Restore Incrementals Method 3: Full + Incremental + Log Backup Added Storage Requirements Requires more than 1X production storage for copy Finest-grained Recovery Slowest Restore Times First Restore Full Backup Then Restore Incrementals Then Apply Logs Method 4: Offload Backups Slave Replication Used with 1 of the above Frees Master for more workload Requires 1X production hardware and storage for standby database Fast failover to standby Backups are last resort, in event of double site failure or need to perform PITR

Full + Incremental + Log Backup Added Storage Requirements Requires more than 1X production storage for copy Finest-grained Recovery Slowest Restore Times First Restore Full Backup Then Restore

4 MySQL Backup Type: Comparison mysqldump LVM Snapshots MySQL Replication MySQL Enterprise Backup Full Backup Incremental Backups Partial Backups Compression Support Allows updates Point Consistent in Time - Backup Speed Poor Good Very Good Very Good Recovery Speed Poor Good Very Good Very good Partial Restore Corruption Detection Meets Regulatory Archive Req. Supports DDL

Point Consistent in Time - Backup Speed Poor Good Very Good Very Good Recovery Speed Poor

database file formats Block Validation Tablespace/Data file recovery Unused Block

5 MySQL Enterprise Backup MySQL Enterprise Backup CLI MySQL Enterprise Monitor Oracle Secure Backup Media Manager (like Oracle Secure Backup) Intrinsic knowledge of database file formats Block Validation Tablespace/Data file recovery Unused Block Compression Consistent Recovery File Compression Database Quickly Accessible Disk Storage Tape Archive

6 MySQL Enterprise Backup: Terms mysqlbackup : backup executable which includes InnoDB, MyISAM and other MySQL Data. mysqlbackup is a compatible replacement for the innobackup post and includes additional features and capabilites ibbackup: finer grained raw innodb backup executable for innodb files alone binlog: contains database changes eg DDL and DML LSN: Log Sequence Number the unique monotonically increasing id for each change in the binlog ibdata: system tablespace files.ibd: single table space file

1 and includes additional features and capabilites ibbackup: finer grained raw innodb backup executable for innodb files alone

7 mysqlbackup Usage Syntax $ mysqlbackup [--sleep=ms] [--compress[=level]] [--include=regexp] [--user=word][--password=word] [--port=port] [--socket=socket] [--no-timestamp] [--ibbackup=ibbackup-binary] [--slave-info] [--backup-and-apply-log] [--databases=list] [--exec-when-locked="utility arg1 arg2..."] [--incremental --lsn=lsn] [--only-known-file-types] MY.CNF BACKUP-ROOT-DIR $ mysqlbackup --apply-log [--use-memory=mb] [--uncompress] [--ibbackup=ibbackup-binary] MY.CNF BACKUP-DIR $ mysqlbackup --apply-log --incremental [--use-memory=mb] [--uncompress] [--ibbackup=ibbackup-binary] INCREMENTAL-BACKUP-MY.CNF FULL-BACKUP-MY.CNF $ mysqlbackup --copy-back MY.CNF BACKUP-DIR

.."] [--incremental --lsn=lsn] [--only-known-file-types] MY.

8 mysqlbackup (innobackup) Examples Full Backup mysqlbackup --user=dba --password=xyz --compress /etc/my.cnf /backups Incremental Backup The backup only contains changed data mysqlbackup --incremental --lsn /etc/my.cnf /incr-backup Partial The backup contains tables in test database that match the.ib.* regular expression. mysqlbackup --include 'test\.ib.*' /etc/my.cnf /backups

cnf /backups Incremental Backup The backup only contains changed data mysqlbackup --incremental

9 How mysqlbackup Works mysqlbackup SQL: FLUSH TABLES WITH READ LOCK Exec s ibbackup InnoDB Tables & Indexes MyISAM Tables & Indexes,.frm, &.mrg files MySQL Command-line SQL Client SQL Hot Backup Files MySQL Database Files Flush, Lock MySQL Server

10 MySQL 高可用和集群

11 驱动新的需求 EXTREME WRITE SCALABILITY REAL TIME USER EXPERIENCE ROCK SOLID RELIABILITY RAPID SERVICE INNOVATION 11 编号

12 不妥协事务完整性 OLTP + 实时分析, 标淮和技术组成 EXTREME WRITE SCALABILITY REAL TIME USER EXPERIENCE ROCK SOLID RELIABILITY ELIMNATE BARRIERS TO ENTRY 12 编号

14 MySQL 的高可用方案 MySQL Replication Asynchronous replication MySQL+DRBD (for Linux) Shared Nothing Active/Passive Application / Web / Web AP Application / Web / Web AP Load Balancing Fail Over on failure MySQL Server Asynchronous Replication MySQL Server MySQL Server Synchronous Replication MySQL Server Shared Disk Based Active/Passive Application / Web / Web AP MySQL Cluster Shared Nothing Active/Active Application / Web / Web AP Fail Over on failure Load Balancing MySQL Server Shared disk MySQL Server MySQL Cluster Synchronous Replication MySQL Cluster 14 编号

Replication MySQL Server Shared Disk Based Active/Passive Application / Web / Web AP MySQL Cluster Shared Nothing Active/Active Application /

15 高可用和扩充性 MySQL 复制在资讯中心之内和之间横向扩充自我疗愈和不受失败影响支援多种架构 Master/Slave, Cascading, Circular 预设是非同步, 半同步是另一种选项复制工具以快速推进资支持监看和最佳实践 Relay Log 15 编号

16 MySQL 集群架构 Clients Application Layer Management MySQL Cluster Data Nodes Data Layer 16 编号

17 MySQL Cluster 的组成 SQL Node (MySQL) Standard SQL Interface Scale-out for Performance Enables Replication NDB API (Application) High Performance C, C++ & Java, LDAP, HTTP API Developer s Guide Data Node (NDB Storage Engine) Data Storage (Memory/Disk) Automatic & User-Defined Partitioning Local & Global Checkpoints Scale-out or scale-up for Capacity & Redundancy Scale dynamically with on-line add node Management Node Administration and Configuration Arbitration Use Two for Redundancy 17 编号

(Memory/Disk) Automatic & User-Defined Partitioning Local & Global Checkpoints Scale-out or scale-up for Capacity &

18 MySQL 集群架构工作能量扩展 Clients Application Layer Management Management MySQL Cluster Data Nodes 18 编号

19 MySQL 集群架构无单点固障 Clients Application Layer Management Management MySQL Cluster Data Nodes 19 编号

20 复制的弹性 Cluster 1 Cluster 2 Synchronous replication within a Cluster node group for HA Bi-Direction asynchronous replication to remote Cluster for geographic redundancy Asynchronous replication to non-cluster databases for specialised activities such as report generation Mix and match replication types InnoDB InnoDB InnoDB Synchronous replication Asynchronous replication 20 编号

replication to non-cluster databases for specialised activities such as report generation Mix

21 多数据中心的可用性跨域复制容灾和据本地化跨数据中心复制整个集群 Fully active/active No passive resources 一个集群分在数个数据中心 Synchronous replication & auto-failover between sites 21 编号

22 排定的在线维护 Scale Backup Evolve Upgrade 22 编号

23 MySQL 集群 : SQL 和 NoSQL 彈性 Mix & Match 23 编号

24 毎分鐘達 12 億次更新操作 Millions of UPDATEs per Second MySQL Cluster Data Nodes NoSQL C++ API, flexasynch benchmark 30 x Intel E Intel Servers, 2 socket, 64GB ACID Transactions, with Synchronous Replication 24 编号

25 MySQL 集群 : Auto-Installer 快速电配置自动发现, 工作负荷优化 25 编号

26 最高等级的性能, 安全和可用度 MySQL Enterprise Security Oracle Premier Lifetime Support Oracle Product Certifications/Integrations MySQL Enterprise Audit MySQL Enterprise Monitor/Query Analyzer MySQL Enterprise Scalability MySQL Cluster Manager MySQL Enterprise Backup MySQL Workbench 26 编号

27 强化开发者运行的灵活性, 减少停机时间 Automated Management Self-Healing HA Operations Start / Stop node or whole cluster On-Line Scaling Reconfiguration On-Line On-Line Upgrades On-Line Backup & Restore Node monitoring Auto-recovery extended to SQL + mgmt nodes Cluster-wide configuration consistency Persistent configurations HA Agents 27 编号

28 Cluster Manager 如何帮助? 例如 : 自 MySQL Cluster 7.0 升级到 7.3 Before MySQL Cluster Manager 1 x preliminary check of cluster state 8 x ssh commands per server 8 x per-process stop commands 4 x scp of configuration files (2 x mgmd & 2 x mysqld) 8 x per-process start commands 8 x checks for started and re-joined processes 8 x process completion verifications 1 x verify completion of the whole cluster. Excludes manual editing of each configuration file. Total: 46 commands hours of attended operation With MySQL Cluster Manager upgrade cluster --package=7.3 mycluster; Results Total: 1 Command - Unattended Operation Reduces complexity Reduces risks of downtime Automated best practices 28 编号

MySQL 企业监控 Web-based, global view of MySQL Cluster (on-premise and Cloud deployments) Automated, rules-based monitoring and alerts (SMTP, SNMP enabled) Query

29 MySQL 企业监控 Web-based, global view of MySQL Cluster (on-premise and Cloud deployments) Automated, rules-based monitoring and alerts (SMTP, SNMP enabled) Query capture, monitoring, analysis and tuning, correlated with Monitor graphs Real-time monitoring of data nodes Integrated with Oracle Support A Virtual MySQL DevOps + Admin! 29 编号

30 Oracle 对 MySQL 的优质服务依靠专家取得独特的效益直接来自源头最大的 MySQL 专业队伍有 MySQL 开发团队做后盾提供向上相容的热修复 MySQL 维护发行 MySQL 以 29 种语言支持 24/7/365 不限支持的次数知识库 MySQL 顾问谘询服务 "The MySQL support service has been essential in helping us with troubleshooting and providing recommendations for the production cluster, Thanks." -- Carlos Morales Playfulplay.com Only From Oracle 30 编号

31 <Insert Picture Here> MySQL 高可用及高扩展解决方案 MySQL 复制和集群杜修文 Oracle MySQL Principle Sales Consultant

MySQL Enterprise Backup

MySQL Enterprise Backup Fast, Consistent, Online Backups A MySQL White Paper February, 2011 2011, Oracle Corporation and/or its affiliates Table of Contents Introduction... 3! Database Backup Terms...

MySQL 備 份, 高 可 用 及 高 扩 展 解 决 方 案

MySQL 備份, 高可用及高扩展解决方案