MySQL Performance Schema

Size: px

Start display at page:

Download "MySQL Performance Schema"

Lillian Phelps
7 years ago
Views:

1 MySQL Performance Schema By Vadim Tkachenko and Alexander Rubin Copyright Percona LLC

2 Table of Contents Chapter 1: MySQL 5.6 Performance Schema in multi-tenant environments Chapter 2: Performance Schema overhead Chapter 3: Performance Schema tables stats About Percona Percona was founded in August 2006 by Peter Zaitsev and Vadim Tkachenko and now employs a global network of experts with a staff of more than 100 people. Our customer list is large and diverse, including Fortune 50 firms, popular websites, and small startups. We have over 1,800 customers and, although we do not reveal all of their names, chances are we're working with every large MySQL user you've heard about. To put Percona's MySQL expertise to work for you, please contact us. Is this an emergency? Get immediate assistance from Percona Support 24/7. Click here Skype: oncall.percona GTalk: oncall@percona.com AIM (AOL Instant Messenger): oncallpercona Telephone direct-to-engineer: or UK Toll Free: Telephone to live operator: Customer portal: Copyright Percona LLC

3 Chapter 1: MySQL 5.6 Performance Schema in multi-tenant environments MySQL 5.6 Performance Schema in multi-tenant environments By Alexander Rubin Hosting a shared MySQL instance for your internal or external clients ( multi-tenant ) was always a challenge. Multi-tenants approach or a schema-per-customer approach is pretty common nowadays to host multiple clients on the same MySQL sever. One of issues of this approach, however, is the lack of visibility: it is hard to tell how many resources (queries, disk, cpu, etc) each user will use. Percona Server contains userstats Google patch, which will allow you to get the resource utilization per user. The new MySQL 5.6 performance_schema has even more instrumentation which can give you a better visibility on per-user or per-schema/per-database level. And if you are running MySQL or higher, Performance Schema is already enabled (with minimum set of instrumentation thou) and ready to use. In this post I will share examples of using Performance Schema for multi-tenant environments. Overview If you want to use Performance Schema, make sure it is enabled (enabled by default starting with MySQL 5.6.6): Performance_schema provides you with the raw metrics and it may be difficult to select data from it. The good news is that you can use the project by. The sys schema (old name: ps_helper) is a collection of views and stored procedures which will provide you with reports in human readable format. The installation is easy, it from github and run: (it will only create database sys and a set of views and stored procedures/stored functions in it) Examples For the multi-tenant environment the most interesting is resource utilization breakdown. Lets say you want to charge per IO similar to model. You can now run this simple query against sys schema, which will use Performance Schema in MySQL 5.6 to generate report (in my example all users starts with a ): 3

4 Chapter 1: MySQL 5.6 Performance Schema in multi-tenant environments If you need more extensive metrics you can use this report: Or a breakdown per user per statement: 4

Chapter 1: MySQL 5.6 Performance Schema in multi-tenant environments If you are using schema per customer approach you get get the per-schema resource utilization using sys.schema_table_statistics.

5 Chapter 1: MySQL 5.6 Performance Schema in multi-tenant environments If you are using schema per customer approach you get get the per-schema resource utilization using sys.schema_table_statistics. Example (from one of Peter Zaitsev s recent webinars): This report may be really slow if you have lots of tables. If you are only interested in disk utilization per database you can directly query the performance_schema: 5

6 Chapter 1: MySQL 5.6 Performance Schema in multi-tenant environments If you also need to get a quick hot tables report with focus on disk utilization (io requests) you can use this query: This will give you a breakdown per table (and will include system files as well). Conclusion Performance_schema in MySQL 5.6 is very useful tool and can help you to get better visualization in MySQL multi-user (multi-tenant) installations. It can also do much more, i.e. find all queries with temporary tables or profile locks and mutex. sys schema provide you with the useful pre-defined reports, the table (view) names are almost self explanatory: If you are using MySQL 5.6, performance_schema will give a additional valuable inside. 6

7 Chapter 2: Performance Schema overhead Performance Schema overhead By Vadim Tkachenko As continuation of my CPU benchmarks it is interesting to see what is scalability limitation in MySQL 5.6.2, and I am going to check that using PERFORMANCE SCHEMA, but before that let s estimate what is potential overhead of using PERFORMANCE SCHEMA. So I am going to run the same benchmarks (sysbench read-only and read-write) as in previous post with different performance schema options and compare results. I am going to use Cisco UCS C250 with next settings: PERFORMANCE SCHEMA disabled (NO PS) PERFORMANCE SCHMEA enabled, with all consumers ON (PS on) PERFORMANCE SCHMEA enabled, but only global_instrumentation consumer enabled. It allows to gather table and index access statistics (PS only global) PERFORMANCE SCHMEA enabled, but all consumers OFF (PS all off) The full results with details are not our Benchmark Wiki There is graph for read-only case: 7

8 Chapter 2: Performance Schema overhead and for read-write: To have some numeric impression, let s see ration of result with PS to result without PS There is table with ratios for read-only case: 8

9 Chapter 2: Performance Schema overhead There is table with ratios for read-write case: So this allows us to make next summary: In read-only case, Performance Schema with all consumers gives about 25% overhead, with global instrumentation only -10%, and with all disabled consumers about 8%. For read-write case, Performance Schema with all consumers gives about 19% overhead, with global instrumentation only -11%, and it is about the same with all disabled consumers. Is that big or small? I leave it for you to decide, I think it may be acceptable in some cases and not in some others. I wish only that Performance Schema with all disabled consumers gives less overhead, 8-11% seems significant. If nothing helps I would like to be able to fully disable / enable performance schema in run-time, not at start-time. As I understand dtrace / systemtap probes can be disabled / enabled at run-time, and when they disabled it is almost 0% overhead, why Performance Schema can t do the same? (Disclaimer: This benchmark is sponsored by Well Know Social Network, and they are generous to make it public) 9

Chapter 3: Performance Schema table stats Performance Schema tables stats In the previous chapter, the benchmark on Performance Schema was mainly in memory workload and against single tables.

10 Chapter 3: Performance Schema table stats Performance Schema tables stats In the previous chapter, the benchmark on Performance Schema was mainly in memory workload and against single tables. Now, after adding multi-tables support to sysbench, it is interesting to see what statistic we can get from workload that produces some disk IO. So let s run sysbench against 100 tables, each rows (~1.2G ) and buffer pool 30G. The scripts and results are on Benchmark Wiki. By Vadim Tkachenko If we look on performance overhead it appears rather big in read-only benchmark, and it is well explained in, so let s keep this question aside and wait on further 5.6 releases with fixes. Now I am going to post some statistics we are able to get from performance schema tables. 1. table_io_waits_summary_by_table 10

11 Chapter 3: Performance Schema table stats Or using this data we can TOP 5 accessed tables via 2. There is table with statistic per index: 11

12 Chapter 3: Performance Schema table stats Interesting that UPDATE/DELETE operations are not counted in INDEX_NAME: PRIMARY, : Inserts are counted against INDEX_NAME = NULL, but it does not mention UPDATEs and DELETEs. 12

13 Chapter 3: Performance Schema table stats 3. Beside logical access to tables, we can see physical IO to files:... or we can get top tables that required read IO: Interesting that top tables that required IO are not the same that most accessed. 13

Powered by TCPDF (www.tcpdf.org) About the authors Vadim Tkachenko co-founded Percona in 2006 after four years in the High Performance Group within the official MySQL Support Team.

14 Powered by TCPDF ( About the authors Vadim Tkachenko co-founded Percona in 2006 after four years in the High Performance Group within the official MySQL Support Team. He serves on Percona's executive team as CTO. He also leads Percona's development group, which produces Percona Server, Percona XtraDB, and Percona XtraBackup. He now lives in California with his wife and their two children. Alexander Rubin joined Percona in He's worked with MySQL since 2000 as a DBA and application developer. He was a MySQL consultant for 7 years prior to Percona (starting with MySQL AB in 2006, then Sun Microsystems and then Oracle). Alexander has helped many customers design large, scalable and highly available MySQL systems and optimize MySQL performance. He has also helped customers design Big Data stores with Apache Hadoop and related technologies.. Visit the Percona library for more free MySQL ebook selections Copyright Percona LLC

MySQL performance in a cloud. Mark Callaghan

MySQL performance in a cloud. Mark Callaghan MySQL performance in a cloud Mark Callaghan Special thanks Eric Hammond (http://www.anvilon.com) provided documentation that made all of my work much easier. What is this thing called a cloud? Deployment