Monitoring MySQL. Kristian Köhntopp

Size: px
Start display at page:

Download "Monitoring MySQL. Kristian Köhntopp"

Transcription

1 Monitoring MySQL Kristian Köhntopp

2 I am... Kristian Köhntopp Database architecture at a small travel agency in Amsterdam In previous lives: MySQL, web.de, NetUSE, MMC Kiel, PHP, PHPLIB, various FAQs and Howto

3 You are Job DBA, Developer, General IT, IT Management Using version , 4.0, 4.1, 5.0, 5.1 Using MySQL for... Webapps, Enterprise, Embedded,... Number of servers... 1, <3, <10, <25, <100, 100 or more

4 Why Monitoring? Audience Consumers of monitoring data Metrics What kind of data necessary? Toolbox Which kind of tool to use?

5 Why Monitoring? Who requires monitoring? Operations (Incident) Infrastructure Development (Capacity) Feature Development (Debug) Compliance (SLA, Legal)

6 Why Monitoring? Each kind of monitoring has different Purpose Metric Raw data, Notification latency Deliverable HA requirements

7 Incident detection Purpose: Are we still online? Metric: High level availability test w/ binary outcome Deliverable: Ticket to Helpdesk Operating Incident Management Latency: Seconds HA Requirement: Minutes, high

8 Capacity planning Purpose: When can I guarantee server overload? (Negative SLA) Metric: detailed records of variables in all subsystems Deliverable: weekly/monthly report to IT Management, general Management Latency: days HA Requirement: days/low

9 Debugging Purpose: Which query crashes the server? Why is this statement slow? Metric: detailed records of variables while processing a single query Deliverable: individual report to single developer Latency: Seconds, Minutes HA Requirement: none

10 Compliance Purpose: Are we fulfilling our contracts? Metric: high level availability tests w/ binary outcome, query times Deliverable: weekly/monthly report to IT management/customer Latency: Days HA Requirement: days, low

11 For Audit Purpose: Detect tampering, alteration and access, create accountability records for changes and access Metric: high level event records with application semantics additionally: inescapable, unforgeable Deliverable: daily/weekly report HA Requirement: Out of path

12 Metrics Data sources at OS level Data sources in MySQL Derived data sources

13 OS Level Internal Availability Check: presence of PID file presence of process test -f linux.pid is not good enough kill -0 $(cat linux.pid) is better than ps axuwww grep mysql[d]

14 OS Level External Availability Check : ping check trivial query Set timeouts for the trivial query according to SLA

15 OS Level Memory Checks: process size in memory VSIZE vs. RSS buffer cache size ( free -m ) swap check! vm.swappiness = 0

16 OS Level iostat -x 1 3 output In general, databases are limited by seek/sec, not MB/sec SSD, FusionIO Network I/O quality Smokeping? (Cluster!)

17 OS Level

18 MySQL General Counters and Config: SHOW /*!50000 GLOBAL */ STATUS; SHOW /*!50000 GLOBAL */ VARIABLES; What is running? SHOW FULL PROCESSLIST;

19 MySQL File Handles: SHOW TABLE STATUS; SHOW OPEN TABLES;

20 MySQL Replication: SHOW SLAVE STATUS; SHOW MASTER LOGS; SHOW MASTER STATUS;

21 MySQL InnoDB: SHOW ENGINE INNODB STATUS; SHOW GLOBAL STATUS LIKE 'inno%';

22 Status: General qps: questions/uptime COM_% Counters:

23 Status: General COM_% Counters Read/Writes: ( select + qcache_hits ) / ( insert+update+delete+replace ) Transactions: #commit, rollback/commit, writes/ commit

24 Status: Caches Table Cache (opened_tables/sec ) (table_cache_size open_tables) Thread Cache (threads_created/sec) (thread_cache_size threads_cached)

25 Status: Caches

26 Status: Caches Query-Cache Hit Ratio: qcache_hits*100 / ( qcache_hits + com_select ) Hits vs. Inserts vs. Not Cached

27 Status: Caches Lowmem Prunes: qcache_lowmem_prunes / uptime qcache_lowmem_prunes per second

28 Status: Caches Increase query cache size: less prunes, higher hit ratio Sometimes it is better to delay writes or to split tables instead

29 Status: Caches

30 Status: Connections Connections max_connections max_used_connections max_connections - threads_connected

31 Status: Connections

32 Status: MyISAM Key Cache Hit Ratio: key_read_requests / key_read target 99.7% or better hit ratio

33 Status: MyISAM MyISAM Lock Contention table_locks_waited * 100 / table_locks_immediate <1% good, 1% warning, >3% you are currently dying distinctly nonlinear behavior

34 Status: MyISAM

35 Status: InnoDB Page Cache Usage: Innodb_buffer_pool_pages_free *100 / Innodb_buffer_pool_pages_total Cache Miss Ratio: (Innodb_buffer_pool_reads / Innodb_buffer_pool_read_requests)*100 target: <3%, <1%

36 Status: InnoDB Cache Monitoring: Innodb_buffer_pool_wait_free must not count up! Log-Monitoring: Innodb_log_waits must not count up!

37 Status: InnoDB InnoDB has many more stats See Innotop output, read up on theory Worth a talk of its own

38 Status: temp tables Temp tables per second: created_tmp_tables Temp tables to Disk: created_disk_tmp_tables * 100 / created_tmp_tables

39 Status: temp tables Additional hints: What kind of filesystem is tmpdir pointing to? Are we selecting BLOB/TEXT types? tmp_table size and max_heap_table_size must match

40 Status: temp tables

41 Status: Replication Functionality: Slave_IO_running: YES, Slave_SQL_running: YES Lag: Seconds_behind_master Rate: Read_Master_Log_Pos/sec,

42 Status: Replication

43 Status: Slow Queries Slow Queries in general: Slow_queries/sec Counting evil queries: select_full_join / sec select_full_join / com_select

44 Toolbox: Incidents Incident detection: Nagios family Load Balancer Live Check Post Mortem: A small shell script running per minute

45 Toolbox: Incidents Nagios Plugins Quality: Bad checks Scripts Not compliant w/ standards Incident monitors vs. Compliance monitors

46 Toolbox: Post Mortem Record per minute, keep one week logged to /var/log/mysql_pl uptime, ps auxwww, df -Th, free -m show full processlist; show slave status; show engine innodb status if HAVE_INNODB == YES

47 Toolbox: Incidents

48 Toolbox: Capacity MySQL Enterprise Monitor Cacti or Munin Actual overload tests increase LB weights monitor latency of standardized probe to detect breakage

49 MEM

50 Tools: Cacti Shiny, but creating templates is a pain! Ready-made templates from /p/mysql-cacti-templates/

51 Tools: Capacity Free MySQL SNMP tools are rare Exporting Variables, Status and Slave Status to SNMP: Perl Coprocess (PoC at best) archives/63-guid.html

52 Toolbox: Console inntop (mytop is dead) maatkit (indispenseable) tuning-primer.sh Self-written tools Establish a culture of tool creation

53 Toolbox: Debug MEM w/ proxy Proxy sometimes problematic Alternative: Rig DB access class mk-query-digest w/ SPAN port at switch

54 Toolbox: Debug

55 Toolbox: Audit Trailing controls Agile development Dump comparison mysqldump --no-data & git & diff mk-show-grants & git & diff etc.

56 Toolbox: Audit We have very many servers Critical data on isolated servers Limited access Wonders of an unlimited license

57

Monitoring MySQL. Presented by, MySQL & O Reilly Media, Inc. A quick overview of available tools

Monitoring MySQL. Presented by, MySQL & O Reilly Media, Inc. A quick overview of available tools Monitoring MySQL Presented by, MySQL & O Reilly Media, Inc. A quick overview of available tools Monitoring! Monitoring your database is as important as benchmarking! You want to view trends over time!

More information

Monitoring MySQL. Geert Vanderkelen MySQL Senior Support Engineer Sun Microsystems

Monitoring MySQL. Geert Vanderkelen MySQL Senior Support Engineer Sun Microsystems Monitoring MySQL Geert Vanderkelen MySQL Senior Support Engineer Sun Microsystems Agenda Short intro into MySQL, the company Monitoring MySQL: some examples Nagios plugins for MySQL MySQL Enterprise Monitor

More information

How to Optimize the MySQL Server For Performance

How to Optimize the MySQL Server For Performance 1 Copyright 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 MySQL Server Performance Tuning 101 Ligaya Turmelle Principle Technical

More information

How To Monitor Mysql With Zabbix

How To Monitor Mysql With Zabbix MySQL Performance Monitoring with Zabbix An alternative to the MySQL Enterprise Monitor? by Oli Sennhauser oli.sennhauser@fromdual.com http:// 1 How many of you... monitor their database servers? monitor

More information

DBA Tutorial Kai Voigt Senior MySQL Instructor Sun Microsystems kai@sun.com Santa Clara, April 12, 2010

DBA Tutorial Kai Voigt Senior MySQL Instructor Sun Microsystems kai@sun.com Santa Clara, April 12, 2010 DBA Tutorial Kai Voigt Senior MySQL Instructor Sun Microsystems kai@sun.com Santa Clara, April 12, 2010 Certification Details http://www.mysql.com/certification/ Registration at Conference Closed Book

More information

Effective MySQL Monitoring. Baron Schwartz March 2012

Effective MySQL Monitoring. Baron Schwartz March 2012 Effective MySQL Monitoring Baron Schwartz March 2012 Who Am I? Who Am I? Who Am I? Maatkit Percona Toolkit Innotop Monitoring Plugins Aspersa Online Tools JavaScript Libraries Consulting Percona Server

More information

Maintaining Non-Stop Services with Multi Layer Monitoring

Maintaining Non-Stop Services with Multi Layer Monitoring Maintaining Non-Stop Services with Multi Layer Monitoring Lahav Savir System Architect and CEO of Emind Systems lahavs@emindsys.com www.emindsys.com The approach Non-stop applications can t leave on their

More information

Tushar Joshi Turtle Networks Ltd

Tushar Joshi Turtle Networks Ltd MySQL Database for High Availability Web Applications Tushar Joshi Turtle Networks Ltd www.turtle.net Overview What is High Availability? Web/Network Architecture Applications MySQL Replication MySQL Clustering

More information

Dave Stokes MySQL Community Manager

Dave Stokes MySQL Community Manager The Proper Care and Feeding of a MySQL Server for Busy Linux Admins Dave Stokes MySQL Community Manager Email: David.Stokes@Oracle.com Twiter: @Stoker Slides: slideshare.net/davidmstokes Safe Harbor Agreement

More information

Monitoring and Alerting

Monitoring and Alerting Monitoring and Alerting All the things I've tried that didn't work, plus a few others. By Aaron S. Joyner Senior System Administrator Google, Inc. Blackbox vs Whitebox Blackbox: Requires no participation

More information

Databases and SQL. Homework. Matthias Danner. June 11, 2013. Matthias Danner Databases and SQL June 11, 2013 1 / 16

Databases and SQL. Homework. Matthias Danner. June 11, 2013. Matthias Danner Databases and SQL June 11, 2013 1 / 16 Databases and SQL Homework Matthias Danner June 11, 2013 Matthias Danner Databases and SQL June 11, 2013 1 / 16 Install and configure a MySQL server Installation of the mysql-server package apt-get install

More information

Using MySQL for Big Data Advantage Integrate for Insight Sastry Vedantam sastry.vedantam@oracle.com

Using MySQL for Big Data Advantage Integrate for Insight Sastry Vedantam sastry.vedantam@oracle.com Using MySQL for Big Data Advantage Integrate for Insight Sastry Vedantam sastry.vedantam@oracle.com Agenda The rise of Big Data & Hadoop MySQL in the Big Data Lifecycle MySQL Solutions for Big Data Q&A

More information

Using Cacti To Graph MySQL s Metrics

Using Cacti To Graph MySQL s Metrics Using Cacti To Graph MySQL s Metrics Kenny Gryp kenny.gryp@percona.com Principal Consultant @ Percona Collaborate 2011 1 Percona MySQL/LAMP Consulting MySQL Support Percona Server (XtraDB) Percona XtraBackup

More information

2000 databases later. Kristian Köhntopp http://google.com/+kristiankohntopp. Mittwoch, 17. April 13

2000 databases later. Kristian Köhntopp http://google.com/+kristiankohntopp. Mittwoch, 17. April 13 2000 databases later Kristian Köhntopp http://google.com/+kristiankohntopp TL;DR about 2000 MySQL instances in production Mostly running MySQL 5.5, some 5.6 beta since May 2012 made gamble that we would

More information

Monitoreo de Bases de Datos

Monitoreo de Bases de Datos Monitoreo de Bases de Datos Monitoreo de Bases de Datos Las bases de datos son pieza fundamental de una Infraestructura, es de vital importancia su correcto monitoreo de métricas para efectos de lograr

More information

High Availability Solutions for the MariaDB and MySQL Database

High Availability Solutions for the MariaDB and MySQL Database High Availability Solutions for the MariaDB and MySQL Database 1 Introduction This paper introduces recommendations and some of the solutions used to create an availability or high availability environment

More information

Database Administration with MySQL

Database Administration with MySQL Database Administration with MySQL Suitable For: Database administrators and system administrators who need to manage MySQL based services. Prerequisites: Practical knowledge of SQL Some knowledge of relational

More information

MONyog White Paper. Webyog

MONyog White Paper. Webyog 1. Executive Summary... 2 2. What is the MONyog - MySQL Monitor and Advisor?... 2 3. What is agent-less monitoring?... 3 4. Is MONyog customizable?... 4 5. Comparison between MONyog and other Monitoring

More information

A recipe using an Open Source monitoring tool for performance monitoring of a SaaS application.

A recipe using an Open Source monitoring tool for performance monitoring of a SaaS application. A recipe using an Open Source monitoring tool for performance monitoring of a SaaS application. Sergiy Fakas, TOA Technologies Nagios is a popular open-source tool for fault-monitoring. Because it does

More information

MySQL Cluster Deployment Best Practices

MySQL Cluster Deployment Best Practices MySQL Cluster Deployment Best Practices Johan ANDERSSON Joffrey MICHAÏE MySQL Cluster practice Manager MySQL Consultant The presentation is intended to outline our general product

More information

MySQL Backup and Recovery: Tools and Techniques. Presented by: René Cannaò @rene_cannao Senior Operational DBA www.palominodb.com

MySQL Backup and Recovery: Tools and Techniques. Presented by: René Cannaò @rene_cannao Senior Operational DBA www.palominodb.com MySQL Backup and Recovery: Tools and Techniques Presented by: René Cannaò @rene_cannao Senior Operational DBA www.palominodb.com EXPERIENCE WITH BACKUP How many of you consider yourself beginners? How

More information

Part 3. MySQL DBA I Exam

Part 3. MySQL DBA I Exam Part 3. MySQL DBA I Exam Table of Contents 23. MySQL Architecture... 3 24. Starting, Stopping, and Configuring MySQL... 6 25. Client Programs for DBA Work... 11 26. MySQL Administrator... 15 27. Character

More information

Synchronous multi-master clusters with MySQL: an introduction to Galera

Synchronous multi-master clusters with MySQL: an introduction to Galera Synchronous multi-master clusters with : an introduction to Galera Henrik Ingo OUGF Harmony conference Aulanko, Please share and reuse this presentation licensed under Creative Commonse Attribution license

More information

Zabbix. At Scale. By Steve Mushero September, 2014. Running the World s Internet Servers. www.chinanetcloud.com Copyright 2014 ChinaNetCloud

Zabbix. At Scale. By Steve Mushero September, 2014. Running the World s Internet Servers. www.chinanetcloud.com Copyright 2014 ChinaNetCloud Zabbix At Scale By Steve Mushero September, 2014 Build & Manage Servers Optimize & Manage Servers Managed Cloud Servers Copyright 2014 ChinaNetCloud Greetings I m Steve I m from Shanghai, China We have

More information

Performance Tuning and Optimization for high traffic Drupal sites. Khalid Baheyeldin Drupal Camp, Toronto May 11 12, 2007

Performance Tuning and Optimization for high traffic Drupal sites. Khalid Baheyeldin Drupal Camp, Toronto May 11 12, 2007 Performance Tuning and Optimization for high traffic Drupal sites Khalid Baheyeldin Drupal Camp, Toronto May 11 12, 2007 Agenda Introduction The LAMP Stack Linux, Apache, MySQL, PHP Drupal Database queries

More information

PGCon 2011. PostgreSQL Performance Pitfalls

PGCon 2011. PostgreSQL Performance Pitfalls PGCon 2011 PostgreSQL Performance Pitfalls Too much information PostgreSQL has a FAQ, manual, other books, a wiki, and mailing list archives RTFM? The 9.0 manual is 2435 pages You didn't do that PostgreSQL

More information

making drupal run fast

making drupal run fast making drupal run fast 2 Objectives Improve drupal performance Provide Simple tips on Increasing Drupal performance We have some data from load testing a site in these different configs: ++ plain drupal

More information

Network Management & Monitoring Overview

Network Management & Monitoring Overview Network Management & Monitoring Overview Advanced cctld Workshop September, 2008, Holland What is network management? System & Service monitoring Reachability, availability Resource measurement/monitoring

More information

Monitoring PostgreSQL database with Verax NMS

Monitoring PostgreSQL database with Verax NMS Monitoring PostgreSQL database with Verax NMS Table of contents Abstract... 3 1. Adding PostgreSQL database to device inventory... 4 2. Adding sensors for PostgreSQL database... 7 3. Adding performance

More information

High Availability and Scalability for Online Applications with MySQL

High Availability and Scalability for Online Applications with MySQL High Availability and Scalability for Online Applications with MySQL Part 1I - Advanced Replication Ivan Zoratti Sales Engineering Manager EMEA ivan@mysql.com April 2007 Agenda Welcome back! and Welcome

More information

MySQL Storage Engines

MySQL Storage Engines MySQL Storage Engines Data in MySQL is stored in files (or memory) using a variety of different techniques. Each of these techniques employs different storage mechanisms, indexing facilities, locking levels

More information

Welcome to Virtual Developer Day MySQL!

Welcome to Virtual Developer Day MySQL! Welcome to Virtual Developer Day MySQL! Keynote: Developer and DBA Guide to What s New in MySQL Andrew Morgan - MySQL Product Management @andrewmorgan www.clusterdb.com 1 Program Agenda 1:00 PM Keynote:

More information

MySQL: Cloud vs Bare Metal, Performance and Reliability

MySQL: Cloud vs Bare Metal, Performance and Reliability MySQL: Cloud vs Bare Metal, Performance and Reliability Los Angeles MySQL Meetup Vladimir Fedorkov, March 31, 2014 Let s meet each other Performance geek All kinds MySQL and some Sphinx Working for Blackbird

More information

MySQL Enterprise Monitor

MySQL Enterprise Monitor MySQL Enterprise Monitor Lynn Ferrante Principal Sales Consultant 1 Program Agenda MySQL Enterprise Monitor Overview Architecture Roles Demo 2 Overview 3 MySQL Enterprise Edition Highest Levels of Security,

More information

Who did what, when, where and how MySQL Audit Logging. Jeremy Glick & Andrew Moore 20/10/14

Who did what, when, where and how MySQL Audit Logging. Jeremy Glick & Andrew Moore 20/10/14 Who did what, when, where and how MySQL Audit Logging Jeremy Glick & Andrew Moore 20/10/14 Intro 2 Hello! Intro 3 Jeremy Glick MySQL DBA Head honcho of Chicago MySQL meetup 13 years industry experience

More information

Optimizing TYPO3 performance

Optimizing TYPO3 performance Optimizing TYPO3 performance Dmitry Dulepov (dmitry@typo3.org) Performance optimization areas: TYPO3 code TYPO3 installation Server hardware Server software Apache MySQL Optimizing TYPO3 code Hardly possible

More information

Monitor the Heck Out Of Your Database

Monitor the Heck Out Of Your Database Monitor the Heck Out Of Your Database Postgres Open 2011 Josh Williams End Point Corporation Data in... Data out... What are we looking for? Why do we care? Performance of the system Application throughput

More information

Zero Downtime Deployments with Database Migrations. Bob Feldbauer twitter: @bobfeldbauer email: bob.feldbauer@timgroup.com

Zero Downtime Deployments with Database Migrations. Bob Feldbauer twitter: @bobfeldbauer email: bob.feldbauer@timgroup.com Zero Downtime Deployments with Database Migrations Bob Feldbauer twitter: @bobfeldbauer email: bob.feldbauer@timgroup.com Deployments Two parts to deployment: Application code Database schema changes (migrations,

More information

5 Percona Toolkit tools that could save your day. Stéphane Combaudon FOSDEM February 3rd, 2013

5 Percona Toolkit tools that could save your day. Stéphane Combaudon FOSDEM February 3rd, 2013 5 Percona Toolkit tools that could save your day Stéphane Combaudon FOSDEM February 3rd, 2013 What is Percona Toolkit Set of cli tools to perform common tasks that are painful to do manually (~30 tools)

More information

MySQL High Availability Solutions. Lenz Grimmer <lenz@grimmer.com> http://lenzg.net/ 2009-08-22 OpenSQL Camp St. Augustin Germany

MySQL High Availability Solutions. Lenz Grimmer <lenz@grimmer.com> http://lenzg.net/ 2009-08-22 OpenSQL Camp St. Augustin Germany MySQL High Availability Solutions Lenz Grimmer < http://lenzg.net/ 2009-08-22 OpenSQL Camp St. Augustin Germany Agenda High Availability: Concepts & Considerations MySQL Replication

More information

SQL diagnostic manager Management Pack for Microsoft System Center. Overview

SQL diagnostic manager Management Pack for Microsoft System Center. Overview Overview What is so cool about the SQL diagnostic manager Management Pack? The SQL diagnostic manager (SQLdm) Management Pack integrates key monitors and alerts used by SQL Server DBAs with Microsoft's

More information

Real-time reporting at 10,000 inserts per second. Wesley Biggs CTO 25 October 2011 Percona Live

Real-time reporting at 10,000 inserts per second. Wesley Biggs CTO 25 October 2011 Percona Live Real-time reporting at 10,000 inserts per second Wesley Biggs CTO 25 October 2011 Percona Live Agenda 1. Who we are, what we do, and (maybe) why we do it 2. Solution architecture and evolution 3. Top 5

More information

Managing your Red Hat Enterprise Linux guests with RHN Satellite

Managing your Red Hat Enterprise Linux guests with RHN Satellite Managing your Red Hat Enterprise Linux guests with RHN Satellite Matthew Davis, Level 1 Production Support Manager, Red Hat Brad Hinson, Sr. Support Engineer Lead System z, Red Hat Mark Spencer, Sr. Solutions

More information

Introduction to Network Monitoring and Management

Introduction to Network Monitoring and Management Introduction to Network Monitoring and Management Jonathan Brewer Network Startup Resource Center jon@nsrc.org These materials are licensed under the Creative Commons Attribution-NonCommercial 4.0 International

More information

Architecting ColdFusion For Scalability And High Availability. Ryan Stewart Platform Evangelist

Architecting ColdFusion For Scalability And High Availability. Ryan Stewart Platform Evangelist Architecting ColdFusion For Scalability And High Availability Ryan Stewart Platform Evangelist Introduction Architecture & Clustering Options Design an architecture and develop applications that scale

More information

Details. Some details on the core concepts:

Details. Some details on the core concepts: Details Some details on the core concepts: Network documentation Diagnostic tools Monitoring tools Performance tools Active and passive tools SNMP Ticket systems Configuration and change management Documentation

More information

How To Monitor A Server With Zabbix

How To Monitor A Server With Zabbix & JavaEE Platform Monitoring A Good Match? Company Facts Jesta Digital is a leading global provider of next generation entertainment content and services for the digital consumer. subsidiary of Jesta Group,

More information

Do it Yourself System Administration

Do it Yourself System Administration Do it Yourself System Administration Due to a heavy call volume, we are unable to answer your call at this time. Please remain on the line as calls will be answered in the order they were received. We

More information

MySQL High-Availability and Scale-Out architectures

MySQL High-Availability and Scale-Out architectures MySQL High-Availability and Scale-Out architectures Oli Sennhauser Senior Consultant osennhauser@mysql.com 1 Introduction Who we are? What we want? 2 Table of Contents Scale-Up vs. Scale-Out MySQL Replication

More information

Applications Manager Best Practices document

Applications Manager Best Practices document Applications Manager Best Practices document This document will list the AdventNet ManageEngine Applications Manager best practices 1. Hardware and Software requirements 2. Configuring Applications Manager

More information

Network Monitoring and Management Introduction to Networking Monitoring and Management

Network Monitoring and Management Introduction to Networking Monitoring and Management Network Monitoring and Management Introduction to Networking Monitoring and Management These materials are licensed under the Creative Commons Attribution-Noncommercial 3.0 Unported license (http://creativecommons.org/licenses/by-nc/3.0/)

More information

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011

Preparing for the Big Oops! Disaster Recovery Sites for MySQL. Robert Hodges, CEO, Continuent MySQL Conference 2011 Preparing for the Big Oops! Disaster Recovery Sites for Robert Hodges, CEO, Continuent Conference 2011 Topics / Introductions / A Motivating Story / Master / Slave Disaster Recovery Replication Tungsten

More information

Products and Solutions

Products and Solutions Products and Solutions Olivier Beutels Sales Manager SkySQL Ab Vangelis Katsikaros Partner Oracle, MySQL and InnoDB are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks

More information

Scaling Graphite Installations

Scaling Graphite Installations Scaling Graphite Installations Graphite basics Graphite is a web based Graphing program for time series data series plots. Written in Python Consists of multiple separate daemons Has it's own storage backend

More information

There are numerous ways to access monitors:

There are numerous ways to access monitors: Remote Monitors REMOTE MONITORS... 1 Overview... 1 Accessing Monitors... 1 Creating Monitors... 2 Monitor Wizard Options... 11 Editing the Monitor Configuration... 14 Status... 15 Location... 17 Alerting...

More information

PTC System Monitor Solution Training

PTC System Monitor Solution Training PTC System Monitor Solution Training Patrick Kulenkamp June 2012 Agenda What is PTC System Monitor (PSM)? How does it work? Terminology PSM Configuration The PTC Integrity Implementation Drilling Down

More information

Robust & Reliable DNS Operations Logging & Monitoring

Robust & Reliable DNS Operations Logging & Monitoring Robust & Reliable DNS Operations Logging & Monitoring These materials are licensed under the Creative Commons Attribution-Noncommercial 3.0 Unported license (http://creativecommons.org/licenses/by-nc/3.0/)

More information

High Availability Solutions for MySQL. Lenz Grimmer <lenz@grimmer.com> 2008-08-29 DrupalCon 2008, Szeged, Hungary

High Availability Solutions for MySQL. Lenz Grimmer <lenz@grimmer.com> 2008-08-29 DrupalCon 2008, Szeged, Hungary High Availability Solutions for MySQL Lenz Grimmer 2008-08-29 DrupalCon 2008, Szeged, Hungary Agenda High Availability in General MySQL Replication MySQL Cluster DRBD Links/Tools Why

More information

Configuring Apache Derby for Performance and Durability Olav Sandstå

Configuring Apache Derby for Performance and Durability Olav Sandstå Configuring Apache Derby for Performance and Durability Olav Sandstå Database Technology Group Sun Microsystems Trondheim, Norway Overview Background > Transactions, Failure Classes, Derby Architecture

More information

MySQL Administration and Management Essentials

MySQL Administration and Management Essentials MySQL Administration and Management Essentials Craig Sylvester MySQL Sales Consultant 1 Safe Harbor Statement The following is intended to outline our general product direction. It

More information

MONyog White Paper. Webyog

MONyog White Paper. Webyog 1. Executive Summary... 2 2. What is the MONyog - MySQL Monitor and Advisor?... 2 3. What is agent-less monitoring?... 3 4. Is MONyog customizable?... 4 5. Licensing... 4 6. Comparison between MONyog and

More information

History of Disaster - The BioWare Community Site

History of Disaster - The BioWare Community Site Writing a social application in PHP/ MySQL and what happens when a million people show up on opening day " Duleepa Dups Wijayawardhana MySQL Community Team "!!"#$%&#'()*#+(,-.$/#+*0#,-$1#-2 Who the hell

More information

Network Management & Monitoring Overview

Network Management & Monitoring Overview Network Management & Monitoring Overview PacNOG 6 November 17, 2009 Nadi, Fiji hervey@nsrc.org Introduction This is a big topic... There are a lot of tools to choose from: - Open Source - Commercial -

More information

Integrated Monitoring for PostgreSQL

Integrated Monitoring for PostgreSQL Introduction Monitoring PostgreSQL Solutions Conclusion credativ limited 2nd April 2008 Introduction Monitoring PostgreSQL Solutions Conclusion Outline 1 Introduction 2 Monitoring PostgreSQL Statistics

More information

Growing in web environment at XING

Growing in web environment at XING Growing in web environment at XING Jens Muecke Nuernberg, 06/24/2010 Content 1. Introduction into XING 2. Why does performance matter? 3. Solving growing pains 4. Why Open Source? Jens Muecke, Nuernberg,

More information

MySQL Replication. openark.org

MySQL Replication. openark.org MySQL Replication Solutions & Enhancements Shlomi Noach June 2011 What is MySQL Replication? Replication is a mechanism built into MySQL. It allows a MySQL server (Master) to log changes made to schema

More information

High-availability with Galera Cluster for MySQL

High-availability with Galera Cluster for MySQL High-availability with Galera Cluster for MySQL LinuxTag 2014 10. Mai 2014, Berlin by oli.sennhauser@fromdual.com 1 / 22 About FromDual GmbH FromDual provides neutral and independent: Consulting for MySQL,

More information

Evergreen Availability Monitoring

Evergreen Availability Monitoring with a focus on Nagios An introduction to monitoring the availability of your Evergreen installation. Michael Tate Scope of presentation What is Availability Monitoring? What to monitor & why to monitor

More information

Capacity planning for IBM Power Systems using LPAR2RRD. www.lpar2rrd.com www.stor2rrd.com

Capacity planning for IBM Power Systems using LPAR2RRD. www.lpar2rrd.com www.stor2rrd.com Capacity planning for IBM Power Systems using LPAR2RRD Agenda LPAR2RRD and STOR2RRD basic introduction Capacity Planning practical view CPU Capacity Planning LPAR2RRD Premium features Future STOR2RRD quick

More information

Network Management & Monitoring Overview

Network Management & Monitoring Overview Network Management & Monitoring Overview Unix & Network Management June 16-18 Papeete, French Polynesia Hervey Allen, Phil Regnauld Introduction This is a big topic... We'll try to respond to what you

More information

CIT 668: System Architecture. Performance Testing

CIT 668: System Architecture. Performance Testing CIT 668: System Architecture Performance Testing Topics 1. What is performance testing? 2. Performance-testing activities 3. UNIX monitoring tools What is performance testing? Performance testing is a

More information

Optimizing Linux Performance

Optimizing Linux Performance Optimizing Linux Performance Why is Performance Important Regular desktop user Not everyone has the latest hardware Waiting for an application to open Application not responding Memory errors Extra kernel

More information

1 How to Monitor Performance

1 How to Monitor Performance 1 How to Monitor Performance Contents 1.1. Introduction... 1 1.1.1. Purpose of this How To... 1 1.1.2. Target Audience... 1 1.2. Performance - some theory... 1 1.3. Performance - basic rules... 3 1.4.

More information

Cloud Based Application Architectures using Smart Computing

Cloud Based Application Architectures using Smart Computing Cloud Based Application Architectures using Smart Computing How to Use this Guide Joyent Smart Technology represents a sophisticated evolution in cloud computing infrastructure. Most cloud computing products

More information

Enterprise-level EE: Uptime, Speed, and Scale

Enterprise-level EE: Uptime, Speed, and Scale Enterprise-level EE: Uptime, Speed, and Scale Reaching beyond EE tools and techniques to service enterprise clients 1. Intro 2. In-memory Caching 3. Load Balancing 4. Multi-environment setup with Docker

More information

Facultat d'informàtica de Barcelona Univ. Politècnica de Catalunya. Administració de Sistemes Operatius. System monitoring

Facultat d'informàtica de Barcelona Univ. Politècnica de Catalunya. Administració de Sistemes Operatius. System monitoring Facultat d'informàtica de Barcelona Univ. Politècnica de Catalunya Administració de Sistemes Operatius System monitoring Topics 1. Introduction to OS administration 2. Installation of the OS 3. Users management

More information

A SURVEY ON AUTOMATED SERVER MONITORING

A SURVEY ON AUTOMATED SERVER MONITORING A SURVEY ON AUTOMATED SERVER MONITORING S.Priscilla Florence Persis B.Tech IT III year SNS College of Engineering,Coimbatore. priscillapersis@gmail.com Abstract This paper covers the automatic way of server

More information

Managing Orion Performance

Managing Orion Performance Managing Orion Performance Orion Component Overview... 1 Managing Orion Component Performance... 3 SQL Performance - Measuring and Monitoring a Production Server... 3 Determining SQL Server Performance

More information

Adobe Marketing Cloud Data Workbench Monitoring Profile

Adobe Marketing Cloud Data Workbench Monitoring Profile Adobe Marketing Cloud Data Workbench Monitoring Profile Contents Data Workbench Monitoring Profile...3 Installing the Monitoring Profile...5 Workspaces for Monitoring the Data Workbench Server...8 Data

More information

MySQL backups: strategy, tools, recovery scenarios. Akshay Suryawanshi Roman Vynar

MySQL backups: strategy, tools, recovery scenarios. Akshay Suryawanshi Roman Vynar MySQL backups: strategy, tools, recovery scenarios Akshay Suryawanshi Roman Vynar April 15, 2015 Introduction 2 This is a brief talk on Backups for MySQL, where we will cover basics of backing up MySQL,

More information

Running MySQL on CentOS Linux. Peter Zaitsev April 14, 2014

Running MySQL on CentOS Linux. Peter Zaitsev April 14, 2014 Running MySQL on CentOS Linux Peter Zaitsev April 14, 2014 About the Presenta9on 2 Cover what you need to run MySQL on CentOS Linux successfully Distribu7on Hardware OS Configura7on MySQL Installa7on MySQL

More information

MyISAM Default Storage Engine before MySQL 5.5 Table level locking Small footprint on disk Read Only during backups GIS and FTS indexing Copyright 2014, Oracle and/or its affiliates. All rights reserved.

More information

SCF/FEF Evaluation of Nagios and Zabbix Monitoring Systems. Ed Simmonds and Jason Harrington 7/20/2009

SCF/FEF Evaluation of Nagios and Zabbix Monitoring Systems. Ed Simmonds and Jason Harrington 7/20/2009 SCF/FEF Evaluation of Nagios and Zabbix Monitoring Systems Ed Simmonds and Jason Harrington 7/20/2009 Introduction For FEF, a monitoring system must be capable of monitoring thousands of servers and tens

More information

Managing MySQL Scale Through Consolidation

Managing MySQL Scale Through Consolidation Hello Managing MySQL Scale Through Consolidation Percona Live 04/15/15 Chris Merz, @merzdba DB Systems Architect, SolidFire Enterprise Scale MySQL Challenges Many MySQL instances (10s-100s-1000s) Often

More information

PANDORA FMS NETWORK DEVICE MONITORING

PANDORA FMS NETWORK DEVICE MONITORING NETWORK DEVICE MONITORING pag. 2 INTRODUCTION This document aims to explain how Pandora FMS is able to monitor all network devices available on the marke such as Routers, Switches, Modems, Access points,

More information

<Insert Picture Here> MySQL Update

<Insert Picture Here> MySQL Update MySQL Update Your name Your title Please Read The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated

More information

MSP Center Plus Features Checklist

MSP Center Plus Features Checklist Features Checklist Your evaluation is not complete until you check out top vendors and the price. Here is a list prepared based customer queries. Features General Easy web interface with admin, technician,

More information

W I S E. SQL Server 2008/2008 R2 Advanced DBA Performance & WISE LTD.

W I S E. SQL Server 2008/2008 R2 Advanced DBA Performance & WISE LTD. SQL Server 2008/2008 R2 Advanced DBA Performance & Tuning COURSE CODE: COURSE TITLE: AUDIENCE: SQSDPT SQL Server 2008/2008 R2 Advanced DBA Performance & Tuning SQL Server DBAs, capacity planners and system

More information

AfNOG 2010 Network Monitoring and Management Tutorial. Introduction to Networking Monitoring and Management

AfNOG 2010 Network Monitoring and Management Tutorial. Introduction to Networking Monitoring and Management AfNOG 2010 Network Monitoring and Management Tutorial Introduction to Networking Monitoring and Management Part I: Overview Core concepts presented: What is network monitoring What is network management

More information

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM?

MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? MEASURING WORKLOAD PERFORMANCE IS THE INFRASTRUCTURE A PROBLEM? Ashutosh Shinde Performance Architect ashutosh_shinde@hotmail.com Validating if the workload generated by the load generating tools is applied

More information

Scaling Database Performance in Azure

Scaling Database Performance in Azure Scaling Database Performance in Azure Results of Microsoft-funded Testing Q1 2015 2015 2014 ScaleArc. All Rights Reserved. 1 Test Goals and Background Info Test Goals and Setup Test goals Microsoft commissioned

More information

XtraBackup: Hot Backups and More

XtraBackup: Hot Backups and More XtraBackup: Hot Backups and More Vadim Tkachenko Morgan Tocker http://percona.com http://mysqlperformanceblog.com MySQL CE Apr 2010 -2- Introduction Vadim Tkachenko Percona Inc, CTO and Lead of Development

More information

Evolution of Web Application Architecture International PHP Conference. Kore Nordmann / @koredn / <kore@qafoo.com> June 9th, 2015

Evolution of Web Application Architecture International PHP Conference. Kore Nordmann / @koredn / <kore@qafoo.com> June 9th, 2015 Evolution of Web Application Architecture International PHP Conference Kore Nordmann / @koredn / June 9th, 2015 Evolution Problem Too many visitors Evolution Evolution Lessons Learned:

More information

Network Monitoring and Management Introduction to Networking Monitoring and Management

Network Monitoring and Management Introduction to Networking Monitoring and Management Network Monitoring and Management Introduction to Networking Monitoring and Management These materials are licensed under the Creative Commons Attribution-Noncommercial 3.0 Unported license (http://creativecommons.org/licenses/by-nc/3.0/)

More information

Percona Server features for OpenStack and Trove Ops

Percona Server features for OpenStack and Trove Ops Percona Server features for OpenStack and Trove Ops George O. Lorch III Software Developer Percona Vipul Sabhaya Lead Software Engineer - HP Overview Discuss Percona Server features that will help operators

More information

Using New Relic to Monitor Your Servers

Using New Relic to Monitor Your Servers TUTORIAL Using New Relic to Monitor Your Servers by Alan Skorkin Contents Introduction 3 Why Do I Need a Service to Monitor Boxes at All? 4 It Works in Real Life 4 Installing the New Relic Server Monitoring

More information

AfNOG-2013. Monitoring of IP Services. Ayitey Bulley Material generously borrowed from the NSRC NME course

AfNOG-2013. Monitoring of IP Services. Ayitey Bulley Material generously borrowed from the NSRC NME course AfNOG-2013 Monitoring of IP Services Ayitey Bulley Material generously borrowed from the NSRC NME course Introduction To monitor or monitoring generally means to be aware of the state of a system. To observe

More information

Best of Breed of an ITIL based IT Monitoring. The System Management strategy of NetEye

Best of Breed of an ITIL based IT Monitoring. The System Management strategy of NetEye Best of Breed of an ITIL based IT Monitoring The System Management strategy of NetEye by Georg Kostner 5/11/2012 1 IT Services and IT Service Management IT Services means provisioning of added value for

More information

White Paper. Optimizing the Performance Of MySQL Cluster

White Paper. Optimizing the Performance Of MySQL Cluster White Paper Optimizing the Performance Of MySQL Cluster Table of Contents Introduction and Background Information... 2 Optimal Applications for MySQL Cluster... 3 Identifying the Performance Issues.....

More information