using mysql enterprise monitor for continuous performance improvement

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Using MEM for Continuous Performance Improvement

Copyright © 2014, Oracle and/or its affiliates. All rights reserved.

Mark Matthews, Consulting Member Technical Staff


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Agenda

• Getting to Know You • Getting to Know MySQL Enterprise Monitor • The Create, Test, Deploy, Tune Feedback Loop • Key Performance Issues Exposed Via Monitoring • Integrating MySQL Enterprise Monitor Into the Loop • Q & A


Getting to Know You

• DBAs in the room • Developers in the room • Continuous delivery in use • Monitoring, what, who uses


Getting to Know MySQL Enterprise Monitor

• Why did we build it? • What is it? • How do I get it?


We Built it to Facilitate Blame Between DBAs and Developers


We Built it to Facilitate Conversations Between DBAs and Developers


MySQL Enterprise Monitor

• Start monitoring MySQL in 10 minutes

• Real-time MySQL monitoring • Performance & Availability

• Dynamically adjusts to changes in your environment

• Aware of relationships between metrics and assets

9


MySQL Enterprise Monitor Architecture

Host/Container

Agent

MySQL

Agent

Service Manager

MySQL

Host/Container

Host/Container

MySQL

Host/Container

Agent

Host/Container

MySQL


“Standard” Deployment

Host/Container

Agent

MySQL

Agent

Service Manager

MySQL

Host/Container

• Broadest Performance Data (CPU, Memory, I/O) • Host Availability Information • Slightly More Complex • Doesn’t Work for DBAAS


Containerized Development Stack

Agent

Service Manager

MySQL

Host/Container

Host/Container

MySQL

Host/Container

Agent

• Only MySQL Performance Data • Flexible Setup/Tear Down • Small, Isolated Workloads


“Agent-less” - DBAAS/Cloud

Agent

Service Manager

MySQL

Host/Container

Host/Container

MySQL

• Only MySQL Performance Data • Fewest Moving Pieces • Simplest Configuration


How Do I Get it?

• Part of the MySQL Enterprise Subscription • Trial Licenses • Oracle Software Delivery Cloud

• https://edelivery.oracle.com/ • “MySQL Database Product Pack”

https://edelivery.oracle.com/


The Create, (Test, Deploy), Tune Feedback Loop


Do you know your application’s performance profile?

• Historically? • What to expect with code changes?


Throughput


Concurrency


Workload Specifics


The Experimental Method

• Historical performance data is the control • Developers should have predictions about effects of change • Verify the hypothesis with metrics • If the results don’t match the hypothesis, figure out why


Key Storage Tier Performance Issues Exposed Via Monitoring

• Unplanned configuration values • Going to disk too often (wasted IOPs) • Inefficient query plans • Statements issued too often


Wrong/Poor Configuration

• MySQL version in use • InnoDB buffer pool size • InnoDB transaction log

and log buffer sizes • Thread cache


Query AnalyzerProxy Connector Plugin 5.6 Performance

Schema

Supported Server Versions

Any Any > 5.6.14

Supported Clients Any JDBC, PHP, ADO.Net Any

Complexity High Medium Low

Value/Richness of Data

Low Medium High

http://ADO.Net


Why Aren’t You Using MySQL 5.6 Yet?


Missing Indexes


On-Disk Temporary Tables


New, Un-optimized Statements


High Rate of Low Latency Statements


Make Changes, Re-deploy, Re-measure

• Realtime feedback on performance impact of changes • Frictionless with MySQL-5.6 and MySQL Enterprise Monitor-3.0 • Straightforward options with earlier MySQL versions


Integrating MEM Into your Continuous I/D Environment

• MEM is a standard web application • Links for retrieving/exporting data work from wget/curl • MEM supports HTTP Basic Authentication over SSL


Command-line Retrieval of Metric Data

• curl --user user:pass --insecure https://etools-stable.no.oracle.com:30000/v2/rest/[asset-selection]?format=CSV -o throughput.csv

https://etools-stable.no.oracle.com:30000/v2/rest/%5B


Command-Line Retrieval of Query Analyzer Data

• This one is a bit trickier (we’ll fix it) • curl --user user:pass --insecure https://etools-

stable.no.oracle.com:30000/BrowseQueriesCsv.action?assetSelection=gunk&graph=gunk&graphTime_interval=00%3A30&graphTime_type=INTERVAL&noDefaults=false&showAllAssets_control=True&time_interval=&exportType=allpages -o queries-by-exec-count.csv

https://etools-stable.no.oracle.com:30000/BrowseQueriesCsv.action?assetSelection=gunk&graph=gunk&graphTime_interval=00%3A30&graphTime_type=INTERVAL&noDefaults=false&showAllAssets_control=True&time_interval=&exportType=allpages


Creating Events Representing Deployments

• Deploy a custom SQL collection at the agent !<class> <namespace>mysql</namespace> <classname>anonymous_user</classname> <query><![CDATA[SELECT COUNT(*) AS deploy_count FROM foo WHERE timestamp >= NOW() - INTERVAL 1 MINUTE]]></query> </class>


Creating Events Representing Deployments (cont)

• Reference in a custom rule • Schedule on appropriate groups/instances on the “Advisors” tab • When event is raised, find in “Events” tab, time scales are sticky

across the application !

• See • http://dev.mysql.com/doc/mysql-monitor/3.0/en/mem-

customdata-collection.html • http://dev.mysql.com/doc/mysql-monitor/3.0/en/mem-

creating-advisors-overview.html

http://dev.mysql.com/doc/mysql-monitor/3.0/en/mem-customdata-collection.html

http://dev.mysql.com/doc/mysql-monitor/3.0/en/mem-creating-advisors-overview.html


Take Aways

• Monitor All MySQL Servers - Production, Stage, Dev • Predict Impact of Changes • Measure • Analyze • Fix What You Find • Rinse, Lather, Repeat (Automate If Possible) • Why Aren’t You Using MySQL-5.6 Yet?


Questions?


MySQL Community Reception @ Oracle OpenWorld!Mingle with the MySQL community and the MySQL team from Oracle for a fun and informative evening! !• Time: September 30 (Tue) @ 7pm • Jillian’s at Metreon 175 Fourth Street, San Francisco, CA

At the corner of Howard and 4th st.; only 2-min walk from Moscone Center !

!!!

!


Oracle University MySQL Training ServicesPrepare Your Organization to Enable Reliable and High-Performance Web-Based Database Applications

“Training and team skill have the most significant impact on overall performance of technology and success of technology projects.” - IDC, 2013

Premier Support customers eligible to save 20% on learning credits.

Benefits

▪ Expert-led training to support your MySQL learning needs ▪ Flexibility to train in the classroom or online ▪ Hands-on experience to gain real world experience ▪ Key skills needed for database administrators and developers !!

• MySQL for Beginners ▪MySQL for Database Administrators ▪MySQL Performance Tuning ▪MySQL Cluster – NEW - Register Your Interest! ▪MySQL and PHP - Developing Dynamic Web Applications ▪MySQL for Developers ▪MySQL Developer Techniques !!▪MySQL 5.6 Database Administrator ▪MySQL 5.6 Developer !To find out more about available MySQL Training & Certification offerings, go to: education.oracle.com/mysql

Top Courses for Administrators and Developers

Top Certifications

RECENTLY RELEASED ALL NEW! MySQL Cluster Training To Register your interest to influence the

schedule on this newly released course – go to education.oracle.com/mysql and click on

the MySQL Cluster Course

http://education.oracle.com/pls/web_prod-plq-dad/db_pages.getpage?page_id=3

http://education.oracle.com/pls/web_prod-plq-dad/db_pages.getpage?page_id=609&get_params=dc:D62018GC10,p_preview:N&sc=WWOU14047594MPP002C005