mongodb days silicon valley: operational best practices with mongodb cloud manager

71
Cloud Manager Dylan Tong Principal Solutions Architect

Upload: mongodb

Post on 16-Apr-2017

476 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Cloud Manager

Dylan TongPrincipal Solutions Architect

Page 2: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Automation: centralized configuration management, and automation of database operational processes

Monitoring: Real-time dashboards and alerts

Back-up: automated PIT snapshots, and PITR for all MongoDB topologies

Database Management-as-a-Service

Page 3: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Integrates with Existing Infrastructure

Page 4: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

https://www.mongodb.com/cloud

User: [email protected]: cloudmanager9!

Page 5: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Everyday

…better

Page 6: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

8:00AM

Scenario 1: Performance Diagnostics and Optimization

Page 7: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Subject: HEEELLLLPP!!!!From: Michael.ScottHeeellpppp! I have a meeting with a big client today to demo our Campaign Donations app, but it’s sloooooooow!!!P.S: already tried ctrl-alt-deleteYours Truly,Michael Scott, VP of Sales

8:01AM

Page 8: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 10: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Detected an impending capacity issueDiscovered un-indexed queries using the new

Profiler Visualization capabilityOptimized slow queries using the new Index

Suggestion and Automated Rolling Index Build features.

Auto-scaled MongoDB through CloudManager

Page 11: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

12:15PM

Scenario 2: Internalizing DBaaS for Agility

Page 12: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

12:15PMMessage From: Tony Stark

Hey buddy, I need your help. Nick who runs my performance team needs a second cluster stood up in our sandbox. Your colleague James says he needs a few days.

I need this cluster right now– we’re on to something big, and my team is idle. Really appreciate your partnership so far, but if your team can’t keep up, we’re going to run on our own in the Cloud.

All I need is a clone—the data included--of the other instance you created for me the other week. Let me know when you can get this done. Thanks!

- Tony Stark, Head of R&D

BACK TO CLOUDMANAGER!!!

Page 13: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Provisioned optimized EC2 Instances in AWS through Provision Manager

Provisioned a new ReplicaSet through Automation

Used Automation to restore a PITR snapshot from Cloud Back-up into the new replicaSet.

Provided Development Team controlled access to Sandbox.

Page 14: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

4:59PM

Scenario 3: Upgrading to Mission Critical

Page 15: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Bill Lumbergh, VIP

Ummm...yeah.. so you know the eCommerce platform that has been in pilot for the past year. Well, good news, we’re ready to take it prime time.

I know it’s Friday evening, and we’re all looking forward to the weekend….but this system needs to be in tier-1 compliance by Sunday.

Oh, and we’re expecting the data, and write volume to increase 5X, but the current budget stands– you’ll figure something out.

I’ll be available this weekend for your status reports – send them to my EA. I’m here for you my man!

4:59PM

Page 16: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

A. B.Plan:• Upgrade to Enterprise• Enable Cloud Back-up• Perform a storage engine

migration over to WiredTiger• Better write concurrency• Disk, index and file-system

cache compression.• Enable advance security

features

BACK TO CLOUDMANAGER!!!

Page 18: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Plan B

Page 19: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Automation: centralized configuration management, and automation of database operational processes

Monitoring: Real-time dashboards and alerts

Back-up: automated PIT snapshots, and PITR for all MongoDB topologies

Database Management-as-a-Service

Page 20: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Integrates with Existing Infrastructure

Page 21: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Everyday

…better

Page 22: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

8:00AM

Scenario 1: Performance Diagnostics and Optimization

Page 23: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Subject: HEEELLLLPP!!!!From: Michael.ScottHeeellpppp! I have a meeting with a big client today to demo our Campaign Donations app, but it’s sloooooooow!!!P.S: already tried ctrl-alt-deleteYours Truly,Michael Scott, VP of Sales

8:01AM

Page 24: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 26: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 27: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 28: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 29: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 30: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 31: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 32: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 33: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 34: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 35: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 36: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 37: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 38: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 39: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 40: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 41: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Detected an impending capacity issueDiscovered un-indexed queries using the new

Profiler Visualization capabilityOptimized slow queries using the new Index

Suggestion and Automated Rolling Index Build features.

Auto-scaled MongoDB through CloudManager

Page 42: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

12:15PM

Scenario 2: Internalizing DBaaS for Agility

Page 43: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

12:15PMMessage From: Tony Stark

Hey buddy, I need your help. Nick who runs my performance team needs a second cluster stood up in our sandbox. Your colleague James says he needs a few days.

I need this cluster right now– we’re on to something big, and my team is idle. Really appreciate your partnership so far, but if your team can’t keep up, we’re going to run on our own in the Cloud.

All I need is a clone—the data included--of the other instance you created for me the other week. Let me know when you can get this done. Thanks!

- Tony Stark, Head of R&D

BACK TO CLOUDMANAGER!!!

Page 44: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Provisioned optimized EC2 Instances in AWS through Provision Manager

Provisioned a new ReplicaSet through Automation

Used Automation to restore a PITR snapshot from Cloud Back-up into the new replicaSet.

Provided Development Team controlled access to Sandbox.

Page 45: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 46: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 47: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 48: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 49: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 50: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 51: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 52: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 53: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 54: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 55: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 56: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

4:59PM

Scenario 3: Upgrading to Mission Critical

Page 57: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

Bill Lumbergh, VIP

Ummm...yeah.. so you know the eCommerce platform that has been in pilot for the past year. Well, good news, we’re ready to take it prime time.

I know it’s Friday evening, and we’re all looking forward to the weekend….but this system needs to be in tier-1 compliance by Sunday.

Oh, and we’re expecting the data, and write volume to increase 5X, but the current budget stands– you’ll figure something out.

I’ll be available this weekend for your status reports – send them to my EA. I’m here for you my man!

4:59PM

Page 58: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager

A. B.Plan:• Upgrade to Enterprise• Enable Cloud Back-up• Perform a storage engine

migration over to WiredTiger• Better write concurrency• Disk, index and file-system

cache compression.• Enable advance security

features

BACK TO CLOUDMANAGER!!!

Page 59: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 60: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 61: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 62: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 63: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 64: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 65: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 66: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 67: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 68: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 69: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager
Page 70: MongoDB Days Silicon Valley: Operational Best Practices with MongoDB Cloud Manager