database automation: the cure for the dba headache · 2010-09-29 · database automation: the cure...
TRANSCRIPT
![Page 1: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/1.jpg)
Database Automation: The Cure for the DBA Headache
Delivered by:Matthew Zito, Chief Scientist
![Page 2: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/2.jpg)
2
Start with the Bad News
![Page 3: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/3.jpg)
3
So Many Headaches…
• Complexity
• Compliance
• Corporate challenges
![Page 4: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/4.jpg)
4
Database Complexity – Blame Larry
• Oracle wants to own the full software stack
• Steadily moving storage, networking, clustering into the database
• DBAs now have to be experts in all of these areas
![Page 5: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/5.jpg)
5
Database Compliance – Blame Enron
• Compliance is security or policy driven
• Involves DBA teams working closely with auditors and security teams
• DBAs often required to implement tools, policies, solutions with minimal support
![Page 6: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/6.jpg)
6
Corporate Challenges – Blame …?
• Mergers and acquisitions create stress and integration work for DBA teams
• Offshoring & outsourcing initiatives can increase workload for teams
• Trying to get management to do the right thing
![Page 7: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/7.jpg)
7
So What are the Goals?
• Improve productivity and efficiency
• Reduce the burden of compliance initiatives while improving process and security
• Take control of new technologies
• Have less stress
![Page 8: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/8.jpg)
8
Let’s Talk about the Sysadmins
![Page 9: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/9.jpg)
9
An Interesting Statistic
Number of Servers Administered by 1 Systems Administrator 10 years ago -30
Number of Databases Administered by 1 Database Administrator 10 years ago -18
![Page 10: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/10.jpg)
10
An Interesting Statistic – cont’d.
Number of Servers Administered by 1 Systems Administrator today – 60-300
Number of Databases Administered by 1 Database Administrator today - 21
![Page 11: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/11.jpg)
11
To Sum it Up…
In 10 years:
• Sysadmins have improved efficiency by 100-500%
• DBAs have only improved efficiency by 20%
Why?
![Page 12: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/12.jpg)
12
What Do DBAs Spend Their Time On?
Non-Productive DBA Work Productive DBA Work
InstallationPatchingAuditing
Version UpgradesPlatform Migrations
Routine Administration
Better QueriesFaster Performance
Architecture ImprovementsNew Applications
Business Intelligence
75-95%of their time
5-25%of their time
![Page 13: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/13.jpg)
13
What Did Systems Folks Do Right?
• Centralize
• Standardize
• Automate
![Page 14: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/14.jpg)
14
Centralize
• Centralize responsibility and administration
• Remove fiefdoms
• Pool resources for greater efficiency
![Page 15: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/15.jpg)
15
Standardize
• Farms of identical servers
• Build rules for administration
• “Patterns” for configurations and deployments
![Page 16: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/16.jpg)
16
Automate
• Turn process into code
• Build “service catalogs” of operational tasks
• Focus on “low-value” or time-consuming tasks
![Page 17: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/17.jpg)
17
“But enough about the servers…
How does this apply to us?”
![Page 18: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/18.jpg)
18
Applying these lessons to Databases
• Centralize database administration
• Standardize every aspect of the database infrastructure
• Automate as much as possible about the database
![Page 19: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/19.jpg)
19
Centralized Database Administration
• Decide internally who’s going to do the grunt work to drive automation and standardization
• Help business units map their needs to standardized database resources and environments
• Improve processes and procedures through mass negotiation
![Page 20: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/20.jpg)
20
Database Standardization
• Define standard builds that include versions, platforms, patches, options, sizings, HA options
• Create standardized configurations for storage, networks, hardware
• Drill down to as few configurations as possible
![Page 21: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/21.jpg)
21
Database Automation
• Script out deployments of standard builds
• Automate ongoing administration for patch deployments
• Use automation to ease compliance and security pains
![Page 22: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/22.jpg)
22
How to get Started
![Page 23: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/23.jpg)
23
Begin at the beginning
• Patching and provisioning are good first targets for database automation
• Can be justified through:–Time to market for new dbs–Compliance with security standards or
process–Simplification of new technologies
![Page 24: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/24.jpg)
24
Oracle Provisioning Automation
• Oracle OUI supports response files and templates
• Oracle also supports “cloned”ORACLE_HOMES, which are easier to automate, but have more limitations
• Test, test, test
![Page 25: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/25.jpg)
25
Oracle Patch Automation
• Four major phases of patching– Understanding the patch– Installation/application of the patch– Custom events required by the patch– QA of the application
• Average patch takes 6 hours to deploy per database manually
• Centralizing patch documentation and scripting can dramatically reduce the first three patch phases
![Page 26: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/26.jpg)
26
Task Automation
• Built scripts to replace manual effort
• Focus on three types of tasks:– Simple, but need to be run repeatedly across
many DBs/instances– Complex, run on one at a time– Tasks with security or compliance impacts
• Perfect examples are password changes, Data Guard automation, setting security policies on the database
![Page 27: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/27.jpg)
27
A Brief Case Study
![Page 28: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/28.jpg)
28
The Company
• Mid-size electronics company
• Mixed SQL Server and Oracle shop
• Three DBAs managing approximately 80 SQL Server and Oracle instances
![Page 29: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/29.jpg)
29
Their Challenges
• Lots of downtime due to improper planning and misconfigurations
• Applications took too long to get rolled out, and when they did, they were poorly written
• The DBA team was stressed and overworked
![Page 30: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/30.jpg)
30
How They Fixed It
• Standardized on 1 configuration of SQL Server
• Built automation for developer admin tasks (i.e. refresh dev from prod)
• Forced application developers to conform to the DBA process
![Page 31: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/31.jpg)
31
The Result
• Downtime is almost non-existent other than hardware failure
• Same three DBAs easily manage three times as many instances (250)
• Applications are on-track and built correctly
![Page 32: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/32.jpg)
32
In Conclusion
![Page 33: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/33.jpg)
33
The Pains are Not Going to Go Away
• SarBox, hackers are here to stay
• If the economy weakens, there will be increasing pressure to do more with less
• Database administration will continue to grow more complex
![Page 34: Database Automation: The Cure for the DBA Headache · 2010-09-29 · Database Automation: The Cure for the DBA Headache Delivered by: ... • Mixed SQL Server and Oracle shop •](https://reader034.vdocuments.site/reader034/viewer/2022042319/5f0940cc7e708231d425f338/html5/thumbnails/34.jpg)
34
This is the Time to Start
• Identify what is inefficient in your environment
• Built standards and processes, and automate as much as you can
• Make sure to track how efficiency improves with automation