provisioning of crs / asm / rac with oracle enterprise … • project oracle eco system –2008 •...

48
Provisioning of CRS / ASM / RAC with Enterprise Manager Rob Zoeteweij Copyright 2009 Zoeteweij Consulting

Upload: nguyendung

Post on 20-May-2018

244 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Provisioning of

CRS / ASM / RAC with

Enterprise Manager

Rob ZoeteweijCopyright – 2009 Zoeteweij Consulting

Page 2: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

This Presentation…

• Is pretty technical

• Includes several (many) Screen dumps

• Covers OEM 10.2.0.4 – 10.2.0.5

• Gives you an insight overview of: How to … / How it

works

• Is about how we do this at Rabobank

2

Page 3: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Agenda

• Introduction

• Out of Box Deployment Procedures

• Customizing

3

Page 4: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Introduction

• Working with Oracle Technology since 1985

• Oracle 3 11g

• Development, DBA, Consultant (Oracle Netherlands)

• Last 5 Years

• Oracle 10g RAC installations

• Oracle 10g Enterprise Manager projects

• Working at Rabobank as independent Oracle consultant

since 2007

4

Page 5: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Introduction

• Project Oracle ECO System – 2008

• Complete Oracle Stack

• Oracle Enterprise Linux

• Oracle RDBMS 10gR2 / 11g

• Oracle Internet Directory

• Oracle Application Server

• Weblogic

• Oracle Enterprise Manager GRID Control

5

Page 6: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

6

Oracle ECO System

Application (e.g. Siebel)

Oracle Application Server

Oracle RDBMS

Oracle Enterprise Linux

Oracle VM

Hardware

X86SAN

business

Ente

rpris

e M

anager

Appliance interface layer

TEC TDP Mercury

Applications build in ADF /

WebCenterApplication server / Coherence

SOA Suite

Oracle Database r10/11 / Real

Application Clusters /

Dataguard / Security / ASM

Virtualisation layer to optimize

performanceBare metal provisioning /

security patches / plug-in for

DMX / ASM / mirroring

Management

Packs for

- Database

- Application

Server

- SOA Suite

- Applications

Page 7: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

7

Expectations of the business

• Reduce complexity

• Improve stability and continuity

• Shorten time to market

• Improve scalability and flexibility

• Comply with Basel II, SOX, IFRS, etc.

• Oracle is a strategic vendor for Rabobank

• Be comparable with market standards

Page 8: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Expectations of the business

• Standardize

• Reduce Human Errors

• Shorten Training Curve

• Shorten Time to Market

8

Page 9: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Oracle Enterprise Manager

Centre of the Universe!

9

Page 10: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Database Clusters

• HP Blade Servers

• Oracle Enterprise Linux AS 4.7

• Servers configured using BMP

• OS Install + Configuration

• OEM Agent installation

10

Page 11: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Provisioning at Rabobank

• Bare Metal Provisioning

• CRS / ASM / DB Provisioning

• One Click Extend Cluster

• Create RAC Database on existing stack

• Delete RAC Database

• Patching

• Agent

• ASM

• Database

11

Page 12: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

CRS / ASM / RAC Provisioning

• Requirements

• Clusterware

• 11.1.0.7

• Install Software and configure

• ASM

• 11.1.0.7

• Install Software

• Create +ASM Instance on each Server in Cluster

• DB

• 10.2.0.4

• Install Software12

Page 13: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Make sure right Patches are installed

• 4865772, 5163573, 5984608, 6073816, 6154480, 6397991,

6437311, 6505859, 6606233, 6614058, 6644734, 6646817,

6799925, 6815341, 6851495, 6951116, 6956120, 6988254,

6990846, 7211127, 7214697, 7232486, 7242607, 7244354,

7310650

13

Page 14: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Make sure to read:

• http://www.oracle.com/technology/products/oem/mgmt_solutions

/provisioning.html

• Achieving Grid Automation with Deployment Procedures

• Saving time and labor on Oracle Patching with EM

Provisioning Pack

• Documentation:

• Using Enterprise Manager For Grid Automation With

Deployment Procedures

• Using a Software Library14

Page 15: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Oracle Clusterware / RAC Provisioning for UNIX

• Installs

• CRS

• ASM

• DB

• Allows you to

• Create + ASM instance

• Create starter Database

15

Page 16: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Consists out of 43 Steps

• Allows the source to be:

• Existing OracleHome

• Software Library

• Use Software Library!

• Central located baselines

• CRS / ASM / DB

16

Page 17: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

17

Page 18: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

18

Page 19: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Enable notification (see next slide)

• 10.2.0.4

• Results in e-mail message like:

• Subject 45.Attention.Step.Failed

• No message text

• 10.2.0.5 Not tested yet

• Should be fixed

19

Page 20: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

20

Page 21: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Notice that: (see next slide)

• each step can be:

• Edited

• Enabled

• Disabled

• Removed

• Step outcome

• Can be inherited

• Ingnore

21

Page 22: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

22

Page 23: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

23

Page 24: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

24

Page 25: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

25

Page 26: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• We don’t use Create Starter Database (See next slide)

• We use a separate DP Procedure for this

• Create RAC Database on configured Stack

26

Page 27: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

27

Page 28: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

• ASM Disk String

• /dev/mpath/36* not allowed

• No use of wildcards

• 10.2.0.4

• 10.2.0.5 Not tested yet

• Should be fixed

28

Page 29: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

29

Page 30: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

30

Page 31: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

31

Page 32: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

32

Page 33: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Out of Box – DP Procedure

• Procedure takes 2 – 2 ½ hours

• Includes +/- 22 Steps – “Checks and Fixes”

• Takes +/- half of processing time

• Doesn’t make sense if target platform is guaranteed the same

• Was configured with same image – BMP

• Split the Out of Box procedure

• Just checking

• To be used when BMP image changes

• Do the actual job

• Reduces processing time to approx 50 Minutes33

Page 34: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Customizing – DP Procedure

• New procedure with Create Like

• Unable to edit the Out Of Box procedures!

• So Create Like and then edit

34

Page 35: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Customizing – DP Procedure• Requirements

• Diskgroup to be used

• Default DATA

• We use DGO, DGT… (Development, Testing,…)

• Listener port

• Default 1521

• We use 39000

• We use one Listener per Server

• Network Admin

• Default $ORACLE_HOME/network/admin

• We use /u01/app/oracle/admin/network/admin

• Shared for server35

Page 36: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Customizing – DP Procedure

• Software Library

• Components

• Directives

• Oracle Directives

• RABO Directives

36

Page 37: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

37

Page 38: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Customizing – DP Procedure

• Make new “RABO” Directives

• RABO – Run Oui Only Prerereqs

• Based on Run Oui Only Prerereqs

• runOuiOnlyPrereqs.pl copied to raboRunQuiOnlyPrereqs.pl

• then make modifications

• RABO – Run ASM Config Tools

• Based on Run Database Config Tools

• runDatabaseConfigTools.pl copied to

raboRunASMConfigTools.pl

• then make modifications

38

Page 39: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

39

Page 40: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

40

Page 41: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

41

Page 42: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

42

Page 43: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Customizing – DP Procedure

• Next, edit the procedure

• Rabo – CRS / ASM / DB Provisioning

• Edit steps you want to modify

• In this example:

• Verify Prerequisite Checks

• Run ASM Configuration Tools

43

Page 44: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

44

Page 45: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

45

Page 46: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Customizing – DP Procedure• Save the modifications

• Start testing

• Notice that when running a DP procedure

• When a Step fails – because of Input typo

• Do an update and retry or…

• Ignore the failure and proceed

• Check /u01/app/oracle/product/10.2.0/agent10g/EMStage/PA

F/Job_59beb3609b747a3fe04048914d0a3729 (this should be

the most recent directory that is present in the ../../PAF directory)

• outputFile

Page 47: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Wrap-up• It does work!

• Make sure you have your requirements

• Start testing the Out Of The Box procedure

• Enhance the Software Library for custom Directives

• Create your customized Directives

• Create your customized Procedure

• Edit the Procedure Steps you want to customize

• Assign the new created Directive

• Configure how the Directive Arguments should be processed

• Ask User at Runtime

• Choose Variable

• Set Value 47

Page 48: Provisioning of CRS / ASM / RAC with Oracle Enterprise … • Project Oracle ECO System –2008 • Complete Oracle Stack •Oracle Enterprise Linux •Oracle RDBMS 10gR2 / 11g •Oracle

Q & A

48