4 oracle rac database deployment-en

8/13/2019 4 Oracle RAC Database Deployment-En

1/94

Solut ions & Engineer ing of Defense and Security Inform ation Systems


2/94


Oracle RAC DatabaseDeployment


3/94


Agenda Linux OS Installation

Linux OS Configuration

Oracle Grid Infrastructure

Oracle Database Software

RAC Database Creation

Manage RAC database

3


4/94


Linux OS installation Version

RedHat Enterprise Linux 5.8 x86_64

Hardware

Memory: 6G at least

Hard Disk: 500G

Network device: two network device each server

4


5/94


Linux OS installation Skip Entering

InstallationNumber

5


6/94


Linux OS installation Customize Hard

Disk partitions

Root partition

200G

Swap partition

32G

/u01: softwareinstallation directory

200G

6


7/94Solut ions & Engineer ing of Defense and Security Inform ation Systems

Linux OS installation The default

Installation ofRed HatEnterprise LinuxServer

Other requiredPackages can beinstalled aftercompleting OS

installation.

7



Linux OS installation Disable

firewall

8



Linux OS installation Disable SELinux

Since OracleDatabase 11g, it canbe installed whenenabling SELinux

9



Linux OS Configuration Set up yum

Set shell resource limits

Verify Kernel parameters

Install required packages

Install asmlib packages

Customize Linux services

10


11/94



Check OS resource Physical memory

#grep MemTotal /proc/meminfo

#free

Swap space

# grep SwapTotal /proc/meminfo

#swapona

Storage space

#dfh

#fdisk -l

OS architecture

#unamea

12



Install required packages Install the following packages, all the 32-bit

packages listed are no longer required.

Check if the package is installed.#rpm -qa --qf %{name}-%{version}-%{release}.%{arch}\n | grep

13

binutils-2.17.50.0.6compat-libstdc++-33-3.2.3compat-libstdc++-33-3.2.3 (32 bit)elfutils-libelf-0.125elfutils-libelf-devel-0.125

gcc-4.1.2gcc-c++-4.1.2glibc-2.5-24glibc-2.5-24 (32 bit)glibc-common-2.5glibc-devel-2.5glibc-devel-2.5 (32 bit)glibc-headers-2.5ksh-20060214

libaio-0.3.106libaio-0.3.106 (32 bit)libaio-devel-0.3.106libaio-devel-0.3.106 (32 bit)libgcc-4.1.2

libgcc-4.1.2 (32 bit)libstdc++-4.1.2libstdc++-4.1.2 (32 bit)libstdc++-devel 4.1.2make-3.81sysstat-7.0.2unixODBC-2.2.11unixODBC-2.2.11 (32 bit)unixODBC-devel-2.2.11

unixODBC-devel-2.2.11 (32 bit)


14/94


Install required packages cons) If the package is not installed, then install it via yum

For example:#yum install elfutils-libelf-devel-3.el5-0.137.x86_64

#rpm -qa --qf "%{name}-%{release}-%{version}.%{arch}\n"|grep elfutils

elfutils-libelf-devel-static-3.el5-0.137.x86_64

elfutils-libelf-devel-3.el5-0.137.x86_64

# yum install gcc

# rpm -qa --qf "%{name}-%{version}-%{release}.%{arch}\n" |grep '^gcc'

gcc-4.1.2-52.el5.x86_64

# yum install gcc-c++

# rpm -qa --qf "%{name}-%{version}-%{release}.%{arch}\n" |grep '^gcc'

gcc-c++-4.1.2-52.el5.x86_64gcc-4.1.2-52.el5.x86_64

14


15/94


Verify kernel parameters Edit/modify /etc/sysctl.conf with the following

change fs.file-max = 6815744

kernel.msgmni = 2878

kernel.msgmax = 8192

kernel.msgmnb = 65536

kernel.sem = 250 32000 100 142

kernel.shmmni = 4096

kernel.shmall = 1073741824

kernel.shmmax = 4398046511104

kernel.sysrq = 1

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144 net.core.wmem_max = 1048576

fs.aio-max-nr = 3145728

net.ipv4.ip_local_port_range = 9000 65500

vm.min_free_kbytes = 51200

Take it effect : #sysctl p

15


16/94


Create database user and group Create user and group

# groupadd -g 501 dba

# groupadd -g 500 oinstall

# groupad -g 502 asmadmin

# useradd -u 500 -g oinstall -G dba,asmadmin grid

# useradd -u 501 -g oinstall -G dba oracle

Check user information # id grid

uid=500(grid) gid=500(oinstall) groups=500(oinstall),501(dba),502(asmadmin)

# id oracle

uid=501(oracle) gid=500(oinstall) groups=500(oinstall),501(dba)

Set password for the user #passwd oracle

#passwd grid

16


17/94


Creating Installation directory# mkdir -p /u01/app/11.2.0/grid

# mkdir -p /u01/app/grid

# mkdir -p /u01/app/oracle

# chown -R grid:oinstall /u01

# chown oracle:oinstall /u01/app/oracle/# chmod -R 775 /u01

When installing grid infrastructure, the installer will modifythe attributes of /u01/app/11.2.0/grid.

17


18/94


Shell resource limits Sets shell limits if necessary to required values.

oracle soft nofile 131072 -- the maximum number of open file descriptors

oracle hard nofile 131072

oracle soft nproc 131072 -- the maximum number of user processes

oracle hard nproc 131072

oracle soft core unlimited

oracle hard core unlimited

oracle soft memlock 3500000 -- the maximum size a process may lock into memory oracle hard memlock 3500000

oracle soft stack 32768

oracle hard stack 32768

grid soft nofile 131072 -- the maximum number of open file descriptors

grid hard nofile 131072

grid soft nproc 131072 -- the maximum number of user processes

grid hard nproc 131072

grid soft core unlimited

grid hard core unlimited

grid soft memlock 3500000 -- the maximum size a process may lock into memory

grid hard memlock 3500000

grid soft stack 32768

grid hard stack 32768

18


19/94


Configuring security login Add the following line at the end of /etc/pam.d/login

19

# pam_selinux.so open should only be followed by sessions to

be executed in the user contextsession required pam_selinux.so opensession required pam_limits.so


20/94


Install ASMlib Download ASMlib packages

ASMlib packages can be downloaded from oracle officialwebsite.http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html

Install asmlib package# rpm -ivh oracleasm*

warning: oracleasm-2.6.18-308.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID1e5e0159

Preparing... ########################################### [100%]

1:oracleasm-support ########################################### [ 33%]

2:oracleasm-2.6.18-308.el########################################### [ 67%]

3:oracleasmlib

20
http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.htmlhttp://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.htmlhttp://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.htmlhttp://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.htmlhttp://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.htmlhttp://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html


21/94


Network Time Protocol Setting Cluster Time Synchronization Service

Oracle clusterware requires the same time zone setting on all clusternodes. We have two options for time synchronization:

Network time protocol(NTP)

Oracle Cluster Time Synchronization Service.

Stop NTP service # /sbin/service ntpd stop

# chkconfig ntpd off

# mv /etc/ntp.conf /etc/ntp.conf.old

21


22/94


23/94


Customize Linux Sevices Stop the following servies

# chkconfig --level 345 cups off

# chkconfig --level 345 avahi-daemon off

# chkconfig --level 345 cpuspeed off

# chkconfig --level 345 hidd off

# chkconfig --level 345 hplip off

# chkconfig --level 345 iscsi off

# chkconfig --level 345 iscsid off # chkconfig --level 345 isdn off

# chkconfig --level 345 pcscd

# chkconfig --level 345 pcscd off

# chkconfig --level 345 rhnsd off

# chkconfig --level 345 sendmail off

# chkconfig --level 345 smartd off

# chkconfig --level 345 kudzu off

# chkconfig --level 345 iptables off

# chkconfig --level 345 ip6tables off

#chkconfig --level 345 bluetooth

#chkconfig --level 345 yum-updatesd

23


24/94


Set Environment variables Edit .bash_profile in the user home directory

ORACLE_BASE=/u01/app/oracle

ORACLE_HOME=

ORACLE_SID=

PATH=$PATH:$ORACLE_HOME/bin

export ORACLE_BASE

export ORACLE_HOME

export ORACLE_SID

export PATH

Based on different user, set ORACLE_* variables todifferent values.

24


25/94


Grid Infrastructure Installation

RAC network setting

Configure ssh equivalence

Configure Oracleasm

Set up Grid Infrastructure

25


26/94


Network Setting Add the following to dns configuration file

192.168.20.101 racbox1.nom.com racbox1

192.168.20.102 racbox2.nom.com racbox2

172.16.20.101 racbox1-priv.nom.com racbox1-priv

172.16.20.102 racbox2-priv.nom.com racbox2-priv

192.168.20.121 racbox1-vip.nom.com racbox1-vip

192.168.20.122 racbox2-vip.nom.com racbox2-vip

192.168.20.201 racdb-scan.nom.com racdb-scan



In the above example, the sub network 192.168.20.xxx isused for public network, and 172.16.20.xxx is used forprivate network.

26


27/94


Configure ssh equivalence Generate ssh keys

[oracle@racbox1 ]$ ssh-keygen t rsa

[oracle@racbox1 ]$ ssh-keygen t dsa

[oracle@racbox1 ]$ ssh racbox2

[oracle@racbox2 ]$ ssh-keygen t rsa

[oracle@racbox2 ]$ ssh-keygen t dsa

Copy and transfer ssh keys [oracle@racbox2 ]$ cat /home/oracle/.ssh/id_*.pub >/home/oracle/.ssh/ authorized_keys [oracle@racbox2 ]$ ssh racbox1 cat /home/oracle/.ssh/id_*.pub>>/home/oracle/.ssh/authorized_keys

[oracle@racbox2 ]$ scp /home/oracle/.ssh/authorized_keys racbox1:/home/oracle/.ssh/

Verify ssh equivalence [oracle@racbox2 ]$ ssh racbox2

[oracle@racbox2 ]$ exit

[oracle@racbox2 ]$ ssh racbox1 [oracle@racbox1]$ ssh racbox1

[oracle@racbox1]$ exit

[oracle@racbox1 ]$ssh racbox2

[oracle@racbox2 ]$

27


28/94


Configure Oracleasm Create asmlib device

# service oracleasm createdisk 'RACOVD' /dev/sdb1

Marking disk "RACOVD" as an ASM disk: [ OK ]

# service oracleasm createdisk 'RACDATA' /dev/sdc1

Marking disk "RACDATA" as an ASM disk: [ OK ]

# service oracleasm createdisk 'RACDFRA' /dev/sdd1

Marking disk "RACDFRA" as an ASM disk: [ OK ]

List asmlib devices # service oracleasm listdisks;

RACDATA

RACDFRA

RACOVD

Scan asmlib devices

#service oracleasm scandisks

28


29/94


Configure Oracleasm conts) Configure oracleasm

# /etc/init.d/oracleasm configure

Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library

driver. The following questions will determine whether the driver is

loaded on boot and what permissions it will have. The current values

will be shown in brackets ('[]'). Hitting without typing an answer will keep that current value. Ctrl-C will abort.

Default user to own the driver interface []: grid

Default group to own the driver interface []: asmadmin

Start Oracle ASM library driver on boot (y/n) [n]: y

Scan for Oracle ASM disks on boot (y/n) [y]:

Writing Oracle ASM library driver configuration: done Initializing the Oracle ASMLib driver: [ OK ]

Scanning the system for Oracle ASMLib disks: [ OK ]

Specify default user and group for asmlib devices:

grid and asmadmin

29


30/94


Perform pre-installation check$ ./runcluvfy.sh stage -pre crsinst -n node-fixup verbose

where node is a comma-delimited list of nodes you want tomake cluster members:

For example:

$ ./runcluvfy.sh stage -pre crsinst -n node1,node2 -fixup -verbose

30


31/94


Set up Grid Infrastructure Login as grid user

$ pwd

/home/grid/grid

$ ./runInstaller

Select skip softwareupdates

Then click

next

31


32/94


Set up Grid Infrastructure Install and

configureOracle GridInfrastructurefor a cluster.

Then click

next

32


33/94


Set up Grid Infrastructure SelectAdvanced

Installation

which gives moreflexibility on gridconfiguration

Then click

next

33


34/94


Set up Grid Infrastructure Select languages

in which yourproduct will run.

Then click

next

34


35/94


Set up Grid Infrastructure Input cluster

name and scanname. The scanname must beresolved by dns.

Then click

next

35


36/94


Set up Grid Infrastructure Add all the

other clusternodes.

Test sshconnectivity

Then click

next

36


37/94


Set up Grid Infrastructure Specify the

networkinterface type:

Public

private

Then click

next

37


38/94


Set up Grid Infrastructure Configure OCR

and voting diskfiles on OracleASM storage.

Then clicknext

38


39/94


Set up Grid Infrastructure Create ASM disk

group for ocr andvoting disk files.

After creation,

click next

39


40/94


Set up Grid Infrastructure Specify ASM

password

Use samepassword forsys/asmsnmp

accounts.

Then click

next

40


41/94



Do not useIntelligent PlatformManagementInterface(IPMI)

Then clicknext

41


42/94


Set up Grid Infrastructure Specify privileged

operating systemgroup for ASMinstance

dba:

asmadmin:

Then click next

42


43/94



Specifyinstallationlocation

Then clicknext

43


44/94



Specify Inventorylocation

Then click

next

44


45/94


Set up Grid Infrastructure Perform

prerequisitchecks

If it passed,

then clicknext

45


46/94


Set up Grid Infrastructure Configuration

summary

If correct, thenclickinstall

46


47/94


Set up Grid Infrastructure Install grid

infrastructuresoftware

47


48/94


Set up Grid Infrastructure Execute

configurationscripts from allcluster nodes.

Then clickokand continueinstalling.

48


49/94


Set up Grid Infrastructure The installation of

Oracle GridInfrastructure for acluster wassuccessful.

Click finishtocompeteinstallation

49


50/94


51/94


Check ASM disk group Login as grid

user

Run asmcacommand

$ asmca

51


52/94


53/94


Create data disk group conts)

the disk groupcreatedsuccessfully.

53


54/94


Create FRA disk group Create FRA diskgroup as the

same as datadisk group

54


55/94


Install Oracle database

55


56/94


Installing Database Login as oracleuser

Run the script

$./runInstaller

Uncheck I wishto receive securityupdates via MyOracle Support.

Then click next

56


57/94


58/94


Installing Database Skip software

updates

Then click

next

58


59/94


Installing Database Install database

software only

59


60/94


61/94


Installing Database Select the

languages inwhich yoursoftware willrun.

Then click

next

61


62/94


Installing Database Select Database

edition:

Enterprise edition

Then click

next

62


63/94


Installing Database

Specify installationlocation

Then click

next

63


64/94


Installing Database

Specify privilegedoperating systemgroups

dba: OSDBA

Then click

next

64


65/94


Installing Database

Performprerequisitechecks

If successful,then click

next

65


66/94


Installing Database Database

configurationsummary

Then click

install

66


67/94


Installing Database Installdatabase

product

67


68/94


Installing Database Executeconfiguration

scripts

Then clickOK

and continue toinstall

68


69/94


Installing Database

Click closeand completeinstallation

69


70/94


Creating RAC database Login as oracleuser

Then run dbcacommand

Select oracle

Real ApplicationClusterdatabase

Click next

70


71/94


Creating RAC database Select create aDatabase

Then click

next

71


72/94


Creating RAC database Database template:General purpose or

transactionprocessing

Then click next

72


73/94


Creating RAC database

Specify databasename

Select nodes forcluster database

Then click next

73


74/94



Configuredatabase controlfor localmanagement

Then click next

74


75/94



Use the sameAdministrativepassword for allaccounts

Then click

next

75


76/94



Specify storagetype and locationsfor database files

Use Oracle-Managed files

Then click next

76


77/94



Enter asmpassword

Then clickok

77


78/94



Specify FRAlocation andenablearchiving

Then click

next

78


79/94



Select sampleschemas

Then click next

79


80/94



Specify databasecharacter set

Adjust otherparameters aftercompletion.

Then clicknext

80


81/94



Database storage:

accept the defaultsetting

Then clicknext

81


82/94


Creating RAC database Click finishand

start to create racdatabase

82


83/94


Creating RAC database Once database

creationcomplete,then click exit

83


84/94


Manage RAC database

Oracle Clusterware Controlcrsctl

Server control untility

srvctl

Use the database console

84


85/94


Oracle Clusterware Control --crsctl

Login as grid user Check the status of cluster

$crsctl status rest

$crsctl check cluster

Start/stop cluster

$crsctl start cluster

$crsctl stop cluster

$crsctl start crs

$crsctl stop crs

85


86/94


Server Control Utility--srvctl Login as oracle user Start RAC database

$srvctl start databased

$srvctl start asmn

Stop RAC database $srvctl stop databased

$srvctl stop asmn

Eg:

$srvctl start database d racdb

$srvctl stop database d racdb

.

86


87/94


88/94


Database Control

Monitor thecluster

Eg: the clustername is

racdb

88


89/94


90/94


Database Control

Monitor theschema ofRAC database

90


91/94


Database Control

Monitor instancesof the cluster

91


92/94


Database Control

Monitor the homepage of databaseinstance

92


93/94


Database Control

Monitor Memoryusage of databaseinstance

93


94/94

Gracias

4 oracle rac database deployment-en

Documents