step by step installing oracle 10g rac on vmware

195
Step by Step installing Oracle 10g RAC on VMware Posted by Kamran Agayev A. on April 5, 2011 In this guide I’m going to show you the process of creating Oracle 10g R2 RAC on OEL4. First of all I have to mention that I’ve prepared this guide based on the well known RAC on VMWare guide of for Vincent Chan which can be found at OTN. After using that guide I’ve decided to create a more screenshot based explained guide and prepared this blog post which contains 150 screenshots! These days wordpress.com is working veeeeery slowly, so it took me two days to upload all images and create this blog post That was really boring. But now the blog post is online and I would be glad to hear the visitors valuable feedbacks. In this tutorial, we use OEL4 because Oracle 10gR2 is not compatible with OEL5 (as the db was released before the OS released) As in my all tutorials, I use vmware virtual machine. In this guide I will create two virtual machines. Let’s start creating the first machine. But before it, create three directories inside one folder (for example c:\vmware) 1 C:\vmware\

Upload: royal-chen

Post on 29-Nov-2014

205 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Step by Step Installing Oracle 10g RAC on VMware

Step by Step installing Oracle 10g RAC

on VMware

Posted by Kamran Agayev A. on April 5, 2011

In this guide I’m going to show you the process of creating Oracle 10g R2 RAC on OEL4. First of all I have to mention that I’ve prepared this guide based on the well known RAC on VMWare guide of for Vincent Chan which can be found at OTN. After using that guide I’ve decided to create a more screenshot based explained guide and prepared this blog post which contains 150 screenshots!

These days wordpress.com is working veeeeery slowly, so it took me two days to upload all images and create this blog post That was really boring. But now the blog post is online and I would be glad to hear the visitors valuable feedbacks.

In this tutorial, we use OEL4 because Oracle 10gR2 is not compatible with OEL5 (as the db was released before the OS released) As in my all tutorials, I use vmware virtual machine. In this guide I will create two virtual machines. Let’s start creating the first machine. But before it, create three directories inside one folder (for example c:\vmware)

1C:\vmware\rac1

2

3C:\vmware\rac2

4

5C:\vmware\sharedstorage

Create the following virtual machine in the first folder and create all shared storages in the third folder

Page 3: Step by Step Installing Oracle 10g RAC on VMware

Select “Red Hat Enterprise Linux 4” and Click Next

Provide the name of the virtual machine (rac1), select the location for vmware disk (you can make it c:\vmware\rac1) and click Next

Page 5: Step by Step Installing Oracle 10g RAC on VMware

Define the size of the hard drive of the virtual machine and click Next (set it to 20 GB and don’t check “Allocate all disk space now” checkbox)

Mount the ISO image of the OEL4 installation and start adding more four hard drives and one Ethernet device. Click on Add button

Page 6: Step by Step Installing Oracle 10g RAC on VMware

Select “Hard Disk” and click Next

Select “Create a new virtual disk” and click Next

Page 7: Step by Step Installing Oracle 10g RAC on VMware

Select “SCSI” and check “Independent->Persistent” and click Next

For the first device, specify the disk size as “3gb”, check “Allocate all disk space now” and click Next

Page 8: Step by Step Installing Oracle 10g RAC on VMware

Create a separate folder named “C:\vmware\sharedstorage” in your hard drive, set the name of the new hard drive to “ocfs2disk.vmdk”.

Page 9: Step by Step Installing Oracle 10g RAC on VMware

After creating the first device, create more three devices with 4GB in size (asmdisk1.vmdk, asmdisk2.vmdk, asmdisk3.vmdk) and make all of them “Independent->Persistent” and don’t allocate the disk space for each of them

Page 10: Step by Step Installing Oracle 10g RAC on VMware

Next, start changing the device node for each of them. Start from the firstly added hard drive, select it, click on Advanced button and make it SCSI 1:0. For next hard drive make it 1:1 and so on

Page 11: Step by Step Installing Oracle 10g RAC on VMware

Add new Ethernet device

Change the network connection to “Host-only”

Page 12: Step by Step Installing Oracle 10g RAC on VMware

Make sure that the last state of your virtual machine looks like as it’s seen above

Page 13: Step by Step Installing Oracle 10g RAC on VMware

Then locate the configuration file of the virtual machine and start editing it

Add the lines that are marked in bold to the configuration file to make the devices be shared between to nodes

- By specifying “disk.locking” to FALSE will allow any virtual machine to load a SCSI disk device even it’s in use by an another virtual machine

- Specify “diskLib.dataCacheMaxSize = “0″ to turn off the disk caching for clustered virtual machines.

- By specifying scsi1.sharedBus = “virtual” will give the whole bus the ability to be shared. This prevents the locking of this specific disk

Page 14: Step by Step Installing Oracle 10g RAC on VMware

Start the virtual machine

As you have already mounted the ISO image of the OEL4, the above screen appears

Page 17: Step by Step Installing Oracle 10g RAC on VMware

Select installation language and click next

Page 18: Step by Step Installing Oracle 10g RAC on VMware

Select appropriate keyboard and click next

Page 19: Step by Step Installing Oracle 10g RAC on VMware

Select “Server” as the installation type and click Next

Page 20: Step by Step Installing Oracle 10g RAC on VMware

Select Disk Druid for disk partitioning method and click Next

Page 21: Step by Step Installing Oracle 10g RAC on VMware

Click Yes for all warnings and click Next

Page 22: Step by Step Installing Oracle 10g RAC on VMware

Double click in the first drive /dev/sda

Page 23: Step by Step Installing Oracle 10g RAC on VMware

Specify ‘/’ as a mount point, make its files system “ext3” and make the End Cylinder 900 (to make the size of the root folder 7Gb). Check “Force to be a primary partition” and click Ok

Page 24: Step by Step Installing Oracle 10g RAC on VMware

Select File System Type as “swap” and change End Cylinder to 1170

Page 25: Step by Step Installing Oracle 10g RAC on VMware

Create mount point called /u01, make its files system “ext3” and make End Cylinder 2610 and click Ok

Page 26: Step by Step Installing Oracle 10g RAC on VMware

Make sure that the last state of your disk partitioning looks like as it’s seen above

Page 27: Step by Step Installing Oracle 10g RAC on VMware

Now let’s configure the network devices. Select the first device and click Edit

Page 28: Step by Step Installing Oracle 10g RAC on VMware

Uncheck “Configure using DHCP” and provide the following ip address and netmask:

IP Address: 192.168.2.131

Netmask: 255.255.255.0

Page 29: Step by Step Installing Oracle 10g RAC on VMware

Select the second device, edit it, uncheck “Configure using DHCP” and provide the following ip address and netmask

IP address: 10.10.10.31

Netmask: 255.255.255.0

Page 30: Step by Step Installing Oracle 10g RAC on VMware

Set the hostname as “rac1.test.az” (you can provide any domain name) and set the gateway to 192.168.2.1

Page 31: Step by Step Installing Oracle 10g RAC on VMware

Disable Firewall and SELinux and click Next

Page 32: Step by Step Installing Oracle 10g RAC on VMware

Select the default language for the system and click Next

Page 34: Step by Step Installing Oracle 10g RAC on VMware

Provide the password for the root user and click next

Page 35: Step by Step Installing Oracle 10g RAC on VMware

Select necessary packages for Oracle installation. Here’s the list of the necessary packages:

X Window System

Gnome Desktop Environment

Page 36: Step by Step Installing Oracle 10g RAC on VMware

Editors

Graphical Internet

Server Configuration Tools

Legacy Network (click Details and select “rsh_server” and “telnet-server”)

Development Tools

Legacy Software Development

Administration Tools

System Tools (select all packages that starts with “ocfs2” and “oracleasm”, select “systat” as well)

Page 38: Step by Step Installing Oracle 10g RAC on VMware

After installation completed the machine restarts. Click Next

Page 42: Step by Step Installing Oracle 10g RAC on VMware

You don’t need to create a user so click Next

Page 44: Step by Step Installing Oracle 10g RAC on VMware

Click Next and finish the installation

Page 45: Step by Step Installing Oracle 10g RAC on VMware

Now let’s install vmware tools. For this, disconnect the mounted ISO image, choose “Install VMware Tools” from VM menu

Page 46: Step by Step Installing Oracle 10g RAC on VMware

Double click on VMware tools icon and run the .rpm file by double clicking on it

Page 47: Step by Step Installing Oracle 10g RAC on VMware

After the window is closed, open new terminal and run vmware-config-tools.pl and finish the installation of vmware tools

Page 48: Step by Step Installing Oracle 10g RAC on VMware

To synchronize the time on the virtual machine with the host machine execute “vmware-toolbox” on the terminal window and check the check box

Page 49: Step by Step Installing Oracle 10g RAC on VMware

Edit /boot/grub/grub.conf file and add “clock=pit nosmp noapic nolapic” to the line that reads kernel /boot

The “clock=pit” prevents the clock for running to quickly and “nosmp noapic nolapic” prevents the clock from running too slowly. After you make the change, reboot the machine for change to take effect

Page 51: Step by Step Installing Oracle 10g RAC on VMware

1 oinstall0203

groupadd dba

0405

mkdir -p /export/home/oracle

0607

mkdir /ocfs

0809

useradd -d /export/home/oracle -g oinstall -G dba oracle

1011

chown oracle:dba /export/home/oracle /u01

1213

passwd oracle

Page 53: Step by Step Installing Oracle 10g RAC on VMware

1 EDITOR=vi0203

export ORACLE_SID=devdb1

0405

export ORACLE_BASE=/u01/app/oracle

06

07

export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1

08

09

export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs_1

10

11

export LD_LIBRARY_PATH=$ORACLE_HOME/lib

12

13

export PATH=$ORACLE_HOME/bin:$ORA_CRS_HOME/bin:/bin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/X11R6/bin

1415

umask 022

Page 55: Step by Step Installing Oracle 10g RAC on VMware

1 su - oracle2

3mkdir -p $ORACLE_BASE/admin

4

5mkdir -p $ORACLE_HOME

6

7mkdir -p $ORA_CRS_HOME

8

9mkdir -p /u01/oradata/devdb

Note that if environment variables are not set correctly, then the above mentioned directories will not be created.

Page 57: Step by Step Installing Oracle 10g RAC on VMware

20472

3oracle hard nproc 16384

45 oracle soft nofile 10246

7oracle hard nofile 65536

Page 59: Step by Step Installing Oracle 10g RAC on VMware

Now mount the third installation cd of the OEL4, connect it and open new terminal. Switch to the RPMS folder inside the cd and install “libaio-0.3.105-2.i386.rpm” and “openmotif21-2.1.30-11.RHEL4.6.i386.rpm” packages

view source

Page 61: Step by Step Installing Oracle 10g RAC on VMware

Change /etc/sysctl.conf file and add the following lines:

view source

print ?

01

kernel.shmall = 2097152

0203

kernel.shmmax = 2147483648

0405

kernel.shmmni = 4096

0607

kernel.sem = 250 32000 100 128

0809

fs.file-max = 65536

1011

net.ipv4.ip_local_port_range = 1024 65000

1213

net.core.rmem_default = 1048576

1415

net.core.rmem_max = 1048576

1617

net.core.wmem_default = 262144

181 net.core.wmem_max =

Page 62: Step by Step Installing Oracle 10g RAC on VMware

9 262144

Then execute the following command for change to take effect:

/sbin/sysctl -p

Page 63: Step by Step Installing Oracle 10g RAC on VMware

Now let’s configure the network configuration files. For this we need to add IP addresses and hostnames to the /etc/hosts file in each node and test the connection by pinging the hostnames

view source

print ?

01

127.0.0.1 localhost

0203

192.168.2.131 rac1.test.az rac1

0405

192.168.2.31 rac1-vip.test.az rac1-vip

0607

10.10.10.31 rac1-priv.test.az rac1-priv

0809

192.168.2.132 rac2.test.az rac2

1011

192.168.2.32 rac2-vip.test.az rac2-vip

1213

10.10.10.32 rac2-priv.test.az rac2-priv

Try the connection by pinging all hostnames (don’t ping VIP addresses as they will be created during clusterware installation):

ping rac1.test.az

ping rac1-priv.test.az

and son on

Page 64: Step by Step Installing Oracle 10g RAC on VMware

Now start creating disk partitions for OCFS2 and ASM. /dev/sdb will be used for OCFS2 and rest devices will be used for ASM.

fdisk /dev/sdb

Type n (to create new partition)

Page 65: Step by Step Installing Oracle 10g RAC on VMware

Type p to create a primary partition

Type 1 to provide the partition number

Double click on Enter and type “w” to save the changes

Perform above steps for all hard disk:

fdisk /dev/sdc

fdisk /dev/sdd

fdisk /dev/sde

Page 67: Step by Step Installing Oracle 10g RAC on VMware

/dev/sdc12

3/dev/raw/raw2 /dev/sdd1

4

5/dev/raw/raw3 /dev/sde1

And run the following command to make it effective

/sbin/service rawdevices restart

Then change the permission for all newly created raw devices:

view source

print ?

1chown oracle:dba /dev/raw/raw[1-3]

2

3chmod 660 /dev/raw/raw[1-3]

45 ls -lat /dev/raw/raw*

Next, switch to the oracle user and create links for raw devices

view source

print ?

1 su - oracle2

3ln -sf /dev/raw/raw1 /u01/oradata/devdb/asmdisk1

4

5ln -sf /dev/raw/raw2 /u01/oradata/devdb/asmdisk2

6

7ln -sf /dev/raw/raw3 /u01/oradata/devdb/asmdisk3

Page 69: Step by Step Installing Oracle 10g RAC on VMware

1# raw devices

2

3ram*:root:disk:0660

4

5#raw/*:root:disk:0660

6

7raw/*:oracle:dba:0660

After performing all above steps, shutdown the virtual machine. Then copy all its files to another directory (c:\vmware\rac2)

Open it, switch to the Options tab, change its name to “rac2” and start it

Page 70: Step by Step Installing Oracle 10g RAC on VMware

Open Network Configuration and change addresses of each Ethernet device.

eth0 – 192.168.2.132

eth1 – 10.10.10.32

Page 71: Step by Step Installing Oracle 10g RAC on VMware

Then from Hardware Device type click on “Probe” button to get new MAC address, enable both network devices, change hostname to rac2.test.az and click Ctrl+S to save the changes. Then add the following line to the /etc/hosts file

127.0.0.1 localhost

Page 72: Step by Step Installing Oracle 10g RAC on VMware

Now it’s time to establish user equivalence with SSH. Oracle Universal Installer installs the binaries in one node and then propagates the files to the other nodes. For this, it uses ssh and scp command in the background during installation to run remote commands and copy files to the other cluster nodes. So SSH must be configured so that these commands not prompt for a password. For this power on the first machine, login with root user, switch to the oracle user and generate RSA and DSA key pairs

su – oracle

ssh-keygen –t rsa (click Enter twice)

ssh-keygen –t dsa (click Enter twice)

Perform above steps in the second node (rac2)

Page 74: Step by Step Installing Oracle 10g RAC on VMware

~/.ssh/authorized_keys2

3cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys

Then from rac1 SSH to rac2 twice and add the .rsa and .dsa keys to the “authorized_keys” file that locates in the first node:

view source

print ?

1ssh rac2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

2

3ssh rac2 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys

Now copy the “authorized_keys” file from rac1 to rac2:

view source

print ?

1scp ~/.ssh/authorized_keys rac2:~/.ssh/authorized_keys

After performing all above steps, you should successfully open SSH connection from rac1 to rac2 and vice verse. So run the following commands in both nodes and ensure that you’re not prompted for the password for the second time:

view source

print ?

01

ssh rac1 date

0203

ssh rac2 date

0405

ssh rac1-priv date

Page 75: Step by Step Installing Oracle 10g RAC on VMware

0607

ssh rac2-priv date

0809

ssh rac1.test.az date

1011

ssh rac2.test.az date

1213

ssh rac1-priv.test.az date

1415

ssh rac2-priv.test.az date

I want to note again “Please make sure that after running above commands on each node, you’re not prompted for the password for the second time”

Page 76: Step by Step Installing Oracle 10g RAC on VMware

Now let’s configure Oracle ASM (Automatic Storage Management). So run the following commands from both nodes with root user:

/etc/init.d/oracleasm configure

Pass “oracle” as a parameter for “default user”

Page 77: Step by Step Installing Oracle 10g RAC on VMware

Pass “dba” as a parameter for “default group”

Pass “y” for the third and fourth parameters

Then create ASM disks on any node (try on the first node – rac1) with a root user:

/etc/init.d/oracleasm createdisk VOL1 /dev/sdc1

Marking disk “/dev/sdc1″ as an ASM disk: [ OK ]

/etc/init.d/oracleasm createdisk VOL2 /dev/sdd1

Marking disk “/dev/sdd1″ as an ASM disk: [ OK ]

/etc/init.d/oracleasm createdisk VOL3 /dev/sde1

Marking disk “/dev/sde1″ as an ASM disk: [ OK ]

Verify that the ASM disks are visible from every node.

/etc/init.d/oracleasm scandisks

Scanning system for ASM disks: [ OK ]

/etc/init.d/oracleasm listdisks

VOL1

VOL2

VOL3

Page 78: Step by Step Installing Oracle 10g RAC on VMware

Now let’s configure Oracle Cluster File System (OCFS2). For this, run “ocfs2console” with a root user from the first node. Then from the Cluster menu select Configure Nodes, click Add button and apply both nodes:

rac1

Page 79: Step by Step Installing Oracle 10g RAC on VMware

192.168.2.131

7777

rac2

192.168.2.132

7777

Page 80: Step by Step Installing Oracle 10g RAC on VMware

Then propagate the configuration to the second node. For this select “Propagate Configuration” from the Cluster menu.

Page 81: Step by Step Installing Oracle 10g RAC on VMware

To configure O2CB to start at the boot unload and configure it on both nodes as a root user:

/etc/init.d/o2cb unload

/etc/init.d/o2cb configure

Page 82: Step by Step Installing Oracle 10g RAC on VMware

and pass the following parameters

“y”

ocfs2

61

Page 83: Step by Step Installing Oracle 10g RAC on VMware

Now format the file system on the first node (rac1). For this run ocfs2console program, select Format from the Tasks menu and click OK to format the drive. Press Ctrl+Q to quit

Now execute the following command on both nodes to mount the files system

mount -t ocfs2 -o datavolume,nointr /dev/sdb1 /ocfs

and add the following line to the /etc/fstab to mount the files system on boot

/dev/sdb1 /ocfs ocfs2 _netdev,datavolume,nointr 0 0

Page 84: Step by Step Installing Oracle 10g RAC on VMware

Create a “clusterware” directory under /ocfs folder and change the owner:

view source

print ?

1mkdir /ocfs/clusterware

2

3chown -R oracle:dba /ocfs

Now to test the shared device, create a file in the /ocfs directory from the first node (rac1) and check the same folder in the second node.

cd /ocfs

touch test_file

ls

Now download the clusterware installation, copy it under /tmp directory, unzip it and start the installation

Page 85: Step by Step Installing Oracle 10g RAC on VMware

./runInstaller

Provide the folder for the Inventory and click Next

Create a “clusterware” directory under /ocfs folder and change the owner:

view source

print ?

1 mkdir /ocfs/clusterware</span></p>

2<p class="MsoNormal" style="margin: 0 0 10pt;"><span style="font-family: Calibri; font-size: small;">chown -R oracle:dba /ocfs

Now to test the shared device, create a file in the /ocfs directory from the first node (rac1) and check the same folder in the second node.

cd /ocfs

touch test_file

ls

Page 86: Step by Step Installing Oracle 10g RAC on VMware

Now download the clusterware installation, copy it under /tmp directory, unzip it and start the installation

./runInstaller

Page 87: Step by Step Installing Oracle 10g RAC on VMware

Provide the folder for the Inventory and click Next

Page 88: Step by Step Installing Oracle 10g RAC on VMware

Change the CRS folder to /u01/app/oracle/product/10.2.0/crs_1 and click Next

Page 89: Step by Step Installing Oracle 10g RAC on VMware

After checking all prerequisites it should not give any warning, so click Next

Page 90: Step by Step Installing Oracle 10g RAC on VMware

Click on Add button and provide the information on the second node:

Public Node Name: rac2.test.az

Private Node Name: rac2-priv.test.az

Page 91: Step by Step Installing Oracle 10g RAC on VMware

Virtual Host Name : rac2-vip.test.az

Click on Edit button, change the Interface type of the first Ethernet device (eth0) to “Public” and the second to “Private”

Page 92: Step by Step Installing Oracle 10g RAC on VMware

Select External Redundancy and provide the location for OCR :

/ocfs/clusterware/ocr

Page 93: Step by Step Installing Oracle 10g RAC on VMware

Select External Redundancy and provide the location for Voting Disk

/ocfs/clusterware/votingdisk

Page 94: Step by Step Installing Oracle 10g RAC on VMware

Now click Install button to start the clusterware installation

Page 96: Step by Step Installing Oracle 10g RAC on VMware

After installation completes, run both scripts on both nodes

Run /u01/app/oracle/oraInventory/orainstRoot.sh on rac1 and rac2 (wait each script to complete before running it on the second node)

Run /u01/app/oracle/product/10.2.0/crs_1/root.sh on rac1 and rac2 (wait each script to complete before running it on the second node)

Page 97: Step by Step Installing Oracle 10g RAC on VMware

After running the second script on the second node (rac2) you’ll get an error (on running VIPCA), so you need to run it manually. Switch to the following directory

cd /u01/app/oracle/product/10.2.0/crs_1/bin

and run the ./vipca to create and configure VIP

Page 98: Step by Step Installing Oracle 10g RAC on VMware

Select the first Ethernet device and Click Next

After running the second script on the second node (rac2) you’ll get an error (on running VIPCA), so you need to run it manually. Switch to the following directory

cd /u01/app/oracle/product/10.2.0/crs_1/bin

and run the ./vipca to create and configure VIP

Page 99: Step by Step Installing Oracle 10g RAC on VMware

Select the first Ethernet device and Click Next

Page 100: Step by Step Installing Oracle 10g RAC on VMware

Type “rac1-vip” on the IP Alias Name for the first node (rac1). The rest boxes will be filled automatically. Click Next

Page 101: Step by Step Installing Oracle 10g RAC on VMware

Click Finish to start the installation

Page 103: Step by Step Installing Oracle 10g RAC on VMware

After vipca finished successfully, switch to the first node and click OK button on the “script running” window.

Page 104: Step by Step Installing Oracle 10g RAC on VMware

Click Exit button to exit the installation of an Oracle Clusterware

Page 105: Step by Step Installing Oracle 10g RAC on VMware

Now copy the installation of the database (Oracle 10gR2) to the /tmp directory, unzip and start the installation. You need to start the installation with an oracle user, so run “xhost +” from the root user to allow the connection to the X server and switch to the oracle user

xhost +

Page 106: Step by Step Installing Oracle 10g RAC on VMware

su – oracle

./runInstaller

Select “Enterprise Edition” and click Next

Page 107: Step by Step Installing Oracle 10g RAC on VMware

Provide the installation directory (/u01/app/oracle/product/10.2.0/db_1)

Page 109: Step by Step Installing Oracle 10g RAC on VMware

The prerequisite check should be successful, so click Next

Page 110: Step by Step Installing Oracle 10g RAC on VMware

Let’s install just a software, so check “Install database Software only” and click Next

Page 111: Step by Step Installing Oracle 10g RAC on VMware

Click Install to start the installation

Page 113: Step by Step Installing Oracle 10g RAC on VMware

Execute the mentioned script on both nodes (wait for the script to finish before running it on the second node)

Page 114: Step by Step Installing Oracle 10g RAC on VMware

After installation finishes, run “dbca” (Database Configuration Assistant), select “Oracle Real Application Clusters database” and click Next

Page 115: Step by Step Installing Oracle 10g RAC on VMware

Select “Configure Automatic Storage Management” and click Next

Page 117: Step by Step Installing Oracle 10g RAC on VMware

Provide the password for an ASM instance, select “Create initialization parameter file (IFILE)” and click Next

Page 118: Step by Step Installing Oracle 10g RAC on VMware

Click OK to create and ASM instance on both nodes

Page 119: Step by Step Installing Oracle 10g RAC on VMware

Click YES to create listener on both nodes

Page 120: Step by Step Installing Oracle 10g RAC on VMware

Now let’s create an ASM disks. For this, click “Create New” button

Page 121: Step by Step Installing Oracle 10g RAC on VMware

Provide the name of the diskgroup “dg1”, select the “External” redundancy, select two disks “raw1,raw2” and click OK

Page 122: Step by Step Installing Oracle 10g RAC on VMware

The disk group will not be mounted in the second node, so omit this warning. The second node should be restarted (but not now)

Page 123: Step by Step Installing Oracle 10g RAC on VMware

Create the second disk group for flash recovery area (fg), select an “External” redundancy, select the last device (raw3) and click Ok

Page 124: Step by Step Installing Oracle 10g RAC on VMware

As you see, the state of disk group shows that it’s not mounted on the second node. For this, we need to restart the second node. Click on Finish and restart the second node. After it starts, login with root user and call dbca from the first node again.

Page 125: Step by Step Installing Oracle 10g RAC on VMware

Move to the above window again and you’ll see that the disk group is mounted on both nodes. Click on Finish button

Page 126: Step by Step Installing Oracle 10g RAC on VMware

Run dbca again and select “Create a Database”

Page 128: Step by Step Installing Oracle 10g RAC on VMware

Select “General Purpose” and click Next

Page 129: Step by Step Installing Oracle 10g RAC on VMware

Provide the database name “devdb” and click Next

Page 130: Step by Step Installing Oracle 10g RAC on VMware

Uncheck “Configure the Database with Enterprise Manager” as it’s taking too much (some hours) to finish (however, if you have enough RAM, you can check it) and click Next

Page 131: Step by Step Installing Oracle 10g RAC on VMware

Provide the password for the SYS user and click Next

Page 132: Step by Step Installing Oracle 10g RAC on VMware

Select “Automatic Storage Management” and click Next

Page 133: Step by Step Installing Oracle 10g RAC on VMware

Provide the password for ASM and click OK

Page 134: Step by Step Installing Oracle 10g RAC on VMware

Select the first disk group and click Next

Page 135: Step by Step Installing Oracle 10g RAC on VMware

Select “Use Oracle-Managed Files” and click Next

Page 136: Step by Step Installing Oracle 10g RAC on VMware

Check “Specify Flash Recovery Area” and chose “FG” disk group and click Next

Page 138: Step by Step Installing Oracle 10g RAC on VMware

Click Next (We’ll create TAF afterwards)

Page 141: Step by Step Installing Oracle 10g RAC on VMware

Click Finish to start the installation

Page 143: Step by Step Installing Oracle 10g RAC on VMware

After some hours (as I was running each virtual machine with 1GB RAM) this screen appears. Click Exit

Page 145: Step by Step Installing Oracle 10g RAC on VMware

After all, check the status of the Clusterware. As you see, some applications are with “OFFLINE” state. To make them online, stop and start them with SRVCTL utility as it’s shown above

Page 146: Step by Step Installing Oracle 10g RAC on VMware

After all, check the CRS status again. As you see, the State column of all applications are ONLINE

Page 147: Step by Step Installing Oracle 10g RAC on VMware

Now connect to the database from the first node (rac1) and run the following query

SQL>col host_name format a20

SQL>SELECT instance_name, host_name, thread#, status from gv$instance;

Page 148: Step by Step Installing Oracle 10g RAC on VMware

Try the conection to both instances:

view source

print ?

01

[oracle@rac1 ~]$ sqlplus system@devdb1

0203

SQL*Plus: Release 10.2.0.1.0 - Production on Wed Mar 30 10:38:40 2011

0405

Copyright (c) 1982, 2005, Oracle. All rights reserved.

0607

Enter password:

0809

Connected to:

10

Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Production

11

With the Partitioning, Real Application Clusters, OLAP and Data Mining options

1213

SQL>exit

1415

[oracle@rac1 ~]$ sqlplus system@devdb2

1617

SQL*Plus: Release 10.2.0.1.0 - Production on Wed Mar 30 10:39:04 2011

181 Copyright (c) 1982, 2005, Oracle. All rights reserved.

Page 149: Step by Step Installing Oracle 10g RAC on VMware

92021

Enter password:

2223

Connected to:

24

Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Production

25

With the Partitioning, Real Application Clusters, OLAP and Data Mining options

2627

SQL>

Let’s query datafiles and logfiles:

view source

print ?

01

[oracle@rac1 ~]$ sqlplus system@devdb1

0203

SQL> col file_name format a45

04

SQL> select file_name, bytes/1024/1024 size from dba_data_files;

0506

SQL> select file_name, bytes/1024/1024 "size" from dba_data_files;

0708

FILE_NAME size

09

--------------------------------------------- ----------

1 +DG1/devdb/datafile/users.259.747087235 5

Page 150: Step by Step Installing Oracle 10g RAC on VMware

011

+DG1/devdb/datafile/sysaux.257.747087221 240

12

+DG1/devdb/datafile/undotbs1.258.747087233 25

13

+DG1/devdb/datafile/system.256.747087209 480

14

+DG1/devdb/datafile/undotbs2.264.747088231 25

1516

SQL>

1718

SQL> col member format a45

19

SQL> select group#, type, member from v$logfile;

2021

GROUP# TYPE MEMBER

22

---------- ------- ---------------------------------------------

23

2 ONLINE +DG1/devdb/onlinelog/group_2.262.747087539

24

2 ONLINE +FG/devdb/onlinelog/group_2.258.747087547

25

1 ONLINE +DG1/devdb/onlinelog/group_1.261.747087519

26

1 ONLINE +FG/devdb/onlinelog/group_1.257.747087533

27

3 ONLINE +DG1/devdb/onlinelog/group_3.265.747132209

28

3 ONLINE +FG/devdb/onlinelog/group_3.259.747132221

29

4 ONLINE +DG1/devdb/onlinelog/group_4.266.747132235

30

4 ONLINE +FG/devdb/onlinelog/group_4.260.747132249

Page 151: Step by Step Installing Oracle 10g RAC on VMware

3132

8 rows selected.

3334

SQL>

Now connect to an ASM instance and query the diskgroups:

view source

print ?

01

export ORACLE_SID=+ASM1

02

sqlplus / as sysdba

0304

SQL> col name format a20

0506

SQL> select group_number, name, state, type, total_mb, usable_file_mb from v$asm_diskgroup;

07

GROUP_NUMBER NAME STATE TYPE TOTAL_MB USABLE_FILE_MB

08

------------ -------------------- ----------- ------ ---------- --------------

09

1 DG1 MOUNTED EXTERN 8188 7048

10

2 FG MOUNTED EXTERN 4094 3760

1112

SQL>

Now let’s create a Service. Services are used to manage the workload in an RAC environment and provide high availability. To create the service run “dbca”

Page 152: Step by Step Installing Oracle 10g RAC on VMware

Select the first option and click Next

Page 153: Step by Step Installing Oracle 10g RAC on VMware

Select “Service Management” and click Next

Page 154: Step by Step Installing Oracle 10g RAC on VMware

Select the first database and click Next

Page 155: Step by Step Installing Oracle 10g RAC on VMware

Provide the name of the Service and click Next

Page 156: Step by Step Installing Oracle 10g RAC on VMware

When you specify PREFERRED instances, you are specifying the number of instances on which a service will normally run. The Oracle Clusterware attempts to ensure that the service always runs on the number of nodes for which you have configured the service. Afterwards, due to either instance failure or planned service relocations, a service may be running on an AVAILABLE instance

Page 157: Step by Step Installing Oracle 10g RAC on VMware

Select Preferred for the first instance, and Available for the second instance, change the TAF policy to Basic and click Finish

After the Service created automatically, check tnsnames.ora file and you’ll see that the new entry is added

When you specify PREFERRED instances, you are specifying the number of instances on which a service will normally run. The Oracle Clusterware attempts to ensure that the service always runs on the number of nodes for which you have configured the service. Afterwards, due to either instance failure or planned service relocations, a service may be running on an AVAILABLE instance

Select Preferred for the first instance, and Available for the second instance, change the TAF policy to Basic and click Finish

Page 159: Step by Step Installing Oracle 10g RAC on VMware

After the Service created automatically, check tnsnames.ora file and you’ll see that the new entry is added

Page 160: Step by Step Installing Oracle 10g RAC on VMware

Try to connect to the database using this service. As you see, we’ll automatically connect to the first instance. Now let’s check the RAC high availability

Page 161: Step by Step Installing Oracle 10g RAC on VMware

For this, while connecting to the first instance (devdb1) using a “service”, open new terminal, connect to the first instance and shut it down

Page 162: Step by Step Installing Oracle 10g RAC on VMware

Now go back to the first session and query the v$instance view again. As you see, you’ll be automatically forwarded to the second instance

In this step by step tutorial I’ve shown you the deep step by step guide using 150 screenshots to make the RAC installation easier for you. I hope you’ll successfully install RAC and make your own tests. Good Luck!

Page 163: Step by Step Installing Oracle 10g RAC on VMware

ADVERTISEMENT

Like this:

Like

2 bloggers like this post.

This entry was posted on April 5, 2011 at 1:16 pm and is filed under Administration, RAC issues. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

77 Responses to “Step by Step installing Oracle 10g

RAC on

Iss said

April 11, 2011 at 8:06 pm

Hi kamran,

im not able able to ping the rac2 machine. im getting destination host unreachablethis what i have on both /etc/hosts file

127.0.0.1 localhost192.168.2.131 rac1.test.ca rac1192.168.2.31 rac1-vip.test.ca rac1-vip10.10.10.31 rac1-priv.test.ca rac1-priv192.168.2.132 rac2.test.ca rac2192.168.2.32 rac2-vip.test.ca rac2-vip10.10.10.32 rac2-priv.test.ca rac2-priv

this is my network settings from the host OSC:\Users\Administrator>ipconfig

Windows IP Configuration

Page 164: Step by Step Installing Oracle 10g RAC on VMware

Ethernet adapter Local Area Connection 2:

Connection-specific DNS Suffix . :IPv4 Address. . . . . . . . . . . : 169.254.2.2Subnet Mask . . . . . . . . . . . : 255.255.255.0Default Gateway . . . . . . . . . :

Wireless LAN adapter Wireless Network Connection:

Connection-specific DNS Suffix . : gateway.2wire.netLink-local IPv6 Address . . . . . : fe80::f42f:5673:3e63:3c42%14IPv4 Address. . . . . . . . . . . : 192.168.2.22Subnet Mask . . . . . . . . . . . : 255.255.255.0Default Gateway . . . . . . . . . : 192.168.2.1

Ethernet adapter Bluetooth Network Connection:

Media State . . . . . . . . . . . : Media disconnectedConnection-specific DNS Suffix . :

Ethernet adapter Local Area Connection:

Media State . . . . . . . . . . . : Media disconnectedConnection-specific DNS Suffix . :

Ethernet adapter VMware Network Adapter VMnet1:

Connection-specific DNS Suffix . :Link-local IPv6 Address . . . . . : fe80::f5f4:c6cf:1a9a:83b9%19IPv4 Address. . . . . . . . . . . : 192.168.65.1Subnet Mask . . . . . . . . . . . : 255.255.255.0Default Gateway . . . . . . . . . :

Ethernet adapter VMware Network Adapter VMnet8:

Connection-specific DNS Suffix . :Link-local IPv6 Address . . . . . : fe80::4d71:e31c:3448:77a5%20IPv4 Address. . . . . . . . . . . : 192.168.183.1Subnet Mask . . . . . . . . . . . : 255.255.255.0Default Gateway . . . . . . . . . :

Tunnel adapter isatap.{81D569CB-A721-4718-881B-F1B45A0F4E08}:

Page 165: Step by Step Installing Oracle 10g RAC on VMware

Media State . . . . . . . . . . . : Media disconnectedConnection-specific DNS Suffix . :

Tunnel adapter isatap.{A0316E71-53CD-4AB8-B35F-DDDD66EDDA8A}:

Media State . . . . . . . . . . . : Media disconnectedConnection-specific DNS Suffix . :

Tunnel adapter Teredo Tunneling Pseudo-Interface:

Connection-specific DNS Suffix . :IPv6 Address. . . . . . . . . . . : 2001:0:4137:9e76:2067:deb:3f57:fde9Link-local IPv6 Address . . . . . : fe80::2067:deb:3f57:fde9%15Default Gateway . . . . . . . . . : ::

Tunnel adapter isatap.{24B7D0DB-9097-4AC3-91EA-C92E6350F04E}:

Media State . . . . . . . . . . . : Media disconnectedConnection-specific DNS Suffix . :

C:\Users\Administrator>

M. Imran said

May 27, 2011 at 8:07 pm

Dear Kamran,How I can check that my OLE 4.8 vmware is sharing disks.

I have fallowed the steps carefully but my OCFS2 disk not mount at second node, I can’t see it on second node after mounting it successfully on node1 (server of ocfs)

I check /etc/ocfs2/cluster.conf that is properly formatted and when I check status of o2cb it shows me Active heartbeat at node1 only.

I am using vmware 7 workstation, my vmx file is as fallows. I am great-full for you help.

Page 166: Step by Step Installing Oracle 10g RAC on VMware

.encoding = “windows-1252″config.version = “8″virtualHW.version = “7″scsi0.present = “TRUE”scsi0.virtualDev = “lsilogic”memsize = “1024″scsi0:0.present = “TRUE”scsi0:0.fileName = “boot_linux.vmdk”ide1:0.present = “TRUE”ide1:0.fileName = “C:\Program Files\VMware\VMware Workstation\linux.iso”ide1:0.deviceType = “cdrom-image”floppy0.startConnected = “FALSE”floppy0.fileName = “”floppy0.autodetect = “TRUE”ethernet0.present = “TRUE”ethernet0.wakeOnPcktRcv = “FALSE”ethernet0.addressType = “generated”usb.present = “TRUE”ehci.present = “TRUE”sound.present = “TRUE”sound.fileName = “-1″sound.autodetect = “TRUE”serial0.present = “TRUE”serial0.fileType = “thinprint”pciBridge0.present = “TRUE”pciBridge4.present = “TRUE”pciBridge4.virtualDev = “pcieRootPort”pciBridge4.functions = “8″pciBridge5.present = “TRUE”pciBridge5.virtualDev = “pcieRootPort”pciBridge5.functions = “8″pciBridge6.present = “TRUE”pciBridge6.virtualDev = “pcieRootPort”pciBridge6.functions = “8″pciBridge7.present = “TRUE”pciBridge7.virtualDev = “pcieRootPort”pciBridge7.functions = “8″vmci0.present = “TRUE”roamingVM.exitBehavior = “go”displayName = “node1″guestOS = “oraclelinux”nvram = “Oracle Enterprise Linux.nvram”virtualHW.productCompatibility = “hosted”

Page 167: Step by Step Installing Oracle 10g RAC on VMware

printers.enabled = “TRUE”extendedConfigFile = “Oracle Enterprise Linux.vmxf”ethernet0.generatedAddress = “00:0c:29:d6:b5:40″tools.syncTime = “TRUE”uuid.location = “56 4d 3d 26 e2 2e e0 18-34 10 06 cb 18 d6 b5 40″uuid.bios = “56 4d 3d 26 e2 2e e0 18-34 10 06 cb 18 d6 b5 40″cleanShutdown = “FALSE”replay.supported = “TRUE”replay.filename = “”scsi0:0.redo = “”pciBridge0.pciSlotNumber = “17″pciBridge4.pciSlotNumber = “21″pciBridge5.pciSlotNumber = “22″pciBridge6.pciSlotNumber = “23″pciBridge7.pciSlotNumber = “24″scsi0.pciSlotNumber = “16″usb.pciSlotNumber = “32″ethernet0.pciSlotNumber = “33″sound.pciSlotNumber = “34″ehci.pciSlotNumber = “35″vmci0.pciSlotNumber = “36″vmotion.checkpointFBSize = “16777216″ethernet0.generatedAddressOffset = “0″vmci0.id = “416724289″tools.remindInstall = “FALSE”ethernet0.connectionType = “bridged”

disk.locking=”FALSE”diskLib.dataCacheMaxSize= “0″scsi0.sharedBus =”virtual”

scsi0:1.deviceType= “disk”scsi0:1.present = “TRUE”scsi0:1.fileName = “asm1.vmdk”scsi0:1.mode = “independent-persistent”

scsi0:2.deviceType= “disk”scsi0:2.present = “TRUE”scsi0:2.fileName = “asm2.vmdk”scsi0:2.mode = “independent-persistent”

Page 168: Step by Step Installing Oracle 10g RAC on VMware

scsi0:3.deviceType= “disk”scsi0:3.present = “TRUE”scsi0:3.fileName = “asm3.vmdk”scsi0:3.mode = “independent-persistent”

scsi0:4.deviceType= “disk”scsi0:4.present = “TRUE”scsi0:4.fileName = “ocr.vmdk”scsi0:4.mode = “independent-persistent”

ethernet1.present = “TRUE”ethernet1.connectionType = “hostonly”ethernet1.wakeOnPcktRcv = “FALSE”ethernet1.addressType = “generated”ethernet1.generatedAddress = “00:0c:29:d6:b5:4a”scsi0:1.redo = “”scsi0:2.redo = “”scsi0:3.redo = “”scsi0:4.redo = “”ethernet1.pciSlotNumber = “37″ethernet1.generatedAddressOffset = “10″ide1:0.startConnected = “FALSE”unity.wasCapable = “FALSE”

den" alt="" />