luci, ricci and the rac bc
TRANSCRIPT
![Page 1: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/1.jpg)
Luci, Ricci and the RAC
...or Clustering on Centos 5 using Conga for an Oracle RAC install
Drawn up by Fauz Ghauri (@fauzg) for barcamp
![Page 2: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/2.jpg)
Introduction
• Hardware
• Installation
• Custom udev rules for iscsi
• Cluster
• Heartbeat and fencing
• RAC Other things to consider for RAC.
• Acknowledgements
![Page 3: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/3.jpg)
Hardware
• Network Cards
– DRAC (Dell Remote Access Card)
– ILO (Integrated Lights Out – HP kit)
– VMware Fence (Built into ESX – maybe server?)
– Etc.
• SAN – Are you using iSCSI?
• VMware – which version of ESX/server do you run?
![Page 4: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/4.jpg)
Installation
• Mainly Defaults used for centos 5 install
• A few extra packages are required outside of the base install.
![Page 5: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/5.jpg)
Installation
![Page 6: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/6.jpg)
Installation
![Page 7: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/7.jpg)
Installation
![Page 8: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/8.jpg)
Installation
![Page 9: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/9.jpg)
Installation
![Page 10: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/10.jpg)
Installation
![Page 11: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/11.jpg)
Installation
![Page 12: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/12.jpg)
Installation – Conga Components
![Page 13: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/13.jpg)
Installation – Conga Components
![Page 14: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/14.jpg)
Installation – Luci
![Page 15: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/15.jpg)
Installation – Luci
![Page 16: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/16.jpg)
Custom udev rules for iSCSI
• If you’re using iSCSI – you’ll need to make sure that your drives are mapped.
# iscsiadm -m discovery -t sendtargets –p <sanIP.mydomain (or maybe ip address)>192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm1 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm2 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm3 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm4 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.crs
![Page 17: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/17.jpg)
Custom udev rules for iSCSI
• Manually log onto targets
– # iscsiadm -m node -T iqn.2006-01.com.openfiler:racdb.asm1 -p 192.168.2.195 -l
• Configure auto login
– # iscsiadm -m node -T iqn.2006-01.com.openfiler:racdb.asm1 -p 192.168.2.195 --op update -n node.startup -v automatic
![Page 18: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/18.jpg)
Custom udev rules for iSCSI
• # (cd /dev/disk/by-path; ls -l *sanname* | awk '{FS=" "; print $9 " " $10 " " $11}')
• Returns:– ip-192.168.2.195:3260-iscsi-iqn.2006-
01.com.openfiler:racdb.asm1-lun-0 -> ../../sda– Etc.– Make a note!– scsi_id –g –u –s /block/sdX – find out which letters map to
which iSCSI device (where X is a, b, c, etc)– Note iSCSI strings.– Create a new rules file in /etc/udev/rules.d/22-
randomnumberandname.rules
![Page 19: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/19.jpg)
Custom udev rules for iSCSI
• ACTION=="add", KERNEL=="sd*", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT==“<iscsi string goes here>", RUN+="/bin/raw /dev/raw/raw1 %N“
• ACTION=="add", KERNEL=="raw1", OWNER=="root", GROUP=="dba", MODE=="0660", SYMLINK+="oracle_ocr"
![Page 20: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/20.jpg)
Cluster
![Page 21: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/21.jpg)
Cluster
![Page 22: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/22.jpg)
Cluster
![Page 23: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/23.jpg)
Cluster
![Page 24: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/24.jpg)
Cluster
![Page 25: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/25.jpg)
Cluster
![Page 26: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/26.jpg)
Cluster
![Page 27: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/27.jpg)
Cluster
This turns yellow asthere’s an issue.
![Page 28: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/28.jpg)
Cluster
![Page 29: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/29.jpg)
Cluster
![Page 30: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/30.jpg)
Cluster
![Page 31: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/31.jpg)
Cluster
![Page 32: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/32.jpg)
Heartbeat & Fencing
• Heartbeat – saying “hi! I’m here” to the cluster.
• Fencing – fencing off a dodgy node
• Fencing on ESX means the creation of a user for fencing.
– useradd and groupadd – insufficient permissions.
– Get it working on ESX before trying to fence remotely.
– Adding permissions can be done by doing the following:
![Page 33: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/33.jpg)
Heartbeat & Fencing
– vmware-vim-cmd vimsvc/auth/role_add groupXVirtualMachine.Interact.PowerOn
– vmware-vim-cmdvimsvc/auth/entity_permission_addvim.Folder:ha-folder-root userX users groupXtrue
• Test it out with the command fence_vmware(syntax in wiki in ackowledgements section)
![Page 34: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/34.jpg)
Things to consider with RAC
• Don’t reboot all nodes at the same time –unless you feel like losing your entire database!
• Bear in mind that the /udev rules should map to some raw disks if you’re using ASM.
• SSH key equivalency (sharing keys).
![Page 35: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/35.jpg)
Acknowledgements
• Thanks to:– [redacted] for getting me going– [redacted] for helping me figure out that nasty little issue
with GSSAPI timing out my SSH connections
• Sources:– http://www.oracle.com/technology/pub/articles/hunter_r
ac10gr2_iscsi.html– http://www.redhat.com/docs/en-
US/Red_Hat_Enterprise_Linux/4.8/html/Cluster_Administration/s1-start-luci-ricci-conga-CA.html
– http://sources.redhat.com/cluster/wiki/VMware_FencingConfig
– http://www.vroem.co.za/?p=7
![Page 36: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/36.jpg)
Bonus Slides!
![Page 37: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/37.jpg)
Bonus Slides!
![Page 38: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/38.jpg)
Bonus Slides!
![Page 39: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/39.jpg)
Bonus Slides!
![Page 40: Luci, ricci and the rac bc](https://reader034.vdocuments.site/reader034/viewer/2022042607/555147ccb4c905c6268b4eb7/html5/thumbnails/40.jpg)
Bonus Slides!