Running Oracle in EC2

Cloud Computing GroupSystem Research LabTRDDCPune

2

Overview Section 1: Pricing and Licensing Section 2: Getting Started with AWS Section 3: Installing Oracle Section 4: Secure Backup

3

Section 1Pricing and Licensing

Section 1: Pricing and Licensing1. Amazon Web Services (AWS) Overview

2. Pricing of relevant AWS Services

3. Oracle Licensing and Support

4. Oracle Secure Backup Cloud Module

4

1.1 AWS Overview: Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Cloud Front Amazon SimpleDB Amazon Simple Queue Service (SQS) Amazon Elastic MapReduce

5

1.2 AWS Pricing EC2: Elastic Compute Cloud (EC2)

Prices http://aws.amazon.com/ec2/#pricing Amazon Machine Image (AMI):

On Demand, Reserved 1 Year, 3 Years Standard CPU AMI:

Small $0.10/hr, $325/yr ($0.03/hr),$500/3yr Large $0.40/hr, $1300/yr($0.12/hr),

$2000/3yr XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr

High CPU AMI: Medium $0.20/hr, $650/yr($0.06/hr),$1000/3yr XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr

6

1.2 AWS Pricing EC2 (Cont’d): Elastic Compute Cloud (EC2)

Elastic IP Public, Static IP IP Map/Re-map > 100/month $0.10 each $0.01 non-attached per hour

Elastic Block Store (EBS) $0.10 GB/month provisioned $0.10 per 1MM/month I/O requests

EBS Snapshots to S3 $0.15 GB/month $0.01 per 1,000 PUT requests (when saving a snapshot) $0.01 per 10,000 GET requests (when loading a snapshot)

7

1.2 AWS Pricing S3: Simple Storage Service (S3)

Prices http://aws.amazon.com/s3/#pricing Operations: PUT, GET, DELETE Storage

$0.15GB/Month < 50TB $0.14GB/Month > 50TB, < 400TB $0.13GB/Month > 400TB, < 500TB $0.12GB/Month > 500TB

Data Transfer $0.10GB all data transfer in

8

1.2 AWS Pricing S3 (Cont’d): Requests

$0.01 per 1,000 PUT, COPY, POST or LIST request DELETES are free $0.01 per 10,000 GET and all other requests

AWS Import/Export Device Handling $80.00 each Data loading $2.49 per hr (hourly increment)

9

1.2 AWS Pricing Import/Export: Not Database exp/imp AWS Import/Export

Device Handling $80.00 each Data loading $2.49 per hr (hourly increment) http://aws.amazon.com/importexport/ Calculator: http://awsimportexport.s3.amazonaws.com/aws-

import-export-calculator.html

10

1.2 AWS Data Transfer Pricing: Data Transfer:

Regions: US, EU Sub-region (zone) Free within zones on private IP Elastic IP or Public IP outside AWS, regional charges

11

1.3 Oracle Licensing: Existing or New License http://www.oracle.com/corporate/pricing/cloud-

licensing.pdf Cost of AMI Pre-built Oracle AMI (11g) Roll your own AMI

12

1.3 Oracle Support: Virtualization Support – AWS Database Support Oracle Secure Backup Cloud Module http://

www.oracle.com/technology/tech/cloud/faq.html#support

No RAC

13

1.4 Oracle Secure Backup Cloud Module: Backups to S3 via. RMAN 9i R2 and higher Pre-installed on Oracle AMIs EC2 and non-EC2 databases Requires S3 and OTN accounts Integrated with Enterprise Manager

14

15

Section 2Getting Started with AWS

Section 2: Getting Started with AWS1. AWS account

2. AWS EC2 Console

3. EC2 Security Groups

4. EC2 Key Pairs

5. EC2 Amazon Machine Images (AMIs)

6. EC2 Elastic IP

7. EC2 EBS Volumes

8. EC2 Snapshots

9. Using EC2 Command Line tools

16 Oracle on EC2, NoCOUG Aug 20th 2009

2.1 AWS account Amazon.com account Sign up for services at http://aws.amazon.com EC2 Console: http://console.aws.amazon.com

17

2.2 AWS EC2 Console

18

2.2 AWS EC2 Console Security Groups Key Pairs AMIs Instances Elastic IPs EBS Volumes EBS Snapshots

19

2.3 EC2 Security Groups

20

2.3 EC2 Security Groups - Create

21

2.3 EC2 Security Groups – Configuration

22

2.4 EC2 Key Pairs

23

2.4 EC2 Key Pairs – Create

24

2.4 EC2 Key Pairs – Save PEM file

25

2.4 EC2 Key Pairs – Save PEM file Only one opportunity Make a copy Make another offline copy Cannot be retrieved or restored PEM?

26

2.5 EC2 AMIs

27

2.5 EC2 AMIs – List Options Show/Hide (Owner, Platform, Architecture) Oracle owner id = 725966715235 Linux only

28

2.5 EC2 AMIs – Launch Instance

29

2.5 EC2 AMIs – Instance Options

30

2.5 EC2 AMIs – Availability Zones us-east-1a us-east-1b us-east-1c us-east-1d

31

2.5 EC2 AMIs – Instance Launch

32

2.5 EC2 Instances - Pending

33

2.5 EC2 Instances – Launched

34

2.5 EC2 Instances – Command Line Tools Scriptable command line tools:

ec2-bundle-instance ec2-confirm-product-instance ec2-describe-instances ec2-describe-reserved-instances ec2-describe-reserved-instances-offerings ec2-monitor-instances ec2-purchase-reserved-instances-offering ec2-reboot-instances ec2-run-instances ec2-terminate-instances ec2-unmonitor-instances

35

2.6 EC2 Elastic IP Static IP tied to account Assign to any account instance Unassigned is more expensive Redirect failed services Scriptable command line tools:

ec2-allocate-address ec2-associate-address ec2-disassociate-address ec2-release-address

36

2.6 EC2 Elastic IPs

37

2.6 EC2 Elastic IP - Allocate

38

2.6 EC2 Elastic IP - Allocated

39

2.6 EC2 Elastic IP - Associate

40

2.6 EC2 Elastic IP - Associated

41

2.7 EC2 Elastic Block Store (EBS) Volumes Persistent Storage Pick zone and region Assign to an instance within a zone Scriptable command line tools:

ec2-create-volume ec2-delete-volume ec2-attach-volume ec2-detach-volume ec2-describe-volume

42

2.7 EC2 EBS Volumes

43

2.7 EC2 EBS Volumes - Create

44

2.7 EC2 EBS Volumes - Creating

45

2.7 EC2 EBS Volumes - Created

46

2.7 EC2 EBS Volumes - Attach

47

2.7 EC2 EBS Volumes - Attached

48

2.8 EC2 EBS Snapshots Copy of EBS Volume into S3 S3 replicates snapshots across zones Snapshots restorable in any zone Snapshots used to copy EBS volumes within

zones Scriptable command line tools:

ec2-create-snapshot ec2-delete-snapshot ec2-describe-snapshot

49

2.8 EC2 EBS Snapshots

50

2.8 EC2 EBS Snapshots - Create

51

2.8 EC2 EBS Snapshots - Created

52

2.9 Using EC2 Command Line Tools Requires at least Java 5 runtime SSH Acces for Linux (Putty for Windows SSH) RDC for windows (not covered) AWS -> Resources – Developer tools – EC2-

API tools (ec2-api-tools.zip) Setup ENV variables:

JAVA_HOME EC2_HOME is path to unzipped files EC2_PRIVATE_KEY (PEM file path) EC2_CERT (your X.509 cert file path)

53

54

Section 3Installing Oracle

Section 3: Installing Oracle1. Connecting to a new instance

2. Mount EBS Volumes

3. Create database

55

3.1 Connecting to a New Instance PEM file is private key First connection SSH as root Linux SSH command line connect using PEM

file “ssh -i <PEM_file> root@<ip_address>”

Windows Putty SSH Client PuttyGen to load and convert PEM file Save Windows equivalent Private Key file Create Session in Putty using new Private Key file for

authentication

56

3.1 Connecting – License Acceptance

57

3.1 Connecting – Oracle Password

58

3.1 Connecting – No DB auto creation

59

3.2 Mount EBS Volumes Create Partitions on devices

“fdisk /dev/sdf” Create Filesystems

“mkfs.ext3 /dev/sdf1” Create mount points, mount, set permissions

“mkdir /m1” “mount /dev/sdf1 /m1; chown –R oracle:dba /m1”

Edit /etc/fstab to automount “/dev/sdf1 /m1 ext3 defaults 1 1”

Repeat for EBS Volumes

60

3.2 Mount EBS Volume – Create FS

61

3.2 Mount EBS Volume – /etc/fstab

62

3.2 Create Database - Choices 11g Oracle Home:

/u01/app/oracle/product/11.1.0/db_1 Oracle provided script:

/home/oracle/scripts/run_dbca.sh (as root) Customize database post creation

DBA crafted scripts (better) Free script:

http://ocpdba.net/dbcreate/index.html (10g)

63

3.2 Create Database - Recommendations Create separate EBS Volume for /admin /admin used for:

DB Creation scripts Admin scripts DB files (init.ora, spfile, broker files, etc.)

Symlinks from /admin/<dbname>/<file> to Oracle software home

EBS volume snapshot used for new DB hosts

64

3.2 Create Database - Recommendations Allow only SSH port to be open in Security

Group Tunnel SQL*Net across SSH outside the cloud If opened, restrict listener port to fixed IPs

65

3.2 Create Database - Cloning /admin EBS Snapshot cloneable to new

Instances EBS volume snapshots (cold db) used for new

db cloning of database files

66

3.2 Create Database - Performance CPU & Memory fixed Within the cloud fastest for I/O I/O can be scaled

Multiple EBS Volumes Oracle ASM Stripe across EBS Volumes

67

68

Section 4Oracle Secure Backup (OSB)

Cloud Module

Section 4: OSB Cloud Module1. OSB Pre-requisites

2. OSB Setup

3. OSB RMAN Integration

4. OSB Performance

5. RMAN / OSB / S3 Use cases

69

4.1 OSB Pre-requisites Download Cloud Backup Installer Included in Oracle AMIs

“/home/oracle/scripts/osbws/osbws_install.jar” S3 Oracle 9i R2 and higher OTN account

70

4.2 OSB Setup – Installer Options List options for OSB Installer

“su – oracle” “java -jar ~oracle/scripts/osbws/osbws_install.jar” “more ~oracle/scripts/osbws/osbws_readme.txt”

71

4.2 OSB Setup – Installer Options Required

AWSID AWS account access key ID AWSKey AWS account secret access key otnUser & otnPass OTN Credentials for download walletDir Stores credentials for use libDir Location for platform specific

download (RMAN SBT library)

Optional platform and proxy parameters Optional Recommended

configFile Initialization parameter file used by future RMAN jobs

Default: $ORA_HOME/dbs/osbsws<ORACLE_SID>.ora

72

4.2 OSB Setup – Sample Installer Script# install_osb.sh# Set before running: AWSID, AWSKEY, OTNUSER, OTNPASS# libDir stores software specific to the platform for RMAN SBT library parms

use

java -jar ~oracle/scripts/osbws/osbws_install.jar \-AWSID $AWSID \-AWSKEY $AWSKEY \-otnUser $OTNUSER \-otnPass $OTNPASS \-walletDir /admin/osbws/wallet \-configFile /admin/osbws/osb_config.dat \-libDir /admin/osbws/software

73

4.2 OSB Setup – Install Platform Library

74

4.3 OSB RMAN Integration RMAN SBT Parms configuration Installed to libDir parameter in installation RMAN Command:

RMAN> configure channel

device type sbt parms

“SBT_LIBRARY=/admin/osbws/sofware/libosbws11.so

ENV=(OSB_WS_PFILE=/admin/osbws/osb_config.dat)

“;

Ready for backups

75

4.4 OSB RMAN Performance 11g Multiple RMAN Channels 11g datafiles can be backed up across multiple

channels 11g Fast Backup Compression RMAN block change tracking

76

4.5 RMAN / OSB / S3 Use Cases Cloning Scalable backups Moving databases Regional Backup/Recovery Availability

77

Thank You