dbaasfeaturing enterprise manager 12c “snap ... - · pdf filemanager 12c “snap...

5/21/2013

1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

DBaaS featuring Enterprise Manager 12c “Snap Clone” and E-Business Suite


Contents

� EBS Cloning

– Drivers

– Present approaches and challenges

� EBS Cloning with Enterprise Manager Snap Clone

� Snap Clone step by step

� Case Study

5/21/2013

2


Glossary of Referenced terms

• Snap Clone: Instant and storage-efficient cloning of databases enabled by EM12c using copy on write capability of the storage layer

� E-Biz Rapid Clone: A command line utility provided to clone App and DB tiers of E-business Suite environment. The database cloning part follows traditional cloning methods necessitating the need of Snap Clone for creating multiple functional copies

� E-Biz Smart Clone: An EM 12c feature to facilitate cloning of E-Biz app tier

� Production environment: A commissioned, operational, production instance of E-business Suite

� Test Master environment: A copy of production (with optional additional processing such as masking and data scrambling) that can be used as a reference for creating multiple functional clones as needed


E-Biz Release 12.1 Architecture

JSP

Forms

BI Publisher

BC4J

OC4J

Web L

iste

ner

UIX

Client

Single instance/RAC

Global Single Data Model

JD

BC

/SQ

L N

et

HT

TP

/ S

10g

Application Database

10g/11g

5/21/2013

3


Drivers for E-Business Suite Cloning

• Typical need for multiple clones

• Dev Environments for Custom development

• Test Environments for QA/UAT/Pre-Production Testing

• Training and Demos

• Typical need for single clones

• Out of place maintenance

• Reporting and DW ETL


Cloning in a typical UAT cycle

Sub setting, masking and application of test metadata

E-Biz Production Database

Test Master Database: The reference copy of database for creating multiple functional copies

Create private copy for functional testing

Create a restore point after each test run

DBA

Functional QA

Infrequent activity (typically once per month for a database)

Recurring activity (typically multiple times per week for each user)

5/21/2013

4


• Database cloning is highly administrator driven

• Applications QA relies on DBAs for cloning the databases for functional testing

• The database cloning is gated by processes (space requisition, approvals, etc)

• Database cloning is not time or storage-efficient

• Usage of RMAN/Dataguard/custom scripts from Rapid Clone or existing EM Procedures

creates full, physical copies

• Full copy requires 100% storage capacity overhead (1 Functional copy of a

database with 4 restore points will need 6x storage; multiplies with a functional copy

for testing each module-GL/AP/AR/FAE)

• Full copy is slow (~ 5 hours for a 500 GB database)

Limitations of existing approaches


EBS Cloning with Enterprise Manager Snap Clone

5/21/2013

5


Enterprise Manager “Snap Clone”: IntroductionDatabase Provisioning in Minutes

• Features

• Leverage storage copy on-write technologies for database provisioning

• Initial support for NAS (Oracle ZFS Appliance and NetApp)

• Integrated lifecycle management (lineage and association tracking)

• “Time travel” capability to restore and access past data

• Benefits

• Agile provisioning (~ 2 minutes to provision a 1 TB database)

• Over 90% storage savings (100 KB of additional space for cloning a 1 TB database)

• Reduced administrative overhead from integrated lifecycle management

NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Test MasterDatabase

NAME SSN SALARY

MILLER 112-23-4567 40,000

SMITH 111-22-3333 60,000

Masking &Sub setting

ProductionDatabase

010110011101001010000111010 Functional Copies –

User can create multiple copies for functional testing without consuming space


Enterprise Manager Snap CloneBringing the best of Private Cloud and Storage technologies

• Eliminates process bottlenecks

• Self-Service model empowers end-users, such as QA

• DBAs become Service Providers as opposed to Request Brokers

• Minimizes storage consumption

• Copy-on-write storage technology eliminates full copies

• Enables agility

• Clone is just a pointer to the snapshot

• Takes minutes irrespective of the size of the database

• Promotes standardization and governance through Service Catalog, Quota, Retirement policies and Chargeback

5/21/2013

6


Snap Clone addresses the recurring activity

Sub setting, masking and application of test metadata

E-Biz Production Database Test Master Database

Create private copy for functional testing

Create a restore point after each test run

DBA

Functional QA

Infrequent activity (typically once per month for a database)

Recurring activity (typically multiple times per week for each user)


Overall End-to-End Process Flow

SSA User (Developer/Tester)

•Provision Storage

•Register Storage

•Create zone

Setup Infrastructure

Provision Clones

SnapShot / Restore Services

•Dehydrate EBS

•Purge Snapshots

•Retire service

•Provision EBS using snaphot templates

•Backup Database using Snapshots

SSA Admin

Create Service Templates

•Create Test Master

•Create Snapshot Profile

•Create Service Template

Cloud Administrator

Create Governance

Policies

•Configure Pools, Quota, ACLs, Metering, Chargeback

Passivate/ Activate EBS

5/21/2013

7


E-Biz Release 12.1 File System layout


Deployment Architecture Choices

APP

VOL_DB

VOL_APP

DB

•Application and Database on separate Host

•Application and Database artifacts in separate volume

•Database Snap Clone done using EM Automation

•Application cloning done manually

Multi Host

APP

VOL_APP&DB

DB

•Application and Database mounted on SAME Host

•Application and Database artifacts in SAME volume

•Database and Application Snap Clone completely automated

Single Host

5/21/2013

8


Snap Clone using a single compute host and a single volume: Step by Step

16 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

DBaaS ConceptsZone

• A logical grouping of cloud infrastructure resources based on functional, departmental or geographic boundaries. Example, Finance Zone, East Coast Zone• Separate charge plans may be defined per zone• Zones can also be used to enforce access control

Resource Pool

• A logical unit of homogeneous clustered or non-clustered resources exhibiting common characteristics. Example, Oracle VM server Pool, Database Pool

Pool Pool

PoolPool

Pool

Pool

PoolPoolPool

Zone

Zone

Zone

cloud

In this specific case, Dev and Test E Biz Suite instances can reside in different zones.

Within each zone, different versions of applications and database can reside in separate pools.

5/21/2013

9


Additional concepts� Software Library: A centralized repository of all reusable components/cloud building blocks

(scripts, assemblies, templates, profiles, etc), accessible from all OMSs in an EM installation.

� Profile: A gold image used as a source of subsequent provisioning in DBaaS/MWaaS on physical environments. This could be a DBCA template, RMAN backup or export dump depending on the type of service

� Service Template: Is a standardized service definition that encapsulates the payload (profile) and method of provisioning

� Service instance: The state of an already deployed service. It can be in “running” or

“stopped” state.


Summary of Steps

� Cloud Administrator sets up

� Storage that can accommodate Test Master and all the clones/snapshots

� Infrastructure Zone comprising servers that have access to the storage

� Self-Service Administrator (typically Apps DBA)

� Sets up a Test Master

� Configures pool database ORACLE_HOME

� Creates a Profile (gold image) to provision from

� Configures Self-Service

� Self-Service User

� Provisions the application, monitors database health, backs up and restores as needed

To learn more about How to set up DBaaS : Please go through the

videoScreenwatch: Setup Database

Cloud Self Service for Data Cloning Using Snap Clone

To learn more about How to set up DBaaS : Please go through the

videoScreenwatch: Setup Database

Cloud Self Service for Data Cloning Using Snap Clone

5/21/2013

10


Detailed Task: Setting up Test Master

� Register a NetApp or SUNZFS NAS storage with Enterprise Manager Cloud Control

� Mount the volume nas:/export/ebs/MyVol1 on a host as /ebs

� Create Test Master environment from production entirely on /ebs

– Option 1: Use the Rapid Clone command line option for cloning the DB and App tiers

– Option 2: One can leverage the automated cloning functionality within the EM Application Management Pack for the App tier and one of EM12c Database Provisioning/RMAN/Dataguard/scripts for the DB tier

– Scramble data on Test Master, as needed

� Discover the Test Master Database created above through EM12c

� Run ‘Synchronize’ job from the Storage Registration page.

� Enable ‘Snap Clone’ for Test Master database


Solution Architecture – File System Schematics

R1

Developer 10.1.2

COMMON_TOP

APPL_TOP

INST_TOP

AS 10.1.3

../ebs/applmgr/apps/apps_st/appl

../ebs/applmgr/apps/apps_st/comn

../ebs/applmgr/apps/tech_st/10.1.2

../ebs/applmgr/apps/tech_st/10.1.3

../ebs/applmgr/inst

../ebs/oracle/db/tech_st/11.1.0

../ebs/oracle/db/apps_st/data

Storage Path => Slcnas301:/export/ebs/MyVol1

APP

VOL_APP&DB

DB

•Application and Database artifacts in SAME volume

•Application and Database mounted on SAME Host

•Database and Application Snap Clone completely automated

Mounte

d o

n

5/21/2013

11


Illustration: Registering the Storage Server

Define frequency of MDU Job run


Detailed Task: Create E-Business Suite Database Pool� Prepare Pool

– Designate few servers within the Zone as Database Pools

– Apply the latest Rapid Clone patches on the Test Master

– Archive the database ORACLE_HOME (say 11.1.0.7) from the Test Master

$ cd $ORACLE_HOME/..

$ tar -cvzf rac_db_oh.tgz [DATABASE TOP LEVEL DIRECTORY]

– Copy or mount this archive on each of the servers of the pool

– Add the Oracle_Home to the central inventory on each of the hosts:

./runInstaller -silent -ignoreSysPrereqs -attachHome ORACLE_HOME="<Oracle_Home_Location>" ORACLE_HOME_NAME="<Name_Of _Oracle_Home>“

– Configure the Oracle_Home & a Listener from it to add as a “Managed Target’ on EM12c

� Create Pool in EM

– Configure a pool for hosting homogeneous versions of database e.g: configure ebs_pool by picking the ORACLE_HOMEs provisioned above in the “Prepare” phase

5/21/2013

12


Detailed Task: Create Snapshot Profile and Service Template

• Profile is the primary interface by which database and associated app are “bottled” into the software library

• It is a single consistent snapshot of Binary + Data + Configuration

• Service Template defines the Service and comprises

• Profile• Placement policy for starting the

database on a member of the pool • Underlying procedure for service

creation


Illustration : E-Business Suite specific Service Template Creation

Snapshot + Writable Space allocation will get mounted as a FlexVol with specified mount point.

Admins can control number of snapshots that can be created by the self-service user

5/21/2013

13


Post Script for E-Business Suite configuration

� Reset the Database user account passwords to the Test Master

� Generate a Unique Port Pool on Host which is determined by the placement Algorithm

� Generate the database context file for Applications using Provisioned SID

� Configure the Database tier using `adcfgclone.pl dbconfig` with above context file

� Generate New Application context file for Middle tier using adclonectx.pl

� Finally update local inventory followed by `adcfgclone.pl appsTier`

Actions of Post Creation “EBS Configuration Script”

Use the Selector to pick-up the Post Script from Software Library. This is important for end-to-end automation


Detailed Task: Create Service Catalogue

•Grant the Service Template to specific users, e.g:

•The Finance app Service Template can be made available to testers of FIN

• The HR app can me made available to testers of HR

• Publish the Service Template to the Service Catalog

5/21/2013

14


Self-Service Experience• Create a request with EBS template with

DBaaS Self-Service portal

• EBS Environment gets Snap Cloned with Application and Database

• Users can monitor the database and manage its state (startup, shutdown) from Self-Service console

• User level access available to EBS and Database console

• Out-of-box console supports customization and RESTFul APIs for integration with orchestration frameworks


EBS Functional Testing leveraging Snapshots‘Time Machine’ experience

QA Engineer always needs to go back & forth to finalize the Test data set.

Developer always needs to go back & forth to fine tune the custom Data Model.

� Private snapshot backup- restore is the ability to Create multiple incarnations of the database without consuming any significant additional space.

� Any self-service Portal user can literally “Time Travel” across these snapshots, and restore to an earlier point in time at will.

Time

5/21/2013

15


Snap Clone for multiple hosts for E-Biz environment


Multi-node cloning leveraging Snap Clone of Database tier

APP

VOL_DB

VOL_APP

DB

Database Snap Clone done using EM Database as a Service The huge savings in storage and provisioning time for the database realized

Application tier is cloned manually or outside the Snap Clone process.

Multi Host

� Prepare TestMaster application tier for cloning : adpreclone.pl appsTier

� Copy the directories from TestMaster to each of the target application tier node:[APPL_TOP]

[COMMON_TOP]

Applications Technology Stack:

[OracleAS Tools ORACLE_HOME]

[OracleAS Web IAS_ORACLE_HOME]

� From Self Service Portal we get the Hostname, SID & Port of the EBS Database clone.

� To wire a Middle tier node with any Snap Clone db using the above values & run

$ cd [COMMON_TOP]/clone/bin$ perl adcfgclone.pl appsTier

a. Ensure that No Applications (adpatch) &/or TechStack (opatch) is applied on TestMaster after Profile creationb. In a Multi-node cloned environment (comprising of Snap Clone) SSA user can’t utilize the Snapshot backup/restore.

5/21/2013

16


Solution Prerequisites and ReferencesPacks

� Enterprise Manager Base Platform - Cloud Control (OMS) version 12.1.0.2.2

� Cloud Management Pack for Database

� Oracle Application Management Pack for Oracle E-Business Suite and Database Lifecycle Management Pack for ongoing E-Business and database management, respectively

Plug-in(s)

� Enterprise Manager for Oracle Database (DB) version 12.1.0.3

� Enterprise Manager Storage Management Framework version (SMF) version 12.1.0.1

� Enterprise Manager for Virtualization (VT) version 12.1.0.4

� Enterprise Manager for Oracle Cloud (SSA) version 12.1.0.5

References

� OTN Home page for Cloud/DBaaS

� Support Note 1549855.1 for DBaaS

� Support Note 406982.1 for E-Biz Rapid Clone for setting up the Test Master

� Getting Started with Oracle Application Management Pack (AMP) for Oracle E-Business Suite, Release 12.1.0.1 (Doc ID

1434392.1)


Case Study: Usage of Snap Clone in Oracle Development Environment Services

5/21/2013

17


Development Environment Services (DES)

• The challenge:

• Satisfy database and application requirements for over 25,000 developers and QA at Oracle

• Numerous application configurations: Database, E-Business Suite, Fusion, Fusion Middleware, PeopleSoft, Enterprise One, Siebel, BEA ..etc

• Different release, platform and language combinations for each product family

• Environments required in five different data centers

• Need Physical and VM templates

• End to end life cycle management: provision, patch, upgrade, backup, performance tuning, refresh, space management ..etc.

• First level support for all issues: hardware, application and environment issues


Illustration: Production to DevelopmentLarge DB for PSR/Stress Testing/Functional QA

Space savings with

Snap Clone

Space savings with

Snap Clone

5/21/2013

18


Development Environment Services (DES)

• Solution

• Focus on automation and self-service

• Use Snap Clone on ZFS for huge reduction in storage usage and time taken for copy

• Benefits

• CRMDB (6TB)

• Snap Cloned in 12 minutes instead of 30 hours for a full copy

• Copies take up only 12GB

• GSI DB (28TB)

• Snap cloned in 3 hours instead of 7 days for a full copy

• Snapshot backups take 15 minutes

• Copies take up only 500GB.

• Similar results for several other large DBs.


dbaasfeaturing enterprise manager 12c “snap ... - · pdf filemanager 12c “snap...

Documents