integrated cloud applications and platform …...provisioning full databases for intense testing,...

17
2/26/2013 1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 2 Database As A Service using Enterprise Manager 12c

Upload: others

Post on 02-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2

Database As A Service using Enterprise Manager 12c

Page 2: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

2

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3

Safe Harbor

The following is intended to outline our general product direction. It is

intended for information purposes only, and may not be incorporated into

any contract. It is not a commitment to deliver any material, code, or

functionality, and should not be relied upon in making purchasing

decisions. The development, release, and timing of any features or

functionality described for Oracle’s products remains at the sole

discretion of Oracle.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4

Agenda • Database as a Service (DBaaS):

• Problem Definition and Key Drivers

• Enterprise Manager 12c:

• Feature Overview

• Customer Proof Points

Page 3: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

3

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5

Database as a Service: Primary DriversIOUG Cloud Computing Survey (2011)

Save costs through consolidation

Save costs through standardization for

operational efficiency

Greater control over security and privacy

Showback or Chargeback

Faster time to market for new application deployment

63%

54%

39%

37%

33%

All the above call for automated and optimized use of Database platform

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6

Database as a Service

• Database as a Service provides

• A shared, consolidated platform to provision database services on

• A self-service model to provision those services

• Elasticity to scale out and scale back database resources

• Chargeback based on database usage

• Database as a Service needs to cater to various use cases

• A developer or a project owner requiring a new database service with/without seed data

• QA requiring a full database refresh for intense load testing

• QA requiring to create multiple clones for functional testing on subset of data

Page 4: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

4

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7

Database as a Service: Key Use Cases

User deploys a dedicated database inside a VM or on physical

Pros: Resource isolation, ideal for enterprise applications like ERP

Cons: VM and database sprawl, administrative overheads, compliance challenges

User deploys a dedicated database inside a VM or on physical

Pros: Resource isolation, ideal for enterprise applications like ERP

Cons: VM and database sprawl, administrative overheads, compliance challenges

1. User needs a new database service with or without seed data

User deploys a database schema inside a database

Pros: High consolidation, minimal administrative and maintenance overhead

Cons: Limited isolation

User deploys a database schema inside a database

Pros: High consolidation, minimal administrative and maintenance overhead

Cons: Limited isolation

2. User needs a clone of an existing database for testing

User makes a full clone of database

Pros: Ideal for load-testing with significant data updates

Cons: Time and space consuming

User makes a full clone of database

Pros: Ideal for load-testing with significant data updates

Cons: Time and space consuming

User makes a thin-clone (using ‘Copy On Write’) of database

Pros: Minimal additional space, instantaneous cloning, ideal for functional testing

Cons: Reduced benefits in case of significant data updates

User makes a thin-clone (using ‘Copy On Write’) of database

Pros: Minimal additional space, instantaneous cloning, ideal for functional testing

Cons: Reduced benefits in case of significant data updates

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8

Database as a Service

� Consolidation

– Ability to consolidate database workloads on common infrastructure

� Standardization

– Ability to create standard database services without creating configuration

sprawl

� Automation

– Ability to provision databases in an agile and automated manner

� Showback / Chargeback

– Ability to meter the usage

Four Essential Components

Page 5: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

5

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9

Enterprise Manager 12c Feature Overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10

DBaaS Consolidation

• Automated discovery mechanisms and rich monitoring data to baseline current

usage

• Provides advisories for physical-to-physical, physical- to-virtual and physical-

to-Exadata consolidation

• Advisories can be based on technical and functional/business constraints

• Supports various consolidation models

• Shared Server, Shared Cluster and Shared Database

• Shared Cluster and Shared Database models complement the physical

consolidation benefits from Exadata

Enterprise Manager Features

Page 6: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

6

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11

DBaaS Consolidation Models

Infrastructure Cloud

Dedicated VMShared pool of hypervisors

Hypervisor

CRMDW ERP

OS

DB

DB

OSDB

OS

DB

DB

OS

ERPDW CRM

DB

OS

DB

DB

Database Cloud

Dedicated DatabaseShared pool of servers/clusters

OS

ERPDW CRM

OS

DB

Database Cloud

Increasing Consolidation

Dedicated SchemaShared Databases

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12

Comparison of DBaaS Consolidation ModelsDedicated VM

(Shared pool of

hypervisors)

Dedicated database

(Shared pool of servers

or clusters)

Dedicated schema

(Shared Databases)

Consolidation

DensityLow High Highest

Maintenance Very complex (VM Sprawl) EasyEasy to Involved (based on

required resource isolation)

ROI Low (Server and Storage Only) High (Servers, storage, and OS)Highest (Servers, Storage, OS,

and DB)

Isolation Excellent Good Least

Implementation &

OnboardingEasy Easy

Difficult (standardize on DB and

OS version)

Application

Suitability

Some (excessive in many

cases)All

Home grown; requires app

validation

Page 7: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

7

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13

DBaaS Standardization

� Enterprise Manager provides a resource pooling mechanism to pool

together homogeneous set of databases

� Enterprise Manager enforces governance for resource

– Placement policies based on load and configuration

– Access control, quota, retirement policies

� Enterprise Manager provides a guided workflow to create a Service

Catalog for providing database services

Enterprise Manager Features

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14

DBaaS Service Governance

• Create homogeneous infrastructure

of platform pools capable of hosting

standard database services

• Define placement policies

• Define access control on those

pools

• Define quota based on CPU,

storage, number of databases, etc

and assign them to roles

• Define retirement policies, e.g. retire

after a month of inactivity

Page 8: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

8

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15

DBaaS Service CatalogGuided workflow to publish services to the catalog

•Create Service Template

•Capture gold image (from reference system) for the provisioning payload

•Define Deployment Procedure for the provisioning logic

• Grant the Service Template to specific users

• Publish the Service Template to the Service Catalog

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16

DBaaS AutomationEnterprise Manager Features

� Out-of-box console for Self-Service Provisioning

� Can cater to DBAs, Developers, QA, Project Owners, etc

� Agile, push button method for handling

� Provisioning simple vanilla databases or schemas for developers

� Provisioning full databases for intense testing, such as upgrade

� Cloning large volumes of data in minutes for testing that involves small

subset of the data

� RESTFUL APIs for external integration and orchestration

Page 9: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

9

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17

Self-Service Provisioning

• Out-of-box console with customization and API support

• Self-Service DB and Schema Provisioning

• Schema-as-a-Service implementation consistent with Oracle Cloud DB Service

• Full database cloning using RMAN

• Database “Snap Clone” feature leveraging underlying storage copy-on-write technologies

• Integrated solution for database lifecycle management: monitoring, backup, patching

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18

Intelligent, transparent Service Placement

Current Load Current PopulationPlacement Policy

Constraints

Automatically find suitable target for placement:

• host for single instance database

• nodes for multi-instance RAC

• databases for schema

Automatically find suitable target for placement:

• host for single instance database

• nodes for multi-instance RAC

• databases for schema

Host NHost1

DBDB

DB/schema

Request

Best

Match

Database Pool

Get no. of database

instances per

Oracle home, or DB

services per

database

Get current CPU

usage and memory

allocation (storage

only for Schema as

a Service)

Validate the

constraints set on

CPU, memory &

number of

instances/services

Page 10: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

10

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19

Schema-as-a-Service• Features

• Consolidate multiple applications in a shared database

• Each application user can provision one or more database schema(s)

• Automated placement based on workload specifications

• Service governance through quotas, retirement policies and chargeback

plans

• Service level guarantee through Database Resource Manager

• Security isolation through Data Vault

• Benefits

• Saves resources through ultimate consolidation of multiple database

applications

• Minimizes administrative overheads and compliance challenges

• Example: Needs a single patching for hundreds of schemas in database

• Increases efficiency from automated provisioning

*New in 12cR2Plugin Update 1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20

• Features

• Leverage storage copy on-write technologies for database provisioning

• Initial support for NAS (Oracle ZFS Appliance and Netapp)

• Integrated lifecycle management (lineage and association tracking)

• “Time travel” capability to restore and access past data

• Benefits

• Agile provisioning (~ 2 minutes to provision a 1 TB database)

• Over 90% storage savings (100 KB of additional space for cloning a 1 TB database)

• Reduced administrative overhead from integrated lifecycle management

DBaaS “Snap Clone”Database Provisioning in Minutes

NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Test MasterDatabase

NAME SSN SALARY

MILLER 112-23-4567 40,000

SMITH 111-22-3333 60,000

Masking &Sub setting

ProductionDatabase

010110011101001010

000111010 Functional Copies –User can create multiple copies for functional testing without consuming space

Page 11: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

11

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21

Replication using: EM+RMAN,

Golden Gate, Dataguard, Netapp

SnapMirror, etc

Test Master

DatabaseProduction Database Masking and Subsetting using EM

Option 1: Snap Clones using Netapp

Flexclone or ZFS share

Private backups

(snapshots) for SSA

user

Option 2: Full Copy using RMAN

Summary of Database Cloning Choices From Enterprise Manager

Private backup for

SSA user•Storage based technology

• Saves space and time

• Ideal for "use and throw“ i.e.

short lived databases

• Suited for functional testing with

minor updates

• Storage Admin involved in setup

•Oracle Database based technology; Storage

neutral

• Restore time proportional to backup size

• Leverages existing technology and

infrastructure

• Suited for intense load and functional testing

• Completely managed by DBAs

Option 1: Snap Clone Option 2: RMAN

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22

Comprehensive API SupportFor Database as a Service operations: Deploy, Delete, List, Manage

Resource Description

Operations

GET POST PUT DELETE

CloudA cloud represents the user's starting view of all accessible

resources ���� ���� ���� ����

Service Family

TypeA service family type is a category of services that are offered by

the cloud. For example, IaaS, DBaaS, MWaaS, etc. These

categories are predefined.���� ���� ���� ����

DBaaS Zone

A DBaaS zone represents a logical boundary where the

resources may reside to support deployment of database

services���� ���� ���� ����

DB Platform

Template

[Service Template]

A DB platform template represents the definition of the

deployable database service ���� ���� ���� ����

DB Platform

Instance

[Service Instance]

A DB platform instance describes the metadata about databases

deployed using the service templates. ���� ���� ���� ����

Page 12: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

12

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23

DBaaS Showback / Chargeback

� Flexible metering and chargeback based on:

– Configuration and monitoring information

– Host and Database level

� Automated rollup using LDAP hierarchy

� Out-of-box reporting for business users (via BI Publisher)

� APIs for integration with billing systems

Enterprise Manager Features

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24

Chargeback/Showback ReportingTailored for different user types

• Rollup based on LDAP

hierarchy

• Summary and Trending

reports for Usage and

Charge

• Drilldowns

Chargeback Administrator Self-Service Portal User Line of Business User

• Charge Trend reports

broken down by resource

• Selectable detail levels

• Charge Plan

configuration

• Integrate with BI Publisher

• Generate Reports in variety of

formats

• Excel, Word, HTML,

PowerPoint, PDF

• Email or FTP reports

Page 13: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

13

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25

Database Metrics for Chargeback

Database Instance Shared Database (Service)

Configuration

Edition

Memory Usage

Option

Storage Usage

Release

Version

RAC Node Count

Option

Edition

Release

RAC Node Count

Usage

CPU Time

CPU Utilization (%)

CPU Utilization (SPECInt)

Network IO

Disk Read (Physical) Operations

Disk Write (Physical) Operations

SQL Executes

User Transactions

CPU Time Per Service

CPU Utilization Per Service

DB Time Per Service

Disk Read (Physical) Operations Per Service

Disk Write (Physical) Operations Per Service

SQL Executes Per Service

User Transactions Per Service

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26

Customer Proof Points

Page 14: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

14

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27

Proof of Value: 10X Faster ProvisioningMulti-Customer Study By Crimson Consulting

With Oracle Enterprise Manager 12c we cut the

time required to provision our RAC systems in

half. Oracle DBA, telecommunications firm

“”

Main point

Standardized builds based on Enterprise

Manager templates are a massive plusHyou get

fewer errors, lower downtime, fewer

infrastructure issues, and faster application

development.”

Oracle DBA, broadcast and telecommunications firm

I can give a set of business resources to a

business segment and they can be responsible

for the capacity that they stand up.

“”Infrastructure team manager, computer tech firm

0

50

100

150

200

250

300

Provisioning Time Before EM12c (hrs)

Provisioning Time With EM12c (hrs)

DBaaS DBaaS+

MWaaS

FullAppStack

Hours

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28

Challenges

� Sprawl of non-standard databases

� Delayed rollout of new services

� Sub-optimal hardware for variable loads

Solution

� DBaaS using EM 12c and Exadata

� Single click provisioning in minutes

Database-As-A-Service

Case Study: HDFC BankIndia’s Leading Bank

10X Fast App Rollout – Rapid Consolidation – Easier Management

Page 15: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

15

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.29

Database Cloud Solution Architecture at HDFC

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.30

Life after Database Cloud Go-live Time to Provision a 300 GB database

Sno List of activity during New DB infra requirement

1 IT team fill tech questionnaire and submit for discussion 0.5 0.5 0

2 Discussion and TCO in 3 days from discussion 3 0 0

3 Floating of funding proposal based on TCO 10 0 0

4 Approved funding raising PO for infra procurement 3 0 0

5 Delivery of server and infra structure 28 0 0

6 Asset code allocation and movement to DC 3 0 0

7 OS and other infra configuration 3 0 0

8 Identify server (compute+ memory ) 0 0.5 0

9 Storage allocation and publishing for new DB instance 3 0 0

10 Database installation and database creation 1 1 0

11 Database restoration 1 1 3

12 OEM or monitoring configuration 0.5 0.5 0

Day 56 Day 3.5 Hour 3

If D

ata

base

in

fra n

ot

avail

ab

le t

ime

take

n

If D

ata

base

in

fra a

vail

ab

le t

ime

take

n

Po

st D

BaaS im

ple

nta

tio

n u

sin

g E

M 1

2c

Total time taken in days /hour

Page 16: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

16

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.31

Features Benefits

Self-service provisioning of dedicated databasesOS level isolation, easy to deploy

Self-service provisioning of dedicated databasesDatabase isolation, ideal for enterprise

applications like ERP

Self-service provisioning of schemaHigh consolidation, reduced

administrative overhead

Full database cloneSetup of update intensive, UAT

environments

“Snap Clone” of databases Setup of database clones for functional

testing

Metering and ChargebackAccountability, usage budgeting

Database as a Service EM 12c Feature Summary

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.32

•Orchestration of test

processes

• Self-service provisioning

of

test environments

• Rich monitoring and

advanced diagnostics

•Chargeback and

Metering

•Orchestration of test

processes

• Self-service provisioning

of

test environments

• Rich monitoring and

advanced diagnostics

•Chargeback and

Metering

Enterprise Manager 12c: Complete list of Cloud Management Features

•Single VM template

provisioning for Oracle VM

for x86 and Sparc

•Multi-tier app (assembly)

provisioning

•Policy driven resource

scale out

and scale back

•Live migration and power

management

•Host and VM level

chargeback

•Single VM template

provisioning for Oracle VM

for x86 and Sparc

•Multi-tier app (assembly)

provisioning

•Policy driven resource

scale out

and scale back

•Live migration and power

management

•Host and VM level

chargeback

•Self-Service provisioning

of seed databases

•Integrated database

lifecycle management

•Chargeback for database

services

•Schema-as-a-Service

•Snap Clone

•Full Clone using RMAN

•Self-Service provisioning

of seed databases

•Integrated database

lifecycle management

•Chargeback for database

services

•Schema-as-a-Service

•Snap Clone

•Full Clone using RMAN

•Self-Service provisioning

of

Java applications

•Application level scale

out and

scale back

•Java Application lifecycle

management

•Chargeback for Java

Services

•Self-Service provisioning

of

Java applications

•Application level scale

out and

scale back

•Java Application lifecycle

management

•Chargeback for Java

Services

IaaS DBaaS Java-aaS TaaS

Cloud Orchestration BlueprintsCloud Orchestration Blueprints

Page 17: Integrated Cloud Applications and Platform …...Provisioning full databases for intense testing, such as upgrade Cloning large volumes of data in minutes for testing that involves

2/26/2013

17

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.33

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.34