iaas/paas with oracle private cloud appliance in practice company. 2 21.11.2017 iaas/paas with...

45
IaaS/PaaS with Oracle Private Cloud Appliance in practice Konrad HÄFELI Senior Solution Manager Infrastructure Engineering @ KonradHaefeli d oag2017

Upload: dinhminh

Post on 14-Mar-2018

230 views

Category:

Documents


2 download

TRANSCRIPT

IaaS/PaaS with Oracle Private Cloud Appliance – in practice

Konrad HÄFELI

Senior Solution ManagerInfrastructure Engineering

@KonradHaefeli doag2017

Our company.

IaaS/PaaS with Oracle PCA - in practice2 21.11.2017

Trivadis is a market leader in IT consulting, system integration, solution engineering

and the provision of IT services focusing on and

technologies

in Switzerland, Germany, Austria and Denmark. We offer our services in the following

strategic business fields:

Trivadis Services takes over the interacting operation of your IT systems.

O P E R A T I O N

COPENHAGEN

MUNICH

LAUSANNE

BERN

ZURICH

BRUGG

GENEVA

HAMBURG

DÜSSELDORF

FRANKFURT

STUTTGART

FREIBURG

BASEL

VIENNA

With over 600 specialists and IT experts in your region.

IaaS/PaaS with Oracle PCA - in practice3 21.11.2017

14 Trivadis branches and more than

600 employees

200 Service Level Agreements

Over 4,000 training participants

Research and development budget:

CHF 5.0 million

Financially self-supporting and

sustainably profitable

Experience from more than 1,900

projects per year at over 800

customers

21.11.2017 IaaS/PaaS with Oracle PCA - in practice4

Technology on its own won't help you.You need to know how to use it properly.

IaaS/PaaS with Oracle PCA - in practice5 21.11.2017

Positioning of Oracle’s Private

Cloud Appliance

Oracle Engineered Systems in a Hybrid Cloud World

IaaS/PaaS with Oracle PCA - in practice6 21.11.2017

IaaS/PaaS with Oracle PCA - in practice7 21.11.2017

Three Deployment Models for Cloud Ready Infrastructure

IaaS/PaaS with Oracle PCA - in practice8 21.11.2017

Oracle Cloud-Ready Infrastructure

IaaS/PaaS with Oracle PCA - in practice9 21.11.2017

Comparison PCA for DB and App

IaaS/PaaS with Oracle PCA - in practice10 21.11.2017

for Databases: for Applications:

Positioning in the market: Exa vs. PCA

IaaS/PaaS with Oracle PCA - in practice11 21.11.2017

Exadata Database Machine

Database platform

Highest performance

Most available

Unmatched scalability

Smart everything

▪ Software

▪ Storage

▪ avalability

▪ Licensing

Private Cloud Appliance

cost-effective solution for your mixed

Oracle and non-Oracle workloads

components shipped fully

preconfigured in a rack

Embedded controller software

automates installation and

configuration

Includes virtualization at no added

cost

Trusted Partitions for Oracle Engineered Systems

IaaS/PaaS with Oracle PCA - in practice12 21.11.2017

Goal: flexible Sub-Capacity-Licensing based on Oracle VM

Requirements:

– Enterprise Manager (see My Oracle Support Note 1471719.1)

– Connected Mode: Usage reported via My Oracle Support

– Disconnected Mode: quarterly Reports, locally stored for two years

Business with PCA

IaaS/PaaS with Oracle PCA - in practice13 21.11.2017

General purpose private cloud

platform:

We have a solution to optimize the

Oracle SW Stack licensing

The system is comparable good…

… the Trusted Partition is the USP

Give it a try, most customers have:

… different HW vendor anyway

… use different DB products

… run on different OSs

Why not run also two Hypervisor?

… for the sake of license savings?

IaaS/PaaS with Oracle PCA - in practice14 21.11.2017

Time to know, what the PCA based

Platform is all about

Building blocks of the architecture

http://www.oracle.com/technetwork/server-storage/private-cloud-appliance/overview/index.html

IaaS/PaaS with Oracle PCA - in practice15 21.11.2017

PCA: Privat Cloud Appliance ZS5: ZFS Storage Appliance

Optimal storage architecture for

enterprise clouds and

virtualization

– Dynamic caching among

dynamic random access

memory (DRAM), flash cache,

and disk drives

– Including compression,

cloning, encryption, and

replication

– Integration with Oracle

Database

Consolidated

Workloads with secure

Multi-Tenancy

– Simple setup &

management

– Reliable

– Fast provisioning and

elastic scaling

– Rapidly deploy

Oracle Applications

using Oracle VM

Templates

Simple to setup & install

Factory integrated

Designed for reliability

and ease of management

PCA costs savings potential

16 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

17

Oracle Private Cloud Appliance

Oracle X5-2 Servers

Oracle ZFS Z3-ES Storage Appliance

• Redundant controllers, high performance virtual

storage

• 8 TB SAS disks

Network Infrastructure

• Oracle Fabric Interconnect F1-15, Oracle Switches

• High speed low latency networking between all

components

• Fully configured fabric networking, no setup required

• Integrates with existing Ethernet and storage networks

Fabric Interconnect

Fabric Interconnect

Compute

Nodes

Compute Nodes

Mgmt Nodes

Management Storage

InfiniBand Expansion

Ethernet Switch

Oracle X6-2 Servers

• 2 to 25 nodes

• CPU: Up to 1100 cores

• Memory: Up to 19.2TB

• Supports any Linux, Solaris and Windows applications

Ne

two

rkin

gM

an

ag

em

en

t

Four 4x10GbE

40G

b/s S

erv

er-to

-Serve

r

Network

Storage

InfiniBand Expansion

21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Scale-out Computing with Expansion Rack Support

Maximum of 2 expansion racks

Interconnected via Infiniband

Expansion racks contain compute nodes only

No management nodes or storage required

85 total compute nodes

– 30 nodes per expansion rack

– 25 nodes base rack

– total of 3740 cores

Customer must use tenant groups to use

nodes in expansion racks

18 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Elastic Infrastructure for Multi-Tenancy

Wire Once Infrastructure

Connect any VM dynamically to any IO resource

Prewired for simplicity, add compute nodes on demand

Dynamically create up to 8 networks per Tenant-Group

Increased Flexibility

Deploy and grow applications as your needs change

Create isolated groups for applications

Improve app to app communication

Software Upgradable System

Appliance features added as SW, no HW changes needed

System managed as a single resource to patch and upgrade

Integrated Software Defined Networking

SoftwareDefinedNetwork

19 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Private Cloud Appliance Orchestration

20

Fabric Interconnect

Fabric Interconnect

Compute Nodes

Compute Nodes

Management Nodes

Management Storage

Ethernet Switch

Networking

Management

Infiniband Expansion

Infiniband Expansion

• Orchestrated Hardware Bringup• Inserts all servers in an Oracle

VM Manager server pool• Configures external networking

(set IP address, etc.)• Performs periodic back-up of

Private Cloud Appliance

OVM Manager

• VM and hypervisor (Xen)

resource management

• VM network / storage

configuration

Dual,

redundant

PCA

management

nodes with

automatic

failover

PCA Controller

• Cloud management (self service, metering and chargeback, etc.) for one or multiple PCAs

• Hardware resource management

• Database, middleware, apps management

• Software management, configuration and compliance management

• Plugin with Oracle VM Manager for full stack management

Enterprise Manager

Compute

Compute

21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Networking

Monitoring

•Performance and

availability

monitoring

•Fault detection and

management

•Incident Manager

Configuration and

Change Management

•Centralized

Inventory Tracking

•Search and compare

configurations

•Drift analysis

•Apply updates and

patches

Disaster Recovery

•SiteGuard

integration

•Multi-Site capability

•Highly customizable

•Storage Vendor

Agnostic

Provisioning

•Gold image based

provisioning

•Bare metal

provisioning of VMs,

hypervisor

•Standardize using

YUM repository

Compliance

•Out of box policies

for regulatory

compliance

•Comprehensive

compliance

reporting

Hardware, OS and Applications - Complete. Automated. Out-of-the-box.

Deploy IaaS: Private Cloud Appliance + Enterprise Manager

21 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Full Tenant Isolation: Tenant Groups

Utilizes Oracle VM Server Pool technology

– Add/remove servers, networks, and VMs to tenant

groups to isolate resources/users

A tenant group can have a mix of hardware types (e.g.

X4-2, X5-2, X6-2)

– VM live migration: forward compatible

– VM live migration: not backwards compatible

Networks can be:

– PVI internal to the rack (node-to-node)

– Different 10GbE ports per tenant groups

– External VLAN enabled networks through 10GbE

ports

All networks built with HA

22

VMVM

VMVM

VMVM

VMVM

VM

Tenant Group 1

Tenant Group 2

Tenant Group 3

VM

sN

etw

ork

Co

mp

ute

N

od

es

Sh

are

d

Sto

rag

e

21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Complete Disaster Recovery Architecture

IaaS/PaaS with Oracle PCA - in practice23 21.11.2017

Full Maximum Availability Architecture support

for Oracle Applications with Site Guard

Oracle VM Disaster Recovery for Non-Oracle

applications

Extend to Oracle Public Cloud

Oracle ZFS Storage Technical Innovations

Optimal Storage SecurityShare/LUN encryption, two-tier key management, end-to-end integrity checks

Oracle Cloud CoengineeringShadow Migration, a feature of Oracle ZFS Storage Appliance, and rolling upgrades, user-level analytics, workflows

Record-Setting Storage PerformanceDRAM/flash architecture (Hybrid Storage Pool), SMP RTOS, most scalable file system (ZFS)

Industry-Leading Storage EfficiencyReal-time analytics, clone/snap, compression, deduplication, Hybrid Storage Pool, data services

Oracle Database CoengineeringOISP, HCC, ADO, OEM Provisioning, SMU, pluggable database analytics

24 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Flash Storage Pools▪ 8 TB to 3 PB of flash storage

▪ Consistent low latency

▪ Database indexes, redo logs, active

partitions

Hybrid Storage Pool▪ Up to 9 PB of storage capacity

▪ Up to 450,000 IOPS at <1 ms – 4 ms

response

▪ Database data; primary, test/dev, backup

High-Performance Controllers▪ 3 TB of DRAM, 144 processor cores

▪ Up to 24x10 GbE, 16x40 Gb IB, 16x16 Gb

FC

▪ Full suite of enterprise software

L2

AR

C

Wri

te F

lash

External Read Flash▪ 2 TB to 300 TB of read flash storage

▪ Apply read flash to any pool

▪ Ideal for database warehousing and

mining

Hybrid Cloud Pools (HCP)▪ Comprised of Oracle Cloud capacity

▪ Functions as a private system resource

▪ Compatible with all system data services

Read

Fla

sh

Wri

te F

lash

Read

Fla

shD

DT F

lash

Deduplication (DDT) Flash▪ Comprised of Oracle Cloud capacity

▪ Functions as a private system resource

▪ Compatible with all system data services

ZS5 Hybrid Storage Architecture

25 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Oracle Intelligent Storage ProtocolDatabase and storage coengineering

Intelligence is in the code within both the

database and storage

Available only with Oracle Database 12c and

Oracle ZFS Storage Appliance OS 8 and above

Storage awareness of database workload

Database sends cues about each I/O to the

storage

Over 70 database I/O types are recognized

Cues grouped into five distinct categories by

storage

Information used by storage to adaptively and

automatically adjust for optimal efficiency

OracleDatabase 12c

Oracle ZFS

Storage

Appliance

dynamically

tunes critical

storage

parameters

I/O cues

exchanged with

Oracle ZFS Storage Appliance

26 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

dNFS TCP IPOISP Network IP TCP dNFS OISP

Dynamic ActionsDynamically record size, log bias

(shipping)

Pluggable database analytics

(shipping)

Oracle Enterprise Manager

provisioning (Shipping)

Analytics AWR feed

I/O fair share scheduling and DB

priority

I/O caching/prefetch

Oracle Intelligent Storage Protocol

Technology: DB Coengineering

Oracle Database with Oracle Intelligent Storage ProtocolExtensions built on top of NFSv4 protocol

Each I/O is tagged with data context

I/O reason

I/O priority

File type (redo log, data file, control file,

backup file)

Database block size for file

Database and/or pluggable database ID

Cache hints

Prefetch hints

27 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Oracle Intelligent Storage Protocol 2.0:

Efficient Cache Management

OLTP START Oracle RMAN START OLTP START Oracle RMAN START

ARC Evictions

• Simultaneous Oracle

RMAN + OLTP

workloads

• RPC fair share scheduler

with DB I/O

prioritization

• Negative cache hints for

lower priority like Oracle

RMAN and archivelog

I/O

Before Extensions With Extensions

28 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

Before ExtensionsWith Extensions

86% reduction in LGWR latency

33% faster datafile backup

• Bounded latency for

higher priority DB

I/O

• RPC fair share

scheduler with DB

I/O prioritization

• Separate thread

pools for READs,

WRITEs, and Oracle

Intelligent Storage

Protocol high-

priority I/O

Oracle Intelligent Storage Protocol 2.0:

Optimized Database Storage

29 21.11.2017 IaaS/PaaS with Oracle PCA - in practice

IaaS/PaaS with Oracle PCA - in practice30 21.11.2017

PCA Administration

Software Components

IaaS/PaaS with Oracle PCA - in practice31 21.11.2017

Oracle Private Cloud Appliance Dashboard

Password Manager (Wallet)

Oracle VM Manager

Operating Systems

(Admin) Databases (Berkeley DB, MySql)

Oracle Private Cloud Appliance Management Software

Oracle Private Cloud Appliance Diagnostics Tool (pca-diag)

Dokumentation

– https://docs.oracle.com/cd/E83758_01/

Oracle Private Cloud Appliance Dashboard

IaaS/PaaS with Oracle PCA - in practice32 21.11.2017

PCA Command Line Interface (CLI)

IaaS/PaaS with Oracle PCA - in practice33 21.11.2017

# pca-admin

Welcome to PCA! Release: 2.0.5

PCA>

PCA> list management-node

Management_Node IP_Address Node_State ILOM_MAC ILOM_State Master

--------------- ---------- ---------- -------- ---------- ------

ovcamn06r1 192.168.4.4 RUNNING 00:10:e0:2e:7c:53 running

ovcamn05r1 192.168.4.3 RUNNING 00:10:e0:31:93:6f running Yes

----------------

2 rows displayed

Status: Success

PCA> exit

#

PCACLI

IaaS/PaaS with Oracle PCA - in practice34 21.11.2017

PCA> help

Documented commands (type help <topic>):

========================================

backup diagnose list rerun show stop

delete help reprovision set start

Undocumented commands:

======================

EOF exit q quit shell

VM Manager

IaaS/PaaS with Oracle PCA - in practice35 21.11.2017

Update Prozess

IaaS/PaaS with Oracle PCA - in practice36 21.11.2017

Rebooting the Management Node Cluster

pca-check-master

pca-updater

Upgrading the Virtualization Platform (Oracle VM)

– Decoupled from the automatisation process

– Needs Rebooting nodes

# pca-updater -m download -s -u http://url.example.com/pca-version-build.iso.zip

# pca-updater -m update –s

(O)VM Templates

IaaS/PaaS with Oracle PCA - in practice37 21.11.2017

http://www.oracle.com/technetwork/server-storage/vm/database-templates-12c-

11gr2-1972804.html

RAC VM Templates (White Paper)

IaaS/PaaS with Oracle PCA - in practice38 21.11.2017

http://www.oracle.com/technetwork/server-storage/private-cloud-appliance/deployment-

of-oracle-rac-on-pca-4013267.pdf

http://edelivery.oracle.co

m/oraclevm

DeployCluster Tool

– fully supports Single

Instance, Oracle

Restart (SIHA) or RAC

deployments

VMware to Oracle VM Migration tool

IaaS/PaaS with Oracle PCA - in practice39 21.11.2017

http://www.oracle.com/technetwork/server-storage/vm/downloads/ovm-tools-3604795.html

Prices http://www.oracle.com/us/corporate/pricing/exadata-pricelist-070598.pdf

IaaS/PaaS with Oracle PCA - in practice40 21.11.2017

Hardware

Private Cloud Appliance Base Rack

– $117k

Internal ZFS Storage

– $46k

Compute node

– $17k

minimal config < $ 200k

ZS5-2 ~ $ 175k

+ HW Maintenance

Software Licensing

Metering and chargeback module incl.

Site Guard

– Oracle Configuration Management

Pack for Applications (no Oracle)

– Database Lifecycle Mgmt Pack and

WLS Mgmt Pack

• $ 12k/proc

Opt. Oracle Cloud Management Pack

– $ 7,5k/proc

IaaS/PaaS with Oracle PCA - in practice41 21.11.2017

Conclusion

Evaluation over TCO and value chain

IaaS/PaaS with Oracle PCA - in practice42 21.11.2017

Requirements definition

TCO Calculation

Scenario comparison

Make or buy decision

As IT department…

As service provider

Added values in the value chain

Compare & Validate

Decide

Conclusion

IaaS/PaaS with Oracle PCA - in practice43 21.11.2017

As an Oracle SW Stack Platform next to a general purpose Cloud

Platform, it has its place

Latest Compute Nodes X7-2 in Dec 2017

The license advantages can justify the costs …

Platform-Ready configuration and operation needs expertise

– Otherwise consider Oracle Cloud Machine (OCM)

– Automatization is key

We believe in the market chance of PCA Platform and looking

forward solving your infrastructure challenges with it

Your ContactKonrad Häfeli

Senior Solution Manager

Partner

Tel. +41 58 459 59 69

[email protected]

21.11.2017 IaaS/PaaS with Oracle PCA - in practice44

Trivadis @ DOAG 2017#opencompany

Booth: 3rd Floor – next to the escalator

We share our Know how!Just come across, Live-Presentationsand documents archive

T-Shirts, Contest and much more

We look forward to your visit

21.11.2017 IaaS/PaaS with Oracle PCA - in practice45