iaas/paas with oracle private cloud appliance in practice company. 2 21.11.2017 iaas/paas with...
TRANSCRIPT
IaaS/PaaS with Oracle Private Cloud Appliance – in practice
Konrad HÄFELI
Senior Solution ManagerInfrastructure Engineering
@KonradHaefeli doag2017
Our company.
IaaS/PaaS with Oracle PCA - in practice2 21.11.2017
Trivadis is a market leader in IT consulting, system integration, solution engineering
and the provision of IT services focusing on and
technologies
in Switzerland, Germany, Austria and Denmark. We offer our services in the following
strategic business fields:
Trivadis Services takes over the interacting operation of your IT systems.
O P E R A T I O N
COPENHAGEN
MUNICH
LAUSANNE
BERN
ZURICH
BRUGG
GENEVA
HAMBURG
DÜSSELDORF
FRANKFURT
STUTTGART
FREIBURG
BASEL
VIENNA
With over 600 specialists and IT experts in your region.
IaaS/PaaS with Oracle PCA - in practice3 21.11.2017
14 Trivadis branches and more than
600 employees
200 Service Level Agreements
Over 4,000 training participants
Research and development budget:
CHF 5.0 million
Financially self-supporting and
sustainably profitable
Experience from more than 1,900
projects per year at over 800
customers
21.11.2017 IaaS/PaaS with Oracle PCA - in practice4
Technology on its own won't help you.You need to know how to use it properly.
Oracle Engineered Systems in a Hybrid Cloud World
IaaS/PaaS with Oracle PCA - in practice6 21.11.2017
Three Deployment Models for Cloud Ready Infrastructure
IaaS/PaaS with Oracle PCA - in practice8 21.11.2017
Comparison PCA for DB and App
IaaS/PaaS with Oracle PCA - in practice10 21.11.2017
for Databases: for Applications:
Positioning in the market: Exa vs. PCA
IaaS/PaaS with Oracle PCA - in practice11 21.11.2017
Exadata Database Machine
Database platform
Highest performance
Most available
Unmatched scalability
Smart everything
▪ Software
▪ Storage
▪ avalability
▪ Licensing
Private Cloud Appliance
cost-effective solution for your mixed
Oracle and non-Oracle workloads
components shipped fully
preconfigured in a rack
Embedded controller software
automates installation and
configuration
Includes virtualization at no added
cost
Trusted Partitions for Oracle Engineered Systems
IaaS/PaaS with Oracle PCA - in practice12 21.11.2017
Goal: flexible Sub-Capacity-Licensing based on Oracle VM
Requirements:
– Enterprise Manager (see My Oracle Support Note 1471719.1)
– Connected Mode: Usage reported via My Oracle Support
– Disconnected Mode: quarterly Reports, locally stored for two years
Business with PCA
IaaS/PaaS with Oracle PCA - in practice13 21.11.2017
General purpose private cloud
platform:
We have a solution to optimize the
Oracle SW Stack licensing
The system is comparable good…
… the Trusted Partition is the USP
Give it a try, most customers have:
… different HW vendor anyway
… use different DB products
… run on different OSs
Why not run also two Hypervisor?
… for the sake of license savings?
IaaS/PaaS with Oracle PCA - in practice14 21.11.2017
Time to know, what the PCA based
Platform is all about
Building blocks of the architecture
http://www.oracle.com/technetwork/server-storage/private-cloud-appliance/overview/index.html
IaaS/PaaS with Oracle PCA - in practice15 21.11.2017
PCA: Privat Cloud Appliance ZS5: ZFS Storage Appliance
Optimal storage architecture for
enterprise clouds and
virtualization
– Dynamic caching among
dynamic random access
memory (DRAM), flash cache,
and disk drives
– Including compression,
cloning, encryption, and
replication
– Integration with Oracle
Database
Consolidated
Workloads with secure
Multi-Tenancy
– Simple setup &
management
– Reliable
– Fast provisioning and
elastic scaling
– Rapidly deploy
Oracle Applications
using Oracle VM
Templates
Simple to setup & install
Factory integrated
Designed for reliability
and ease of management
PCA costs savings potential
16 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
17
Oracle Private Cloud Appliance
Oracle X5-2 Servers
Oracle ZFS Z3-ES Storage Appliance
• Redundant controllers, high performance virtual
storage
• 8 TB SAS disks
Network Infrastructure
• Oracle Fabric Interconnect F1-15, Oracle Switches
• High speed low latency networking between all
components
• Fully configured fabric networking, no setup required
• Integrates with existing Ethernet and storage networks
Fabric Interconnect
Fabric Interconnect
Compute
Nodes
Compute Nodes
Mgmt Nodes
Management Storage
InfiniBand Expansion
Ethernet Switch
Oracle X6-2 Servers
• 2 to 25 nodes
• CPU: Up to 1100 cores
• Memory: Up to 19.2TB
• Supports any Linux, Solaris and Windows applications
Ne
two
rkin
gM
an
ag
em
en
t
Four 4x10GbE
40G
b/s S
erv
er-to
-Serve
r
Network
Storage
InfiniBand Expansion
21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Scale-out Computing with Expansion Rack Support
Maximum of 2 expansion racks
Interconnected via Infiniband
Expansion racks contain compute nodes only
No management nodes or storage required
85 total compute nodes
– 30 nodes per expansion rack
– 25 nodes base rack
– total of 3740 cores
Customer must use tenant groups to use
nodes in expansion racks
18 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Elastic Infrastructure for Multi-Tenancy
Wire Once Infrastructure
Connect any VM dynamically to any IO resource
Prewired for simplicity, add compute nodes on demand
Dynamically create up to 8 networks per Tenant-Group
Increased Flexibility
Deploy and grow applications as your needs change
Create isolated groups for applications
Improve app to app communication
Software Upgradable System
Appliance features added as SW, no HW changes needed
System managed as a single resource to patch and upgrade
Integrated Software Defined Networking
SoftwareDefinedNetwork
19 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Private Cloud Appliance Orchestration
20
Fabric Interconnect
Fabric Interconnect
Compute Nodes
Compute Nodes
Management Nodes
Management Storage
Ethernet Switch
Networking
Management
Infiniband Expansion
Infiniband Expansion
• Orchestrated Hardware Bringup• Inserts all servers in an Oracle
VM Manager server pool• Configures external networking
(set IP address, etc.)• Performs periodic back-up of
Private Cloud Appliance
OVM Manager
• VM and hypervisor (Xen)
resource management
• VM network / storage
configuration
Dual,
redundant
PCA
management
nodes with
automatic
failover
PCA Controller
• Cloud management (self service, metering and chargeback, etc.) for one or multiple PCAs
• Hardware resource management
• Database, middleware, apps management
• Software management, configuration and compliance management
• Plugin with Oracle VM Manager for full stack management
Enterprise Manager
Compute
Compute
21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Networking
Monitoring
•Performance and
availability
monitoring
•Fault detection and
management
•Incident Manager
Configuration and
Change Management
•Centralized
Inventory Tracking
•Search and compare
configurations
•Drift analysis
•Apply updates and
patches
Disaster Recovery
•SiteGuard
integration
•Multi-Site capability
•Highly customizable
•Storage Vendor
Agnostic
Provisioning
•Gold image based
provisioning
•Bare metal
provisioning of VMs,
hypervisor
•Standardize using
YUM repository
Compliance
•Out of box policies
for regulatory
compliance
•Comprehensive
compliance
reporting
Hardware, OS and Applications - Complete. Automated. Out-of-the-box.
Deploy IaaS: Private Cloud Appliance + Enterprise Manager
21 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Full Tenant Isolation: Tenant Groups
Utilizes Oracle VM Server Pool technology
– Add/remove servers, networks, and VMs to tenant
groups to isolate resources/users
A tenant group can have a mix of hardware types (e.g.
X4-2, X5-2, X6-2)
– VM live migration: forward compatible
– VM live migration: not backwards compatible
Networks can be:
– PVI internal to the rack (node-to-node)
– Different 10GbE ports per tenant groups
– External VLAN enabled networks through 10GbE
ports
All networks built with HA
22
VMVM
VMVM
VMVM
VMVM
VM
Tenant Group 1
Tenant Group 2
Tenant Group 3
VM
sN
etw
ork
Co
mp
ute
N
od
es
Sh
are
d
Sto
rag
e
21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Complete Disaster Recovery Architecture
IaaS/PaaS with Oracle PCA - in practice23 21.11.2017
Full Maximum Availability Architecture support
for Oracle Applications with Site Guard
Oracle VM Disaster Recovery for Non-Oracle
applications
Extend to Oracle Public Cloud
Oracle ZFS Storage Technical Innovations
Optimal Storage SecurityShare/LUN encryption, two-tier key management, end-to-end integrity checks
Oracle Cloud CoengineeringShadow Migration, a feature of Oracle ZFS Storage Appliance, and rolling upgrades, user-level analytics, workflows
Record-Setting Storage PerformanceDRAM/flash architecture (Hybrid Storage Pool), SMP RTOS, most scalable file system (ZFS)
Industry-Leading Storage EfficiencyReal-time analytics, clone/snap, compression, deduplication, Hybrid Storage Pool, data services
Oracle Database CoengineeringOISP, HCC, ADO, OEM Provisioning, SMU, pluggable database analytics
24 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Flash Storage Pools▪ 8 TB to 3 PB of flash storage
▪ Consistent low latency
▪ Database indexes, redo logs, active
partitions
Hybrid Storage Pool▪ Up to 9 PB of storage capacity
▪ Up to 450,000 IOPS at <1 ms – 4 ms
response
▪ Database data; primary, test/dev, backup
High-Performance Controllers▪ 3 TB of DRAM, 144 processor cores
▪ Up to 24x10 GbE, 16x40 Gb IB, 16x16 Gb
FC
▪ Full suite of enterprise software
L2
AR
C
Wri
te F
lash
External Read Flash▪ 2 TB to 300 TB of read flash storage
▪ Apply read flash to any pool
▪ Ideal for database warehousing and
mining
Hybrid Cloud Pools (HCP)▪ Comprised of Oracle Cloud capacity
▪ Functions as a private system resource
▪ Compatible with all system data services
Read
Fla
sh
Wri
te F
lash
Read
Fla
shD
DT F
lash
Deduplication (DDT) Flash▪ Comprised of Oracle Cloud capacity
▪ Functions as a private system resource
▪ Compatible with all system data services
ZS5 Hybrid Storage Architecture
25 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Oracle Intelligent Storage ProtocolDatabase and storage coengineering
Intelligence is in the code within both the
database and storage
Available only with Oracle Database 12c and
Oracle ZFS Storage Appliance OS 8 and above
Storage awareness of database workload
Database sends cues about each I/O to the
storage
Over 70 database I/O types are recognized
Cues grouped into five distinct categories by
storage
Information used by storage to adaptively and
automatically adjust for optimal efficiency
OracleDatabase 12c
Oracle ZFS
Storage
Appliance
dynamically
tunes critical
storage
parameters
I/O cues
exchanged with
Oracle ZFS Storage Appliance
26 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
dNFS TCP IPOISP Network IP TCP dNFS OISP
Dynamic ActionsDynamically record size, log bias
(shipping)
Pluggable database analytics
(shipping)
Oracle Enterprise Manager
provisioning (Shipping)
Analytics AWR feed
I/O fair share scheduling and DB
priority
I/O caching/prefetch
Oracle Intelligent Storage Protocol
Technology: DB Coengineering
Oracle Database with Oracle Intelligent Storage ProtocolExtensions built on top of NFSv4 protocol
Each I/O is tagged with data context
I/O reason
I/O priority
File type (redo log, data file, control file,
backup file)
Database block size for file
Database and/or pluggable database ID
Cache hints
Prefetch hints
27 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Oracle Intelligent Storage Protocol 2.0:
Efficient Cache Management
OLTP START Oracle RMAN START OLTP START Oracle RMAN START
ARC Evictions
• Simultaneous Oracle
RMAN + OLTP
workloads
• RPC fair share scheduler
with DB I/O
prioritization
• Negative cache hints for
lower priority like Oracle
RMAN and archivelog
I/O
Before Extensions With Extensions
28 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Before ExtensionsWith Extensions
86% reduction in LGWR latency
33% faster datafile backup
• Bounded latency for
higher priority DB
I/O
• RPC fair share
scheduler with DB
I/O prioritization
• Separate thread
pools for READs,
WRITEs, and Oracle
Intelligent Storage
Protocol high-
priority I/O
Oracle Intelligent Storage Protocol 2.0:
Optimized Database Storage
29 21.11.2017 IaaS/PaaS with Oracle PCA - in practice
Software Components
IaaS/PaaS with Oracle PCA - in practice31 21.11.2017
Oracle Private Cloud Appliance Dashboard
Password Manager (Wallet)
Oracle VM Manager
Operating Systems
(Admin) Databases (Berkeley DB, MySql)
Oracle Private Cloud Appliance Management Software
Oracle Private Cloud Appliance Diagnostics Tool (pca-diag)
Dokumentation
– https://docs.oracle.com/cd/E83758_01/
PCA Command Line Interface (CLI)
IaaS/PaaS with Oracle PCA - in practice33 21.11.2017
# pca-admin
Welcome to PCA! Release: 2.0.5
PCA>
PCA> list management-node
Management_Node IP_Address Node_State ILOM_MAC ILOM_State Master
--------------- ---------- ---------- -------- ---------- ------
ovcamn06r1 192.168.4.4 RUNNING 00:10:e0:2e:7c:53 running
ovcamn05r1 192.168.4.3 RUNNING 00:10:e0:31:93:6f running Yes
----------------
2 rows displayed
Status: Success
PCA> exit
#
PCACLI
IaaS/PaaS with Oracle PCA - in practice34 21.11.2017
PCA> help
Documented commands (type help <topic>):
========================================
backup diagnose list rerun show stop
delete help reprovision set start
Undocumented commands:
======================
EOF exit q quit shell
Update Prozess
IaaS/PaaS with Oracle PCA - in practice36 21.11.2017
Rebooting the Management Node Cluster
pca-check-master
pca-updater
Upgrading the Virtualization Platform (Oracle VM)
– Decoupled from the automatisation process
– Needs Rebooting nodes
# pca-updater -m download -s -u http://url.example.com/pca-version-build.iso.zip
# pca-updater -m update –s
(O)VM Templates
IaaS/PaaS with Oracle PCA - in practice37 21.11.2017
http://www.oracle.com/technetwork/server-storage/vm/database-templates-12c-
11gr2-1972804.html
RAC VM Templates (White Paper)
IaaS/PaaS with Oracle PCA - in practice38 21.11.2017
http://www.oracle.com/technetwork/server-storage/private-cloud-appliance/deployment-
of-oracle-rac-on-pca-4013267.pdf
http://edelivery.oracle.co
m/oraclevm
DeployCluster Tool
– fully supports Single
Instance, Oracle
Restart (SIHA) or RAC
deployments
VMware to Oracle VM Migration tool
IaaS/PaaS with Oracle PCA - in practice39 21.11.2017
http://www.oracle.com/technetwork/server-storage/vm/downloads/ovm-tools-3604795.html
Prices http://www.oracle.com/us/corporate/pricing/exadata-pricelist-070598.pdf
IaaS/PaaS with Oracle PCA - in practice40 21.11.2017
Hardware
Private Cloud Appliance Base Rack
– $117k
Internal ZFS Storage
– $46k
Compute node
– $17k
minimal config < $ 200k
ZS5-2 ~ $ 175k
+ HW Maintenance
Software Licensing
Metering and chargeback module incl.
Site Guard
– Oracle Configuration Management
Pack for Applications (no Oracle)
– Database Lifecycle Mgmt Pack and
WLS Mgmt Pack
• $ 12k/proc
Opt. Oracle Cloud Management Pack
– $ 7,5k/proc
Evaluation over TCO and value chain
IaaS/PaaS with Oracle PCA - in practice42 21.11.2017
Requirements definition
TCO Calculation
Scenario comparison
Make or buy decision
As IT department…
As service provider
Added values in the value chain
Compare & Validate
Decide
Conclusion
IaaS/PaaS with Oracle PCA - in practice43 21.11.2017
As an Oracle SW Stack Platform next to a general purpose Cloud
Platform, it has its place
Latest Compute Nodes X7-2 in Dec 2017
The license advantages can justify the costs …
Platform-Ready configuration and operation needs expertise
– Otherwise consider Oracle Cloud Machine (OCM)
– Automatization is key
We believe in the market chance of PCA Platform and looking
forward solving your infrastructure challenges with it
Your ContactKonrad Häfeli
Senior Solution Manager
Partner
Tel. +41 58 459 59 69
21.11.2017 IaaS/PaaS with Oracle PCA - in practice44