„jumpstart oracle database deployments with sun zfs storage appliance” zbyszek swoczyna, systems...
DESCRIPTION
Plug into the Cloud with Oracle Database 12c, 27.06.2013TRANSCRIPT
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1
Oracle Storage for Oracle Database
Zbygniew Swoczyna Storage Architect, SE Manager
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 2
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3
Oracle Optimized Storage Portfolio Best of Breed plus Unique Optimizations for Oracle Software
Oracle Software Runs Faster and More Efficiently on Oracle Storage
Database NAS SAN Tape
Servers
Virtual Machine
Operating System
Database
Middleware
Applications
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4
NAS
Choice of Oracle Database Deployments
Production • High performance and efficiency • High availability and low risk • Effective consolidation
Test & Development • Extreme efficiency • Simplified management
Data Protection • High throughput • Extreme resiliency
Leadership Efficiency and Low Costs for All Environments
Applications
Oracle Database Instances
Physical and Virtual Servers
Tape SAN
Production Test & Dev Data Protection
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5
§ 41,650 concurrent application users § 47 database instances § 15.4 million database transactions per hour § 8 disparate enterprise applications § 4 storage protocols § 3 weekly full backups to StorageTekTape § Zero downtime environment
Every Sun ZFS Storage Appliance powering the Oracle Cloud delivers to cloud storage extremes
Oracle IT Achieves 3x Consolidation Over 330 Sun ZFS Storage Appliances and 120PB of Storage
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6
Oracle IT Storage Platform
Oracle on Oracle vs. Legacy Solutions
50%
Less tuning and trouble shooting
12x Faster at Compute Farm Workloads
3:1 Consolidation
VS
3x Faster with twice as
many clone and snapshots
5x
Faster in Database Test Suite Executions
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7
Sun ZFS Storage Appliance Best-of-Breed Capabilities
• High Performance NAS Family
• Robust suite of data services
• Efficient data reduction
• Simplified management
• Lower TCO
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8
Storage Efficiency Optimizations
Throughput Optimizations
Data Protection Optimizations
Management Optimizations
Sun ZFS Storage Appliance Optimized for Oracle Database
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 9
Thin Provisioning
Snap / Clone
Compression
Throughput Optimizations
Data Protection Optimizations
Management Optimizations
Storage Efficiency Optimizations
Sun ZFS Storage Appliance Storage Efficiency Optimizations For Oracle Database
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10
Active Less Active Historical
Oracle Database Enterprise Edition
Partitioning Option
Advanced Compression
Option
Hybrid Columnar
Compression
Data Specific Compression
• Oracle Database Partitioning • Higher performance & availability • Simplified management
• Advanced Compression Option • Suitable for active data • Compresses all data types 2x to 4x
• Hybrid Columnar Compression • Optimized for historical data • Query mode for data warehousing - Typical 10x compression, faster scans
• Archival mode for old data - Typical 15x-50x compression ratios
Oracle Database Partitioning and Compression
Only with Oracle Exadata, Pillar Axiom, Sun ZFS Storage Appliance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11
Sun ZFS Storage Appliance Permanently Shrink Storage Requirements with HCC
10x to 15x Data Compression
Ideal for: Data Warehousing, Database ILM, DR, Test/Dev
3–5x Less Disk Space
3–5x Less Energy Used
3–5x Lower Cost Than non-Oracle NAS
Oracle Database 11g R2 Enterprise Edition on Any Server, No Additional Charge
Oracle Database with Hybrid Columnar
Compression
Sun ZFS Storage
Appliance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12
ORDERS TABLE (7 years)
5% Hot Data = 2.5TB
2012
Existing Storage
2011 20% Active Data = 10TB
• 50 percent Less Active
2005-2010
75% Archive Data = 37.5TB 3TB with ACO 2.5TB with HCC
Reduce Storage Footprint and Costs 84% Less Storage with Oracle Database Partitioning and Compression
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13
Sun ZFS Storage Appliance
HCC data stays compressed: On disk In storage caches Over networks In memory In system caches Many data sets fit in memory Shorter backup windows and remote replication for DR
Higher Efficiency AND Performance with Hybrid Columnar Compression
Retail Database
Original Tables
HCC Tables Improvement
Size 735 GB 38GB 19.3x
Query 1 52:06 10:52 4.7x
Query 2 2:22:44 16:50 8.4x
Query 3 7:06 1:06 6.4x
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14
Sun ZFS Storage Appliance
Oracle Database Throughput Optimizations
High Throughput Controllers
Large, Fast Caches
Infiniband
Direct NFS
Data Protection Optimizations
Management Optimizations
Storage Efficiency Optimizations
Throughput Optimizations
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15
Over 9x more memory bandwidth Fundamental limit of legacy designs
5x to 10x more CPU cores More concurrent requests More concurrent data services
4x greater network link bandwidth Faster single stream throughput
Traditional NAS Controllers Cannot Sustain High Multi-Stream Performance
Sun ZFS Storage Appliance
High Throughput Controllers Increase Performance and Flexibility
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16
Sun ZFS Storage Appliance
Tuned NFS and TCP
Scalable RPC
Optimized I/O transfers
Horizontal network scaling
Oracle Direct NFS, Streamlining IO and Improving Performance
Execute I/O NFS Client NFS Server
IP Network Link IP NIC NIC
RPC RPC Establish Connection
TCP TCP Ensure Delivery
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17
Sun ZFS Storage Appliance
Tuned NFS and TCP
Scalable RPC
Optimized I/O transfers
Horizontal network scaling
Oracle Direct NFS, Streamlining IO and Improving Performance
Execute I/O NFS Client NFS Server
IP Network Link IP NIC NIC
RPC RPC Establish Connection
TCP TCP Ensure Delivery
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18
Oracle Direct NFS : 8KB and 1MB Reads
0
500
1,000
1,500
2,000
2,500
NFS 1x10Gb
dNFS 1x10Gb
dNFS 2x10Gb
Optimization Removes Software Bottlenecks
§ Linux Kernel NFS – Software bottlenecks – 25K IOPS – 680 MBPS limit
§ Direct NFS with 1x10GbE – Hardware bottlenecks – 145K IOPS – 1,100 MBPS
§ Direct NFS with 2x 10GbE – 225K IOPS – 2,000 MBPS
0
50
100
150
200
250
kNFS 1x10Gb
dNFS 1x10Gb
dNFS 2x10Gb
1MB Read Throughput (MB/S) 8KB Read IOPS (Thousand/S)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19
Throughput with Oracle Direct NFS and HCC Higher Throughput for Remote Replication
0
50
100
150
200
250
300
350
400
450
500
No Compression HCC Archive High HCC Query Low M
illio
ns
37 MR/min
450 MR/min § No compression – 1GbE bottleneck – Baseline
§ HCC Query Low – 1GbE bottleneck – 12x more throughput
§ HCC Archive High – CPU bottleneck – 7.5x more throughput Th
roug
hput
(mill
ions
of r
ows/
min
)
280 MR/min
7.5x
12x
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20
Oracle Direct NFS Proof Point: OLTP Processing
0.00
0.25
0.50
0.75
1.00
1.25
1.50
0 10,000 20,000 30,000 40,000 50,000 60,000
New
Ord
er R
espo
nse
Tim
e (s
)
New Order Rate (New Orders Per Minute)
Oracle Direct NFS Linux Kernel NFS
§ 3.2x more throughput at the same response time
§ 4.3x faster response time at the same throughput
§ 2x better CPU efficiency
§ Hit application-level bottleneck
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21
Oracle Database Runs Best on Oracle Storage Example: Oracle Intelligent Storage Protocol - OISP (*)
DB I/O metadata communicated to ZFS Storage
DB Control File Writes prioritized among other IO in ZFS Storage
Oracle Database
Que
ry D
ata
R
espo
nse
Database data
2TB DRAM 10TB FLASH (R / W) 2PB DISK
0.03ms 0.10ms
30.00ms
ZFS Storage
Oracle Intelligent Storage Protocol: Unique language that enables dynamic communication between an Oracle Database and Oracle’s ZFS Storage Appliances. Database message examples: • File type: tablespace, redo logs, RMAN backup, etc. • I/O priority
ZFS Storage Appliances dynamically assigns system resources to optimize
Oracle Database performance and efficiency
(*) future announcement
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22
Sun ZFS Storage Appliance
Integration with Oracle Systems
Snap / Clone / Replicate
Self Healing
NDMP Management Optimizations
Storage Efficiency Optimizations
Throughput Optimizations
Data Protection Optimizations
Oracle Database Data Protection Optimizations
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23
Integration with Oracle Systems Remote Direct Memory Access (RDMA)
Zero copy networking
Low latency transfers
High bandwidth network
Increased CPU efficiency
Execute I/O NFS Client NFS Server
IP Network Link IP NIC NIC
RPC RPC Establish Connection
TCP TCP Ensure Delivery
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Execute I/O NFS Client NFS Server
IP Network Link IP NIC NIC
RPC RPC Establish Connection
TCP TCP Ensure Delivery
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Execute I/O NFS Client NFS Server
Network Link NIC NIC
RPC RPC Establish Connection
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24
Integration with Oracle Systems Remote Direct Memory Access (RDMA)
Zero copy networking
Low latency transfers
High bandwidth network
Increased CPU efficiency
Execute I/O NFS Client NFS Server
IP Network Link IP NIC NIC
RPC RPC Establish Connection
TCP TCP Ensure Delivery
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Execute I/O NFS Client NFS Server
IP Network Link IP NIC NIC
RPC RPC Establish Connection
TCP TCP Ensure Delivery
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Execute I/O NFS Client NFS Server
Network Link NIC NIC
RPC RPC Establish Connection
Oracle Instance ZFS File System I/O Request
Oracle Database Server
Sun ZFS Storage Appliance
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25
Integration with Oracle Systems RDMA Benefits for RMAN Backup
0
200
400
600
800
1,000
1,200
1,400
1,600
IPoIB RDMA
§ Throughput tested on a CPU constrained system
§ 2.3x increase in backup throughput
§ Gain due to CPU efficiency at processing I/O requests
Th
roug
hput
(MB
/s)
1520 MB/s
670 MB/s
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 26
Integration with Oracle Systems RDMA Benefits for Online Transaction Processing
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
0 200 400 600 800 1000
RDMA TCP/IP
§ Read response time constrained system
§ 20% improvement in I/O response time
AND
§ 38% increase in transaction throughput D
B F
ile S
eque
ntia
l Rea
d (m
s)
Transaction Rate (Database Transactions/sec)
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 27
Sun ZFS Storage Appliance
Hybrid Storage Pools
Enterprise Manager Integration
Oracle VM Integration
DTrace Storage Analytics
Storage Efficiency Optimizations
Throughput Optimizations
Data Protection Optimizations
Management Optimizations
Oracle Database Data Protection Optimizations
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 28
Snap Manager for Oracle DB Enables administrators to easily create and manage snapshot copies in the ZFS Storage Appliance
• Allows for quick and efficient backup, restore, and cloning of application instances
• “Application Aware” à Ensures no data loss and consistent backups
• Currently in Beta; General Availability in October
• Supports Oracle 10g, 11g, RAC – Currently supports NFS and CIFS protocols (FC & iSCSI future) – CLI version for multiple client platforms (Solaris, Linux, Windows)
• Database host support includes Solaris, Linux, Windows
• Snapshot types – Hot: Online – Cold: Offline – Standby: DataGuard standby clone
• Snapshot maintenance – Automated scheduler – Retention policies – Custom Attributed (annotate snapshot with metadata)
• Rollback to a snapshot
Rollback
Snapshot
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 29
Sun ZFS Storage Appliance
Automatic, real-time visualization of multiple workloads Interactive drill downs on storage resources Analyze I/O from both physical servers and VM clients
Only Storage System with Database and Application Oriented Analytics
Database OLTP workload 8KB block size, random I/O
NetApp FAS can not show these I/O details
OLTP Operation/ Storage IO
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 30
Sun ZFS Storage Appliance
Easier and Faster to Manage than NetApp
Sun ZFS Storage Appliance
Faster to provision new storage
Faster in administrative tasks
Faster to troubleshoot issues
36% 36% 44%
Source: Edison Group Comparative Management Costs Study, 2010.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 31
Sun ZFS Storage Appliance
Optimize Database Storage in Different Environments
§ System Utilization: Biotech company pinpoints disk bottlenecks and under-utilization
§ System Performance: Web Services firm correlates client issues with writes in changing workload and reconfigures
§ Tuning: Finances Services company uncovers partial-block update issues not found by NetApp
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 32
Streamlined Operations
60% Less Management
Saves 40% on Storage
Unmatched Efficiency
Higher Performance
50% More Performance
Optimize Storage for Oracle Database
Reignite IT Driven Business Innovation with Oracle Storage
Reduce The Total Cost of Storage for Oracle Database
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 33