zfs appliance

81

Click here to load reader

Upload: fran-navarro

Post on 11-May-2015

3.204 views

Category:

Technology


19 download

DESCRIPTION

ZFS Appliance

TRANSCRIPT

Page 1: ZFS appliance

1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle’s ZS3 seriesEnterprise Storage Systems

Fran Navarro

Preventa Sistemas Oracle

Nov 2013

Page 2: ZFS appliance

2 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.

The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Important Disclosure

Page 3: ZFS appliance

3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Hardware-defined StorageCustom hardware drives system

performance and efficiency

Software-defined StorageStorage software drives system

performance and efficiency

Application Engineered Storage

Enterprise software drives system performance and efficiency

Oracle is Driving the Storage System Evolution

Page 4: ZFS appliance

4 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle ZS3 StorageApplication Engineered Storage

Integrated Analytics

Real-time visualizations cuts troubleshooting

times by 50%

Optimized for Oracle Software

OISP cuts database tuning times by 65%; HCC delivers

10-50X compression

World-record performance and leading

price performance

Extreme Performance

Page 5: ZFS appliance

5 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ORACLE’S NEXT GENERATIONZFS STORAGE APPLIANCE:

ZS3 SERIES

BEST PERFORMANCE

MOST EFFICIENT

ENGINEERED FOR ORACLE SOFTWARE

Page 6: ZFS appliance

6 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Strong and Steady Product Maturation

ZFS Filesystem

Analytics

• 2nd Gen. Platform• Software Release OS7

• Deduplication• Thin Provisioning• Enterprise RAS• Shadow Migration• Surpassed an Exabyte Stored

• ZS3 series release• Software Release OS8

• 200PBs in Oracle *IT• World-record Performance• Oracle Database (OISP)• IaaS Offering • SMU/Oracle DB• DE2 Disk Enclosures

2009 2010 2011 2012

2013

• First Platform Release- Compression, Replication, etc.

• Hybrid Storage Pool (with Flash)• Analytics• Development engaged in 2004

2008

• 3,000th Customer• 10,000th system sold• Hybrid Columnar Compression• ZFS Backup Appliance• 150PBs in Oracle *IT• Foundation for Oracle Cloud• Best-in-class SPC-1• Best-in-class SPC-2• Most efficient ($/IOP) SPECsfs

• 1,000th Customer• Unified Storage (block)• InfiniBand• Replication• Thin Provisioning• Best-in-class User Interface

Oracle’s ZFS Storage Appliance

Page 7: ZFS appliance

7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Snap Clone Replication

ApplicationI/O

Virtual Poolfile, volume, and

data services

ReadIntensive

I/OStorage Poolread flash, writeflash, and drives

Storage

Performance- Automates storage tiering (HSPs)- Eliminates distinct file and volume management- Concurrent block and file I/O, with shared data services- Multi-core, multi-threading RTOS

Data Integrity- Entire I/O path validated before data stored- Eliminates potential for bit rot, phantom writes, etc.

Analytics- Comprehensive and precise file-level view

Com-press Dedup Thin

Provision

WriteIntensive

I/O

• Auto Administration

• System Analytics• Virtual Storage

Pools• Dynamic Data

Tiering• Modular Scalability• Oracle SW

integration

Storage OS

CIFSNFS FCiSCSI

IB

Mirror,RAID-Zx

Engineered for Unified Storage

Page 8: ZFS appliance

8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle’s new ZS3 Series

ZS3-2 ZS3-4

• Single or Dual Controllers• 512GB DRAM• 8 PCIe Slots• 16 Disk Enclosures*• 12TB Read Flash• 4TB Write Flash*

• Single or Dual Controllers• 2TB DRAM• 14 PCIe Slots• 36 Disk Enclosures• 12TB Read Flash• 10TB Write Flash

2x Faster3x More ScalableOS8 Storage OS Support

* ZS3-2 will release with expansion to 8 disk enclosures. Scale to 16 expected within 6 months of release.

ZFS Storage Operating System• Most powerful storage software suite• Engineered Integration with Oracle software

Page 9: ZFS appliance

9 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Software | Hybrid Storage Pools

80 CPU cores

2TB Memory

12TB Read Flash

10TB Write Flash

Page 10: ZFS appliance

10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Hybrid Storage Pool

Storage Media Latencies

DRAM0.03ms

FLASH0.10ms

DISK30.00ms

Introduced first by Oracle on ZFS Storage Appliances in 2008

Dynamically Serve 70-90% of I/O from DRAM Not to Scale

Page 11: ZFS appliance

11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

• Fibre channel• iSCSI• InfiniBand over IP/RDMA• iSER• SRP• NFS V3 and V4• CIFS• HTTP• WebDAV• FTP/SFTP/FTPS• ZFS NDMP V4

Comprehensive Suite of Enterprise Software

• OISP• Hybrid Columnar Compression• Hybrid Storage Pools• Single, double and triple-parity RAID

(RAIDZ, RAIDZ2,RAIDZ3)• Mirroring and triple mirroring• End-to-end data integrity• Local and remote replication• Snapshots and clones• Quota(s)• In-line deduplication• Compression• Thin provisioning• Antivirus via ICAP protocol• Online data migration• Clustering

• Browser and CLI interface

• Management dashboard

• Hardware/component view

• Role-based access control

• Phone home

• Event and thresholdbased alerting

• Storage analytics

• Scripting

• Workflow automation

• Advanced networking

• Snap Management Utility

• Source aware routing

Data protocols Data services Management

Page 12: ZFS appliance

12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Majority of the Fortune 100 Rely on Oracle ZFS Storage

Page 13: ZFS appliance

13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Majority of the Top 10 Global Banks Rely on Oracle ZFS Storage

Page 14: ZFS appliance

14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle’s ZFS Storage is the fastest growing major storage vendor

Page 15: ZFS appliance

15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Over 150 companies switch from NetApp and EMC to Oracle ZFS

Storage every quarter…

Page 16: ZFS appliance

16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Page 17: ZFS appliance

17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Best Performance#12x Faster than NetApp in OLTP, 2x Faster than NetApp in File serving,4x Faster than NetApp in OLAP/DSS, 4x Faster than NetApp in VDI/VM4x Faster than NetApp in Backup, 5x Faster than NetApp in Restores.

Most Efficient#185% Smaller backup windows than NetApp, 44% Faster trouble-shooting than NetApp, 2x Better price/performance in OLTP than NetApp, 5x Better price/performance in File serving than NetApp, #1 in Analytics and HSPs.

Engineered for Oracle Software#1

Only NAS vendor with Hybrid Columnar Compression, Only NAS vendor with Oracle Intelligent Storage Protocol, Only NAS vendor engineered with ADG. , Only NAS vendor that enables the full-featured Oracle 12c ADO capability.

Storage for Oracle *IT and Cloud#1

Only NAS vendor with over 225PBs in enterprise environments that get updated before customers use the latest firmware releases. Only NAS with NFS cloud environment generated 3.2B database transactions per hour.

Page 18: ZFS appliance

18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18

ZFS Storage Appliances

Increase database responsiveness.

Engineered for extreme performance.

Minimize backup windows.

Expedite large data queries.

Page 19: ZFS appliance

19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle’s ZS3 StorageThe Fastest Storage System Available

17.3 GB/s @ $23/MB/s

World-record performance, streaming and on-line application processing (SPC-2)

4-6X more efficient than every other storage product

has never exceeded 13GB/s @ $88/MB/s

has never exceeded 15GB/s @ $131/MB/s

has never exceeded 13GB/s @ $95/MS/s

BESTPERFORMANCE

Page 20: ZFS appliance

20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

450K IOPS / 700μs

Best-in-Class application responsiveness and performance (SPECsfs)

5-8X better $/IOP than everything in its class

Best is 1.2ms with FAS6240 and 100K IOPS / 1.7ms on FAS3250

BESTPERFORMANCE

Best is 3.2ms, 456K IOPS with a 56 node Isilon system

Oracle’s ZS3 StorageThe Fastest Storage System Available

Page 21: ZFS appliance

21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Best Performance is Not Enough

Page 22: ZFS appliance

22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

87% of Storage Costs Are the Result of Inefficient Systems or Software

Source: Oracle Customer Advisory Boards

Page 23: ZFS appliance

23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23

ZFS Storage Appliances

Minimize the time it takes to trouble-shoot and resolve IT issues.

Industry-leading storage efficiency.Eliminate the time required to assess, tune, and deploy storage tiers.

Eliminate management of disparate files and volumes.

Page 24: ZFS appliance

24 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

MOSTEFFICIENT

Management Efficiency | Analytics

• Industry’s most comprehensive real-time visualization of application- and storage-related workloads (on right picture of database and table index analytics)

• Visualize CPU, cache, protocol, disk, memory, networking, and system-related data, all at the same time.

• Drill down quickly on areas of concern

• Support multiple simultaneous application and workload analysis in real-time, to help compare various aspects of system stress

• Analysis can be saved, exported and replayed for further analysis

Page 25: ZFS appliance

25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ZFS Appliance Dashboard

• Starting point for appliance analysis– Ideal for single device

monitoring

• Real-time updates to graphical view of operations– Utilization and alerts

easy to identify

Monitoring at a glance

Page 26: ZFS appliance

26 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ZFS Storage Appliance Analytics

• Simple yet sophisticated instrumentation

• Available on all ZFS Storage Appliance models

• Analysis can be saved, exported and replayed for further analysis

Automatic real-time visualization of application and storage workloads

Page 27: ZFS appliance

27 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ZFS Storage Analytics

Page 28: ZFS appliance

28 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Statistics

• Statistics are a collection of data displayed and graphed by ZFS Analytics

• Every layer of the stack has available statistics– CPU– Disk– Network– Protocols

Page 29: ZFS appliance

29 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Drilling Down into Statistics

• Statistics can be drilled down to form ad-hoc queries– Which clients have the highest access rate on a certain day of the week?– Which NFS operations are taking at least 2 milliseconds during high

production load?– Which disks are seeing the most amount of activity over the past month?

Page 30: ZFS appliance

30 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Navigate Through Time

‘Arrow’ buttons move back and forth between the past and present

‘Pause’ suspends the graph, but not data collection ‘Zoom’ buttons control the time scale of the graph

‘Clocks’ are pre-defined zooming to by-minute and by-hour

‘Calendars’ can display an entire day, entire week, or entire month

Page 31: ZFS appliance

31 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Worksheets

• A worksheet is a user-defined collection of statistics

• They are persistently saved and can be shared by users

• Handy for crafting just the family of statistics that are relevant for your performance analysis

Page 32: ZFS appliance

32 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

• A user running a performance test increases the load on the storage in an unexpected way and the storage administrator can drill into the issue in real time to understand where the load is coming from.

Phantom Workloads Exposed

File Level Visibility

Page 33: ZFS appliance

33 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Phantom Workloads ExposedWhere is my IO load coming from?

Page 34: ZFS appliance

34 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Phantom Workloads ExposedWhat is that client doing?

Page 35: ZFS appliance

35 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Phantom Workloads ExposedWhat’s happening inside that file?

Page 36: ZFS appliance

36 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ZFS Appliance Monitor iPhone application that monitors multiple ZFS Storage Appliances

Brings the power of DTrace Analytics at your fingertips

Easily view the health/status of any ZFS Appliance, anywhere

Ideal for Execs/Storage Admins with need for instant access to information

Graphical and intuitive display of:• System and component status (disks, CPU, RAM, fans, etc)• Service status (NFS, iSCSI, SMB, etc)• Resource & I/O status• DTrace Analytics (real time statistics via saved worksheets)• Logs for alert, system, fault, audit, phone home• Active systems problems (can be marked as repaired via app)• High level group status including storage use, problems, hardware status• Storage utilization• Remote activation of system and component locator LED

Availablenow on

App Store

Page 37: ZFS appliance

37 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ZFSSA Monitoring and Managementmonitoring with Enterprise Manager for single pane of glass

Enterprise Grade Monitoring/Management Facility– Comprehensive Dashboard View

• Central Repository for Analytics Storage

• Database Configuration, Hardware and Network Configuration

• Operational and Availability Analytics

– For Storage Platforms

• Information is collected by installed Plug-Ins

• Stored in real-time on the Oracle Enterprise Manager Repository

For the Storage 7000– Data collected by Dtrace Analytics and FMA

• Data is corroborative between SS7000 and OEMGC

• Includes capacity Utilization

• Cache usage and performance metrics

• Detailed Alerts

– Enables collaboration between the DBA and Storage Administrator

Page 38: ZFS appliance

38 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle EM Cloud Control Plug-in for ZFSSA

• Oracle Enterprise Manager Cloud Control (OCC) 12c communicates with the ZFSSA appliance through a plug-in deployed to an active OCC agent.

• The plug-in collects status and data from the ZFSSA and relays it to the OCC management server, which stores the data in the OMS repository database.

• The ZFSSA plug-in formats screens and reports in the OCC web interface.

Page 39: ZFS appliance

39 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Integrating ZFS with Enterprise Manager

• ZFS appliance becomes an additional target to monitor

• Provides method for n-way monitoring of multiple ZFSSA systems through common EM interface

Monitor ZFS appliances as part of the enterprise

Page 40: ZFS appliance

40 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Wide Range of Individual Measurements

• Ability to monitor statistics across all functions of the appliance– Appliance status– Cache activity– Disk throughput– Network devices– Protocol activity

• Graphical view of metrics

Complete set of metrics for system monitoring from EM

Page 41: ZFS appliance

41 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ZFSSA – OEMCC MetricsHigh Level Metric Sub-Metrics

Logical Status

Share identifier, Available (GB), Total allocated (GB), Data (GB), Share percentage used, Quota (GB), Reserved (GB), Unused Reserved (GB), SCSI LUN

Project Status

Project identifier, Available (GB), Total allocated (GB), Project Data (GB), Project percentage used, Quota (GB), Reserved (GB), Unused Reserved (GB), Total Share Quota (GB), Project Over Allocated

Configuration Service Service name, Service Status

Appliance Capacity Totals

Storage pool, Pool owner, Pool status, Data profile, Available (GB), Total used (GB), Pool used percentage, Total Capacity (GB), Data disks, Spare disks, Cache Disks, Total project quota (GB), Quota Allocation(GB), Reservations (GB) Pool over allocated

Cache ARC Size (MB)Cache L2ARC Size (MB)CPU Utilization %Disk I/O Ops Operations per SecondDisk I/O Ops Latency Operations per SecondDisk I/O Bytes KB per SecondNetwork Device KB per SecondNFSv2 Ops Operations per SecondNFSv3 Ops Operations per SecondNFSv3 Ops Latency Operations per SecondNFSv4 Ops Operations per SecondSMB Ops Operations per SecondSMB Ops Latency Operations per SecondiSCSI Ops Operations per SecondiSCSI Ops Latency Operations per Second

Initiator and Target GroupsProtocol, Group name, Address, Initiator or target

High Level Metric Sub-MetricsARC Activity Activity, Accesses per secL2ARC Activity Activity, Accesses per secARC Activity by Share Share, Accesses per secL2ARC Activity by Share Share, Accesses per secNFSv3 Operations by Share NFSv3 Share, Operations per secNFSv4 Operations by Share NFSv4 Share, Operations per secNetwork IO Direction Direction, KB per secNetwork IO by Device Device, KB per secNetwork Interface Performance Interface, KB per sec

Physical Component StatusCluster state, Cluster state description, Cluster peer state, Cluster peer state description

Appliance Information

Reported node name, Product model, Appliance serial nbr, Chasis serial nbr, Appliance SW version, Install time, Last update time, Power on time, Up time, Clustered, Cluster peer

Appliance Logical informationShare identifier, Share type, Mount point, Data profile, Data compression, Cache usage, NFS, CIFS

IP Network InterfacesInterface, IP Address, CIDR, IP Version, Management enabled

IP Network Interface to Datalink relationship Interface, Datalink, Jumbo frames

IP Datalink to device relationship Datalink, Link, ClassIP Network Devices Network Device, Device speed, Device up

Alert Log ContentsProblem ID, Time stamp, Alert description, Alert log problem type

Fault Log ContentsProblem ID, Time stamp, Description, Fault log problem type

Problem Log ContentsUUID, Description, Problem severity, Problem log code

Replication ActivityProblem ID, Time stamp, Replication description. Replication log problem type

Page 42: ZFS appliance

42 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Set Custom Thresholds

• Manage alerting based on specific limits– Alerting can be turned on

or off, send messages only on customer-defined key metrics

– Generate alert levels based on independent system use cases

Tune alerting to specific needs

Page 43: ZFS appliance

43 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Expanded Reporting Features

• Expanding monitoring through the Oracle stack– Identify relationships between database and storage resources– Track network performance

Database relationship and Network performance monitoring

Page 44: ZFS appliance

44 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Redirect to Appliance for Detailed Management

• For more granular analysis and control, link from the appliance summary page directly to the appliance dashboard– Will require ZFS appliance login

for security

Link directly from EM to launch ZFSSA GUI

Page 45: ZFS appliance

45 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Available Resources

• Enterprise Manager Grid Control/Cloud Control– http://www.oracle.com/us/products/servers-storage/storage/nas/oracle-en

terprise-grid-manager-ds-431598.pdf– http://www.oracle.com/technetwork/oem/enterprise-manager/downloads/inde

x.html

• ZFSSA EM Plug-in– http://www.oracle.com/technetwork/oem/grid-control/downloads/zfs-stora

ge-plugin-487867.html– http://download.oracle.com/otn/java/oem/Oracle_GC_Plugin_InstallGuide

.pdf

Links

Page 46: ZFS appliance

46 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle Software Runs Fastest and Most Efficiently

on Oracle Storage

Page 47: ZFS appliance

47 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Application Engineered Storage

OISP ADO HCC

Dynamic and automatic database-

storage tuning

Advanced and dynamic database (data) optimization

Superior database, data warehousing

compression

Page 48: ZFS appliance

48 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

OracleIntelligentStorageProtocol

Eliminates hundreds of hours spent tuning (and re-tuning) storage and database for optimal performance

Page 49: ZFS appliance

49 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

DB I/O metadata communicated to ZFS Storage

DB Control File Writes prioritized among other IO in ZFS Storage

Oracle Database

Que

ry D

ata

Res

pons

e

Databasedata

2TB DRAM

10TB FLASH (R / W)2PB DISK

0.03ms0.10ms

30.00ms

ZFS Storage

Oracle Intelligent Storage Protocol: Unique language that enables dynamic communication between an Oracle Database and Oracle’s ZFS Storage Appliances.

• Available only for Oracle Database 12c customers using Oracle Direct NFS (dNFS) with Oracle ZFS Storage Appliances that are running software version OS8

Oracle’s ZS3 systems dynamically assign system resources to optimize Oracle Database performance and efficiency

Oracle Intelligent Storage Protocol (OISP)Cut Database and Storage Tuning Time in Half

Page 50: ZFS appliance

50 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Without OISP With OISP

Two shares: logfile and datafile

NFSServer

OISP Tunes

Logfile share

Datafile share

NFSServer

Multiple shares, each with its own Record Size and

LogBias setting

/mnt/dbname/redo (Record Size, LogBias)/mnt/dbname/control (Record Size, LogBias)/mnt/dbname/pfile (Record Size, LogBias)/mnt/dbname/datafile (Record Size, LogBias)/mnt/dbname/tempfile (Record Size, LogBias)/mnt/dbname/chgtrack (Record Size, LogBias)/mnt/dbname/backup (Record Size, LogBias)

/mnt/dbname/logfile (OISP sets Record Size, LogBias)redo

/mnt/dbname/datafile (OISP sets Record Xize, LogBias)controlpfiledatafiletempfilechgtrackbackup

OS8 | OISP: Auto Tuning of Record Size, LogBias

Page 51: ZFS appliance

51 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

AutomaticDataOptimization

Increases database efficiency and performance, by dynamically moving data across storage tiers and compression algorithms

Page 52: ZFS appliance

52 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ADO: Dynamically Assesses Data Usage PatternsDatabase ‘heat map’

10 0111 10 10 0111 101 1

00 0101 10 10 0101 10

0 010 0111 10 10 0111 100 010 0111 10 00 0111 001 1

01 0101 10 00 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 00 00 0111 100 110 0100 11 10 0111 100 0

10 0101 10 10 0101 001 1

00 0101 10 10 0101 101 110 0100 11 10 0111 100 0

10 0110 11 10 0111 100 0

10 0111 10 00 0111 001 1

01 0101 10 00 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 00 00 0111 100 1

00 0101 10 10 0101 101 110 0100 11 10 0111 100 0

00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 110 0100 11 10 0111 100 0

10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0

10 0100 11 10 0111 100 0

10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0

10 0111 10 10 0111 100 01 1

1 1

10 0100 11 10 0111 100 0

10 0100 11 10 0111 1010 0111 10 10 0111 10

10 0100 11 10 0111 100 0

10 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 10 00 0111 001 1

01 0101 10 00 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 00 00 0111 100 110 0100 11 10 0111 100 0

10 0101 10 10 0101 001 1

00 0101 10 10 0101 101 110 0100 11 10 0111 100 0

00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 10 00 0111 001 1

01 0101 10 00 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 0

00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 1

00 0101 10 10 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 10 00 0111 001 1

01 0101 10 00 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 0

00 0101 10 10 0101 101 110 0111 10 10 0111 100 010 0101 10 10 0101 001 1

00 0101 10 10 0101 101 110 0100 11 10 0111 100 0

10 0111 10 00 0111 001 1

01 0101 10 00 0101 101 110 0100 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 00 00 0111 100 1

00 0101 10 10 0101 101 110 0100 11 10 0111 100 0

10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0

10 0111 10 10 0111 100 010 0111 10 10 0111 100 0

10 0110 11 10 0111 100 0

10 0100 11 10 0111 100 0

10 0111 11 10 0111 100 010 0111 10 10 0111 101 110 0110 11 10 0111 100 0

Page 53: ZFS appliance

53 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Heat MapWhat it tracks

“Heat Map” tracking

– Database level Heat Map shows which tables and partitions are being used

– Block level Heat Map shows last modification at the block level

Comprehensive

– Segment level shows both reads and writes

– Distinguishes index lookups from full table scans

– Automatically excludes stats gathering, DDLs, table redefinitions, etc

High Performance– Object level at no cost– Block level < 5% cost

Active

Frequent Access

Occasional Access

Dormant

Actively updated

Infrequently updated, Frequently queried

Infrequent access for query and updates

Long term analytics & compliance

HOT

COLD

Page 54: ZFS appliance

54 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

0101101110101010010100100100001000

1010101101001011010011100001010010

Archive Data

011100001010001011011

101010100101001001000

010001010101101001011

010101001010010010001

Automatic Data Optimization Usage Based Data Compression

Hot Data

3X Advanced Row Compression

Warm Data

10101010111010100110101110000101000

10110111010101001010010010000100010

10101101001011010011100001010010010

1000010010000100010101011010010

10X Columnar Query Compression

1000010100100101001010110111000010

1010101011101010011010111000010100010110111

010101001010010010000100010101011010010110

10011100001010010010100001001000010001010

101010101110101001101011100001010001011011

15X Columnar Archive Compression

011101010100101000010001010101011100001010

101010101110101001101011

10000101000101101110101

01001010010010000100010

101011010010110100111000

01010010010100001001000

01000101010111001101010100101001001000010001

1110010100100101001010110111011010

101010101110101001101011100001011101011001

Page 55: ZFS appliance

55 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Heat MapEnterprise Manager

Page 56: ZFS appliance

56 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

HybridColumnarCompression

Increases database efficiency and performance, by enacting columnar compression for data warehousing, analytics, and mining operations

Page 57: ZFS appliance

57 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Store Less Data AND Run Faster

• Up to 50x space reduction

• Average 5x faster queries

• Only available on Oracle storage

• Increases performance for most data warehouse and data protection

Oracle Database Hybrid Columnar Compression

Hybrid Columnar Compression (HCC)

735GB 38GB

1

2

31

2

3

0

2 Hours, 22 Min, 44 Sec 16 Min, 50 Sec

8xFasterQuery

94%LessStorage

UncompressedWith Hybrid Columnar

Compression

Retail Data Warehouse Example

Page 58: ZFS appliance

58 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

More Software | Data Reduction

• Thin Provisioning

• Deduplication

• Compression

Page 59: ZFS appliance

59 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Data

Unused

Data

Unused

Data

UnusedVolume C80% of Reserved Space Consumed

Volume B50% of Reserved Space Consumed

Volume A20% of Reserved Space Consumed

Traditional Allocation58% consumed. 100% reserved.

No storage available.

Data

Data

Data

Volume C100% of Consumed

Volume B100% of Consumed

Volume A100% of Consumed

Thin Provisioned58% consumed. 42% storage available.

StorageAvailable

For AllVolumes

Software | Data Reduction: Thin Provisioning

Page 60: ZFS appliance

60 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Software | Data Reduction: Deduplication

• Block level (in-line) deduplication

• Not recommended for database backup, active transactional workloads, or heavy throughput workloads

• Recommended for data reduction VM boot images Hash Function

Actual Data Blocks

Physically Stored Data Blocks

Page 61: ZFS appliance

61 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Software | Data Reduction: Deduplication

• Reduce Costs– Leverage current backup software

– “Inexpensive” and high performance Sun servers

– Shrink backup window by up to 90% (client dedupe)

• Flexibility– Deduplication at the client, backup server, neither, or both

– Deduplicate by data type – eliminates “all or nothing” approach

• Reduce Risk– No hardware vendor lock-in

– Regular disk and tape storage – taking advantage of compression and encryption

– Possible tape deduplication

Deduplication is often completed in the application software layer

Page 62: ZFS appliance

62 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

ORACLE DATABASE COMPRESSION

ACO

• Algorithms calculated at the database compute tier

• Additional license cost

STORAGE COMPRESSION

• ZFS Storage Appliance

• 4 Levels of compression

• Algorithms executed at the storage tier

• Data type agnostic

• No additional cost

HCC

• Algorithms exeecuted at the database compute tier

• Available at no additional charge with Oracle storage only

Software | Data Reduction: Compression

Page 63: ZFS appliance

63 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Software | Data Reduction: Compression Options

LZJB – low-overhead compression, aka “compression for free”

GZIP-2 – lightweight version of gzip algorithm

GZIP – higher compression, but at some compute overhead penalty

GZIP-9 – highest compression, but can consume significant compute resources

• No software license fees for compression

• Options: select compression to suit your workload

• Balance performance and data reduction

• LZJB is very lightweight – in fact it increases performance in some cases

• Higher compression options if more data reduction needed, more compute overhead tolerated

ZFS Storage Compression Considerations

Mo

re C

om

pressio

nM

ore

P

erfo

rman

ce

Page 64: ZFS appliance

64 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Software | Data Reduction: Database Compression

Advanced Compression Option (ACO)• 2-4x reduction in storage• Faster queries in many cases,

due to improved I/O and memory efficiency

• Better network bandwidth utilization

Hybrid Columnar Compression (HCC)

Up to 50x reduction in data storedAverage 5x better performanceIncluded at no additional cost with

Oracle storage devices

Page 65: ZFS appliance

65 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Snap Manager for Oracle DBManage snapshot copies in the ZFS Storage Appliance

• Allows for quick and efficient backup, restore, cloning and provisioning of application instances

• “Application Aware” Ensures no data loss and consistent backups

• Supports Oracle 10g, 11g, RAC– Currently supports NFS/dNFS and iSCSI protocols– CLI version for multiple client platforms (Solaris, Linux, Windows)

• Database host support includes Solaris, Linux, Windows

• Snapshot types– Hot: Online– Cold: Offline

• Snapshot maintenance– Automated scheduler– Retention policies– Custom Attributed (annotate snapshot with metadata)

• Rollback to a snapshot

Rollback

Snapshot

Page 66: ZFS appliance

66 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 66

Oracle Storage Best Practices for Oracle VM

Page 67: ZFS appliance

67 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle VirtualizationThe Full Stack, End-to-End

Application-Driven Virtualization

DATA CENTER

Servers Servers Servers

Oracle VM Servers

Oracle Enterprise Manager

12cVM

VM

VM

VM

VM

VM

Server Virtualization Desktop Virtualization

Oracle VMTemplates

&Assemblies

E-Business SuiteVMs

Software Delivery Cloud

US

ER

S

Contact Service Center

Oracle Sun Ray Clients

PCs, MACs,

MOBILE

DEVICES

THIN CLIENTS

Oracle Virtual Desktop Client

BROWSER

Oracle Secure Global DesktopApplication Stack

Oracle D

esktop V

irtualization

• Oracle VM Server for x86• Oracle VM Server for SPARC

(LDoms)• Oracle Solaris Zones• Dynamic Domains

• Oracle Secure Global Desktop• Oracle VM VirtualBox

Network

Storage

Storage

Network Virtualization

• Oracle Xsigo Data Center Fabric

Page 68: ZFS appliance

68 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Virtualization Platform: Oracle VMServer Virtualization and Management

• Cost effective – no license fees

• High performance – virtualize apps with confidence

• Enterprise-quality support – global, 24x7 support

• Faster application deployment – Over 90+ templates

• Integrated stack- Interoperability, security across stack

• For both Oracle and non-Oracle applications

• The only server virtualization software supported and certified with Oracle products

Page 69: ZFS appliance

69 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

• VM Observability w/ Storage Analytics– Optimized storage workload visibility– 44% faster in diagnostics/troubleshooting

• Higher performance with Hybrid Storage Pools– Accelerated read cache VM performance– Improved virtualization write performance

• Storage Efficient Provisioning– Accelerates Virtual Machine Deployment by 34%– Faster Oracle VDI Provisioning by 40%

• Lower TCO– 8x higher storage efficiencies with compression and de-dup– Optimized Power/Space/Cooling– No-charge for protocols

Higher Storage agility with virtualization and Oracle ZFS Storage appliance

Financing World GrowthFinancial Institute Relies on Sun ZFS Storage

Page 70: ZFS appliance

70 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

+

+ +

Oracle VM Server + Templates

Sun Blade Modular System

Sun Unified StorageFlash Enabled

Ora

cle M

anag

emen

t

Oracle Solaris / Linux OS

Oracle and 3rd Party Applications

Oracle Network Fabric Architecture

=+

+

Oracle Optimized Solution for Enterprise Cloud Infrastructure

ZFS Storage Appliance

Sun Blade 6000 + Ethernet switched NEMs

Page 71: ZFS appliance

71 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Network Configuration• NFS protocol over 10GigE network

– NFS integrates file access, file locking, and mount protocols into a single, unified protocol to improve security

– NFS offers the utmost simplicity in attaching storage in Oracle VM virtualization environments over Ethernet.

– NFS on Sun ZFS Storage Appliance scales well to many concurrent I/O threads. This high I/O throughput enables more VM stacks to perform I/O without sacrificing service levels.

– Two 10 GbE interfaces supply plenty of bandwidth to access virtual machine data.

• IB and FC are also available alternatives to this configuration

Page 72: ZFS appliance

72 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle VM 3.0

• Storage Connect Framework– Support for Native Storage Services– Share/LUN creation, deletion, expansion– Access Group creation– Allows storage operations to be done via OVM Manager

• OCFS2 1.8 cluster file system– Instant clone support

What’s new for Storage?

Page 73: ZFS appliance

73 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle VM Storage ConnectAdvanced Storage Operations

Storage Connect Plug-Ins for Management…• Oracle and 3rd party storage…from the Manager UI

More than just provisioning…

• Create LUNs or Volumes• Expand LUNs or Volumes• Associate, share with VMs

Create LUN

CLONE VM

3.0

Sun ZFS Storage

Storage Connect Plug-In Framework & API

Oracle ZFS Plug-In

Pillar Storage

Pillar Plug-In

vendor_specific_command_CREATE_LUN

OCFS2 Filesystem

JBOD

OCFS2 Plug-In

_INSTANT_CLONE

Storage Repositories

Page 74: ZFS appliance

74 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Storage Connect for ZFSSA

• Current ZFSSA Storage Connect has support for iSCSI and FC LUNS– NFS support to come when OVM adds support in framework– NFS can still be added as a Generic File Server or Generic FC

array

Page 75: ZFS appliance

75 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Configuration Best Practices

• Consider a Hybrid approach– Template/VM repositories on iSCSI block LUN

• Takes advantage of OCFS2 cloning for rapid template/OS deployment

– Application data (database, middleware) mounted direct from Guest VM via NFSv3. • Takes advantage of excellent NAS performance of ZFSSA

– EHCC & dNFS for the databases

– Analytics to pinpoint application issues down to the VM and even down to the file

– Snap&Clone on the ZFSSA for rapid Test/Dev rollout

– Avoids issues with Block Alignment on data intensive shares or LUNs

Page 76: ZFS appliance

76 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Final ConsiderationsOracle ZFS Storage AppliancesNAS and Unified Storage

Page 77: ZFS appliance

77 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle’s ZFS Storage Systems

Over 225PBs in Production at Oracle!

ORACLE CLOUDSocial. Mobile. Complete.

Storage foundation for Oracle’s Enterprise Cloud, IT, and Product Development Infrastructure

Page 78: ZFS appliance

78 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Best Performance. Best Efficiency. Engineered for Oracle Software.

Trusted by a majority of the F100, ~4000 enterprise business, and Oracle IT

Foundation storage for Oracle Cloud (over 25 million users)

Fastest Growing Storage Vendor

Oracle Storage ZFS Storage Appliances

Page 79: ZFS appliance

79 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

DEMOS

• Demo ZFS + Vmware– http://www.youtube.com/watch?v=i47XhPsAVTQ

• Demo ZFS Analitics– http://www.youtube.com/watch?v=JazDlzTe9vE

• Demo ZFS + OVM– Instalar ZFS Appliance Simulator + OVM

http://www.oracle.com/technetwork/systems/hands-on-labs/hol-deploy-cloud-ovm-sunzfs-1889199.html

Page 80: ZFS appliance

80 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Page 81: ZFS appliance

81 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.