using multi tiered storage systems for storing both structured & unstructured data - jan...
Post on 21-Jan-2015
1.767 Views
Preview:
DESCRIPTION
TRANSCRIPT
1
<Insert Picture Here>
The Power of Automated Tiered Storage Jan Okrasinski Oracle Day, Tallinn 11.03.2011
3
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
4
The Storage Challenge… Reduce Cost, Improve Access, Retain Forever
VARIED DATA ACCESS 80% of data never used after 90 days. 72% state it is harder to find info within their company. 1
DATA DIVERSITY Multi-application/OS data sources stored in many repositories. Only 5% structured. 2
LENGTHY RETENTIONS Severe penalties for data loss with over half of companies requiring 100-year archives.
ENVIRONMENTAL LIMITS Storage consumes ~40% of datacenter power. Growing at 20% CAGR. 3
Massive Data Growth
Resource Constraints
Drivers for Tiered Storage
Reduce Cost • Match Data
Value to Storage
• Actively Manage Data Lifecycle
5
Customer Financial Products People
Reduce Risk • Satisfy Legal / Audit
Requirements • Reduce Compliance risk • Improve Business
Continuity • Improve Service Levels
Increase Performance • Leverage new
technologies without disrupting production environment
• Remove stale data from production resources
• Ease upgrades
6
Is Tiered Storage Relevant for Me?
• Capacity Growth Assumptions – 100 GB per day created – 3 copies made • Copy 1 for real time use • Copy 2 for local redundancy • Copy 3 for Disaster Recovery
– Annual Data Growth = 50% (IDC estimates it at 60%)
Data Crea(on
One Week
One Month
Six Months
One Year
Seven Years
One Day
100GB
300GB 2.1TB 9.0TB 54TB 109TB 1.25PB
7
The Important Role of Tape
• Economical “green” storage – superior for data at rest
– Tape consumes 290x less energy than disk over 5 years1
• Data growth makes disk too costly and too risky – even with deduplication – Tape is 100,000 time more reliable then disk (bit error rate
1014 vs. 1019) – Tape requires fewer technology refreshes – RAID adds more components to fail
• Tape provides the maximum – Portability – Capacity – Security
• Performance
8
Exadata Smart
Flash Cache in Storage
Nodes
Database Smart Flash Cache
Flash Disks in Storage Array
• Higher latency • HW RAID/SAN bottlenecks • Extra DRAM required • Manual data placement • Can be used as shared storage or
for mixed workloads
• InfiniBand: low latency, high throughput
• Smart cache, or mirrored flash storage
• Write cache • Flash cache shared by all cluster
nodes • Uses F20 flash cards
Flash Use Cases Comparison
• Lowest latency • Linear scalability • DAS flash array or PCIe
card • Smart cache, read-only • Node-specific
9
Tiered Storage Foundation Cost Optimized
Single Tier of Disk Storage
Modern Multi-tiered Storage
Multi-tiered Disk Storage
Performance Disk $7 - $22/GB
100%
38%
62%
Flash Storage $40 - $54/GB
32%
6%
Capacity Disk $1 - $6/GB
Tape Drives $0.25 - $1/GB
Average ~$15,000/TB
Average ~$8,000/TB
Average ~$4,000/TB
60%
10
Oracle Tiered Storage Industry-leading Cost, Capacity and Performance
Modern Multi-tiered Storage
Performance Disk
Flash Storage
32%
6%
Capacity Disk
Tape Drives 60%
Oracle Sun Flash Storage • 100x more power efficient than disk • 2x higher performance than disk
• Equals 4000 FC disks in only 1RU
Oracle StorageTek Tape • 290x more energy efficient and 3x
longer lasting than disk
• 5x better TCO then de-duplication1
• #1 in Scalability, Quality and Reliability
Oracle Sun 6000 Storage Arrays • Integrated SSDs • 4x cheaper than EMC
• 2x higher performing than EMC
Oracle Sun ZFS Storage Appliance • Integrated DRAM and flash cache • 1.6x higher density than competition
• 1/3 less CapEx & OpEx vs. competition
11
The Tiered Storage Challenge… • Siloed – Each tier managed separately
• Inefficient – Multiple resources over-provisioned
• Complex to manage – Manual intervention for data movement between tiers – Numerous storage hardware resources to patch/manage/
maintain
AUTOMATED TIERED STORAGE Dynamically Access Optimal Storage Resources
Where Does Tiered Storage Management Fit?
Storage Archive
Manager
Flash Tape
Content Management Applications
Business or Industry Application
Disk
4. Storage Tiered Storage Devices.
13
How Does SAM Move Data Around Tiers of Storage Provides 4 Core Processes
• Policy Based (keep up to 4 copies)
• Non-Disruptive
• Dynamic
• Sustainable
• Data ALWAYS available
Archiver
Stager
Releaser R
ecyc
ler
14
SAM QFS: Manages Data on Tiered Storage
14
• Two integrated technologies − Quick File System (QFS): posix compliant
− Storage Archive Manager (SAM): Automated Tiered Storage Manager
• Access via standard interfaces including FC, iSCSI, NFS, CIFS
• Policy based dynamic archiving − Right information, right tier, right time
• Simplify storage management • Sustainable throughout the data lifecycle • Cost effective long term data protection
15
Business Ready
Storage Systems
Future
Evolving Tiered Storage Environments Siloed > Consolidated > Optimized
© 2010 Oracle Corporation – Proprietary and Confidential
Past Today
Disk
Tape
Tape
Flash
FC/SAS/SATA
Unified Storage Exadata
NAS
Tape
FC / SAS / SATA
Increasing Simplicity, Efficiency, Cost Effectiveness
Software
16
Tiered Storage Evolution Software Optimized Across Hardware Platforms
Modern Multi-tiered Storage
Performance Disk
Flash Storage
32%
6%
Capacity Disk
Tape Drives 60%
Oracle Database • Flash optimized • Automatically place data within
tiers of storage
• Policies to alert you to migrate data
• Built-in data protection
• Reduces storage costs by up to 10x
Oracle Sun Storage Archive Manager (SAM)
• Policy-based data management across all storage media
• Seamless disk/tape data protection for database environments
• Future protection from technology changes
17
Tiered Storage Evolution Software Optimized Hardware
Modern Multi-tiered Storage
Performance Disk
Flash Storage
32%
6%
Capacity Disk
Tape Drives 60%
Oracle Exadata Database Machine
• Extreme performance for OLTP, Data Warehousing and Consolidation
• Performs up to 1,000,000 IOPS
• Up to 50 GB/s raw I/O bandwidth
Oracle Sun ZFS Storage Appliance
• Intelligent data placement across flash and disk
• Highest levels of data integrity
• Advanced DTrace analytics • Integrated data services and
storage management at no extra cost
18
Tiered Storage Automation
Tier 0/1
Tier 2
WAN
Data Creation
One Week
One Month
Six Months
One Year
Seven Years
Forever One Day
Tier 3
• Policy-based • Dynamic • Non-disruptive • Seamless
heterogeneous integration
• Transparent to applications
• Open • Built-in data
protection
19
Not All Data is Created Equal
Source: ESG Research Brief, Implementing the Right High Availability and Disaster Recovery Plan for Your Business, August 2010.
20
Not All Data is Created Equal
Source: ESG Research Brief, Implementing the Right High Availability and Disaster Recovery Plan for Your Business, August 2010.
Protection Classes Availability Objectives
Recovery Point Objective (RPO)
Recovery Time Objective (RTO)
Mission Critical Data • Near zero downtime, most
valuable 99.999% • Continuous to 1
minute • Instantaneous to
1.5 minutes
Business Critical • Important data, good availability
99.999% • 1 to 10 minutes • 2 minutes to 15 minutes
Archive Online Data • Cost sensitive, low access, online
performance 99.99% • 10 minutes to 2
hours • 15 minutes to 2
hours
Archive Nearline Data • Cost sensitive, low access
99.9% • 2 hours to 1 day • 2 hours to 1 day
Offline Data • Most cost sensitive, compliance
related, ~72-hr recovery Offline • 1 day to 1 week • 1 day to 1 week
21
Oracle Recovery Manager (RMAN)
• Oracle-preferred method for efficient database backup and recovery – Reduces exposure to data loss – Ensures transaction integrity and manages all info for database
recovery at any point in time – Backup to disk preferred for faster restore
• Built-in – Cost-effective, no extra licenses – No third party technology to purchase and coordinate
• Copies only database blocks changed since previous backup – Up to an order of magnitude reduction in backup and recovery times – Significantly improved Recovery Time Objectives (RTO)
22
Oracle Secure Backup (OSB) Enterprise Tape Backup Management – Database Backup
Oracle Database
RMAN Integration
Oracle Secure Backup File System Data
Oracle Enterprise Manager
• Oracle database backup / recovery management – Utilize RMAN command line restoring
to original or alternate location
• Provides media management layer for RMAN – Built-in integration – No additional
licensing costs – Exclusive performance optimizations – Achieving 25 – 40% faster backup
to tape than comparable products
• More than 75% less expensive than comparable products
23
Creating an Infinite Disk Repository Using Sun Storage Archive Manager (SAM)
• Shared infrastructure
• Each database instance has it’s own “virtualized” disk
• Policy based data movement with SAM
• Tiered Disk and Tape
• Data read direct from storage
Sun Storage Archive Manager Metadata Server
Individual Fast Recovery Areas
Sun Storage Archive Manager Infrastructure
Tier 1 – Sun
Storage 6000 or
ZFS Storage
Appliance $$
Tier 2 – ZFS
Storage Appliance
$
Tier 3 – StorageTek
Tape Storage
SAM Policy
$$$
Oracle 10g/11g Database Servers
New price per processor licencing
model
24
Benefits of an Infinite Disk Repository • Infinite disk repository for each Oracle instance
• All Data Protection data looks like it resides on disk
• Faster recovery time objectives and better recovery point objectives
• Mitigates need for redundant backup application
• Retention policies in database control
• Provides continuous fast direct access to the data
• Transparent migration of files
25
Example Use Case : Disk-to-Disk-to-Tape Using Sun Storage 6000 Series Fast Recovery Area
Oracle Database
Sun Storage 6000 Series
RMAN backups, archived redo logs
stored in Fast Recovery Area
SATA Disk Fast Recovery Area
FC Disk Indexes, Tables,
Redo logs
SSD Indexes, Tables, Temp,
Undo, Redo logs
Media Manager
StorageTek Tape Storage
Media manager backs up recovery area files to tape for longer-term
storage
26
Comprehensive & complete • Visibility from data creation to deletion
• Fewer boundaries between hardware and software
• Single-vendor service & support
Open • Data placement abstracted from hardware
• Open formats for forever data access
• Heterogeneous
Drive Down Complexity • Visibility from application to archive
• Policy-based
• Dynamic
Tiered Storage Considerations Complete, Open and Automated
27
Additional Resources
• Tiered Storage Resource Kit: – White Paper: Tiered Storage Takes Center Stage – White Paper: Optimizing Information with a Tiered Storage Architecture – White Paper: Tape Technology Leaps Forward in the 3rd Era – Archive and Storage Videos – Special Offers, Customer Success Stories and More! – https://landingpad.oracle.com/webapps/dialogue/ns/dlgwelcome.jsp?
p_ext=Y&p_dlg_id=8691050&src=6965184&Act=36 • Product Documentation
– http://www.oracle.com/us/products/servers-storage/storage/index.html
28
top related