digital archiving business benefits, challenges, and best practices christine rogers principal...
TRANSCRIPT
Digital ArchivingBusiness Benefits, Challenges, and Best Practices
Christine RogersPrincipal Product Manager
Oracle, StorageTek Archive SolutionsSeptember 30, 2014
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Program Agenda
Archiving Benefits
Deploying an Archive
Archive Success Stories
1
2
3
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Archiving• Access strategic content
– Permanent record of fixed content– Allows for collaboration and global sharing of archive data
vs. Backup• Restore lost or corrupted content
– Business Continuity – day-to-day restores of applications, user files, emails, etc
– Disaster Recovery – massive restores of disk arrays, server nodes, or entire data centers
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Factors Driving The “Keep Everything Forever” Mindset Today’s Archives
Digitization
Business OpportunityCompliance & E-Discovery
Preservation
Data Growth
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Title-Only LayoutOracle Digital Archive Benefits
Lower Costs
Improve Efficiencies
Unlock Value
Save up to 80% on overall storage costs
Lower administrative burden with set and forget automated archive policies
Easily leverage your data through online file access
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Lower Backup Costs: Save 5x on Software and 4x on StorageSave 80% by Archiving Rarely Used Data
$2,550,000
$640,000
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Tiered Storage Drives Down Archive Costs
26xTiered Storage
Save
through
http://www.oracle.com/us/corporate/analystreports/industries/clipper-tco-storage-2013-1959019.pdf
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle Storage Archive AutomationEase Administrative Burden & Unlock Data Access
Tape Archive
Primary Disk
Disk ArchiveSt
anda
rd P
OSI
X Fi
le S
yste
m A
PI
Appl
icati
ons
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
How Do I Deal With?Oracle Solves Common Archive Concerns
1. Total cost of ownership and storage efficiency
2. Meeting retention requirements / infinite retention requirements
3. Managing data growth and complexity
4. Surviving tech refreshes and data migrations
5. Ensuring data protection, integrity and security
6. Maintaining access to data as applications become obsolete
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
ORACLE STORAGETEK DIGITAL ARCHIVE
SEAMLESSAutomated and Tiered Storage Provides Lowest TCO
PROACTIVE Intelligent Monitoring Ensures Data Access
FUTURE-PROOFLimitless Capacity and Performance for Worry Free Growth
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Tape Archive
Primary Disk
Disk Archive
Tiered Storage Digital Archive
SeamlessHierarchical Storage Management, Automated Policies & Data MigrationOpen Formats
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
StorageTek Storage Archive Manager
Hierarchical Storage Management
Enterprise Scalability
Automated Data Movement
Polic
ies
To M
ove
Dat
a
High Availability
FlashDiskTape
Open Formats
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Highest Scalability Hundreds of SAN clients Hundreds of file systems Billions of files Petabytes of disk cache Exabytes of archive
Enterprise Scalability and Performance
Fast Performance For large files sizes, existing
customers can ingest >5 GB/s For small (100KB files), ingest rates
of up to 10,000 IOPS have been observed
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
High Availability
• Automatic Failover– SAM servers are clustered with
automatic failover between servers
• Maintain Access to Data– Active server always has access
to primary disk cache, archive disk, and tape archive layers
Clustered StorageTek Storage Archive Manager Servers
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
FILE INDEX
Backup / Archive Software Not Required
FILE
Digital Tape Written with Open Format
Simplify File Access
Open Archive Formats Simplify File AccessOnly the tape is needed to retrieve the file
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Horizontal Scalability: tape ingest performance improved 10x!• Use QFS clients for archive and
staging to/from tape
OpenStack Swift support for object based storage• Create private clouds
leveraging tiered storage
Automated Data Integrity Validation with Self-Healing• Supporting LTO5,6 and
T10000C,D drives
LTFS import / export support
New Advancements
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
ProactiveIntegrity Throughout Your Data’s Lifecycle
Data Write
Data Integrity ValidationTape Analytics Health
Analysis
Periodic Media Scan
Media Validation
Data Read
2
3
Data Integrity Validation
Records & Checks CRCs
1
4
Checks CRCs
Application
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
StorageTek Tape AnalyticsMonitoring Every Exchange in the Archive
Tape Analytics Analyzes Over 150 Exchange Health Attributes
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
When NERSC Scanned 24,000 Tapes (15 Million Meters) in Their Digital Archive… 99.99993%
Was Read Error FreeSource: Mark Peters, ESG Technology Brief, http://www.oracle.com/us/corporate/analystreports/corporate/esg-nersc-case-study-202702.pdf
National Energy Research Scientific Computing (NERSC)
REAL WORLD
EXAMPLE
How Reliable is Tape?
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
How do we move to 100% Data Integrity?Since the NERSC study, Oracle has introduced:
STORAGETEK DATA INTEGRITY VALIDATION
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Intelligently Stream Data to the Archive
• Archive Manager creates a CRC (T10 ANSI standard) for each record
• StorageTek T10000C/D checks CRC as each record is received
• The CRC of each record is written to tape with that record
• When a record is read from tape the CRC is always checked
StorageTek T10000 Tape Drives
StorageTek Data Integrity Validation
Records have CRC added at host
Records Sent to Tape with CRC
Record CRC checked; write
and read
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Schedule media validations to check the integrity of inactive media
• Data is kept inside library and tape drive
• Results of validation are sent to host
• StorageTek Storage Archive Manager can be set to self-heal
• Automatically select media to verify based on– Tape Analytics Health
Indicator– Date Since Last Accessed– Random Sampling– VOLSER Range– Newly Entered
• Select Type of Scan– Basic Verify (~1 minute)
• Validate the cartridge Media Information Region (MIR)
– Standard Verify (~15-30 minutes)
• Validate two upper and two lower data wraps on tape
– Complete Verify (~1 hour/TB)
• Validate entire contents of tape cartridge
– Complete Verify Plus (1+ hours/TB)
• Validate entire contents of tape cartridge, including DIV CRCs
Automated Media Validation
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
CUSTOMER PERSPECTIVE“We chose Oracle’s StorageTek solutions over the competition because no other company can offer the same tape storage density, data integrity validation and data assurance technology.”
Jake Carroll, Senior Information Technology Manager
COMPANY OVERVIEW• Leading center for neuroscience research• Industry: Education and Research• Employees: More than 300
CHALLENGES/OPPORTUNITIES• Improve productivity and enhance scientists’
confidence• Eliminate disruption to research activities caused by
system failures • Ensure compliance with stringent research funding
conditions
SOLUTIONS• StorageTek Storage Archive Manager• StorageTek SL3000 Modular Library System• StorageTek Tape Analytics
RESULTS• Enhanced the safety and reliability of valuable
research data• Retrieved data 66% faster• Slashed daily metadata backup time by 99%• Guaranteed sufficient storage and reduced costs
Queensland Brain Institute Increases DataResponse Speeds by 66%
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Disk
SL8500SL3000
SL150
ZS3
FS1
750 TB
850 PB
50.3 PB
Future ProofIndustry Leading Capacity, Performance and Availability
3.5 PB
2.9 PB
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
High Availability
• Scale Non-disruptively• Service Non-disruptively• Replication and Mirroring• Online Data Migrations• End to End Data Integrity Validation
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 27
Front Porch Digital’s Content Storage Management Solutions are Purpose-Built for Large-Scale Rich Media
SAMMA
Emmy Award-winning migration process for converting content fromanalog to digital, for production, monetization, or preservation
DIVASolutions
Protect, manage, store,and deliver rich media,
in an integrated and streamlined workflow
LYNX
Media-grade privatecloud solution, enablingan integrated networkfor all digital content
distributed worldwide
• Simplifies the complex workflows inherent with migrating, managing, and distributing media assets
• Redefines archiving with instantaneous asset access and control on a technology-agnostic integration platform
• Leverages the scale and cost advantages the cloud offers via secure, private networks
• Automatically captures and migrates analog and digital audio and video
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 28
Combination of Oracle and Front Porch Digital Addresses the High-Performance Needs for Rich Media
DIVA LYNX
SAMMA
• Seamless and optimized rich media workflows increase lifetime value of digital content
• Integrates with 150+ technology partners for advanced orchestration and distribution
• Manage data growth on premise and in the cloud
Oracle Technology – Database, Java
Engineered Systems, Servers, Storage Oracle Web Center
Industry Leading Performance and Scalability
Optimized to work together to deliver enterprise-grade,high-performance for complex requirements
Automated asset management, archival, and distribution for efficient content monetization
On-premise or in the cloud, ensures content availability anytime, anywhere
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
CUSTOMER PERSPECTIVE“Oracle’s StorageTek T10000D tape drive delivers a tremendous competitive advantage for us. We can write 1.5x faster and each drive stores nearly 3.5x more data than our legacy system did—enabling us to purchase one tape library instead of three and to reduce operating costs.”Andy Hurt, Senior Information Technology Manager
COMPANY OVERVIEW• Leading center for neuroscience research• Industry: Media and Entertainment• Employees: More than 100
CHALLENGES/OPPORTUNITIES• Deploy highly available, affordable, and scalable
storage solutions to support the company’s cloud-based, media-content-storage management platform—LYNX
• Build a storage environment that can scale easily and cost-effectively to meet individual client needs and provide a competitive advantage for the rapidly growing media-storage-solutions provider
SOLUTIONS• StorageTek T10000D Tape Drives• StorageTek SL3000 Modular Library System• StorageTek Tape Analytics
RESULTS• Delivered high capacity and performance solutions for
storing 60 TB of media content delivered daily by customers
• Reduced management costs, and increased data reliability and access
• Reduced IT investment and operating expenses, such as data-center power and cooling costs
Front Porch Digital Reduces Operating CostsLeveraging StorageTek Libraries and Drives
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
The World’s Largest Archives rely onOracle StorageTek
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Title-Only Layout
Lower Costs
Seamless
Improve Efficiencies
Proactive
Unlock Value
Future-Proof
Archiving With Oracle StorageTek
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 32
Learn More About Oracle’s Storage Solutions
• "New Medical Records Management Requirements: Healthcare Record Consolidation" – Monday, 2:45-3:30pm at the
Intercontinental
• “OZDLRA: A New Era in Data Protection" – Monday, 3:00-3:45
• "Oracle Zero Data Loss Recovery Appliance: Deployment Best Practices", – Tuesday, 3:45-4:30, Moscone
South – 305
• "The Storage Forum at Oracle OpenWorld 2014“– Wednesday, 3:30-6pm at the
Cityview @ Metreon
• "Maximize Data Value Through Extreme Scalability and Accessibility“ – Wednesday , 2-2:45pm at the
Intercontinental
• "Engineered System Disaster Recovery and Backup-and-Recovery Best Practices– Thursday, 12-12:45 at the
Intercontinental
Monday Tuesday Wednesday/Thursday