#mfsummit2016 operate: the race for space

The Race for Space

David Shepherd | Senior Solutions Consultant | 24th February 2016

Stephen Mogg | Senior Sales Engineer

Agenda

•Storage Then and Now

•Storage Requirements in the Enterprise

•The need for Data Retention

•Provisioning, Presentation and Consumption

Storage Then and Now

1986

A typical business class PC had a 10MB hard disk

2016

A typical mobile phone has 16GB of storage. (1600x)

A typical business class PC has 512 GB of storage. (51200x)

Enterprise Disk drives 6TB in size (614400x)

As a comparison…

If cars had improved at the rate of storage.

• Assume a car in 1986 had an average top speed of 100mph

• Average top speed in 2016 would be 5,120,000 mph or 1422 mps

• Or 0.09 c where c is the speed of light in a vacuum. It would probably be important to get your brakes checked…

Enterprise Storage in the 21st

Century

Industry Need for Storage is Expanding

Today’s Data Centre Challenges

The Value of Data

50-60%of Enterprise Data

20-25%

15-20%

1-3%

Tier 0

Ultra High

Performance

Tier 1

High-value, OLTP,

Revenue

Generating

Tier 2

Backup/Recovery,

Reference Data,

Bulk Data

Tier 3

Object, Archive,

Compliance

Archive,

Long-term Retention

Source: Horison Information Strategies - Fred Moore

Enterprise Storage Tomorrow

Differentiated “Tiered” Information

Timely Identification, Classification, and Efficient

Placement

Software-Based Storage (OPEX)

Separated Control Plane and Data Plane

Open, Extensible, Unified and Simplified

Industry Standard Hardware Building Blocks (CAPEX)

Commodity Off-the-Shelf Servers for Control Plane

Commodity Off-the-Shelf Drives for Data Plane

Enterprise Storage Market

Source : IT Brand PulseThe Epic Migration to Software Defined Storage

20% Open Source in next 2 years. (up from 1%)

How Do You Manage Growth ?

• Existing SAN Infrastructure

• Can existing SAN meet the capacity ?

• Is it cost effective to expand existing storage ?

• Software Defined Storage

• Clustered solution based on multiple servers to provide a fault tolerant storage solution based on Enterprise Servers and Storage.

SUSE Enterprise Storage

• Extensively Scalable

• Storage Appliance to Cost Effective Cloud Solution

• Industry Leading Storage Functionality (Hammer Release)

• Unified Block and Object with File Coming

• Thin Provisioning

• Erasure Coding

• Cache Tiering

• Built upon Clustered Servers

• Self Healing

• Self Managing

SUSE Enterprise Storage with Ceph

Optimise performance with minimal monitoring and storage administration

Block

Storage

File

System

Object

Storage

Monitor

Nodes

Management

Node

Build enterprise class storage with commodity servers and disk drives

$

Add capacity as needed

Reduce capital expense

Broaden choice of vendors

Public Network

OSD1 OSD2 OSD3 OSD4

Heterogeneous operating system support with iSCSI storage protocol

Cluster Network

iSCSI Gateway

RBD Module

iSCSI Gateway

RBD Module

iSCSI Initiator

RBD image

Provisioning, Presentation and Consumption

So What ?

• We have a software defined storage infrastructure

• We need to make the storage available.

• We need to be able to be able to utilise the storage from existing Enterprise Platforms.

• How do we then provision the storage, present it to the required systems, and consume the space provided..

The Need for Data Retention

Data Retention

• Major reason for storage growth

• Different Industries have different statutory requirements

• Banking

• Telecoms

• Health

UK Data Retention Regulations (2014)

UK Data Retention Regulations (2014)

Data Retention Challenges

• Storage is not the whole solution

• How do you provide access ?• Is historic data still available to applications ?

• How do you manage security ?• Backup and restore of retained data. Disaster recovery of

storage.

• How do you implement retention policies ?• Are files retained in accordance with age, file type etc.

Tools that can help

• File Reporter - Know what you have• Who has rights, how did they get rights

• What type of files have been added in the last month

• Who is taking up the most amount of storage

• Storage Manager - Manage File structure• Automate storage assignment / cleanup

• Policy based user / group storage

• No custom IDM scripts but clear policies

Enterprise Data Retention Solution

OES2015 as a Storage Gateway

Leveraging the use of SUSE Storage to multiple client types

OES2015 as a storage gateway

• Can present the block devices from SUSE Storage as native Kerberos CIFS volumes to Active Directory

• NFS also supported

• Can make use of Storage Tiering technology (Dynamic Storage).

• Dynamic Storage allows data to stay as one volume from a user perspective but to split the data based on policy to a primary and a shadow storage location.

• Allows SUSE Storage to act as shadow storage.

Dynamic Storage

Figure 1-1 User View of the File System Directory

Dynamic Storage (DST)

• The primary storage is your existing volume

• The secondary volume is your shadow storage• Data is moved by policy between the primary and the

secondary.

• Access to the data is seamless from the existing volume.

• Users do not notice that data moves.• The moves are transparent.

Benefits of Dynamic Storage

• Old data can be moved from the SAN primary storage to SUSE Storage seamlessly. (data is read-only during the move).

• Frees space on the SAN

• Can reduce backup and restore windows.

• Unlike SAN based functionality DST is file based not block based.

Data move is policy controlled.

Controlled from a server based web app or the command line.

Multiple Policies can be applied

Data can be moved from primary to secondary or secondary to primary

Data move can take place based on multiple conditions.

Management of large Volumes

• Simple management of large data sets

• NSS dynamic rights assignment with minimal server utilisation over very large volumes.

• Rights inheritance • Rights do not need assigning at each level.

• Volume size can be 8 Exabytes, file size 16TB

• NSS is the only file system designed to share files from the outset.

Integration with Active Directory

• Native Integration with AD

• SMB 2 with pipelining support

• Kerberos

• OES Servers join AD as member servers

• AD Tools used for management

• AD Security principals used to assign rights

Future Developments

• OES2015 SP1 will add the following

• AD Client access to Salvage and Purge

• Integration with multiple AD Forests

• Improved CIFS performance

• Dynamic Storage

• Implementation of a third tier to cloud.

Data Access to Mobile Clients

• Using Filr 2.0 (Available as part of OES)

• Gives access to all data from tablet and smart phone form factors from their original locations.

• Data does not need to be moved to another data store

Filr 2.0 IOS Client

Touch ID Supported for Authentication

IOS Pin code also supported

Filr 2 IOS Client

Documents can be loaded from any network drive exposed by Filr, edited and saved back

Any app written to IOS 8 or later can use the same functionality

Summary

• SUSE Storage can provide large amounts of storage that can replace more expensive SAN based options.

• OES 2015 can utilise the storage whilst providing class leading capabilities for data retention and full support for Active Directory

• Filr 2.0 can securely make that data available to mobile connected devices.

Questions ?