solidfire technical deep dive (m2)

SolidFirePetr Slačík

Systems Engineer NetApp

[email protected]

27.3.2017

© 2017 NetApp, Inc. All rights reserved. 1


SolidFire Introduction

Element OS

System Architecture

Scale-out Guaranteed Performance

Automated Management

Data Assurance

Global Efficiencies

Data PathConnectivityNodes

1

2

3



Element OS

System Architecture

1

2

3



Data Assurance

Global Efficiencies



Builtfor dynamic

infrastructure

Bornout of the cloud

Designedfor consolidation

of mixed workloads

Enablesa next generation

datacenter



Element OS

System Architecture

1

2

3



Data Assurance

Global Efficiencies


Element OS

© 2017 NetApp, Inc. All rights reserved. 6 Element OS | Overview

Node

Node

Node

Node

Node

ELEMENT

ELEMENT

ELEMENT

ELEMENT

ELEMENT

Global

Efficiencies

Scale-out Automated

Management

Guaranteed

Performance

Data

Assurance

ELEMENT™ OS

Element OS

Scale-out




Data Assurance

Global Efficiencies

1 2 3

Scale-Out Platform


Mix, match, and add new

nodes as demand dictates

Start with a 4-node cluster with

desired performance/capacity mix

Element OS | Scale-out

Capacity & PerformanceNodes

© 2017 NetApp, Inc. All rights reserved. 9 Element OS | Scale-out

SITE 1 S ITE 2

4805

9605

19210

Future

9605

CAPACITY PERFORMANCE

MEMORYCPU

Non-disruptive

Granular

Mix Nodes

Scale Out /

Scale Back

No Forklift

Upgrades


MEMORYCPU



SITE 1 S ITE 2

4805

9605

19210

9605


MEMORYCPU

Non-disruptive

Granular

Mix Nodes

Scale Out /

Scale Back

No Forklift

Upgrades

19210


MEMORYCPU



SITE 1 S ITE 2

9605


MEMORYCPU

Non-disruptive

Granular

Mix Nodes

Scale Out /

Scale Back

No Forklift

Upgrades


MEMORYCPU

SITE 3


MEMORYCPU

9605

19210

4805

9605

Benefits SummaryElement OS | Scale-out


✓ Simplify capacity planning

✓ Seamless generational upgrades

✓ Instant resource availability

✓ Defer capital expenditures

✓ Eliminate continual architecture of point solutions

✓ Requires…. no manual intervention, no reconfiguration, and no server, client or application changes

✓ Eliminate “Hot Spots”

Element OS

Guaranteed Performance




Data Assurance

Global Efficiencies

Scale-out

1 2 3

How QoS Works

© 2017 NetApp, Inc. All rights reserved. 14 Element OS | Guaranteed Performance

APP BEHAVIOR

Burst

Max

Min

QoS in Practice

© 2017 NetApp, Inc. All rights reserved. 15 Element OS | Guaranteed Performance

PE

RF

OR

MA

NC

E

T IME

SYSTEM PERFORMANCE

BEFORE QoS

AFTER QoS

BOOT STORM

3

1

2

BOOT STORM

3

1

2

BOOT STORM

PE

RF

OR

MA

NC

EP

ER

FO

RM

AN

CE

Benefits SummaryElement OS | Guaranteed Performance


✓ Allocate storage performance independent of capacity

✓ Manage performance real-time without impacting other volumes

✓ Guarantee performance to every volume with fine-grain QoS settings

✓ Enable multiple databases or applications to coexist on the same storage

✓ Reduce time spent managing performance issues

Element OS | Guaranteed Performance

Element OS





Data Assurance

Global Efficiencies

Scale-out

1 2 3

Simplified Management

© 2017 NetApp, Inc. All rights reserved. 18 Element OS | Automated Management

API

User Interface

Active IQ

VMware vCenter

OpenStack

CloudStack

PowerShell

SDKs

Self-service Portals

Homegrown Apps

INTERFACES PLUG-INS TOOLSCUSTOM

INTEGRATIONS

TIME YOUR BUSINESS

DESIGN

Initial size (GB or IOPS)

INSTALLATION OPERATING

GB and IOPS required

Account Creation

SCALING

GB and IOPS needed

UPGRADEDESIGN

Initial size (GB or IOPS)

Anticipated growth over lifecycle of array

IOPS required lifetime of product

Node size selection

RAID type, RAID grouping

Drive type (FC, NL, Flash)

Drive quantities and ratio

Cache requirements

Drive Sparing

Aggregate/CPG

MetaLUN and Bin file layout

INSTALLATION

Bin File/RAID Layout

Aggregate/MetaLUN creation

Snapshot spare spacing

Vol0/quorum drive layout

Aggregate snapshot frequency

Snapshot growth limits

OPERATING

GB and IOPS required

Account Creation

Host to HBA assignment and tracking

Host initiator count limits

RAID type required

Primary Control Node assignment

IOPS limitation concerns

Snapshot growth policy

Thin Provisioning (or not)

Aggregate/CPG assignment

40% CPU limit considerations

SCALING

GB and IOPS needed

Drive Shelves required

Power/floor space restrictions

Control node limitations (CPU storage)

UPGRADE

HBA compatibility list

CPU utilization on control nodes

Maintenance window

Mitigate risk during node outage

Storage System TasksOther Vendors


Comprehensive Monitoring


CLUSTER

REAL-TIME

TELEMETRY

Real-Time UI

• Easy

integration

customer traps

SNMP Logging

• Support Access

• Upgrades

• Phone Home

M Node

M

• Proactive

Support

• 5 – 60 Seconds

• Events/Logging

• 5 year Historical

Reporting

Active IQ

TIER 3 SUPPORT

• Per Volume

Performance

• Efficiencies

• Alerts

• Running Tasks

• System States

• API Generation

– Latency

– IOPS

– Bandwidth

– Queue Depth

Maintenance Windows | Non-DisruptiveAutomated Management


M Node

M

FirewallActive Support

ELEMENT OS UPDATES - OS RESTART

KERNEL UPDATES - NODE REBOOT

NODE RE-IMAGING - NODE REMOVAL

REVERSE-SSH

MULTIPLE

UPGRADE

PATHS

Benefits SummaryElement OS | Automated Management


✓ Rapidly deploy applications & services to meet business needs

✓ Automated data distribution & load balancing eliminates downtime, reduces administrative tasks

✓ Complete REST based APIs reduces automation development time

✓ Reduce risk of human error

Element OS

Global Efficiencies




Data Assurance

Global Efficiencies

Scale-out

1 2 3

All Efficiencies Are Global

© 2017 NetApp, Inc. All rights reserved. 24 Element OS | Global Efficiencies

Efficiencies Tied to

Individual Arrays

Compression

Deduplication

No Scaling Thin Provisioning

OTHERS

Stranded

Capacity

Stranded

Capacity

Isolated Efficiency

Missed Dedupe Opportunities

Wasted Capacity

Always On Global No Impact

Array 1

Array 2



Element OS

System Architecture

1

2

3



Data Assurance

Global Efficiencies


SolidFire Environmental Diagram

© 2017 NetApp, Inc. All rights reserved. 26 System Architecture | Introduction

10 GbE NETWORK iSCSI

SVIP

HOSTSADMINISTRATOR

NETWORK

1/10 GbE NETWORK

MVIPM-NODE

NODES

INTERNET

ACTIVE CLOUD MONITORING

ACTIVE SUPPORT

SolidFire Scale OutAdd New Nodes to Scale Capacity and Performance


* SolidFire's Effective Capacity calculation accounts for Helix data protection, system overhead and global efficiencies including compression, deduplication and thin provisioning. SolidFire

customers typically achieve an effective capacity range of 5x to 10x the (usable) capacity depending on application workloads. The above capacity calculations show 5x efficiency gains

4805▪ 10TB effective capacity*

▪ 50,000 guaranteed IOPS


▪ 50,000 guaranteed IOPS


▪ 100,000 guaranteed IOPS PerformanceC

apacity

Start with four 9605 nodes

Adding 4805 nodes scales performance faster than capacity

Scale linearly by adding 9605 nodes

Scale faster by adding 19210 nodes

Building Blocks of SolidFire PlatformNodes

© 2017 NetApp, Inc. All rights reserved. 28 System Architecture | Nodes

4805

✓ (10) 480GB SSD

✓ 10 – 20TB (effective)

✓ 50,000 IOPS

✓ 128GB shared memory

✓ 2x6-core 2.1GHz

19210

✓ (10) 1.92TB SSD

✓ 40 to 80TB (effective)

✓ 100,000 IOPS


✓ 2x14-core 2.6GHz

9605

✓ (10) 960GB SSD

✓ 20 – 40TB (effective)

✓ 50,000 IOPS


✓ 2x6-core 2.1GHz

1U Form Factor

10 SSD Drives

System Architecture

Connectivity


Connectivity Data PathNodes

1 2 3

iSCSI Physical ConnectivityPutting the Pieces Together

© 2017 NetApp, Inc. All rights reserved. 30 System Architecture | Connectivity

– 10 GbE

– Network Vendor Agnostic

– LACP Bonding

– iDRAC Enterprise Support Included

OPTIONAL 1 GBE OUT OF

BAND MANAGEMENT INCLUDED

Nodes

Scale-Out Nodes

To Hosts or Trunked to Core

Redundant 10GbE switches(Customer switch, Core or TOR)

Dedicated Management Network

FC ConnectivityPutting the Pieces Together

© 2017 NetApp, Inc. All rights reserved. 31 System Architecture | Connectivity

To Hosts or Trunked to Core

Nodes

Scale-Out Nodes

Redundant FC switches(Customer switch, Core or TOR)

Redundant 10GbE switches(Customer switch, Core or TOR)

FC Nodes

PLACE NODES ANYWHERE

FC node

– Receives FC traffic, does a SCSI pass-through to storage nodes

– Full active-active across ports

– 4x16G ports, 4x10G ports

– 2 or 4 FC nodes per cluster

Storage node– Receives data from FC node and sends acknowledgement

– 2x10G ports, delivers either 50k or 100k IOPS

Shared nothing HA

- Hot swappable FC nodes and Storage Nodes

- WWN’s of ports on FC nodes for zoning determined

by cluster as a whole

- LUN masking used for multi-tenancy

Scale-out to 40-node cluster

Full SolidFire functionality

Dedicated Management Network

Major Users So l idF ire Successes

was able to drop a development build from:

…by deploying SolidFire® as Cinder block storage in its OpenStack environment

HOURSto

MINUTES

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---

3 segments, 5 targets, many programs

All-Flash Array for the Next-Gen Data Center

The Digital Enterprise

Transforming

DigitalsNative Digitals

Service Providers

Cloud and

Hosting

Cable and

Telco

SaaS


Questions?

solidfire technical deep dive (m2)

Documents