dell 高性能存储解决方案

Dell 高性能存储解决方案詹健

高级存储产品经理戴尔（中国）有限公司

Dell Storage Forum 2012June 10–13, 2012 | Boston, Massachusetts

Bigger, Better, Faster更大，更强，更快！

• HPC: Bigger, Better, Faster– HPC is all about High Performance

› Solving Bigger problems› Better answers to problems› Solving problems Faster

– The TeraFLOPS barrier was broken in June 1997 (1 trillion operations per second)

– The PetaFLOPS barrier is now being routinely broken (1000x)

• HPC Data Explosion– This means more data (capacity)– This means more IO performance (throughput)– New technology is going to accelerate data growth by an average of 2-4

times

• Result – more storage capacity is needed and more storage performance is needed

2


灵活性 , 适应性 , 选择性

• The performance importance of data changes over the life of the data– At first, performance is very important

– After a period of time, the performance is less important

• Why keep data on high-performance storage that isn’t being used?

• Based on applications and performance importance there are three basic categories of data requirements:1.Fast Scratch

• Performance, performance, performance

2.Primary (/home)• Reliability

3.Long-term• Capacity (very little performance)

3


快速

归档用户

4

High performance and scalability

Reliability and good

performance

High capacity and cost effective

HPCStorage

Dell NSS

Dell HSS

Dell TSS

Cluster working space

User DataHome directories

Applications

HSM, Data retentionretention Archive, backup

Dell 对高性能计算存储解决方案的观点


Dell 集成高性能计算存储解决方案根据规模和工作负载来定位

5

Workstation

Workgroup

Department

SuperComputer

用户 :Dell NSS

Conceptual, not to scale ~1-2 GB/s

Division

用户 :Dell NSS

Throughput

Data Archiving, HSM: TSS

Primary Storage: Dell HPC NFS Storage solution (NSS)

for local data, home directories

Scratch Space: (DT-HSS)High speed cluster working space

for application data


• Dell is delivering solutions using two approaches:1. Complete solutions - Fully vetted, tested, supported

› Come with end-to-end support from Dell and partners

› Detailed documentation including best practices, performance and sizing guidance

› Deployment services

2. Roll-Your-Own› Dell creates technical whitepapers containing:

– Recommended configurations

– Configuration best practices and sizing guidance

› Customer buys hardware and uses whitepapers as a reference

› Full Dell warranty and support on Dell components

– Limited or no deployment services; no solution type services

• Overtime, deliver building blocks that will integrate into the larger HPC storage ecosystem

6

Dell 所提供的高性能计算存储解决方案


Dell-Terascala HPC Storage Solution (DT-HSS) Fast Scratch

/scratch

7


8

Metadata Storage Server (MDS) Pair•Active/Stand-by Servers•Shared storage between two servers•Serves metadata for user data on Object Storage Servers

Clients

Storage Interconnect

Object Storage Server (OSS) Pair•Active/Active Servers•Shared storage between two servers•Stores user data

Management Interconnect

Management Server

Single name space across object servers

One or moreObject Pairs

Object Storage Server (OSS) Pair•Active/Active Servers•Shared storage between two servers•Stores user data

IB/10Gb

DT-HSS 架构概览 (Scratch Space)


DT-HSS架构 : Metadata Server Pair

9

Metadata Server (Active) Metadata Server (Stand-by)

PowerEdge R710 PowerEdge R710

PowerVault MD3220

6Gbps SAS redundant interconnect

Failover

Object Server (Active) Object Server (Active)

PowerEdge R710 PowerEdge R710

6Gbps SAS redundant interconnect

Failover

PowerVault MD3200

PowerVault MD1200

PowerVault MD3200

PowerVault MD1200

PowerVault MD1200PowerVault MD1200

DT-HSS Architecture: Object Server Pair


DT-HSS 简化的管理

10

Comprehensive Failover System

Reduced Complexity in

common FS Tasks

Single Snapshot of Entire System

Alerts and Notifications on Status


DT-HSS 性能

• QDR InfiniBand connectivity from clients to storage• Single OSS Pair with total of 96 3.5” 2TB NL SAS disks

– Up to 64 clients, 1-2 threads per client– Tests using IOZone, 1024KB block size, 60GB file size, 16 LUNs

• Max Reads: 6.5GB/s | Max Writes: 4.3GB/s

11


12

Scale in Performance and Capacity

• Add two more OSS pairs

– Additional 288TB raw (~218TB formatted)

– 9.6 GB/s (read)

– 7.8 GB/s (write)

2x IB

2x IB

2x IB

• Add another OSS pair

– Two OSS servers

– 144TB raw (~109 TB formatted)

– Up to 4.8 GB/s (read)

– Up to 3.9 GB/s (write)

QDR InfiniBand switchGigE for Management

2x IB

2x IBGig

E

• HSS3 144TB configuration– 144TB raw (~109 TB

formatted)– Up to 4.8 GB/s (read)– Up to 3.9 GB/s (write)– MDS: 1.5 billion files

DT-HSS – 扩展性


总结

13

424140393837363534333231302928272625242322212019181716151413121110 9 8 7 6 5 4 3 2 1

Metadata Pair

User Data

OSS Pair

DT-HSS

• Scale out storage appliance for throughput intensive applications

• Leverages Lustre, industry’s leading open-source parallel file system

• Rich management interfaces simplifies end to end storage management


Dell NFS Storage Solution (NSS)

Primary/home

14


NSS 解决方案组成

• Single NFS Gateway– Perc H800 RAID card(s) in NFS gateway

› Dell MD1200 JBOD’s connected to RAID card(s)

– RAID-60 or RAID-60+LVM

15

• Two Active-Passive NFS Gateways– Dell MD3200 RBOD contains RAID card

– Dell MD1200 JBOD’s are connected to RBOD

– RAID-6 + LVM

NFS Gateway– Dell Server (R710)– IB, 10GigE options (GigE management

standard)

Hardware(NFS gateway)

Software andSupport

– RHEL 6.1 OS w/ NFS v4 (v3 optional)– Red Hat Scalable File system (XFS)– Red Hat Cluster Suite (for HA)

Scale up to 288TB under a single name space!


• Two PowerEdge R710s configured in active/stand-by serving a single file system• HA requires the ability to shut-down a misbehaving server

– Private network for heartbeat and control (including power control)– Plug power into controllable PDU’s– Enterprise iDRAC is the primary fencing device used to control misbehaving server– APC PDU is the secondary fencing device

• HA software shuts down server and cuts power to it

16

PowerVault MD1200

PowerVault MD3200

Dell R710 Active Server

Dell 710 Standby Server

Private GigE Switch(PowerConnect 5524)

APC PDUAPC PDU

2

2

GigE

Power Cords

IB or 10GigE

SAS (6Gbps)

1

1

IB/10GigE IB/10GigE

NSS-High Availability (NSS-HA) 架构


NSS-HA 性能最大达 288TB



Dell NSS解决方案的优势

• Performance tuned NFS storage– Best possible performance

– No need to experiment with tuning options – already tuned

18

30%


HPC Tiered Storage Solution(HTSS)

HSM and Archive/archive

19


HPC解决方案中数据的快速增长

• Explosive growth in research data is leading to data management challenges

• Huge amount of data needs to be stored for future analysis– Example: One institute can generate approximately 400TB of

data per week

• Increasing compliance requirements direct preserving data for long periods of time– Example: NSF can ask for data preservation for up to 20 years

• Majority of data produced is rarely touched 2-3 weeks after creation

• Cold data occupies space on primary and scratch space– All the data does not need to be on high performance storage!

20


21

IB/10GbE Ethernet

Primary Storage:Dell NSS

Dell DX Object Storage

Dell ML6000 Tape Libraries

Dell DL2200 powered by CommVault

Dell Compute Cluster

Dell HPC 分级存储解决方案 (HTSS)

Fibre Channel


策略集合

22

Time Based Policy

“If the atime of a file is greater than 60 days, migrate the data blocks to HSM”

Size Based Policy

“If the file is larger than 100 GB, migrate the data blocks to HSM”

Directory Based Policy“If the data is in a certain directory, migrate data blocks to HSM”

User/Group

“If the data is owned by user laytonj, then migrate the data blocks to HSM”

Combination of Policies“If a file is older than 60 days, larger than 10GB, and is in a certain directory, then migrate the data blocks to HSM”


Dell 存储产品家族

26


大规模扩展的归档存储

简单、易于承受、固定的内

容

DX 目标存储平台

基于磁盘的备份系统

稳定可靠，满足创新的需求

DR4000 存储平台

多协议的企业级存储

功能强大，自我优化

Compellent Storage

Center

统一的、虚拟化的存储

简单易用且功能多样

EqualLogic

PS & FS

模块化的存储系统

兼顾价值和性能

PowerVault

MD & NX

D2D 和D2T 备份应

用简单易用的数据保护和恢复

PowerVault

DL, TL & MTL

戴尔拥有全面的存储产品线Compellent：智能分层，应用优化的虚拟存储，业界最佳ＴＣＯEqualLogic：横向扩展，云就绪，最佳虚拟环境存储PowerVault：高性价比、功能充实的入门级存储DR：提升数据存储保护效率DX：面向大数据的目标对象数据、实现长期低 TCO

“要记得，戴尔是一个具有全面存储产品的‘选手’” – John Webster, Evaluator Group, CNET 新闻 , 2011 年 3 月 22日

27


Dell NAS – 根据客户需求选择最适合产品

• Multiprotocol scale-out NAS for EqualLogic Storage• Based on Dell Hardware and Dell Fluid File System• High Performance Scalable Architecture, unified management• Alignment with EqualLogic Family Values, inclusive software feature delivery

EqualLogic FS7x00 EqualLogic FS7x00

• Multiprotocol scale-up NAS for PowerVault MD Storage• Based on Dell Hardware and Dell Fluid File System• High availability NFS and CIFS capability that scales beyond traditional file servers• Robust replication, snapshot, dedupe and compression features *

PowerVault NX3x00 PowerVault NX3x00

• Primarily for Windows Environments with emphasis on CIFS performance• Based on two R710 servers and Windows Storage Server 2008 R2 Enterprise• Flexible Deployments with a variety of iSCSI and SAS storage backend options • Advanced Windows File Management features, High Availability and native Active

Directory

PowerVault NX3000HAPowerVault NX3000HA

Mid

ran

ge &

ad

van

ced

B

asic

dep

loym

en

ts

• Clustered scalability and high availability NAS for Compellent SANs• Based on Compellent hardware and Windows Storage Server 2008 Enterprise• Simplified Management, easily-accessible snapshots, file level dedupe (Single Instance

Storage)• Versatile SAN connectivity with support for both Fibre Channel and iSCSI

Compellent Storage Center NASCompellent Storage Center NAS

* Dedupe later in CY2012


30

在存储领域，戴尔正在成为一个更有活力的引人注目的参与者

1 IT Knowledge Hub ， 2011年 3 月 21日2 Gartner Group，面向中端和高端模块化磁盘阵列的魔力象限（ Magic Quadrant for Midrange and High-End Modular Disk Arrays）， 2011年 11月 5 日4 IDC Multiclient Report，服务器虚拟化 2010年（ Server Virtualization 2010）， 2010年 9 月

Gartner魔力象限2011年中端和高端的模块化磁盘阵列 2

挑战者领导者

前瞻性

探索者补缺者

执行力

2011年 11月

Dell Confidential


谢谢！

31

dell 高性能存储解决方案

Documents