leveraging the power of compute and storage grids · computing and storage grids are an emerging...

23
Leveraging the Power of Compute and Storage Grids Rick Jooss – Network Appliance

Upload: others

Post on 18-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

Leveraging the Power of Compute and Storage Grids

Rick Jooss – Network Appliance

Page 2: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

2Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

SNIA Legal Notice

The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:

Any slide or slides used must be reproduced without modificationThe SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.

This presentation is a project of the SNIA Education Committee.

Page 3: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

3Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Abstract

Leveraging the Power of Compute and Storage Grids

As compute and storage resource requirements grow, enterprise ITusers are redefining their server and storage infrastructure. Anincreasingly prevalent trend is to deploy large numbers of small servers and virtualize them, and to deploy modular storage, rather than large frame arrays, to serve core and departmental application workloads. Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will learn about the usage scenarios for grid computing in engineering test, core test and development, and production environments, and the best practices associated with multi-protocol grid deployments: Flexibly configuring and managing multiple and virtualized host operatingenvironments, Provisioning storage, and Protecting data with advanced technologies such as software-based SAN boot.

Page 4: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

4Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Challenges

Growing computing needs

More responsiveness

Limited budget, space, energy and cooling

Page 5: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

5Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Types of Grids

Technical Computing Grids

Data Grids

Utility Computing Grids

Page 6: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

6Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Enterprise Trends Supporting Utility Grids

Modular Array Growth

$0

$200

$400

$600

$800

$1,000

$1,200

$1,400

$1,600

1 2 3 4 5 6 7 8

Quarters (2005-2006)

Rev

enue

* - IDC - 2007

Small virtualized servers

Modular storage for core workloads

Blade Server Growth

-20,00040,00060,00080,000

100,000120,000140,000160,000180,000200,000

1 2 3 4 5 6 7 8

Quarters (2005-2006)

Uni

ts

Page 7: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

7Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

PerspectiveServers Client

Systems

StorageNetwork

Client Network

VirtualizedStorage

Page 8: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

8Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Infrastructure Choices

Server

OS Provisioning

Boot Protocol

Page 9: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

9Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Server

BladesPro

SpacePowerInfrastructure

Con Flexibility

Racks/TowersPro

Lower fixed costCon

Infrastructure

Page 10: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

10Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

OS ProvisioningDisk-full

ProInstalled baseAvailability of commercial software

Con Bare metal installationTools to track and manage images

Diskless Pro

Reliability Performance SupportabilityRapid Provisioning / Re-purposing

Con Availability of commercial softwareInstalled base

Page 11: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

11Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Boot Protocol

iSCSI Pro - Cost, Flexibility, Scalability

Con - Installed base

NFSPro - Cost, Flexibility, Scalability

Con – OS support

Fibre ChannelPro - Installed base, Performance

Con - Cost, Scalability

Page 12: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

12Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Advantages of Virtualized Storage

Flexibility / Speed

Capacity

Business Continuity

Availability

Page 13: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

13Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Flexibility / Speed

Servers ClientSystems

StorageNetwork

Client Network

Boot LUNS

OS_app_1

OS_app_2

OS_app_3

OS_app_4

OS_app_5

OS_app_6

OS_app_7

Page 14: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

14Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Capacity

Clone

Clone

Clone

Clone

Clone

Clone

Clone

OS_app_1

OS_app_2

OS_app_3

OS_app_4

OS_app_5

OS_app_6

OS_app_7

Client Network

Golden LUNS Boot LUNs/Clones

Servers

Page 15: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

15Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Capacity

Server

GoldenLUNs

Clones

Libraryof

golden images

StorageNetwork

Boot LUNs/Clones

Page 16: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

16Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Flexibility and Capacity - Cloning

A B C D A

GoldenLUN

B C D

Cloned LUN

B’ D’A

GoldenLUN

B C D

ClonedLUN

GoldenLUN

Page 17: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

17Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Clone Deployment Process

Install OSRemove identity (name, IP, etc…) off imageLock it as golden imageClone imageImage gets identity based on MAC address during boot

Page 18: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

18Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Clones – Speed and Capacity Advantages

Time to Prov ision

-

5.0

10.0

15.0

20.0

25.0

30.0

10 30 50 70 90 110 130 150 170

Num ber of Servers

Tim

e - H

ours

Space to Provision

Without Cloning:

With Cloning:

Without Cloning:

With Cloning:

Number of unique images: 1000 50 60 10

Image Size (GB): 15 15 15 15

Number of clones: 0 1000 0 60

Clone Size- 10% (GB): 1.5 1.5 1.5 1.5

Total needed capacity (GB): 15,000 2,250 900 240

Page 19: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

19Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Business Continuity

Mirroring

Data Center 1 Data Center 2

Page 20: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

20Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Availability

server1

server3

server4

server2blade1

blade2

blade3

blade4

blade5

blade1

blade2

blade3

blade4

blade5

Page 21: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

21Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Case Study

100+ KM

Location 1 Location 2

ArrayTape

BackupServer

Array Tape BackupServer

Page 22: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

22Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Summary

Utility Grid computing is happening

Virtualized Storage is a key enabling technology to make Utility computing grids a possiblity

Page 23: Leveraging the Power of Compute and Storage Grids · Computing and storage grids are an emerging deployment topology designed to support this horizontal scaling need. Attendees will

23Leveraging the Power of Compute and Storage Grids © 2007 Storage Networking Industry Association. All Rights Reserved.

Q&A / Feedback

Please send any questions or comments on this presentation to SNIA: [email protected]

Many thanks to the following individuals for their contributions to this tutorial.

SNIA Education Committee

Robert PeglarJeff Eckard Bruce MoxonDavid Dale