virtualisation, tiered storage, space management … · virtualisation as migration tool no caching...

IBM System Storage

© 2007 IBM Corporation

Virtualisation, tiered storage, space managementHow does it all fit together?

Dr Axel KoesterSenior Consultant, Enterprise [email protected]

Luxembourg Storage Seminar, 09.05.2007

2

IBM System Storage

[email protected] © 2007 IBM Corporation

50505050 Years of Disk Storage: 1956 First Disk System

IBM System 350 + RAMAC 305 Disk IBM System 350 + RAMAC 305 Disk StorageStorage

5 MB, 50.000 US$5 MB, 50.000 US$

RAMAC: Random Access Method for Accounting and Control

3

IBM System Storage


Magnetic Drum 13“diam,42 ft. 5MB =

940 pages single-spaced5MB =

2000 ft. tape (200 char/“)5MB =

60K 80-column punched cards5MB =

RAMAC capacity compared

Average 500ms, max. 750msAccess time

Max. 100 bits/inch, min. 55 bits/inchRecording density

100, with 500 8bit-charactersTracks/disk-surface

61cmDiameter

50Number of Disks

5MB ("Mega-Characters")Capacity

RAMAC Storage: For Accounting and Control – only!

4

IBM System Storage


33 Years of tiered Storage: Speed versus Capacity

1970

IBM 3420

IBM 3850 Mass Storage System (1974)

472 Billion472 BillionCharactersCharacters

IBM 3850 Cartridges (19,5m)with Staging-Disk IBM 3336

IBM 3420 Tape

5

IBM System Storage


Information Management Software since ~20 years

� Data Facility Systems Managed Storage (DFSMS) since 1988

� Tivoli Storage Manager (TSM / ADSM) since 1993

� Content management & discovery software ContentMgr, Commonstore, Filenet, Productivity Center, …

6

IBM System Storage


The Landscape Today

VirtualisationVirtualisation

Tiered StorageTiered Storage

Space ManagementSpace ManagementServer Virtualisation

SAN Virtualisation - SVC

File Virtualisation - GPFS

Tape Virtualisation

Tivoli Storage Manager

HSM Space Manager

Productivity Center

DFSMS

FC / SATA / Tape


Policy-based Migration

7

IBM System Storage


Goals of Virtualization

� Server Virtualization:– Efficient usage of resources

– Less hardware / floorspace

– Still: Administrative effort per partition/OS

� Storage Virtualization:– Efficient usage of resources

– (Somewhat) less hardware

– Reduce admin effort: Manage pools, not racks

SystemP5

SystemZ9

~95%

8

IBM System Storage


Goals of Tiered Storage

1. Provide storage at the appropriate cost level per application

2. Provide recovery capabilities as required per application

� Enablers for tiered storage:– Online application migration capabilities (SVC)

– Pool management

– Resource usage monitoring (TPC)

9

IBM System Storage


Goals of Space Management

1. Minimize highest storage tier costs

2. Automate placement of application data, reduce admin effort

3. Optimize application restore capabilities

� Enablers for space management:– Policy-based automation (HSM, FS)

– Transparent resource usage (TPC)

10

IBM System Storage


Space Management

11

IBM System Storage


Space Management with Tivoli HSM

� For Windows, Unix, or Linux

� Inactive data is transparently migrated by process rules, while remaining accessible

12

IBM System Storage


Tivoli Hierarchical Storage Management

85% fill grade: Delete

50% fill grade: Pre-migrate

Migration rule (s)

for inactive data

Disk cache Tape

»

Recall rules & quotas

TSM Repository

13

IBM System Storage


Fast Application Restore with Tivoli HSM

Logical disk size unchanged but physical disk size reduced to size of one disk cluster

After a disaster, only 4kB have to be restored to make this application startable

14

IBM System Storage


Elements required with Tivoli HSM

� TSM server (the one used for standard backup/restore/archive)

� TSM client software ( " )

� Enable client-side HSMMigrate

Recall

TSM Client HSM

TSM Server

15

IBM System Storage


Resource Management

16

IBM System Storage


Administrator's Swiss Army Knife

� One application for:

– Data and storage management (cross-vendor)

– Performance statistics

– Analysis, reporting, quota violations

– Prediction

– Avoiding out-of-space conditions (e.g. trigger provisioning)

– Error detection & correlation

– Topology browsing

– Chargeback/billing …

17

IBM System Storage


� Storage Resource Management Tool

� Relates the application view with the system view on data

� Correlation Engine

� Storage Esperanto: SMI-S / GS3

TotalStorage Productivity Center TPC

�

Applikation? User? Share? LUN? WWN? Path? Container?

18

IBM System Storage


TotalStorage Productivity Center TPC

IBM TotalStorage Productivity Center

Standard Edition

Limited Edition (limit = 2TB)

Productivity Center For Data

Productivity Center For Fabric

Productivity Center For Disk

Productivity Center For Replication

Limited Edition ships for free with every IBM storage Elements can be ordered separately

19

IBM System Storage


20

IBM System Storage


21

IBM System Storage


Resource Virtualisation

22

IBM System Storage


Block-based Storage Virtualisation

� Benefits:– Homogeneous administration

– Migrate while online

– Increased storage fill grade

– Balanced performance

– Isolate non-interoperable systems

– Less specialized staff required

– Heterogeneous distant replication

– Substantial software licenses economies

SANVolume Controller

SAN

23

IBM System Storage


Why did we chose in-band Storage Virtualisation?

Host

Zone

Storage

Zone Storage

Zone

Host

Zone

Host

Zone

Storage

Zone

In-band Appliance Array Based Intelligent Switch

SAN Volume Controller HDS TagmaStore EMC Invista

Control

Path

MetaDataFast Path

Intelligent

Blades

24

IBM System Storage


Why did we chose in-band Storage Virtualisation?

Host

Zone

Storage

Zone Storage

Zone

Host

Zone

Host

Zone

Storage

Zone

In-band Appliance Array Based Intelligent Switch

SAN Volume Controller HDS TagmaStore EMC Invista

Control

Path

MetaDataFast Path

Intelligent

Blades

No storage poolNo storage poolconcept. No stripingconcept. No striping

ImageImage --mode mode pass throughpass throughaccess only.access only.

VirtualisationVirtualisationas migration toolas migration tool

No cachingNo cachingconcept. Reliesconcept. Relieson subsystemon subsystemfunctions forfunctions for

Replication etcReplication etc

ExpensiveExpensiveswitchswitch

hardwarehardware

PerformancePerformance ……??SPC benchmark?SPC benchmark?

25

IBM System Storage


SAN Volume Controller: #1 in official SPC benchmarks

� SPC = official benchmark for storage, compare to "TPC" for servers

� SPC-1™ measures random access performance in database environments whereas SPC-2™ measures sequential throughput

� SPC-2 focuses on file serving in a real-word environment– Not the ideal 100%-cache-hit peak number

– Benefits of read prefetch mechanism

– Benefits of sequential IO detection

�All numbers circa +20% for current SVC 4.1

To-be-announced SVC 4.2 is expected to exceed 6000 MB/s in SPC-2 benchmark.

http://www.storageperformance.org

26

IBM System Storage


File Virtualisation

27

IBM System Storage


IBM Storage Tank Technology

� Goal: Let the system assign resources (DFSMS-like)

1. Define classes of IT projects with policies & rules

2. Associate new projects with a class of policies

3. See how everything finds its most-suitable place by itself, over time, without human interaction

28

IBM System Storage


IBM Storage Tank Technology

� Examples of policy-driven data placement:

Storage Pool

Storage Pool

Storage Pool

Storage Tank Policies

Place new files on fast reliable storage, migrate as they age

Place temp files on non-mirrored non-backed storage

Keep related files together�

�

�

29

IBM System Storage


IBM Storage Tank Technology now in GPFS 3.1

1. Policy driven data movement between all storage classes including full box migration.

2. Single point management across all storage classes including snapshot.

3. Isolation of storage configuration and effective application used storage.

4. Scalability from ThinkPad to BlueGene.

5. SAP certified with DB2 and Oracle Databases.

GPFS 2.x: thousands of satisfied customers worldwide

GPFS 3.1 + Policies

30

IBM System Storage


How they fit together:

VirtualisationVirtualisation

Tiered StorageTiered Storage

Space ManagementSpace ManagementServer Virtualisation

SAN Virtualisation - SVC

File Virtualisation - GPFS

Tape Virtualisation


HSM Space Manager

Productivity Center

DFSMS

FC / SATA / Tape


Policy-based Migration

31

IBM System Storage


DisclaimersNo part of this document may be reproduced or trans mitted in any form without written permission from I BM Corporation.

Product data has been reviewed for accuracy as of t he date of initial publication. Product data is su bject to change without notice. This information c ould include technical inaccuracies or typographical err ors. IBM may make improvements and/or changes in th e product(s) and/or program(s) at any time without notice. Any statements regarding IBM's fut ure direction and intent are subject to change or wi thdrawal without notice, and represent goals and objectives only.

The performance data contained herein was obtained in a controlled, isolated environment. Actual resu lts that may be obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situ ation, there is no guarantee that the same or simil ar results will be obtained elsewhere. Customer exper iences described herein are based upon information and opinions provided by the customer. The same results may not be obtained by every user.

Reference in this document to IBM products, program s, or services does not imply that IBM intends to m ake such products, programs or services available i n all countries in which IBM operates or does busines s. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functio nally equivalent program, that does not infringe IB M's intellectual property rights, may be used instead. It is the user's responsibility to evalua te and verify the operation on any non-IBM product, program or service.

THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS O R IMPLIED. IBM EXPRESSLYDISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNES S FOR A PARTICULAR PURPOSE OR INFRINGEMENT. IBM sh all have no responsibilityto update this information. IBM products are warra nted according to the terms and conditions of the a greements (e.g. IBM Customer Agreement, Statement of Limited Warranty, International Progra m License Agreement, etc.) under which they are pro vided. IBM is not responsible for the performance or interoperability of any non-IBM prod ucts discussed herein.

Information concerning non-IBM products was obtaine d from the suppliers of those products, their publi shed announcements or other publicly available sources. IBM has not tested those products in conn ection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Question s on the capabilities of non-IBM products should b e addressed to the suppliers of those products.

The providing of the information contained herein i s not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inqu iries regarding patent or copyright licenses should be ma de, in writing, to:

IBM Director of LicensingIBM CorporationNorth Castle DriveArmonk, NY 10504-1785USA

32

IBM System Storage


TrademarksThe following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both.

Linear Tape-Open, LTO, LTO Logo, Ultrium logo, Ultrium 2 Logo and Ultrium 3 logo are trademarks in the United States and other countries of Certance, Hewlett-Packard, and IBM.

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States and/or other countries.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States and/or other countries.

Intel, Intel Inside (logos), MMX and Pentium are trademarks of Intel Corporation in the United States and/or other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a trademark of Linus Torvalds in the United States and other countries.

Other company, product, or service names may be trademarks or service marks of others.

�ServerProven�System z9�System p5�System Storage�Tivoli�TotalStorage�TotalStorage Proven�TPF�Virtualization Engine�X-Architecture�xSeries�z/OS�z/VM�zSeries

�ON (button device)�On demand business�OnForever�OpenPower�OS/390�OS/400�Parallel Sysplex�POWER�POWER5�Predictive Failure Analysis�pSeries�S/390�Seascape

�eServer�FICON�FlashCopy�GDPS�Geographically Dispersed Parallel Sysplex

�HiperSockets�i5/OS�IBM�IBM eServer�IBM logo�iSeries�Lotus

�AIX�AIX 5L�BladeCenter�Chipkill�DB2�DB2 Universal Database�DFSMSdss�DFSMShsm�DFSMSrmm�Domino�e-business logo�Enterprise Storage Server�ESCON

33

IBM System Storage


virtualisation, tiered storage, space management … · virtualisation as migration tool no caching...

Documents