nov½ ibm storwize v7000 unified block-file storage system
TRANSCRIPT
© 2011 IBM Corporation
Nový IBM Storwize V7000 Unified block-file storage systemSimon PodepřelStorage [email protected]
© 2011 IBM Corporation2
Unified Storage Launch
Agenda
§ V7000 Unified Overview
§ IBM Active Cloud Engine for V7kU
© 2011 IBM Corporation
Overview V7000 Unified
© 2011 IBM Corporation4
Unified Storage Launch
Just about one year after first GA, we will be delivering the next major step forward in the evolution of IBM Storage
© 2011 IBM Corporation5
Unified Storage Launch
IBM Active Cloud
Engine™
FileSupport
Easy Tier
RAID
Innovative GUI
SAN
Virtualization
Snapshots
Technology Integration Continues
ClusteredSystems
V7000 Unified
V7000 Unified
…IBM brings you the IBM Storwize V7000 Unified Storage System
IBM Storwize V7000 Unified
© 2011 IBM Corporation6
Unified Storage Launch
Introducing…
§ IBM Storwize V7000 Unified
– A unified storage system with tightly integrated management for both block and file capabilities
– Support for NFS/CIFS/FTP/HTTPS/SCP file protocols in addition to existing block functions (FCP and iSCSI)
– File replication and file level snapshots for business continuity and disaster recovery in addition to existing block functions
6
V7000 Unified
V7000 Unified
© 2011 IBM Corporation7
Unified Storage Launch
Storwize V7000 Unified System Components
§ What is the Storwize V7000 Unified (V7kU)§ Traditional Storwize V7000 (V7k)§ Up to 9 expansion enclosures§ 240 disk drives maximum§ All V7k supported back-end storage
subsystems§ File Modules§ Quantity of 2§ Minimum V7kU configuration requires 6U
ü Storwize V7000 Unified General Availability November 30, 2011
© 2011 IBM Corporation8
Unified Storage Launch
8
Storwize V7000 Unified System Components Cont.
üThe V7kU Includes all V7k v6.3 updates§ Greater flexibility for remote mirror
– Replicate between V7k and almost any other storage subsystem via SVC
– Balance remote data currency with network bandwidth cost to better meet application requirements
§ Additional drive options – 200GB and 400GB SFF SSDs
• More SSD options at lower cost – 3TB 7.2K RPM LFF HDD
• 50% greater maximum system capacity
§ Enhanced Tivoli Storage FlashCopy Manager support–VMware vSphere 4 and vSphere 5–DB2, Oracle, and SAP on HP-UX
ü Storwize V7000 General Availability November 18, 2011
© 2011 IBM Corporation9
Unified Storage Launch
§ Modular, midrange disk storage that grows as your needs grow– Unified model scales to 240 HDDs (ten 24 bay control enclosures)– Base model scales to 480 HDDs (twenty 24 bay control enclosures)
§ Support for 10Gbps iSCSI server attach– Up to 7x improvement in iSCSI throughput vs. 1Gbps iSCSI– Upgradable from existing Storwize V7000 systems
§ Enterprise class capabilities in a midrange offering– Virtualization, thin provisioning, FlashCopy, Easy Tier all built in– Sophisticated local and remote mirroring
§ High Performance in a Midrange Disk System– Up to almost 1M IOPS– Up to 82,000 IOPS for “database-like” 70/30 R/W workload
§ Easy to set up and manage– Innovative, intuitive GUI eliminates complexity– Non-disruptive data migration included, unique in a product of this class
§ Ushering in a new era in storage efficiency– Save up to 75% of space using space efficient FlashCopy– Increase disk utilization up to 30%
§ Investment protection– Virtualize external storage arrays and extend asset life
§ IBM Active Cloud EngineTM with V7000 Unified– Cloud Storage is an attractive means of delivering storage services
while saving both time and cost
Expand EasilyExpand Easily
Start SmallStart Small
Benefits to You - IBM Storwize V7000 Unified
9
© 2011 IBM Corporation10
Unified Storage Launch
Clients can Scale UP and/or Scale OUT as business needs demand
IBM Storwize V7000 Clustered Systems
§ SCALE UP to add capacity
§ SCALE OUT to add performance§ Cluster two systems to provide smarter scalability
§ Buy only as much capability as you need, when you need it
§ Increase performance, connectivity and cache
§ Clustered system operates and is managed as a single system
Non-disruptive scalability vs. disruptive controller swaps
10
Note: IBM Storwize V7000 Unified does not currently support clustered systems. A maximum of 240 drives are currently supported.Note: IBM Storwize V7000 base model does support clustered systems with up to 480 drives.
© 2011 IBM Corporation11
Unified Storage Launch
§ 2.5” 7.2K Near-Line SAS Disk Drive– 1 TB
§ 240 HDDs per single system
§ *480 HDDs per dual clustered system
Lowest Cost
§ 3.5” 7.2K Near-Line SAS Disk Drives– 2 TB, 3 TB
§ 120 HDDs per single system
§ *240 HDDs per dual clustered system
Lowest Cost
§ 2.5” 10K SAS Disk Drives– 300 GB , 450 GB, 600 GB
§ 240 HDDs per single system
§ *480 HDDs per dual clustered system
Medium Performance
§ 2.5” Solid State Drives– 200 GB, 300 GB, 400 GB
§ 2.5” 15K SAS Disk Drives– 146 GB, 300 GB
§ 240 HDDs per single system
§ *480 HDDs per dual clustered system
High Performance
IBM Storwize V7000 Unified Disk Drive Choices for Clients
* IBM Storwize V7000 Unified does not currently support clustered systems.
IBM Storwize V7000 base model does support clustered systems.
© 2011 IBM Corporation12
Unified Storage Launch
12
IBM Storwize V7000 Unified - Virtualized Storage§ All IBM Storwize V7000 Unified storage is virtualized
– Enables rapid, flexible provisioning and simple configuration changes– Enables non disruptive movement of data among tiers of storage, including
Easy Tier– Enables data placement optimization to improve performance
§ Storwize V7000 Unified also virtualizes external Fibre Channel storage– Capacity from existing storage systems becomes part of Storwize V7000/U
system– Single user interface to manage all storage, regardless of vendor: Designed to
significantly improve productivity– Virtualized storage inherits all Storwize V7000 Unified rich function including
FlashCopy, Easy Tier, and thin provisioning– Helps improve existing storage utilization – Improve availability by practically eliminating storage-related causes of
application downtime– Migrate data from external storage to Storwize V7000 Unified storage or
keep external storage as part of Storwize V7000 Unified system long-term– Extends life and enhances value of existing storage assets– Supports storage systems from IBM, EMC, HP, 3PAR, Sun/Oracle,
Hitachi, NetApp, Fujitsu, Bull, Compellent, NEC, Pillar, and more
External Virtualization
© 2011 IBM Corporation13
Unified Storage Launch
IBM Storwize V7000 Unified Integrates Storage Administration
§ Integrates file and block applications in a single storage system
§ Adds supports for file access protocols -NFS, CIFS, FTP, HTTPS, SCP
§ Supports file replication and snapshots for business continuity
13
© 2011 IBM Corporation14
Unified Storage Launch
14
The V7kU File Modules
§ Additional hardware and software on top of the V7k
§ File Modules (FMs) provide file services§ CIFS, FTP, HTTP(S), NFS, and SCP
§ Software stack originates from the Scale Out NAS (SONAS) product§ Large system made of many racks of nodes and
storage§ Highly scalable clustered solution§ Roots in the Scale Out File Services (SoFS) project
© 2011 IBM Corporation15
Unified Storage Launch
15
A Glance at SONAS to Better Understand the V7kU
Management Node
The management node provides the user interface for configuring, administering and monitoring the SONAS system.
Interface Node
The interface node provides the connections to the customer’s IP network for file serving capabilities (CIFS, NFS, HTTPS, FTP).
Storage Node
The storage node provides the connection to the back-end storage
The SONAS system is comprised of 3 types of nodes or roles
SONAS R1.3 combines the management and interface roles into 1 node pair, yet allows for many more interface nodes – Highly scalable
The V7kU shrinks the SONAS system further by combining all 3 roles into a single node pair – 2 File Modules
© 2011 IBM Corporation16
Unified Storage Launch
16
V7kU Connections
§ 10 GbE NAS IO– Customer’s Switch
§ GbE GPFS Sync– Direct Cable Connections
§ GbE Management– Customer’s switch
§ 8Gb Fibre Channel– Direct Attach (No Switch)
§ SAS– 4 lanes at 6 Gbps per strand
(24 Gbps), 2 strands per SAS Chain (48 Gbps), 2 SAS chains (96 Gbps), Totaling 600 MBpsfull duplex
© 2011 IBM Corporation17
Unified Storage Launch
Requirements for customer infrastructure
§ Authentication server (choose one)– Windows Active Directory (with optional SFU or NIS)– LDAP (Lightweight Directory Access Protocol)– Samba PDC (optional with NIS)
§ Load Balancing/Name Resolution– DNS round-robin, each incoming request allocated to next available IP adress on a file
module
§ Time server for synchronization– NTP service required to synchronize file modules with authentication services
§ Network Connectivity– Ports: 4 x 1 GbE for File Modules, min. 2 x 1 GbE for V7000– 4 x IP adresses for File Modules and V7000 control canisters– Management: 1 x IP adress for Unified cluster and min. 1x IP adress for V7000 cluster – Optional 10GbE for file service (3x) or iSCSI attachment V7000 (2x)– Min 1x public IP adress per interface for file services (recommended: 2x)
§ Optional:
§ Backup server: choice of NDMP or TSM
§ TSM HSM
§ Antivirus scan engine
© 2011 IBM Corporation18
Unified Storage Launch
18
V7kU Environment
File Modules
Network Shared DiskViaFibreChannel
RemoteV7kU
TSM/HSM or NDMP over Ethernet only
*
*
Customer Provided ServicesAuthentication Server
Domain Name Server
Network Time Server (Optional)
V7kU Software delivered as a single IBM program product
All needed V7kU software components are packaged, integrated, tested, & pre-installed at the factory on V7kU hardware
© 2011 IBM Corporation19
Unified Storage Launch
19
V7kU Installation§ V7k USB key process has been extended to cover entire V7kU
§ Process flow:§ On Windows workstation enter IP addresses for V7000 and File Modules§ Plug USB key into V7k§ Wait for blinking light to stop§ Remove USB key
§ Then plug USB key into one of File Modules§ Wait for blue blinking lights to go off§ Remove USB key
§ Return USB key to Windows workstation to confirm results
§ USB key configures network addressing between V7k & V7kU§ Allows them to refer to and address each other
§ USB key also carries credential (ssh key) from V7k to File Module§ Enables secure communications between the two§ Utilizes the NasUser role
© 2011 IBM Corporation20
Unified Storage Launch
20
File System Volume Management§ Commands provided to configure volumes for file system use§ mkdisk, mkfs (for GPFS)
§ These commands will perform multiple steps automatically § Configure volume on V7k (mkvdisk)§ Create NSD in GPFS§ Add NSD to GPFS file system
§ File system volumes are marked with the file system to which they belong
§ Known to V7k layer and reported in Volumes panels of the GUI
§ Volumes that are in a file system have a restricted command set§ According to those functions that are supported and work as needed§ No FlashCopy, Metro Mirror or Global Mirror§ Cannot be thin provisioned§ Cannot use volume mirroring§ No migration between storage pools or to image mode§ Cannot be resized
© 2011 IBM Corporation21
Unified Storage Launch
21
Management Integration§ V7kU presents a single management interface to cover all
aspects of the system§ Graphical User Interface (GUI) hosted on File Module provides
access to all features§ Command Line Interface (CLI) hosted on File Module forwards
requests to File or Block layers as needed
© 2011 IBM Corporation22
Unified Storage Launch
22
Management Access
V7K GUI elements integrated into V7kU GUI
V7k commands generated in V7kU then forwarded to the V7k
üAll management access is via the V7kU
© 2011 IBM Corporation23
Unified Storage Launch
23
The Graphical User Interface (GUI)
© 2011 IBM Corporation
IBM Active Cloud engine for V7kU
© 2011 IBM Corporation25
Unified Storage Launch
IBM Active Cloud Engine™ for Storwize V7000 Unified
§ Policy-based File Administration – Optimize performance by placing files onto
the most appropriate storage pool – Lower storage costs over time by moving
inactive files to archive disk or tape, and deleting unwanted, expired files
– Improve administrator productivity by automating file management
– Improve data protection with policy-based file backup
Files
Migrate inactive data to tape, tape lib, or de-duplication device via TSM Server
Storage Pools
© 2011 IBM Corporation26
Unified Storage Launch
26
IBM General Parallel File System§ IBM General Parallel File System (GPFS)§ Clustered file system across multiple hardware nodes§ Basis of the SONAS technology which the V7kU leverages§ In continuous development since 1995§ Developed for High Performance Computing (HPC)§ Has run on 3900 nodes with 4 PBs of storage
§ GPFS provides§ Concurrent high-speed file access to applications executing on
multiple nodes of clusters§ Single flat file system
§ V7kU in the simplest sense is a two node SONAS cluster with a V7k providing disks
© 2011 IBM Corporation27
Unified Storage Launch
27
Network Shared Disks§ GPFS file systems span across multiple physical disks§ These disks are called Network Shared Disks (NSDs)
§ Storage pools are logical collections of disks§ Each storage pool contains disks with similar performance characteristics
§ V7kU has a V7k providing “disks”§ Both V7k internal and virtualized external storage
§ The NSDs that are visible to GPFS are V7k Vdisks§ Usually made up of multiple disks
© 2011 IBM Corporation28
Unified Storage Launch
28
§ Perform complex operations such as moving, mirroring, or deleting files; providing storage virtualization and a single management context.
§ Partition file system storage for considerations such as:§ Improved price-performance by matching the cost of
storage to the value of the data§ Improved performance by:§ Reducing the contention for premium storage§ Reducing the impact of slower devices§ Allowing you to retrieve archived data when needed
§ Improved reliability by providing for:§ Replication based on need§ Better failure containment§ Creation of new storage pools as needed
§ Two types of storage pools:§ Internal Storage Pools
§ Max of 8 per file system§ 1 required as the system storage pool§ 7 for user pools
§ External Storage Pools§ Intended for use as near-line storage
Fastest disk pool in the file system is Pool 1. In a file system with tiered pools, this is SAS pool.
Pool 2 is a customer named “user pool”
If HSM is used, Pool 3 is the external pool, which is managed by the external TSM Server
V7kU Storage Pools
SAS
NS
D
Physical or Virtual
Tape
TSM Server Storage
SAS
NS
D
SA
SN
SD
SA
SN
SD
POOL1
POOL2
POOL3
FILE SYSTEM
EXTERNAL POOL
NL
SA
S
NS
D
NL
SA
S
NS
DN
L S
AS
N
SD
NL
SA
S
NS
D
NL
SA
S
NS
D
NL
SA
S
NS
D
© 2011 IBM Corporation29
Unified Storage Launch
… … …>
….. ….. ...
scaleout
scaleout
Create and write files/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
IBM Scale Out NAS/V7kU
Policy EngineGlobal Namespace
Note: all three files, in same directory,
but each allocated to different physical
storage pool
Data striped across all disks in storage
pool.High performance, auto-tuning, auto-
load balancing
Tier 1: SAS drives Tier 2: 1TB SATA drives Tier 3: 2TB SATA drives
Interface nodes
Interface nodes
Interface nodes
Storage nodes
Storage nodes >Storage
nodes
Logical Physical
Workload auto-balanced across all
interface nodes
© 2011 IBM Corporation30
Unified Storage Launch
Write file – one user – scale out more disk drives
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
Interface node
Global Namespace
Interface node
Policy Engine
Tier 1 Tier 3
Interface node
IBM Scale Out NAS/V7kU
Storage nodes
Storage nodes >Storage
nodes ….. ….. ... scaleout
… … …> scaleout
Write performance is aggregate of all disk drives in storage pool
More disks and storage pods provides more performance
Logical Physical
© 2011 IBM Corporation31
Unified Storage Launch
Read files – one user
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
Global NamespacePolicy Engine
Tier 1 Tier 2 Tier 3
IBM Scale Out NAS /V7kU
… … …>
….. ….. ...
scaleout
scaleout
Interface nodes
Interface nodes
Interface nodes
Storage nodes
Storage nodes >Storage
nodes
Parallel read of file, performance is
aggregate all disk drives in that storage
pool.
Logical Physical
© 2011 IBM Corporation32
Unified Storage Launch
Read files – multiple users – in parallel
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_design.ppt
/home/appl/data/web/unstructured_big_video.mpg
Global NamespacePolicy Engine
Tier 1 Tier 2 Tier 3
IBM Scale Out NAS/V7kU
… … …>
….. ….. ...
scaleout
scaleout
Interface nodes
Interface nodes
Interface nodes
Storage nodes
Storage nodes >Storage
nodes
Parallel streaming reads of multiple files
to multiple users
Logical Physical
© 2011 IBM Corporation33
Unified Storage Launch
Read files – one user – scale out more disk drives
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
Global NamespacePolicy Engine
Tier 1 Tier 3
IBM Scale Out NAS/V7kU
… … …>
….. ….. ...
scaleout
scaleout
Interface nodes
Interface nodes
Interface nodes
Storage nodes
Storage nodes >Storage
nodes
Logical Physical
Read performance is aggregateof all disk drives in storage pool.
More disks and storage pods provides more performance
© 2011 IBM Corporation34
Unified Storage Launch
… …
… …
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
Push asynchronous updates to remote site
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
IBM Scale Out NAS/V7kU
Global NamespacePolicy Engine
Tier 1: SAS drive Tier 2: SATA drives
Storage node
Storage node
Remote Scale Out NAS
Interface node
2. Scan, hash compare
Interface node
hash
hash
Hash determines incremental
changes to send
1. Read policies
3. Parallel transmit to remote site(s)
Remote Scale Out NAS
© 2011 IBM Corporation35
Unified Storage Launch
Scan engine reads Storage Policies
• Automated Tiered Storage policy statement examples:
• Migration policies, evaluated periodically
• rule 'cleangold' migrate from pool ‘TIER1' threshold (90,70) to pool ‘TIER2‘
• rule 'hsm' migrate from pool ‘TIER3' threshold(90,85) weight(current_timestamp – access_time) to pool ‘HSM' where file_size > 1024kb
• rule 'cleansilver' when day_of_week()=Monday migrate from pool 'silver' to pool 'bronze' where access_age > 30 days
• Deletion policies, evaluated periodically
• rule 'purgebronze' when day_of_month()=1 delete from pool 'bronze' where access_age>365 days
• There are also Policies for:• File based Backup/Archive• Restore/Retrieve• Many more options…..
© 2011 IBM Corporation36
Unified Storage Launch
36
Storage nodesStorage nodesStorage nodes Storage nodesStorage nodesStorage nodes
Scan Engine
Interface nodesInterface node
Interface node
Interface node
Global Namespace
Some or all nodes (both storage and
interface) can participate in parallel
scan engine
ScaleOut
Metadata scan
Scan > 10 million files/minute per node
/home
/appl
/data
/web
Tier 1 Tier 2 Tier 3
Policy Engine
•Scan Engine reads internal V7kU file system metadata•Does not need to read the file or directory tree•All nodes can participate in scan of file system
1. Start scan
2. Read policies
3. Parallel Scan 4. Return results of scan
IBM Scale Out NAS/V7kU
© 2011 IBM Corporation37
Unified Storage Launch
37
Storage nodesStorage nodesStorage nodesStorage nodes Storage nodesStorage nodes
Data Movement
Interface nodesInterface
nodeInterface
nodeInterface
node
Global Namespace
6. All nodes (both storage and
interface) can participate in parallel
data movement
ScaleOut
/home
/appl
/data
/web
Tier 1 Tier 2 Tier 3
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
Policy Engine
Note: all three files, no change to logical
directoryIBM Scale Out NAS/V7kU
5. Carry out policy based on results of scan
© 2011 IBM Corporation38
Unified Storage Launch
Backup acceleration using Tivoli Storage Manager
§ IBM V7kU has special exploitation for high-speed backup by Tivoli Storage Manager (TSM)– V7kU scan engine quickly identify incremental changes in the file system, then passes the list of
changed files directly to TSM– Avoids need to walk the directory trees to identify changed files – Reduces backup window to the time needed to copy changes to external TSM storage
§ Parallel data movement using multiple interface nodes => to TSM Server
Tivoli StorageManager
backup server
Scan engine results
IBM Scale Out NAS
•Any TSM-supported device including:
•ProtectTier de-dup•Virtual Tape Library•Tape
Data
© 2011 IBM Corporation39
Unified Storage Launch
… …
… …
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
Backup / Restore using Tivoli Storage Manager
/home
/appl
/data
/web
/home/appl/data/web/important_big_spreadsheet.xls
/home/appl/data/web/big_architecture_drawing.ppt
/home/appl/data/web/unstructured_big_video.mpg
IBM Scale Out NAS/V7kU
Global NamespacePolicy Engine
Tier 1: SAS drive Tier 2: SATA drives
Storage node
Storage node
Tivoli StorageManager
Interface node
1. Scan to identify changed files
Interface node
3. Parallel data movement using multiple interface nodes to TSM
server - backup to Tape, Virtual Tape Lib, or De-duplication
2. Pass list of changedfiles to TSM
© 2011 IBM Corporation40
Unified Storage Launch
Hierarchical Storage Management to tape using TSM
§ IBM V7kU provides policy-driven Hierarchical Storage Management to tape– Scan engine used to identify files needing to be migrated to tape– Passes list of required data blocks to be migrated directly to Tivoli Storage Manager / Hierarchical Storage
Manager (TSM/HSM)– Stub file is left on disk – auto-recall if accessed
§ Store petabytes of data, on terabytes of disk
Migrate inactivedata to tape, tape lib, or de-duplication device
TSM/HSMServer
IBM Scale Out NAS
Scan engine results
Data
© 2011 IBM Corporation41
Unified Storage Launch
The Power of One – IBM Storwize V7000 Unified
One system
One management framework
One GUI
One unified block and file solution
41
§ Storwize V7000 Unified supports a 6U block and file solution managed from one GUI§ IBM Active Cloud EngineTM
§ Further enhanced GUI § Enterprise-class capability§ High performance in a midrange disk system§ Integrated non disruptive migration function§ Integrated no-charge Easy Tier function§ Integrated no-charge thin provisioning function§ Similar benefits to SVC when virtualizing external storage
ü Storwize V7000 Unified General Availability November 30, 2011
© 2011 IBM Corporation42
Unified Storage Launch
42
Thank You!
Thank YouFor more information,
please visitibm.com/storage/storwizev7000
© 2011 IBM Corporation43
Unified Storage Launch