spectrum virtualize copy services v2

Upload: kiran-kumar

Post on 01-Mar-2018

271 views

Category:

Documents


6 download

TRANSCRIPT

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    1/63

    IBM North America Technical Leadership Team

    2016 IBM Corporation

    Byron Grossnickle: Consulting I/T Specialist - Virtualization

    Bill Wiegand: Consulting I/T Specialist - Virtualization

    Accelerate with IBM Storage:Spectrum Virtualize Copy Services

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    2/63

    Accelerate with IBM Storage

    2016 IBM Corporation2

    Agenda

    Volume Mirroring

    FlashCopy

    Metro Mirror

    Global Mirror

    Global Mirror with Change Volumes

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    3/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Volume Mirroring

    Volume mirroring allows creation of one Volume with twocopies of MDisk extents

    There are not 2 volumes with the same data on them

    Copies can be in different storage pools

    In SVC that can mean across 2 storage frames

    Copies can be of completely different structures

    Image, striped, sequential, space-efficient, compressed

    Minimal impact to volume availability if one set of MDisks goes offline

    Automatic incremental resync

    Volume mirroring sits below the upper cache and copyservices

    FlashCopy, Metro Mirror, Global Mirror have no awareness that aVolume is mirrored

    Anything that can be done today with a volume can be done with a mirrored volume

    including migration, expand/shrink, etc. In version 7.3 mirroring can take advantage of the lower cache

    Volume mirroring can be used for:

    Data Protection

    Data Transformation

    3

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    4/63

    Accelerate with IBM Storage

    2016 IBM Corporation5/19/20164

    Copy Rate On Initial Sync/Re-Sync

    Mirror Rate Setting Data Copied/s

    0 0

    1-10 128 KB

    11-20 256 KB

    21-30 512 KB

    31-40 1 MB

    41-50 2 MB Default

    51-60 4 MB

    61-70 8 MB

    71-80 16 MB

    81-90 32 MB

    91-100 64 MB

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    5/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    FLASHCOPY

    Spectrum Virtualize

    5

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    6/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    6

    IBM Storwize - FlashCopy

    Cascaded FlashCopy:

    Copy the copies

    Up to 256targets

    Source

    vdisk

    FlashCopy

    Relationships

    Start incremental FlashCopy

    Data copied as normal

    Some data changed by apps

    Start incremental FlashCopy

    Only changed data copied

    by background copy

    Later

    Disk0Source

    Map 1 Map 2

    Map 4

    Disk1FlashCopy

    target of Disk0

    Disk2FlashCopy

    target of Disk1

    Disk4FlashCopytarget of Disk3

    Disk3FlashCopy

    target of Disk1

    Incremental FlashCopy:

    Volume level

    point-in-time copy

    FlashCopy:Volume level

    point-in-time copy

    with any mix of thin

    and fully-allocated

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    7/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    FlashCopy Overview

    Source volume may be spread across multiple disk subsystems or pools

    Target volume may be to one or more disk subsystems, dif ferent thansource

    Create up to 256 copies of a source volume

    Because we use linked lists the source volume is only impacted by 1 copy on writeoperation regardless of the number of copies

    Copy is accessible almost immediately

    Copy may be updated independently o f the source

    Background Copy Rate establishes copy rate goal

    Value of 0 has a "No Copy" effect

    Data rate 128 KB/s to 64 MB/s per Volume

    Support for 128 Consis tency Groups

    Support for 4096 mappings

    Invoked via Web User Interface, CLI or script

    With 7.5 code 2 GB of FlashCopy bitmap space

    Enough to FlashCopy 4 PB using a 256 KB grain size

    Prior to 7.5 enough to copy 1 PB using a 256 KB grain size

    7

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    8/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Types of FlashCopy

    8

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    9/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Snapshot

    This is also known as a FlashCopy no copy

    Only stores changed grains from the original

    A grain is 64 or 256 kb in size

    Default is 256 kb

    64 kb grain size uses 4X the bitmap space but can save physical disk space

    Background copy rate will be set to 0 Raising the background copy rate will produce a full copy

    Will generally always show copying in the status

    9

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    10/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Clone

    Produces a full, standalone copy of the original

    The target can be used for read/write immediately

    The Background Copy Rate determines the speed of the

    background copy

    Default of 50 (2 MB/s)

    Relationship is automatically deleted once the copy isfinished

    10

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    11/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Backup (aka Incremental FlashCopy)

    Produces a full copy of the original

    The target can be used for read/write immediately

    Tracks changes from the original

    When started again, only transfers the changes to update the full copy to the new point

    in time of the original

    The Background Copy Rate determines the speed of the

    background copy

    Default of 50 (2 MB/s)

    Relationship is maintained once copy is finished

    11

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    12/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Automated FlashCopy by Right Click

    Automatically creates a target of the same type as the

    original

    Puts the copy in the same pool as original

    12

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    13/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Advanced FlashCopy

    Allows you to use existing target volumes OR create targetvolumes of the type you designate

    Allows you to designate the target pool ( if you choose to

    create them)

    13

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    14/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Background Copy Rate vs Clean Rate

    Background Copy Rate The rate at which data is copied to the

    target when the background copy rate is > 0 Default is 50 (or 2 MB/s) for non-snapshot copies and 0 for snapshots

    A FlashCopy nocopy can be changed to a full copy by raising the copyrate to something > 0

    Clean Rate The rate at which data is copied between copies ina linked list when the clean rate is > 0 and the background copy

    rate = 0 Default is 0 for snapshots and 50 (or 2 MB/s) for non-snapshot copies

    If clean rate is > 0, each target gets grains that have been changed fromthe original to maintain it's point in time. This, in turn, means that in amultiple copy situation, each target may contain many of the same grainsas other targets Eliminates stop time

    If clean rate = 0, each target only gets grains that are unique to it's copythat no other copy has. This saves space, but can extend the amount oftime that it takes to stop a FlashCopy Saves space

    14

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    15/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Background/Clean Copy Rate

    15

    Copy rate setting Data copied/s 256 KB grains/s 64 KB grains/s110 128 KB 0.5 2

    1120 256 KB 1 4

    2130 512 KB 2 8

    3140 1 MB 4 16

    4150 2 MB 8 32

    5160 4 MB 16 64

    6170 8 MB 32 128

    7180 16 MB 64 256

    8190 32 MB 128 512

    91100 64 MB 256 1024

    101-110 128 MB *By RPQ

    111-120 256 MB *By RPQ

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    16/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    FlashCopy Overview 1

    Multiple targets are arranged in alinked list

    Most recently started mapping is at thehead and dependent on source

    Targets started earlier are dependent onnewer target mappings Only dependent until fully copied

    Write to source causes wri te tonewest target in linked list

    Older targets get their data from newertarget for unsplit grains

    Write to target causes write to nextolder target in linked list

    Assumes there is still a dependency onthat target

    Example assumes clean rate of 0 onsnapshots

    Use the lsfcmapdependantmapscommand to figure out wheredependencies exist

    16

    Source

    IncrFC-1

    (latest)

    Snap-3

    Snap-2

    Snap-1

    (oldest)

    Depends upon

    Depends upon

    Depends upon

    Progress = 100%

    Progress < 100%

    Progress < 100%

    Progress < 100%

    Depends upon

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    17/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    FlashCopy Overview 2

    17

    Source

    Snap-1(latest)

    IncrFC-1

    Snap-3

    Snap-2

    (oldest)

    No Dependency

    Depends upon

    Depends upon

    Progress < 100%

    Progress = 100%

    Progress < 100%

    Progress < 100%

    Depends upon

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    18/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    FlashCopy Overview 3

    It is important to note

    that when using GMCVin combination with

    FlashCopy, the best

    practice is to stop

    GMCV, start your FC

    and then restart GMCV This ensures that the

    GMCV relationship is at

    the top of the dependency

    tree and will stop and start

    freely with the cycling

    mode.

    18

    Source

    IncrFC-1

    (latest)

    Snap-1

    Snap-3

    Snap-2

    (oldest)

    Depends upon

    Depends upon

    Depends upon

    Progress < 100%

    Progress < 100%

    Progress < 100%

    Progress = 100%

    No Dependency

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    19/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Day1 - FlashCopy #1 w/clean rate = 50

    19

    A l t ith IBM St

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    20/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Day 2 - FlashCopy Mapping #2 w/cleanrate = 50

    20

    After starting the FlashCopy #2 mapping change the block B to B

    A l t ith IBM St

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    21/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Day 3 - FlashCopy Mapping #3 w/cleanrate = 50

    21

    After starting the FlashCopy #3 mapping change the block C to C

    A l t ith IBM St

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    22/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Starting FlashCopy Mapping 1-3 w/cleanrate = 0

    22

    A l t ith IBM St

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    23/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Single point for copy services

    Asynchronous remote copy/Global Mirror

    Synchronous remote copy/Metro Mirror

    Compatible between all members of theStorwize family

    Fibre Channel and/or IP Replication

    Mirror ing types can be used in anycombination

    Use to meet business needs

    Disaster recovery up to 25000KM

    Business Continuance up to 300KM

    Works with native and externallyvirtualized storage

    Network Protocol Flexibility

    Environment Flexibility

    StorageNetwork

    Node

    Managed Disks

    Virtual LUNsVirtual LUNsVirtual LUNsVirtual LUNs

    Node Node Node Node NodeNode Node

    StorageNetwork

    Node

    Managed Disks

    Virtual LUNsVirtual LUNsVirtual LUNsVirtual LUNs

    Node Node Node Node NodeNode Node

    Single Platform for Remote Copy Services

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    24/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    REMOTE COPY

    Spectrum Virtualize

    24

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    25/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Spectrum Virtualize Metro Mirror Function

    Metropolitan distance synchronous remote mirroring function Up to 300km between sites for business continui ty

    As with any synchronous remote replication, performance requirements may limit usable distance

    Host I/O completed only when data stored at both locations

    Unless write rates are low, not a good candidate for IP based replication

    Important to keep subsystem performance similar

    Designed to maintain fully synchronized copies at both sites

    Once initial copy has completed During resync data is not consistent; use a point-in-time copy

    All mirror ing types/transports del ivered as single feature

    Offers great implementation flexibility

    Operates between members of the Storwize Family at each site

    Local and remote volumes may be on any Spectrum Virtualize supported disk systems

    In order to replication between SVC and Storwize, the receiving Storwize must be in the replication layer

    25

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    26/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Spectrum Virtualize Global Mirror Function

    Long distance asynchronous remote mirroring function

    Up to 25000 km distance (250ms) between sites for business continuity

    Does not wait for secondary I/O before completing host I/O

    Helps reduce performance impact to applications

    Designed to maintain consistent secondary copy at all times

    Once initial copy has completed

    Copies are not consistent during a re-sync Use a FlashCopy for a good point-in-time

    Built on Metro Mirror code base

    All remote copy functions delivered as single feature

    Offers great implementation flexibility

    Operates between Storwize members at each site

    Local and remote volumes may be on any Storwize Family supported disk systems

    To replicate between SVC and Storwize, the Storwize system must be in the replication layer

    26

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    27/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Low Bandwidth Remote Mirroring GMCV

    Potential Problem: Spectrum Virtualize Global Mirror delivers very high datacurrency at remote site but requires network bandwidth to support this currency

    No mechanism to control RPO

    Global Mirror with Change Volumes (GMCV) option makes regular copies of dataat primary location and transmits them to secondary location

    RPO and network bandwidth consumption can be regulated

    User can select frequency of these copies, which determines network bandwidthrequired and data currency

    Provides much more flexibility to meet specific application currency and networkcost requirements

    GMCV is l imited to 256 relationships per system

    With RPQ and 7.x code this can be lifted to 2048 relationships per system

    27

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    28/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Global Mirror with Change Volumes (GMCV)

    Initially copy all data from primary volume to secondary volume at point-in-time of when GMrelationship started

    When copy completes a point-in-time copy of the secondary is taken to ensure data consistency

    Cycle is started again Either immediately or when cycle timer trips

    Maximum Round Trip Latency

    FC with DH8, V9K, V7KG2, V5KG2 - 250 ms. All other equipment 80 ms

    IP - 1Gb 80ms, 10Gb 10ms

    Bandwidth sized based on RPO desired (10 minutes to hours)

    No FlashCopy l icense is required

    28

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    29/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    GMCV Cycling Period

    The user configures the cycl ing period

    This is the minimum time between cycle starts

    Default is 300 seconds (5 minutes)

    If the link is slow or I/O throughput is high, it may take longer than this for the

    new data to be transferred to the secondary

    If so then the next copy will start as soon as the last one has finished

    RPO is up to 2X the cycling period

    Actual RPO is determined by the Freeze Time listed on the

    relationship

    29

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    30/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    GMCV Cycling Period Options

    Options for -cyclingmode are none | multi

    Specifies the behavior of Global Mirror for this relationship

    Specifying the default none gives identical behavior to

    regular Global Mirror even though you may have change

    volumes attached to the relationship

    Specifying multi uses the cycling protocol

    To start a relationship with cycling mode set to multi there

    must be change volumes defined for the relationship

    Admin can create change volumes or let system create them via GUI

    when configuring GM with Change Volumes option

    Note that the cycling mode can only be changed when the relationship

    is stopped and in a stopped state

    30

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    31/63

    Accelerate with IBM Storage

    2016 IBM Corporation

    Remote Copy Partnership Topologies

    Up to 4 Spectrum Virtualize family members in direct or

    indirect partnerships

    Topologies are related to remote copy partnerships

    This differs from remote copy relationships (a volume and its mirrored

    partner)

    Only 1 IP partnership per Storwize family member issupported

    The rest must be made up of Fibre Channel relationships.

    Topology Types

    Quadrature or Triangle Line

    Star

    31

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    32/63

    Accelerate with IBM Storage

    2016 IBM Corporation Copyright IBM Corporation2016

    Remote Copy Partnership Topologies

    Since any system can only have 1 IP partnership only 2 of these

    partnerships could be IP The rest have to be Fibre Channel

    Both Storwize systems in this example need to be in the

    replication layer in this instance

    If all were Storwize systems, they could be in the default storage layer

    Quadrature (or triangle) Partnership Topology

    32

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    33/63

    Accelerate with IBM Storage

    2016 IBM Corporation Copyright IBM Corporation2016

    Remote Copy Partnership Topologies

    Since any system can only have 1 IP partnership only 2 of these

    partnerships could be IP

    The rest have to be Fibre Channel

    All Storwize systems in this example need to be in the replication

    layer in this instance

    If all were Storwize systems, they could be in the default storage layer

    Line Partnership Topology

    33

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    34/63

    Accelerate with IBM Storage

    2016 IBM Corporation Copyright IBM Corporation2016

    Remote Copy Partnership Topologies

    Since any system can only have 1 IP partnership only 2 of these

    partnerships could be IP The rest have to be Fibre Channel

    All Storwize systems in this example need to be in the replication

    layer in this instance

    If all were Storwize systems, they could be in the default storage layer

    Star Partnership Topology

    34

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    35/63

    g

    2016 IBM Corporation

    Fibre Channel Connectivity Options

    Native Fibre Channel - Including FCoE

    Dark Fiber

    FCIP Either Brocade or Cisco

    DWDM/CWDM

    Note: Storwize members have no knowledge of WAN

    35

    Unix

    Others

    Wintel

    DS5K OthersDS8K

    SVC/Storwize

    DS3/4/5KXIV

    SVC/Storwize

    IP WAN

    Max 250 ms roundtrip latency

    (80ms pre 7.4 and older hardware)

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    36/63

    g

    2016 IBM Corporation

    Native IP Remote Copy Partnership

    Enables use of 1Gbit or 10Gbit Ethernetconnections using TCPIP without the need for FibreChannel or FCIP routers for replication

    Supports all remote copy modes MM and GM GM with Change Volumes preferred mode

    Covered by normal remote copy license It is not a new replication offering, but rather a new transport versus using

    a Fibre Channel network

    WAN Optimizers are NOT supported with this technology

    Configuration: Automatic path/session configuration via discovery of remote

    cluster using IP management addresses of both systems inthe IP remote copy partnership

    Configure IP partnership using either 1Gbit or 10GbitEthernet ports but not both at same time

    Currently cannot switch speeds anywhere in end-to-end linkother then WAN E.g. cannot connect 10Gbit port to 1Gbit switch and then connect 1Gbit

    out to WAN E.g All 10Gbit->WANWAN

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    37/63

    g

    2016 IBM Corporation

    Bridgeworks SANSlide Optimization

    With TCP/IP, information transfer slows the further you go.

    This is because of the latency caused by waiting for

    acknowledgment of each set of packets sent since the next packet

    set cannot be delivered until the previous one has been

    acknowledged by the remote system.

    37

    (Figure from REDP5023)

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    38/63

    g

    2016 IBM Corporation

    Bridgeworks SANSlide Optimization 2

    Latency in s tandard IP network (1Gb link speed):

    depends on the routing infrastructure

    depends on distance

    Latency = Round Trip Time (RTT) for a single packet set

    38 (Figure from REDP5023)

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    39/63

    2016 IBM Corporation

    Bridgeworks SANSlide Optimization 3

    Enhanced parallelism by using multiple virtual connections (VC) that share the same IP linksand addresses:

    When waiting for one VCs ACK, it sends more packets across other VCs

    If packets are lost from any VC, data will be retransmitted

    Artificial Intelligence engine adjusts number of VCs, receive window size, and packet size as appropriateto maintain optimum utilization/performance of the links

    39

    (Figure from REDP5023)

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    40/63

    2016 IBM Corporation

    Bridgeworks SANSlide Optimization 4

    Latency in IP network (1Gb link speed):

    depends on the routing infrastructure depends on distance

    Latency = Round Trip Time (RTT) for a single packet set

    40 (Figure from REDP5023)

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    41/63

    2016 IBM Corporation

    Remote Copy IP Partnership Requirements

    If you use IP replication, you must meet the following requirements:

    TCP ports 3260 and 3265 are used by systems for IP partnership communications These ports must be open on any firewalls

    Port 3260 is the port used by the systems to initially discover each other

    Port 3265 is for the actual IP Replication sessions used to transmit data

    The maximum supported round-trip latency between sites is 80 ms for a 1 Gbps link

    The maximum supported round-trip latency between sites is 10ms for a 10 Gbps link

    The recommended method of replication is Global Mirror with Change Volumes

    The inter-cluster heartbeat traffic consumes 1 Mbps per link

    The minimum bandwidth requirement for an inter-cluster link is 10 Mbps

    Maximum throughput is currently restricted based on use of 1gigE or10gigE ports

    One 1gigE port could do up to 111 MB/s unidirectional / 190 MB/s bidirectional

    Two 1gigE ports could do 220 MB/s unidirectional / 325 MB/s bidirectional One 10gigE ports could do up to 200 MB/s unidirectional

    Two 10gigE ports could do up to 400 MB/s unidirectional

    41

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    42/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Remote Copy

    Configuring Ethernet Ports

    42

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    43/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Remote Copy

    Link bandwidth setting is configured using Mbits not MBytes and youset this to what the communication link actually can sustain or whatis actually allocated for Spectrum Virtualize replication

    Background copy rate setting is a percentage of the link bandwidthand determines the bandwidth available for init ial sync and resyncsor for GMCV

    Configuring Partnership

    43

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    44/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Remote Copy

    Partnership Properties

    44

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    45/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    Either Ethernet port 1 or 2 on a node/node canister can be configured for IPreplication but not both

    The remote copy por t group on each system includes two IP address, one fromeach node, and when initially configured the system wi ll establish which one fromeach site is used This pairing can not be chosen or changed by an administrator

    In this example H1 and M2 have established a session

    If H1 node fails then the session between H1 and M2 fails and the systemautomatically establishes another session between H2 and either M1 or M2 The IP address used for replication on H1 does not failover to H2

    One Link One I/O Group

    45

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    46/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    The remote copy port group on each system includes four IP address, one from each node,and when initially configured the system will establish which one from each site is used

    If H1 node fails then the session between H1 and M2 fails and the system automaticallyestabl ishes another session between H2, H3 or H4 and M1, M2, M3 or M4

    One Link Two I/O Groups

    46

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    47/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    One Link More Than Two I/O Groups

    47

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    48/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    Remote copy port group setup for dual redundant l inks: Port group 1: two IP addresses, each on a different node in different system (green)

    Port group 2: two IP addresses, each on a different node in different system (orange)

    Maximum of 2 simultaneous IP replication sessions at any time Only one active per node, so in this configuration if node A1 would fail then Link 1 would no longer be

    available and only link 2 would be active

    Result is loss of half of the bandwidth available for replication If bandwidth sizing dictates dual links required and if one link fails resulting in MM or regular GM not able to operate

    properly, recommendation is to have 2 I/O Groups at each site to allow the failed link to restart on other nodes available insystems

    Dual links with all ports active and no standby ports

    48

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    49/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    Again maximum of 2 simultaneous IP replication sessions at any

    time

    Only one active per node so in this example if node M2 would fail then Link 1 would no longer be

    available and only link 2 would be active

    Result is loss of half of the bandwidth available for replication

    Dual Links - One I/O Group, One Port per Node

    49

    H1

    1

    H2

    M1

    M2

    12

    2Secondar

    y Volume

    Primary

    Volume Remote Copy Port Group 1

    Remote Copy Port Group 2

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    50/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    Each remote copy port group on each system includes two IP address, one from I/O Group inthis example, and when initially configured the system will establish the pairings used

    If H1 node fails then the session between H1 and M2 fails and the system automaticallyestablishes another session between H3 and either M2 or M4 since they are all in the sameremote copy port group with H1

    Dual Links - Two I/O Groups, One Port per Node

    50

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    51/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Native IP Replication

    Cannot today non-disruptively switch from a FC partnership to an IPpartnership Must delete relationships and delete partnership and start over basically

    If currently replicating over FC and can take outage on hosts replicating volumes, we have a method usingsync flag on mkrcrelationship

    SANSlide What it does and doesnt do: It optimizes link utilization, but not latency

    It uses standard TCP/IP no UDP

    It doesnt do any encryption, compression or de-duplication

    Only two systems can be in one IP Replication partnership Can do A->B partnership

    Cannot do A->B->C->D or A/B/C->D

    A system can be in an IP partnership with one other system and in FCpartnership with others Still a maximum of 4 systems in partnership with each other

    FC replication and IP replication can be used with any combination ofSpectrum Virtualize systems all running V7.2

    Miscellaneous Information

    51

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    52/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Replication Implementation Considerations

    Although not required, it is highly recommended to dedicate ports tothe remote copy process

    Dedicate SAN ports for FC mirroring

    Dedicate IP ports for IP replication

    ISCSI and IP replication not recommended on the same ports

    Port dedication can help with the following problems: SAN buffer to buffer credit issue for FC replication

    If ports are shared, this can cause production traffic slowdown

    1920 errors due to insufficient WAN bandwidth

    Spectrum Virtualize Node to Node communication issues

    On Spectrum Virtualize and V9000 with code 7.x, this will require that

    you use port masking to take node to node traffic off the dedicatedports

    The local_fc_port_mask parameter can be set on a cluster to restrict the node to node traffic to specificports

    Other members of the Storwize family (V3700,V5000,V7000) do not need this set, because node to nodetraffic prefers the back-plane to the FC SAN.

    Port Usage

    52

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    53/63

    2016 IBM Corporation

    Best Practice Port Designations

    53

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    54/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Replication Implementation Considerations

    Use an IP partnership when:

    FCIP equipment is not an option

    Only when IP network is stable

    Does not work well on IP networks that are not healthy

    When bandwidth requirements do not exceed 200-300 MB/s

    Only use 10Gb when latency does not exceed 10 ms

    Use a Fibre Channel partnership when

    You have reached the maximum (1) IP partnerships per system and need another

    High bandwidth is a requirement (greater than 200-300 MB/s)

    You have a method of taking FC over the WAN (FCIP routers)

    What type of partnership do I use?

    54

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    55/63

    2016 IBM Corporation Copyright IBM Corporation2016

    Replication Implementation Considerations

    Use Metro Mirror when:

    You absolutely have to have a base RPO of 0

    Base RPO - Meaning rolling logs forward does not count

    Only when you have the bandwidth to sustain it

    Production traffic will be slowed if you don't

    Use Global Mirror when: You don't need base RPO of 0, but want a small base RPO (2 min or less)

    You don't quite have the bandwidth for Metro Mirror

    You don't want your production applications to be affected by somewhat slower replication

    Use of 7.2 code can improve situations when bandwidth is not an issue

    Use Global Mirror with Change Volumes when: You can tolerate a base RPO of 10 minutes or greater

    Your production applications are being affected by slow downs from Global Mirror

    Your WAN link is not sufficient to keep up with the peaks from Global Mirror

    Generally when you are using IP based replication

    What kind of remote copy relationship do I use?

    55

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    56/63

    2016 IBM Corporation

    Mirroring Adjustable Parameters

    Link Bandwidth

    Amount of bandwidth in Mb/s for Spectrum Virtualize to use on the WAN link

    Background Copy Rate

    % of link bandwidth that can be used for initial sync and re-sync traffic GMCV is always initial synch/resync traffic

    Relationship Bandwidth Limit

    CLI only lssystem, chsystem

    The speed in MB/s that any ONE relationship is allowed to go

    GM Link Tolerance

    CLI only lssystem, chsystem

    Specified the length of time in seconds for which an inadequate intersystem link istolerated for a GM operation. Default = 300 seconds

    GM Max Host Delay

    CLI only lssystem, chsystem

    Specifies the maximum time delay in ms, at which the GM link tolerance timer startscounting down. Default = 5 ms

    56

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    57/63

    2016 IBM Corporation

    Mirroring Adjustable Parameters

    GM Inter-cluster Delay Simulator

    CLI only lssystem, chsystem

    Can simulate a delay between Spectrum Virtualize systems in ms

    GM Intra-cluster Delay Simulator

    CLI only lssystem, chsystem

    Can simulate a delay between I/O groups for Hyperswap distance

    simulation in ms

    Max Replication Delay

    CLI only lssystem, chsystem

    Maximum amount of time in seconds that I/O can be delayed without

    producing a 1920 error

    57

    Accelerate with IBM Storage

    M lti Cl d St G t Vi i F t C bilit

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    58/63

    2016 IBM Corporation

    Amazon S3

    Multi-Cloud Storage Gateway Vision Future CapabilityHybrid Use Cases: The Future of Storage Economics

    Replicated

    Note: The Multi-cloud Storage Gateway

    is a planned future enhancement

    Vision is to support other platforms like Spectrum Accelerate and DS8000

    Rackspace

    MicrosoftAzure

    Private Cloud

    Spectrum

    Virtualize

    Spectrum

    Scale

    Compressed

    Encrypted

    Integrity

    Validated

    Multi-cloud Storage Gateway

    Backup

    DR

    Tiering

    Archive

    Data

    sharing

    58

    Accelerate with IBM Storage59

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    59/63

    2016 IBM Corporation59

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    60/63

    2016 IBM Corporation

    Legal Notices

    Copyright 2015 by International Business Machines Corporation. All rights reserved.

    No part of this document may be reproduced or transmitted in any form with out written permission fro m IBM Corporation.

    Product data has been reviewed for accuracy as of the date of init ial publication. Product data is subject to change witho ut notice. This document could incl ude

    technical inaccuracies or typographi cal errors. IBM may make improvements and/or changes in the product(s) and/or program(s) described herein at any time

    without not ice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without noti ce, and represent goals and objectives

    only. References in thi s document to IBM products, prog rams, or services does not impl y that IBM intends to make such product s, programs or services available in

    all countries in w hich IBM operates or does business. Any reference to an IBM Program Product in this do cument is not intended to state or imp ly that only that

    program product may be used. Any functionally equivalent pro gram, that does not infringe IBM's intellectually property ri ghts, may be used instead.

    THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER OR IMPLIED. IBM LY DISCLAIMS ANY

    WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT. IBM shall have no respons ibi lit y to update t his

    information. IBM products are warranted, if at all, according to the terms and conditi ons of t he agreements (e.g., IBM Customer Agreement, Statement of Limit ed

    Warranty, International Program License Agreement, etc.) under which they are provi ded. Information concerning non -IBM products w as obtained from the suppl iers

    of those products, their pu blished announcements or other publi cly available sources. IBM has not tested those products i n connection w ith this pub lication and

    cannot confirm the accuracy of performance, compatibility or any other claims related to non -IBM products. IBM makes no r epresentations or warranties, ed orimplied, regarding non -IBM products and services.

    The provision of the infor mation contained herein is not intended to, and does not, grant any right or li cense under any IBM patents or copyrights. Inquiri es

    regarding patent or copyright l icenses should be made, in writing, to:

    IBM Director of Li censing

    IBM Corporation

    North Castle Drive

    Armo nk, NY 1 0504- 785

    U.S.A.

    60

    Accelerate with IBM Storage

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    61/63

    2016 IBM Corporation

    Information and Trademarks

    IBM, the IBM logo, ibm .com, IBM System Storage, IBM Spectrum Storage, IBM Spectrum Control, IBM Spectrum Protect, IBM Spectrum Archive, IBM Spectrum Virtualize, IBM Spectrum Scale, IBM

    Spectrum Accelerate, Softlayer, and XIV are trademarks of International B usiness Machines Corp., registered in many jurisdictions worldwide. A current list of IBM trademarks is available on the

    Web at "Copyright and trademark information" at http://www.ibm.com/legal/copytrade.shtml

    The following are trademarks or registered trademarks of other companies.Adobe, the Adobe l ogo , Pos tScr ipt , and the Post Scri pt logo ar e eith er r egis tered trad emark s o r tr ademar ks of Adobe Sy stem s In cor por ated in the Unit ed St ates, and/o r o ther cou ntr ies.

    IT Infrastructure Library is a Registered Trade Mark of AXELOS Limited.

    Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

    Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel

    Corporation or its subsidiaries in the United States and other countries.

    Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

    Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

    Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.

    Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or bot h and i s used under license therefrom.

    ITIL is a Registered Trade Mark of AXELOS Limited.UNIX is a registered trademark of The Open Group in t he United States and other countries.

    * All other products may be trademarks or registered trademarks of th eir respective companies.

    Notes:

    Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user willexperience will vary depending upon considerations su ch as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.

    Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios st ated here.

    All cus tom er ex ampl es c ited or d escr ibed in thi s p resen tati on are p resen ted as il lus trat ion s of the manner in w hic h s ome cus tomers have used IBM p rod uct s an d t he r esul ts they may have achi eved.

    Actual envi ron ment al cos ts and perf orm ance char acter ist ics wil l var y depend ing on ind ivi dual cus tom er c onf igu rati ons and condi tio ns.

    This publication was produced in the United States. IBM may not offer the prod ucts, services or features discussed in this document i n other countries, and the inform ation may be subject to change

    without notice. Consult your local IBM business contact for inf ormation on the product or services available in your area.

    All stat ement s r egard ing IBM's fu tur e di rect ion and int ent are su bjec t to c hang e or wit hdr awal wit hou t not ice, and repr esent goal s and objec tives onl y.

    Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the

    performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products sh ould be addressed to the suppliers of those products.

    Prices subject to change without notice. Contact your IBM representative or Busi ness Partner for the most current pricin g in your geography.

    This presentation and the claims outlined in it were reviewed for compliance with US law. Adaptations of these claims for use in other geographies must be reviewed

    by the local country counsel for comp liance with local laws.

    61

    Accelerate with IBM Storage

    http://www.ibm.com/legal/copytrade.shtmlhttp://www.ibm.com/legal/copytrade.shtml
  • 7/25/2019 Spectrum Virtualize Copy Services V2

    62/63

    2016 IBM Corporation

    Special notices

    This document was developed for IBM offerings in th e United States as of the date of publ ication. IBM may not make these offerings available in o ther countries, and the

    information is subject to change without noti ce. Consult your local IBM business contact for information on the IBM offerings available in your area.

    Information in this document concerning non -IBM products was obtained from the suppliers of these products or other public sources. Questions on the capabilities of non-

    IBM products should be addressed to the suppliers of those products.

    IBM may have patents or pending patent applications covering subject matter in this do cument. The furnishing of thi s document does not give you any li cense to these

    patents. Send license inq uires, in wri ting, to IBM Director of Li censin g, IBM Corpor ation , New Castle Drive, Armonk , NY 10504-1785 USA.

    All statements regard ing IBM fu tur e dir ecti on and i ntent are sub ject to change or wi thd rawal wi tho ut not ice, and rep resen t goal s and o bjec tiv es only.

    The information contained in t his document has no t been submitted to any fo rmal IBM test and is p rovided " AS IS" with no warr anties or guarantees either expressed or

    implied.

    All examples cit ed or descr ibed in th is d ocument are presen ted as il lustr ations of the m anner in w hich some IB M produc ts can be used and the res ul ts t hat may be achi eved.

    Actual en vir onmental costs and perfo rmance characteristi cs wi ll v ary d epend ing on individ ual c lient con figur ations and c ond it ions.

    IBM Global Financing offering s are provided throug h IBM Credit Corporation in the United States and other IBM subsidiaries and di visions w orldwide to q ualified commercial

    and government clients. Rates are based on a client's credit rating , financing terms, offering type, equipment type and opti ons, and may vary by country. Other restrictionsmay apply. Rates and offerings are subject to change, extension or withdrawal withou t notice.

    IBM is not responsible for print ing errors in this document that result in pricing or i nformation inaccuracies.

    All pri ces s how n are IBM's Uni ted States sugg ested list p rices and are s ubject to change w ithou t notice; resell er p rices may var y.

    IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms appl y.

    Any performance data c ontain ed in th is docu ment was determ ined in a cont rol led envi ronment. Actual resu lts may var y si gn if icant ly and are d epend ent o n many fac tor s

    includi ng system hardware configur ation and software design and configuration . Some measurements quoted in this document may have been made on development-level

    systems. There is no guarantee these measurements wil l be the same on generally-available systems. Some measurements quoted in this document may have been

    estimated through extrapolation. Users of this document shoul d verify the applicable data for their specific environment.

    62

    Accelerate with IBM Storage

    T d k

  • 7/25/2019 Spectrum Virtualize Copy Services V2

    63/63

    Trademarks

    The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.

    The following are trademarks or registered trademarks of other companies.

    * All other products may be trademarks or registered trademarks of their respective companies.

    Notes:

    Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user willexperience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.

    IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.

    All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actualenvironmental costs and performance characteristics will vary depending on individual customer configurations and conditions.

    This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change withoutnotice. Consult your local IBM business contact for information on the product or services available in your area.

    All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

    Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance,compatibili ty, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

    Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

    Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

    Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.

    Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

    Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

    Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel

    Corporation or its subsidiaries in the United States and other countries.

    UNIX is a registered trademark of The Open Group in the United States and other countries.

    Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

    ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.

    IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.

    For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:

    *, AS/400, e business(logo), DBE, ESCO, eServer, FICON, IBM, IBM (logo), iSeries, MVS, OS/390, pSeries, RS/6000, S/30, VM/ESA, VSE/ESA,WebSphere, xSeries, z/OS, zSeries, z/VM, System i, System i5, System p, System p5, System x, System z, System z9, BladeCenter

    Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not

    actively marketed or is not significant within its relevant market.

    Those trademarks followed by are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.