active data pools

8/2/2019 Active Data Pools

1/45

2009 IBM Corporation

Using TSM Active Data Pools for On-Site andOff-Site Backup and Restore

Dave Daun

IBM Advanced Technical [email protected]


2/45

IBM Advanced Technical Support

2009 IBM Corporation2

Agenda

Overview of Active Data Pools

Defining Active Data Pools

Removing Inactive Files from an Active

Data PoolRestoring from Active Data Pools

Restrictions and Potential Issues

Active Data Pools Offsite Volumes

Implementation Ideas

Demonstration


3/45



Active Data Pools

New feature in TSM 5.4

Long standing requirement from the TSM community

New Storage Pool Type

Only for Backup data

Only for Sequential Access pools

Implementation is similar to Copy Storage Pools Restore will come automatically from the Active Data Pool

Why use Active Data Pools

Faster restore of data

Useful for disaster recovery Minimizes tape mount activity during restore

New function in TSM V6

Offsite functions using Disaster Recovery Manager (DRM)


4/45



TSM Pool Types

Random Disk Sequential Disk

(FILE)

Primary

Copy Pool

ActiveData Pool

Sequential TapeSequential Disk

(FILE)

Sequential Tape Sequential Disk

(FILE)

Sequential Tape


5/45


6/45



Removing Inactive Versions from Active Data Pools

Inactive versions in a Active Data Pool are treated as expired files

Version is inactivated when a new backup version is receivedfrom the client

Reclamation removes inactive versions from Active Data Pools

Reclamation must be run regularly

MOVE DATA or MOVE NODEDATA will also remove inactive

versions from an Active Data Pool RECONSTRUCT defaults to YES on MOVE DATA or MOVE

NODEDATA in an Active Data Pool


7/45



Active Data Pools Disk vs. Tape

Benefits of Active Data Pools on sequential disk

Optimized access to active versions for fast restore

Reduced size of disk pool if only active versions are stored

Reduced data movement in preparation for restore of active data

Benefits of Active Data Pools on sequential tape

Reduced storage requirement (onsite or offsite) while protecting dataagainst media failure or disaster

Simplified tape management because of fewer tapes


8/45



Defining an Active Storage Pool

Define the pool DEFINE STGPOOL ACTIVE_POOL POOLTYPE=ACTIVEDATA

Add the active data pool to an existing primary pool definition (optional)

UPDATE STGPOOL PRIM_POOL ACTIVEDATAPOOLS=ACTIVE_POOL

Schedule a command to copy from the primary pool to the active pool

COPY ACTIVEDATA PRIM_POOL ACTIVE_POOL MAXPROC=4

Create a new policy domain to enable active data pools (or update anexisting domain)

DEFINE DOMAIN ACT_DOMAIN

ACTIVEDESTINATION=ACTIVE_POOL


9/45



Controlling Which Nodes Use Active Data Pools

Policy Set

Policy Domain

ACTIVEDESTINATION

Management Class

Copygroup

NODES

Active Pool

Primary Pool


10/45



Controlling Which Nodes Use Active Data Pools

1. Use an existing domain:

Simply use the UPDATE DOMAIN command and specify the list ofactive-data pools in the ACTIVEDESTINATION parameter.

2. Restrict which nodes can write to an active-data pool:

Decide which nodes are critical and should use Active Data Pools

Define a new domain and specify the list of active-data pools in the

ACTIVEDESTINATION parameter.

Update the node definitions to assign the nodes to the new domain

Complete the policy structure (copy it if possible)


11/45



Getting Active Versions Into an Active Data Pool

Using simultaneous copy (not available for LAN-Free)

New parameter on DEFINE and UPDATE STGPOOL commandACTIVEDATAPOOLS

Specifies the names of active-data pools where the server

simultaneously writes data during a client backup operation. The combined total number of storage pools in the COPYSTGPOOLS

and the ACTIVEDATAPOOLS cannot exceed three.

COPY ACTIVEDATA command

Use this command to copy active versions of backup data from aprimary storage pool to an active-data pool.

Similar to BACKUP STGPOOL

Should be used in addition to simultaneous copy


12/45



Removing Inactive Files from an Active Data Pool

When a file is deactivated, the logical occupancy of the volume it isstored on is reduced by the size of the file. This causes reclamation torun sooner for the volume.

Reclamation (with aggregate reconstruction) is used to remove

inactive files from the active data pool. Reconstruction will build the new aggregate by copying just the active

files and not any deleted or inactive files.

The COPY ACTIVEDATA command and MOVE DATA/NODEDATAcommands will reconstruct aggregates as they are copied or moved

within an active-data pool. Do not specify RECONSTRUCT=NO onthe MOVE DATA/NODEDATA commands when dealing with active-data pools.


13/45



Collocation of Active Data An Example

Client

Active data pool

A0 B0 C0 D0

A0 B0 C0 D0

A0 B0 C0 D0

1. Client backs up A0, B0, C0, D0 to primary pool

with simultaneous write to active data pool.

Server

Active/inactiveprimary pool

B1A0 B0 C0 D0 E1

Client Server

B1 E1

B1A0 B0 C0 D0 E1

B1A0 B0 C0 D0 E1

2. Client backs up B1, E1 with simultaneous

write to active data pool. B0 deactivated.

B1A0 B0 C0 D0 E1

Client Server

B1A0 B0 C0 D0 E1

B1A0 C0 D0 E1

3. Reclamation removes inactive B0 fromactive data pool.

B1A0 B0 C0 D0 E1

Client Server

B1A0 B0 C0 D0 E1

B1A0 C0 D0 E1

4. Client restores active files A0, C0, D0, B1,and E1 from active data pool.

A0 C0 D0 B1 E1




Active data pool Active data pool

Active data pool


14/45



Client data restore when using Active Data Pools

When restoring client data, the server will select the activeversion of a file from an Active Data Poll whenappropriate. The restore order has been modified toinclude Active Data Pools:

1. Active Data Pool (FILE)

2. DISK (random)

3. FILE (primary or copypool)

4. Active Data Pool sequential tape onsite.

5. Sequential onsite-volume (primary, copy or Active DataPool), priority considers: mounted(idle) -> automated ->manual


15/45



Restoring Volumes or Storage Pools with Active Data Pools

Two new parameters on the RESTORE STGPOOL andRESTORE VOLUME commands:

ACTIVEDATAONLY

Specifies that active versions of backup files are to be restored

from active-data pools only.

ACTIVEDATAPOOL

Specifies the name of the active data pool from which the activeversions of backup files are to be restored. If this parameter is

not specified, files are restored from any active data pool inwhich active versions of backup files can be located.

Note: Inactive files cannot be restored from active datapool and will be deleted from the primary pool (when thevolume is deleted)


16/45



Active Data Pools - The Q OCC and Q CONTENT commands

Query Occupancy Command:

Number of Files

Reduced when non-aggregated files are deleted duringdeactivation

Reduced by number of logical files only when aggregate is deleted

Physical Size reflects the actual size of the aggregates (as itdoes today)

Logical Space Occupied

Reduced by size of logical file being deleted

Reduced by size of logical file that is removed during reclamation(reconstruction)

Query Content Command:

Will show all logical files in an aggregate regardless if it hasbeen removed


17/45



Active Data Pools Restrictions and Potential Issues

Can only be used for Backup data, not Archive data or HSM data

NDMP Backups do not go to Active Data Pools

A point-in-time restore will not use Active Data Pools

Must plan for time needed to do active data copies Concurrent copies may be slower

COPY ACTIVEDATA may be an additional process

COPY ACTIVEDATA runs somewhat slower than BACKUPSTGPOOL

Difference is due to additional processing needed to verify theactive/inactive state of logical files in aggregates and actaccordingly.

Must check ownership of files and see of Node is authorized to

used Active Data Pools for each file


18/45



Active Data Pools for Off-Site

Active Data Pool volumes will be processed by the PREPAREcommand and by the Query DRMedia and MOVE DRMediacommands

Active Data Pool volumes can have an access mode of OFFSITE

Active Data Pool volumes with an access mode of OFFSITE will usethe off-site reclamation process (data is read from Primary Poolvolumes)

The implementation is nearly identical to Copy Storage Pools

S


19/45



Active Data Pools for Off-Site - Command Changes

SET DRMACTIVEDATASTGPOOL New command

QUERY DRMSTATUS Output now shows Active Pools

UPDATE VOLUME - no change OFFSITE for ADP volumes

MOVE DRMEDIA new parm: ACTIVEDATASTGPOOL=

PREPARE new parm: ACTIVEDATASTGPOOL=

QUERY DRMEDIA new parm: ACTIVEDATASTGPOOL=

IBM Ad d T h i l S


20/45



Active Data Pool Implementation Ideas

Use an Active Data Pool as a substitute for disk onlypool

Reduces the size of the disk requirement

Faster restores from disk (non-point-in-time restores)

BackupsActive

Pool

Primary

Pool

Tape

Copy

Pool

(for offsite)

Migration

IBM Ad d T h i l S t


21/45




Use an Active Data Pool for on-site media recovery

Reduces the size of the tape requirement

Faster restores from tape (non-point-in-time restores)

BackupsActive

Pool

Primary

Pool

Tape

Copy

Pool

(for offsite)

Migration



22/45




Use an Active Data Pool as a staging area for an

anticipated restore

Reduces the size of the disk staging area

Faster restores when enough time is available to perform thestaging operation

Use a special Policy Domain to enable a single node copy

BackupsActive

Pool

Primary

Pool

Tape

Copy

Pool

(for offsite)

Migration

Copy when needed



23/45




Use an Active Data Pool as a staging area for recurringBackupset generation

Reduces the number of tape mounts needed for Backupsetgeneration

Use Policy Domain to restrict Active Pool to only those nodesthat need Backupsets

Backups

Active

Pool

Primary

Pool

Tape

Copy

Pool

(for offsite)

Migration

Backupsets



24/45




Use an Active Data Pool for off-site vaulting

Reduces the size of the off-site tape requirement

Faster disaster restores from tape (very few inactivefiles on the disaster tapes)

Use DRM to manage off-site Active Data Pool volumes

Backups

Active

Pool

(for off-site)

Primary

Pool

Migration



25/45




Use an Active Data Pool as an electronic vaulting target

Reduces the amount of data which must be stored in theremote location

Faster disaster restores

Replaces the Copy Storage Pool

Use DRM to manage the off-site volumes

BackupsActive

Pool

Primary

Pool

Migration

ExtendedSAN



26/45



Active Data Pool Demonstration

Server Layout

DISKPOOL1

Random

Primary Pool

DISKPOOL2

Random

Primary Pool

ACTPOOLSequential

Active Data Pool

POOL101

POOL102

POOL201

STGPOOL VOLUMES

VOL001VOL002

..

VOL014

DEVCLASS

DISK

ACTDEV

NODE

ACTNODE1

(ACTDOM1)

ACTNODE2

(ACTDOM2)



27/45




Server Scripts

FILEVOLS displays the status, utilization and percent reclaimable ofthe ACTPOOL volumes

RECLAIM runs reclamation on the ACTPOOL with a threshold of 10%

ACTLOG5 displays the last five minutes of Activity Log records

Windows Scripts

Touchfiles updates the last access date of specified number of files



28/45




Highlights

Backup repeatedly and run reclamation to see theinactive files removed from the active pool

Backup with concurrent copy to the active pool Use the COPY ACTIVEDATA command to populate the

active pool

Restore data from an active data pool

Perform off-site storage pool reclamation



29/45



Active Data Pools Q DOMAIN



30/45



Active Data Pools Q STGPOOL



31/45



Active Data Pools Q STGPOOL



32/45



Active Data Pools COPY ACTIVEDATA



33/45



Active Data Pools The FILEVOLS Script



34/45



Active Data Pools Day 1: First Incremental



35/45

pp


Active Data Pools Day 1: First Incremental



36/45

pp


Active Data Pools Day 2: Subsequent Incremental



37/45

pp


Active Data Pools Day 2: Subsequent Incremental



38/45

pp


Active Data Pools Day 2: Reclamation



39/45


Active Data Pools Day 2: After Reclamation



40/45


Active Data Pools Day 3: After Reclamation



41/45


Active Data Pools Client Restore



42/45


Active DataPools

Actlog forClient Restore



43/45


Active Data Pools Offsite Reclamation



44/45


Active Data Pools Offsite Reclamation



45/45

Questions???

active data pools

Documents