jp morgan remote to core implementation

15
December 2006 Remote to Core – Part 2 - Implementation S T R I C T L Y P R I V A T E A N D C O N F I D E N T I A L This deck is for Remote to Core presentation purposes and process understanding. It is not intended to replace detailed installation, deployment guidelines or standards documentation maintained by those groups primarily responsible for the associated tasks described. Author: J. Napier

Upload: john-napier

Post on 26-Dec-2014

173 views

Category:

Technology


0 download

DESCRIPTION

JP Morgan Remote to Core Implementation as presented by John Napier PMP, CSM. A core component of JP Morgan Chase's Data Protection Initiative (DPI)

TRANSCRIPT

Page 1: JP Morgan Remote to Core Implementation

December 2006

Remote to Core – Part 2 - Implementation

S T

 R I 

C T

 L Y

   P R

 I V A

 T E

   A N

 D   

C O

 N F

 I D E

 N T

 I A L

This deck is for Remote to Core presentation purposes and process understanding. It is not intended to replace detailed installation, deployment guidelines or

standards documentation maintained by those groups primarily responsible for the associated tasks described.

Author: J. Napier

Page 2: JP Morgan Remote to Core Implementation

2

Contents

Solution

High-Level Process Framework

Bringing the Filer Online

Netbackup SnapVault Management (NSVM) Requirements

NSVM Setup

NBU Policy Attributes

Notes

Reference - Netbackup Snapvault Naming

Reference - FAS270C Wiring Detail

Page 3: JP Morgan Remote to Core Implementation

3

Solution: Netbackup Snapvault Management (NSVM)

Symantec NetBackup utilizes Network Appliance Snapvault functionality to perform backups on NFS-mounted and/or CIFS-mapped file systems residing on NetApp filers. The Netbackup job scheduler initiates a NetApp Snapvault backup; a NetApp Snapshot copy is created on the primary NetApp storage system and is then replicated to a NetApp secondary storage system

Based on the quick creation of a snapshot and a transfer of only changed blocks via NetApp Qtree Snapmirror replication, fast backups and restores can be easily accomplished from local to remote locations.

Backups in the form of Snapshot copies on the primary(Remote) and secondary(Core) NetApp storage systems are managed (creation, retention, deletion) with NetBackup.

All backup data stored is in file format, including all incremental backups, and each incremental backup can be viewed as a full backup image by any administrator or end-user with associated access control and security rights. Data to be restored can be quickly located with a full view into what the environment looked like at the time the backup was created, and as far back as data retention will permit.

The “file system” view of backups can be accessed by end users as well, and empowers the user to perform self-restores, if the administrator permits.

Standard Solution for Remote to Core provides for 30days local backup protection and 60 days remote backup retention – all backups on disk and online.

Page 4: JP Morgan Remote to Core Implementation

4

High-Level Process Framework

Preliminary Site List

T. Kovinchick

Network Bandwidth AnalysisM. Ulery

Backup Policy Review

B. Diechler

Server/Share Mapping

R. Calviello

DCO/Facilities

T. Kovinchick

No

No

R2C Process Framework30-Nov-2006

# of Links/Type of LinksCapacity Available

during Backup Window

Policies for 30/60 Standard RetentionExtended Policies

Site Metrics(Inventory/TapeMedia

Share MappingServers/Volumes/Sizes/

Site Survey FormIP Addresses

Yes

Discovery and Evaluation

Site Remediation

Required

Installation and configuration

From – To Mapping

Equipment Order/ArrivalT.Kovinchick

NetApp

Remote Filer ConfigurationNAS Deploy

NetBackup Policy SetupB. Deichler

Core Volume(s) Configured

NAS Deploy

Data Seeding (Robocopy)

ScriptR. Calviello

Remote Filer Installation/Availability

NetApp First Full Backup to Core

Share Data Seeded

Baseline Data Movement

Config Sheet

K.Spakrs

SA Create vststab

entries for mount points

TBD

Follow-Up Volume Usage/

AdjustmentNAS Ops

Standard NetApp to QA

Build Team Check List

NetApp K.Sparks

Facilities/Network Ready

Validation K.Sparks

This workflow loop will be further

detailed in future versios

Post-Site Processes still to be defined

30-45 Day Revisit/ReSize identified

Page 5: JP Morgan Remote to Core Implementation

5

Current State Diagram – Remote Site

AD AD AD

SAN Fabric

FAStTStorage

ADAD

Tape drive

Ethernet Ethernet

PC PC PCPCPC PC

“Microsoft Only” Users

AD Backup

Tape drive

DomainController

Standard Medium Office DeploymentClustered Novell/Netware Servers (or)Clustered Windows 2000/3 Servers1Pair each for Print, File, Build/AppEMC/FastT SAN storageLocal Tape Backup(NBU,other)

Page 6: JP Morgan Remote to Core Implementation

6

Target State Diagram

Eth

ern

et

SV/SM

NDMP

Core

Daily Backup Image Resides at Core(60d)

Filer Initiates Snapshot Snapshot is Remote-side Backup(30d) Begins Snapvault Replication

Remote

AD AD AD

SAN Fabric

FAStTStorage

ADAD

Tape drive

Ethernet Ethernet

ADBackup

Tape drive

DomainController

FAS 270C

PC PC PCPCPC PC

“Microsoft Only” Users

Not in use after client migration

Page 7: JP Morgan Remote to Core Implementation

7

High-Level Process – Bringing Filer Online

Network Configuration – established in System Configuration sheet

Interfaces to User Network

Prefer Etherchannel GbE or 100Mb (multi-mode VIF, Active-Active Trunk)

Minimally Multi-Homed GbE or 100Mb (single-mode VIF, Active-Passive)

Interfaces to WAN (Snapvault replication) – utilize same interfaces.

Volumes and Share Creation – established through F&P Share Discovery and Backup Policy

Includes NFS mount points for UNIX-based NBU instances

Disable standard OnTap scheduled snapshots on non-Root volumes

Limit Qtrees to 6 per volume (to control QSM snapshot limits of 255 per volume)

Join filer to AD Domain

Map shares Source/Target for Robocopy Process (if Filer not initially used as Primary storage)

Applications running on F&P Shares should be identified in advance. Applications typically generate a higher data change rate and need to be tracked accordingly.

Page 8: JP Morgan Remote to Core Implementation

8

Netbackup SnapVault Mgmt (NSVM) Req’s.

NetApp Hardware Any platform combination that SnapVault supports

Data ONTAP Primary: Data ONTAP 6.5.2 or laterSecondary: Data ONTAP 7.1 or later

NetApp Software Snapshot, SnapRestore[1]

Primary: sv_ontap_priSecondary: sv_ontap_sec

NetBackup NetBackup Enterprise 6.0 or laterNDMP OptionAdvanced Client OptionNetApp SnapVault Option

Protocols NFS, CIFS

Client SolarisWindowsNetBackup 6.0 or later

Media Server N/A (but Master must be NetBackup 6.0 or later)

Applications File SharingOracle (8i or later) on Solaris

Page 9: JP Morgan Remote to Core Implementation

9

High-Level NSVM Setup

NetBackup

NBU 6 Enterprise Server installed on Master & Media Servers

NDMP Option licensed and installed within NBU

Veritas ICS is installed

NBU Advanced Client is licensed and installed

NetApp/OnTap

SnapVault Primary and SnapVault Secondary licenses added

NDMP on the filers is ON

Enable SnapVault

Disable local Snapshot schedules

Page 10: JP Morgan Remote to Core Implementation

10

High-Level Process – NSVM Setup (continued)

Setup NDMP Credentials for NDMP Host

Verify information

Grant Access on Primary

Grant Access on Secondary

Create SnapVault Target Volume on SnapVault Secondary(Filer)

Page 11: JP Morgan Remote to Core Implementation

11

High-Level Process – NSVM Setup (continued)

All NSVM SnapVault backups are managed via NetBackup for both backups and restores.

NSVM Manages the Snapshot copies (retention/copies) on the Primary and Secondary)

Storage Unit type is set to Disk and Disk type is set to SnapVault

Media Server is appropriate selected

The SnapVault server should be specified as the name of the NetApp Secondary system

Specify the absolute pathname to volume as the volume that was created on the Secondary

Page 12: JP Morgan Remote to Core Implementation

12

High-Level Process – Setup NBU Policy Attributes

Policy Type is WindowsNT

Policy Storage Unit is the Storage unit setup in earlier step

Check off

Set # of Snapshots to keep on the primary to 30

Schedules:

Name Schedule – Type (FULL) – Frequency

Destination (Snapshots Only)

Retention (Manages retention of copies on Secondary) – 60 Days

Clients

Backup Selections

Page 13: JP Morgan Remote to Core Implementation

13

High-Level Process – Notes:

Backup Policy changes

Backup policies should be aligned to remote volumes and incorporate all qtree paths within the volume having similar retention policy

Any policy requirement for longer than 60day retention should have an alternate Secondary(target) vault volume defined.

Currently – the “first” snapvault relationship between a new Remote site and Core, should be manually performed from NAS Admin in a create & break process.

In our environment, we have seen NBU fail to create Snapvault relationships for first time Remote sites.

Configurations for NBU must have the Media Server and Advanced Client components running on the same platform. Either both on Windows or both on Solaris.

If UNIX is the Media Server/Advanced Client platform, then all shares must have NFS exports added.

30-Day Adjustment: Remote volumes should be originally configured with extra capacity (estimate 20%) as data change rate and snapshot consumption for the first 30 days of backups will not be known. After 30days of Snapshots/Backups are accumulated, the volumes can be re-adjusted to normal free-space levels. Flex-vols allow for dynamic growth or size reduction.

Page 14: JP Morgan Remote to Core Implementation

14

Reference - Remote to Core Netbackup Snapvault Naming

\vol\stxarlbna01_STX4501PRTVN02\qtree1

stxarlbna01_STX4501PRTVN02 stxarlbna01_vault1

Example: Remote Site Arlington Filer: stxarlbna01

Volumes: stxarlbna01_STX4501APPVN02 format: filername_Volume stxarlbna01_STX4501DATVN02 stxarlbna01_STX4501PRTVN02

Netbackup PolicyName: snapvault_stxarlbna01_STX4501PRTVN02 format: snapvault_remote filer_remote volumeDSU: (host)stxjipcna01 (vol) stxarlbna01_vault1 format: snapvault server/core filer, core filer volume created for remote filerPath: \vol\stxarlbna01_STX4501PRTVN02\qtree1, format: path for all qtrees within volume having same retention \vol\stxarlbna01_STX4501PRTVN02\qtree2, \vol\stxarlbna01_STX4501PRTVN02\qtree3, \vol\stxarlbna01_STX4501PRTVN02\qtree4

\vol\stxarlbna01_STX4501PRTVN02\qtree2

\vol\stxarlbna01_STX4501PRTVN02\qtree3

\vol\stxarlbna01_STX4501PRTVN02\qtree4

NBU Naming of Snapshots from Bkup Policy:NAS+NBU+PFI+ino0s041+snapvault_stxarlbna01_STX4501PRTVN02+sv+stxarlbna02_STX4501PRTVN02+2006.12.01.21h00m17s

Client Policy name Policy type(snapvault)

Volume Name Timestamp

Example Core Site JIP Filer: stxjipcna01

Volumes: stxarlbna01_vault1 format: remote filername_vault1 stxarlbna01_LT_vault1 LT – for non-standard retention

\vol\stxarlbna01_STX4501PRTVN02\qtree1

\vol\stxarlbna01_STX4501PRTVN02\qtree2

\vol\stxarlbna01_STX4501PRTVN02\qtree3

\vol\stxarlbna01_STX4501PRTVN02\qtree4

Maximum Snapshots: 30 defines Primary site snapshot copies(backups)Policy Schedule Retention: 2 Months (60 days) defines Secondary site backupsMaster/Media Server NFS Mounts: /snapvaults/stxarlbna01/STX4501PRTVN02/qtree1 format: /snapvaults/<remote_filer>/<volume>/<qtree>

Primary Source Data. Snapvault Primary. Local Retention for Instant Recovery

Backup Target. Snapvault

Secondary. Core Retention Online/

Ondisk

Snapvault Backup establishes 1 to 1 relationship for each Source Qtree and Target Qtree

stxarlbna01_LT_vault1

This qtree requires LongerTerm retention and will use a different DSU volume

Page 15: JP Morgan Remote to Core Implementation

15

Reference - FAS270C Wiring Diagram (M.Bachert)

OPEN OPEN

CA

UT

ION

FIBRECHANNEL 1

FAULT

FIBRECHANNEL 2

ON

OFF

10/100/1000 ETHERNETCONSOLE

OPEN OPEN

CA

UT

ION

FIBRECHANNEL 1

FAULT

FIBRECHANNEL 2

ON

OFF

10/100/1000 ETHERNE T CONSOLE

1Gb 2GbSHELF

IDPSU1 PSU2

MODULE A

MODULE B

NETWORK SWITCH TERMINAL SERVER NETWORK SWITCH

POWER POWER

Hardware Dimensions U.S. Metric Rack Units*

FAS270

Height 5.25 in. 13.3 cm

3U (Rack Mount)Width 17.6 in. 44.7 cm

Depth 20 in. 50.85 cm

Weight 77 lbs. (loaded) 35 kg

Amps @ 100-120V Amps @ 200-240V

Hardware Rated Actual Rated Actual P/S Volt Range

FAS270 7 3.95 3.5 1.9 100 – 240 VAC