data chatwith kyle hailey andtim gorman

Private and confidential© 2014 Delphix. All Rights Reserved Private and confidential© 2014 Delphix. All Rights Reserved

Data chat

with Kyle Hailey and

Tim Gorman

Private and confidential© 2014 Delphix. All Rights Reserved Private and confidential© 2014 Delphix. All Rights Reserved

Virtualized storage is fast

becoming the new norm.

Nobody can justify provisioning

non-production environments

the way they did up to now.

Private and confidential© 2014 Delphix. All Rights Reserved Private and confidential© 2014 Delphix. All Rights Reserved 3

• PROD is what we care most about…

The problem

PROD



– But behind every PROD…

• There is QATEST…

The problem

PROD QATEST




• There is QATEST, DEV…

The problem

PROD QATEST DEV




• There is QATEST, DEV…

• …and other project-specific environments to support

The problem

PROD QATEST DEV


• Also, as PROD grows…

The problem

PROD PROD


DEVQATEST

• Also, as PROD grows…

– Then so do the supporting non-PROD environments…

The problem

PROD


The problem

CEO

COO

CFO CMO CSO CIO

• And so inevitably the situation shifts from this…


The problem

CEO

COO

CFO CMO CSO CIO

StorageAdministrator

• To this…


• Some try to mitigate the problem by copying subsets of PROD…

Attempting to solve the problem…

PRODQATEST DEV UAT


• Some try to mitigate the problem by copying subsets of PROD…

• …but it is difficult and time-consuming to create referentially-correct

subsets of databases. Most give up…


PRODQATEST DEV UAT


• What inevitably happens is that cloning is performed less

frequently…

• …meaning that schemas and data are older, dirtier due to previous

testing, and too small to accurately represent reality


PRODQATEST DEV UAT



PROD

DEV for Tom

DEV for Dick

DEV for Sally

DEV for Harry

DEV for Becky

And while in a perfect world what we’d like to see is something like

this…



PROD

DEV

Tom Dick Sally Harry Beck

y

…in the real world we see this…


• It’s not easy for developers or testers to share environments

simultaneously




simultaneously

– Changes made by each user conflict with one another




simultaneously


• So it becomes necessary to serialize access to the limited number of

environments




simultaneously



environments

– Each user queues at the resource, so their project takes more time

elapsed




simultaneously



environments


elapsed

– Each user destructively changes the resource




simultaneously



environments


elapsed


• And now we need a way to reset or clean up the environment

between each use




simultaneously



environments


elapsed


• And now we need a way to reset or clean up the environment

between each use

– Reset or clean up takes time, which causes further delays between uses



All kidding aside…You are here


• The biggest problem with cloning environments and databases is all

the duplication

A solution…



the duplication

– Most (if not all) of the blocks comprising the database or file-system

exactly the same

A solution…



the duplication


exactly the same

• What if we store only one copy of each version of a block?

A solution…



the duplication


exactly the same


– Copy-on-write (COW)

• Never modify a block, but insert a new version instead

A solution…



the duplication


exactly the same




• Then let the storage figure out what we’re supposed to be seeing?

A solution…



the duplication


exactly the same





– The storage maintains the relationships and versions on retrieval

A solution…



the duplication


exactly the same






• And then make it portable so that ANY platform (Unix/Linux,

Windows) can use it?

A solution…



the duplication


exactly the same






• And then make it portable so that ANY platform (Unix/Linux,

Windows) can use it?

– NFS (network file system)

A solution…


• Cloning the old way…

A solution…

PROD DEV

Private and confidential© 2014 Delphix. All Rights Reserved 33

What happens when ask for a copy ?

Developer or AnalystBoss, Storage Admin, DBA


• Cloning the smart way…

A solution…

PROD DEV



– As changes are made to the clone, only those changed blocks are

stored…

A solution…

PROD DEV




stored…

• Takes less storage, faster to copy

• The cost of the clone has gone way down in terms of storage and

time

A solution…

PROD DEV




stored…



time

A solution…

PROD

CapEx

DEV




stored…



time

A solution…

PROD

CapEx OpEx

DEV


Key Terms

Terms for Production Environment

Terms for the DelphixAppliance

Terms for Pre-Production Environment

Source host Delphix Server Target host

Source database dSource VDB


Key Terms: Source Host

Production Development

The source host is the host on which the instance for the source database runs. Typically this is the production host.


Key Terms: Source Database

1 TB Storage


The source database is copied into the Delphix Server via standard Oracle RMAN APIs.

Delphix Server then stays in sync via incrementalRMAN backups and by collecting redo.


Key Terms: Delphix Server

1 TB Storage


The Delphix Server acts as a backup destination for the source databases, and as network attached storage for VDBs. It also hosts the Delphix management GUI.


Key Terms: dSource

1 TB Storage


The dSource is the Delphix Server’s compressed representation of the source database. It is the basis for the storage that is allocated to a VDB.

~256 GB Storagefor dSource


Key Terms: Target Host

1 TB Storage


The target host is the host on which the instance for the VDB runs. Typically this is wherever the pre-prod database runs today.



Key Terms: VDB

1 TB Storage


The VDB is a fully functional database running on a target host.The storage for a VDB is managed by Delphix, and provided to the target host via NFS. Changes are stored in the Delphix Server.


No additional storagefor VDB outside of Delphix

Only changesstored for VDB


Delphix Overview

1 TB Storage ~256 GB Storagefor dSource


No additional storagefor VDB outside of Delphix

Only changesstored for VDB

Delphix Server 4.1

• Platforms Vmware

Amazon EC2

• DatabasesOracle

SQL Server

Postgres

Sybase

• App Data

• Data Masking

• Replication

How can Delphix help DBAs?

• Scratch environments Testing one-off patches, patchset updates (PSU’s), and critical-patch upgrades (CPU’s)

• SQL tuningWhen tuning a specific SQL statement, how can you effectively test the impact of…

- adding or dropping an index?

- gathering CBO statistics a bit differently?

…without getting an act of Congress/Parliament?

data chatwith kyle hailey andtim gorman

Technology