Download - Toug 2013 delphix_share
![Page 1: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/1.jpg)
Database Virtualizationand instant cloning
Kyle Haileyhttp://dboptimizer.com
![Page 2: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/2.jpg)
Who is Kyle Hailey
1990 Oracle– 90 support– 92 Ported v6– 93 France– 95 Benchmarking – 98 ST Real World Performance
2000 Dot.Com 2001 Quest 2002 Oracle OEM 10gSuccess!
First successful OEM design
![Page 3: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/3.jpg)
Who is Kyle Hailey
1990 Oracle– 90 support– 92 Ported v6– 93 France– 95 Benchmarking – 98 ST Real World Performance
2000 Dot.Com 2001 Quest a 2002 Oracle OEM 10g 2005 Embarcadero
– DB Optimizer
![Page 4: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/4.jpg)
Who is Kyle Hailey
• 1990 Oracle 90 support 92 Ported v6 93 France 95 Benchmarking 98 ST Real World Performance
• 2000 Dot.Com• 2001 Quest • 2002 Oracle OEM 10g• 2005 Embarcadero
DB Optimizer
• 2010 Delphix
When not being a Geek- Have a little 4 year old boy who takes up all my time NoCOUG board
IOUG Liaison
![Page 5: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/5.jpg)
Database Cloning Challenge
If you can’t satisfy the business demands then your process is broken.
![Page 6: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/6.jpg)
Two Parts
I. Cloning TechnologyII. Accelerate your business
![Page 7: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/7.jpg)
Part I : Cloning Technology
3. Virtual2. Thin Clone1. Physical
![Page 8: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/8.jpg)
=
database
1. Physical Cloning
![Page 9: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/9.jpg)
Problem
Developers
QA and UAT
Reports
First copy
Production
• CERN - European Organization for Nuclear Research
• 145 TB database• 75 TB growth each year• Dozens of developers want copies.
![Page 10: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/10.jpg)
workaroundsDevelopers
QA and UAT
ReportsShared
Sub set copy
Production
Many copies
![Page 11: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/11.jpg)
Physical Clones
Database SubsetsShared Databases
![Page 12: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/12.jpg)
Subsets
![Page 13: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/13.jpg)
ProductionThe Production ‘Wall’
Classic problem is that queries that run fast on subsets hit the wall in production.
Developers are unable to test against all data
![Page 14: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/14.jpg)
Shared Full
![Page 15: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/15.jpg)
Shared access = Poor Productivity
Developerfrustration
Databases become old and unrepresentative.
![Page 16: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/16.jpg)
Never enough environments
Average customer makes 12 copies of production- Charles Garry, Database Product Manager Oracle
![Page 17: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/17.jpg)
Physical CopiesTime consuming
Copy RMAN backup, archive logs, copy data over, recover
Coordinate System, Storage ,Database ,Network, manager
Space consuming 20 report DBs x 40 TB = 800TB
=> bottlenecks
“Culture of NO”
![Page 18: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/18.jpg)
![Page 19: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/19.jpg)
Setup Develop
![Page 20: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/20.jpg)
Setup Develop
QA
![Page 21: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/21.jpg)
$40M
$75M
$850M
$27,000M
Storage
IT
Develop
Business
![Page 22: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/22.jpg)
“Culture of NO”
![Page 23: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/23.jpg)
ERP Project Failures 2011
• NYC CityTime : delays $63 M => $760 M • Montclair Uni: delays sues PeopleSoft• Idaho : delays ERP cost millions
Standish : IT Project Failure Rate
1994 1996 1998 2000 2002 2004 2009
31% 40% 28% 23% 15% 18% 24%
★http://www.galorath.com/wp/software-project-failure-costs-billions-better-estimation-planning-can-help.php*http://www.pcworld.com/article/246647/10_biggest_erp_software_failures_of_2011.html
![Page 24: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/24.jpg)
NoDBAhttp://martinfowler.com/bliki/NoDBA.html
![Page 25: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/25.jpg)
Clone 1 Clone 3
99% of blocks are Identical
Clone 2
![Page 26: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/26.jpg)
![Page 27: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/27.jpg)
2. Thin Cloning
![Page 28: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/28.jpg)
Clone 1 Clone 2 Clone 3
Thin Provision
![Page 29: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/29.jpg)
2. Thin Cloning
Cornerstone Technology: File System Snapshots
![Page 30: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/30.jpg)
Thin Cloning
1. Put database in hot backup2. Snapshot DB Files @ point in time3. Take database out of hot backup
Copy to non-production Snapshot again Export over NFS or FC to Host
4. Recovery Database
![Page 31: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/31.jpg)
I. ClonedbII. Copy on Write Snapshots
a) EMC (COFW)b) EMC w/ SRDF,Recover Point
III. Allocate on Writea) ZFSb) EMC VNX (ROW)c) Netapp (WAFL)
2. Thin Provision Cloning
![Page 32: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/32.jpg)
RMAN backup
dNFSsparse file
I. clonedb
![Page 33: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/33.jpg)
RMAN backup
dNFSsparse file
I. clonedb
![Page 34: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/34.jpg)
I. CloneDB1. dNFS 11.2.0.2+
– cd $ORACLE_HOME/rdbms/lib– make -f ins_rdbms.mk dnfs_on
2. Clonedb.pl initSOURCE.ora output.sql– MASTER_COPY_DIR="/rman_backup”– CLONE_FILE_CREATE_DEST="/nfs_mount”– CLONEDB_NAME="clone"
3. sqlplus / as sysdba @output.sql– startup nomount PFILE=initclone.ora – Create control file backup location– dbms_dnfs.clonedb_renamefile ('/backup/file.dbf' , '/clone/file.dbf');– alter database open resetlogs;Tim Hall
www.oracle-base.com/articles/11g/clonedb-11gr2.php
![Page 35: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/35.jpg)
I. CloneDB
RMAN
physical
Target A NFS Server
Clone 1
Clone 2
Read only Clone 3
Target B
Clone 1
Clone 2
Clone 3
![Page 36: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/36.jpg)
I. clonedbII. Copy on First Write (COWF)
a) EMC BCVb) EMC w/ SRDF,Recover Point
III. Allocate on Writea) ZFSb) EMC VNX (ROW)c) Netapp (WAFL) ZFS
2. Thin Provision Cloning
![Page 37: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/37.jpg)
D
ActiveFile
SystemSnapshot
CBA
File System constant - EMC
II. Copy on Write a) EMC snapshots
![Page 38: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/38.jpg)
D
ActiveFile
SystemSnapshot
DCBA
Changes written in place - EMCChanges to new area - VMware
II. Copy on Write a) EMC snapshots
![Page 39: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/39.jpg)
Non-Prod FilerEMC Filer
Database Luns
Target A
Target B
Target C
Clone 1
Clone 2
Clone 3
Clone 4
SnapshotsMax 16No BranchingMultiple Copies
a) EMC BCVIII. Allocate on Write
BCV Day 1
snapshot
Snapshotor break
Day 2
Timefinder – snapshots multiple LUNs
SnapshotsWrite Penalty
![Page 40: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/40.jpg)
Non-Prod FilerEMC Filer
ProductionDatabase
Database Luns
Target A
Target B
Target C
Clone 1
Clone 2
Clone 3
Clone 4
File system level
SRDF Symetrix
Snapshot day 1
Snapshot day 1
Snapshot day 2
Snapshot day 2
II. Copy on Write b) EMC SRDF
Recover Point Appliance
SnapshotsMax 16No Branching
![Page 41: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/41.jpg)
I. clonedbII. Copy on Write (COFW)
a) EMC BCVb) EMC SRDF or Recover Point
III. Allocate on Writea) ZFSb) EMC VNX (ROW)c) Netapp (WAFL)
2. Thin Provision Cloning
![Page 42: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/42.jpg)
Data Blocks
root
a. ZFSb.EMC VNX (ROW)c. Netapp(WAFL)
III. Allocate on Write
![Page 43: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/43.jpg)
Jonathan Lewis © 2013
ZFS
a b c d e f g h i
Data
Metadata128 entries per block
![Page 44: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/44.jpg)
a b c d e f g h i
"Updates"
b' c'
Data only becomes visible when root block is written
Jonathan Lewis © 2013
![Page 45: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/45.jpg)
Aging data
Blocks that can be freed when we don’t want the older snapshot any more
a d e f g h i
b' c'
b c
Jonathan Lewis © 2013
![Page 46: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/46.jpg)
a d e f g h i
New State
b' c'
Jonathan Lewis © 2013
![Page 47: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/47.jpg)
Cloning
b' c'a d e f g h i
My clone(filesystem)
Your clone(filesystem)
Jonathan Lewis © 2013
![Page 48: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/48.jpg)
a) ZFS
• 1 disk = 1 filesystem• ~1990: N disks = 1 FS• 2001: ZFS starts• 2005: ZFS ships• 2008: ZFS storage appliance ships• 2010: Delphix heads ZFS open source
• Dephix also produces own file system DxFS originally based on ZFS
III. Allocate on Write
![Page 49: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/49.jpg)
FS vs. ZFS• FS per Volume
• FS limited bandwidth
• Storage stranded
• Many FS in a pool
• Grow automatically
• All bandwidth
Storage PoolVolume
FS
Volume
FS
Volume
FS ZFS ZFS ZFS
3a) ZFSIII. Allocate on Write
![Page 50: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/50.jpg)
a) ZFS
Snapshot rootLive root
Delphix Proprietary and Confidential
ZilIntent Log
III. Allocate on Write
![Page 51: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/51.jpg)
ZFS Appliance + RMAN
1. ZFS Appliance– Project db_master– Project db_clone – 4 file systems: datafile, redo, archive, alerts
2. Source Database– NFS Mount ZFS Appliance – Backup with RMAN
3. ZFS Appliance• Select db_master• Snapshots• Then each filesystem on db_master clone it onto db_clone
4. Target Host– NFS Mount db_clone– recover clone
cloning-solution-353626.pdf
a) ZFS III. Allocate on Write
![Page 52: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/52.jpg)
Oracle ZFS Appliance + RMAN
1. physical
ZFS Storage Appliance
RMAN Copyto NFS mount
Target A
Clone 1
Clone 1
Snapshot
NFS
a) ZFS III. Allocate on Write
cloning-solution-353626.pdf
RMANCopytoday
RMANCopy
Yesterday
![Page 53: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/53.jpg)
NetApp FilerNetApp Filer
Database Luns
snapshot
Target A
Target B
Target C
Clone 1
Clone 2
Clone 3
Clone 4
snapshot
clones
b) NetappIII. Allocate on Write
![Page 54: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/54.jpg)
NetApp FilerNetApp Filer
ProductionDatabase
Database Luns
snapshot
Target A
Target B
Clone 1
Clone 2
snapshot
snapshot
snapshot
b) NetappIII. Allocate on Write
![Page 55: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/55.jpg)
NetApp FilerNetApp Filer
Physical Database
Database Luns
snapshot
Target A
Target B
Clone 1
Clone 2
snapshot
snapshot
snapshot
b) NetappIII. Allocate on Write
![Page 56: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/56.jpg)
Netapp tr-3761.pdf
![Page 57: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/57.jpg)
Netapp
Snap Manager
SnapManagerRepository
Protection Manager
Snap Drive
Snap Manager
Snap Mirror
Flex Clone
RMANRepository
Production
Development
DBA
Storage Admin
![Page 58: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/58.jpg)
NetApp Filer - DevelopmentNetApp Filer - Production
Database Luns
Target A
Target B
Target C
Clone 1
Clone 2
Clone 3
Clone 4
Snap mirror
Snapshot Manager for Oracle
Flexclone
Repository Database
Netapp
SnapDrive
Protection Manage
Production
Development
![Page 59: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/59.jpg)
I. clonedbII. Copy on First Write (COFW)
a) EMC BCV b) EMC SRDF or Recover Point
III. Allocate on Writea) ZFS b) EMC VNX (ROW)c) Netapp (WAFL)
2. Thin Provision Cloning
![Page 60: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/60.jpg)
• Clonedb • EMC BCV• ZFS
• EMC SRDF• EMC VNX• Netapp*
2. Review: Thin Provision Cloning
*Netapp is best solution and complicated
![Page 61: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/61.jpg)
![Page 62: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/62.jpg)
2. Thin Cloning
![Page 63: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/63.jpg)
2. Thin Provision Cloning
![Page 64: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/64.jpg)
![Page 65: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/65.jpg)
3. Database Virtualization
![Page 66: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/66.jpg)
Virtualization Layer
Virtualization
SMU
![Page 67: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/67.jpg)
DatabaseVirtualizationAppliance(DVA)
3 Physical Copies 3 Virtual Databases
![Page 68: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/68.jpg)
One time backup of source database
Database
Production
Instance
File system
RMAN APIs
![Page 69: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/69.jpg)
ZFS (Oracle) and DxFS (Delphix) Compress Data
Database
Production
Instance
File system
Data is compressed typically 1/3 size
![Page 70: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/70.jpg)
Incremental forever change collection
Database
Production
Instance
File system
Changes are collected automatically foreverData older than retention widow freed
![Page 71: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/71.jpg)
Typical Architecture
Database
File system
Production
Instance
Database
File system
Development
Instance
Database
File system
QA
Instance
Database
UAT
Instance
File system
![Page 72: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/72.jpg)
Database
File system
Production
Instance
Database
Development
Instance
Database
QA
Instance
Database
UAT
Instance
![Page 73: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/73.jpg)
Virtualization Layer
x86 hardware
Allocate StorageAny type
SMU
Choose your virtualization Layer:• Delphix and Oracle SMU automated out of box• Netapp and EMC SRDF/Recover Point require massive scripting• Delphix share blocks in memory
ZFS Storage Appliance
![Page 74: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/74.jpg)
a) Oracle 12c SMUOracle Snap Management Utility for ZFS Appliance
• Requires ZFS Appliance• Supports Linux , Solaris 10+, Windows 2008+• GUI
– snapshot source databases – provision virtual databases
3. Database Virtualization
![Page 75: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/75.jpg)
![Page 76: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/76.jpg)
Use Cases
1. Development2. Backup3. Reporting
![Page 77: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/77.jpg)
1. Development Acceleration
![Page 78: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/78.jpg)
1: Development Acceleration
a) Developer each get a copy– Fast, fresh, full, frequent– Self service
b) Branching *c) Federated *
* Delphix only
![Page 79: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/79.jpg)
Source
FastSource Database
Target HostVirtual
Database
NFS
Fiber
Fiber
RMAN over TCP
No Data Movement
![Page 80: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/80.jpg)
Source
Fresh
Virtual Database
Fiber
![Page 81: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/81.jpg)
Source
Frequent
Virtual Database
Virtual Database
Target Hosts
Virtual Database
Virtual Database
Fiber
![Page 82: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/82.jpg)
Full clones
![Page 83: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/83.jpg)
Self Service
![Page 84: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/84.jpg)
1 b) Rapid QA via Branching
![Page 85: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/85.jpg)
dSource
1 b) Branching
Developer VDB
QA VDB
![Page 86: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/86.jpg)
Devv2.6 v2.6v2.6
QA UAT
v2.6
v2.6 v2.6v2.6v2.7
v2.6 v2.6v2.6v2.8
v2.6v2.6 v2.6v2.6
v2.6v2.7 v2.6v2.7
v2.6v2.8 v2.6v2.8
![Page 87: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/87.jpg)
Devv2.6 v2.6v2.6
QA UAT
v2.6Production
v2.6 v2.6v2.6v2.7
v2.6 v2.6v2.6v2.8
Source Control for the database data
v2.6v2.6 v2.6v2.6
v2.6v2.7 v2.6v2.7
v2.6v2.8 v2.6v2.8
![Page 88: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/88.jpg)
DevProd
2.6
![Page 89: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/89.jpg)
Dev
QA
Prod
2.6
![Page 90: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/90.jpg)
Dev
QA
UAT
Prod
2.6
![Page 91: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/91.jpg)
Dev
QA
UAT
Prod
Dev
QA
UAT
2.6
2.7
![Page 92: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/92.jpg)
Dev
QA
UAT
Prod
Dev
QA
UAT
2.6
2.7
Dev
QA
UAT2.8
![Page 93: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/93.jpg)
Dev
QA
UAT
Prod
Dev
QA
UAT
2.6
2.7
Dev
QA
UAT2.8
Data Control = Source Control for the Database
![Page 94: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/94.jpg)
Dev
QA
UAT
Dev
QA
UAT
2.6
2.7
Dev
QA
UAT
2.8
Data Control = Source Control for the Database
Production Time Flow
![Page 95: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/95.jpg)
1 c) Federated Cloning
![Page 96: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/96.jpg)
![Page 97: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/97.jpg)
Source2
Source3
Source1
1 c) Federated sources
Virtual Database
Virtual Database
Virtual Database
Virtual Database
![Page 98: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/98.jpg)
“I looked like a hero”Tony Young, CIO Informatica
![Page 99: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/99.jpg)
1. Review Development Use Cases
a) Developer each get a copy
b) QA (Branching) *
c) Federated *
* Delphix only
![Page 100: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/100.jpg)
2. Quality
a) Forensicsb) A/B testingc) Recovery
![Page 101: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/101.jpg)
Source
2 a) Forensic Analysis
Virtual Database
![Page 102: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/102.jpg)
Source
2 b) Upgrades, Patches, RAT, A/B
Virtual Database
![Page 103: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/103.jpg)
• Production vs Virtual– invisible index on Prod– Creating index on virtual
• Flashback vs Virtual• Keep tests for compare
2 b) Upgrades, Patches, RAT, A/B
![Page 104: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/104.jpg)
2 c) Recovery
![Page 105: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/105.jpg)
Source
2 c) Logical Recovery Production
Virtual Database
![Page 106: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/106.jpg)
Source
2 c) Logical Recovery Development
Virtual Database
VDB rolled back
![Page 107: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/107.jpg)
Source
Recovery
VDB
V2P
![Page 108: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/108.jpg)
2. Review Quality
a) Forensics
b) A/B testing
c) Recovery : Logical and physical
![Page 109: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/109.jpg)
3: Analyticsa) Fast refreshes
b) Temporal queries
c) Confidence testing
![Page 110: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/110.jpg)
Fast Refreshes• Refresh in minutes• Without data movement• Faster , cheaper
Physical Virtual
![Page 111: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/111.jpg)
Temporal Data
![Page 112: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/112.jpg)
3: reportinga) Fast refreshes
b) Temporal queries
c) Confidence testing
![Page 113: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/113.jpg)
Review: Use Cases
1. Developmenta) Full, Fresh, Fast , Self Serveb) QA Branchingc) Federated
2. Qualitya) Forensicsb) Testing : A/B, upgrade, patchc) Recovery: logical, physical
3. Reportinga) Fast refreshb) Temporal Datac) Confidence testing
![Page 114: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/114.jpg)
Typical Architecture
Database
File system
Production
Instance
Database
File system
Development
Instance
Database
File system
QA
Instance
Database
UAT
Instance
File system
![Page 115: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/115.jpg)
Database
File system
Production
Instance
Database
Development
Instance
Database
QA
Instance
Database
UAT
Instance
Delphix & Oracle SMU
![Page 116: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/116.jpg)
EM 12c: Snap Clone DBaaS
Handles Clone Provisioning
Netapp can handle source database change synchronization with development storage array
EM 12c clone provisioning not currently compatible with Netapp synchronization technology
![Page 117: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/117.jpg)
Netapp EM 12c w/ Netapp DVA
Thin clone limited (1) limited (1) yes (1) limited # snapshots
Source linking limited (2) no yes (2) no continuous pull
Provision VDB no limited (3) yes (3) limited to snapshots
User ready no limited (4) yes (4) no branching
Cloud ready no no yes
DVA = database virtualization appliance
![Page 118: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/118.jpg)
![Page 119: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/119.jpg)
over 10 times
"perhaps the single largest storage consolidation opportunity history“
![Page 120: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/120.jpg)
![Page 121: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/121.jpg)
![Page 122: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/122.jpg)
![Page 123: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/123.jpg)
Oracle 12c
![Page 124: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/124.jpg)
80MB buffer cache ?
![Page 125: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/125.jpg)
200GBCache
![Page 126: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/126.jpg)
5000
Tnxs
/ m
inLa
tenc
y
300 ms
1 5 10 20 30 60 100 200
with
1 5 10 20 30 60 100 200Users
![Page 127: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/127.jpg)
8000
Tnxs
/ m
inLa
tenc
y
600 ms
1 5 10 20 30 60 100 200Users
1 5 10 20 30 60 100 200
![Page 128: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/128.jpg)
Memory Prices
• EMC sells $1000/GB• X86 memory $30/1GB
• TB RAM on a x86 costs around $32,000 • TB RAM on a VMAX 40K costs around $1,000,000
![Page 129: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/129.jpg)
$1,000,000
$32,000
$6,000
Prices to cache 200GB database in memory either on• Target hosts• EMC array• Delphix Appliance
![Page 130: Toug 2013 delphix_share](https://reader037.vdocuments.site/reader037/viewer/2022103111/54c6ed1f4a7959ac2f8b4589/html5/thumbnails/130.jpg)
Database Virtualization