ise information systems engineering - oracle dwh · ise information systems engineering ... exadata...

www.ise-informatik.de

16. August 2010, ise GmbH

ISE Information Systems Engineering

Firmenpräsentation

& Datawarehouse Expertise


30. März 2011, ise GmbH

Oracle ExadataeXtreme MigrationHerbert Rossgoderer


Solutions

built for

You.Über ISE – Information Systems Engineering

� IT-Consultingfirma � Gesellschaftsform GmbH

� Unternehmensberatung für Groß- und Mittelstandsunternehmen

� Gründungsjahr: 1991

� Schwerpunkte:

� Oracle Core Technology � Datenbank (RAC), Application Server

� Oracle EXADATA � eXtreme Performance

� Oracle Datawarehouse & BI

� Oracle Beehive

�

Copyright (C) ISE GmbH - All Rights Reserved 3

� Migrationen

� Individuelle Softwareentwicklung und Consulting

� Mitarbeiter: 60

� Standorte: Gräfenberg bei Nürnberg (Hauptsitz), München, Nürnberg (Niederlassungen)


Solutions

built for

You.

www.ise-exadata-testcenter.de


The first and only Exadata Testcenter in Germany

“Fly&Try”


Solutions

built for

You.ISE Exadata Testcenter �� „Fly&Try“

ISE operates the first and only Exadata Testcenter in Germany – directly at the Nuremberg Airport

The ISE Exadata Testcenter can be used by customers exclusively for a certain period of time.

Customers are supported by Oracle and ISE Experts working with Exadata technology from the very beginning and

were also involved in the first Exadata implementations in Europe.

Fly Try Buy

• Fly to Nuremberg Airport

• Go directly to the Testcenter

• CheckIn at Airport Hotel

• Load your own data

• Stress the Machine

• Benchmarks

• Evaluation

• See amazing results

• Decide for Exadata

• Design right architecture

• Migration concepts


Preparation Execution Wrap-Up

• Load your own data

• Deploy your application• Evaluation

• PoC

•Hands On Trainings

• Migration concepts

• Integration concepts


Solutions

built for

You.

First

Exadata & ExalogicTestcenter in EMEA

Oracle Exalogic Elastic Cloud



Solutions

built for

You.

Sun Oracle Exadata X2


Overview


Solutions

built for

You.Exadata Evolution

Sun Oracle (V2)

Database Machine

�� DWH + OLTP

Sun Oracle (X2-2 / X2-8)

Database Machine

�� DWH + OLTP + Consolidation


HP Oracle (V1)

Database Machine

�� DWH

09/2008

09/2009

09/2010


Solutions

built for

You.

Database Grid Intelligent Storage Grid

14 High-performance low-cost

storage servers8 x 2-way 6-core servers � 96 cores (x86-64)

Scaleable Grid of industry standard servers for Compute and Storage

Exadata Hardware Architecture


InfiniBand Network

OR

2 x 8-way 8-core servers� 128 cores (x86-64)

168 Intel cores in storage

100 TB High Speed disk, or336 TB High Capacity disk

5.3 TB PCI Flash

Data mirrored across storage servers

3 36-port 40Gb/s switches

Unified Net- servers & storage

1080 4Gb/s FC Ports equivalent

Oracle Linux or Solaris 11 Express


Solutions

built for

You.

Complete Family Of Database MachinesFor OLTP, Data Warehousing & Consolidated Workloads

Oracle Exadata X2-8Oracle Exadata X2-2


� Quarter, Half, Full and Multi-Racks • Full and Multi-Racks


Solutions

built for

You.

Oracle Exadata X2


Capacity and Performance


Solutions

built for

You.

Performance figures

Component Theory (Bit/s) max. useful MB/s

CPU Core 100-200 MByte/s

Fibre Channel 2GFC 2 Gbit/s 200 MByte/s

Basic Performance Figures




Ethernet 1GigE 1 Gbit/s 100 MByte/s

Ethernet 10GigE 10 Gbit/s 1240 MByte/s

Infiniband DDR 4x 20 Gbit/s 2048 MByte/s

Infiniband QDR 4x 40 Gbit/s 4096 MByte/s


Solutions

built for

You.Exadata Product Capacity

X2-2

Quarter Rack

X2-2

Half Rack

X2-2

Full Rack

X2-8

Full Rack

Raw Disk1HP disks 21 TB 50 TB 100 TB 100 TB

HC disks 72 TB 168 TB 336 TB 336 TB

Raw Flash1 1.1 TB 2.6 TB 5.3 TB 5.3 TB


User Data2

(assuming no

compression)

HP disks 6 TB 14 TB 28 TB 28 TB

HC disks 21 TB 50 TB 100 TB 100 TB

1 – Raw capacity calculated using 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes.

2 – User Data: Actual space for end-user data, computed after single mirroring (ASM normal redundancy) and after

allowing space for database structures such as temp, logs, undo, and indexes. Actual user data capacity varies by

application. User Data capacity calculated using 1 TB = 1024 * 1024 * 1024 * 1024 bytes.


Solutions

built for

You.Exadata Product Performance

X2-2

Quarter Rack

X2-2

Half Rack

X2-2

Full Rack

X2-8

Full Rack

Raw Disk Data Bandwidth1,4

HP disks 5.4 GB/s 12.5 GB/s 25 GB/s 25 GB/s

HC disks 3 GB/s 7 GB/s 14 GB/s 14 GB/s

Raw Flash Data Bandwidth1,4 11 GB/s 25 GB/s 50 GB/s 50 GB/s


Disk IOPS3,4HP disks 10,800 25,000 50,000 50,000

HC disks 5,400 12,500 25,000 25,000

Flash IOPS3,4 225,000 500,000 1,000,000 1,000,000

Data Load Rate4 1 TB/hr 2.5 TB/hr 5 TB/hr 5 TB/hr

1 – Bandwidth is peak physical disk scan bandwidth, assuming no compression.

2 – Max User Data Bandwidth assumes scanned data is compressed by factor of 10 and is on Flash.

3 – IOPs – Based on IO requests of size 8K

4 – Actual performance will vary by application.


Solutions

built for

You.

Oracle Exadata


Software Features


Solutions

built for

You.Exadata Software Features

� Exadata Smart Scans

� 10X or greater reduction in data sent to database servers

� Exadata Storage Indexes

� Eliminate unnecessary I/Os to disk

� Exadata Hybrid Columnar Compression (EHCC)

� Efficient compression increases effective storage capacity and increases user data scan bandwidths by a factor of 10X


increases user data scan bandwidths by a factor of 10X

� Exadata Smart Flash Cache

� Breaks random I/O bottleneck by increasing IOPs by 20X

� Doubles user data scan bandwidths

� I/O Resource Manager (IORM)

� Enables storage grid by prioritizing I/Os to ensure predictable performance

� Inter-leaved Grid Disks

� Enables storage grid that allows multiple applications to place frequently accessed data on faster portions of the disk


Solutions

built for

You.

Oracle Exadata


Physical Migration Paths


Solutions

built for

You.

AttributeAttribute ValueValue DescriptionDescription

Platform Platform

DependencyDependencyYes Linux x86- 64 bit

Oracle Oracle

DependencyDependencyYes Source system should be on 11g Release 2

This method will move ASM extents. No change on

ASM Online


Metadata ChangeMetadata Change Manualdatabase level storage parameters. All large

segments should be created with 4M-8M INITIAL &

NEXT STORAGE parameters

Migration OutageMigration OutageOnly during

pre-migration

During ASM rebalance operation major data

warehousing activity can continue without

interruption.

OthersOthers• Your existing disk group should be in NORMAL redundancy.

• For performance reasons you should be using 4M AU size

Best Suits ForBest Suits For

1. Linux platforms already running on Oracle 11g Release 2 ASM

databases with diskgroup AU of 4M

2. Exadata v1 Users


Solutions

built for

You.


Platform Platform

DependencyDependencyYes Linux x86- 64 bit

Oracle Oracle

DependencyDependencyYes Source system should be on 11g Release 2

Metadata ChangeMetadata Change Manual

This will be moving Oracle blocks as they are. All

large segments should be created with 4M-8M

INITIAL & NEXT STORAGE parameters

RMAN



Migration OutageMigration Outage Low

•If database is running FORCE LOGGING mode your

down time will be low

•Recovery + Control File Update Time

•If not you should take tablespaces into readonly

mode during migration (by one by) which increase

downtime

OthersOthers --

Best Suits ForBest Suits For

1. Linux platforms already running on Oracle 11g Release 2 ASM

databases

2. Exadata v1 Users


Solutions

built for

You.


Platform Platform

DependencyDependencyYes Limited

Oracle Oracle

DependencyDependencyPartially Metalink Note 413484.1


DataGuard - Physical Standby


Metadata ChangeMetadata Change Manual large segments should be created with 4M-8M


Migration OutageMigration OutageOnly during

pre-migration

OthersOthers --

Best Suits ForBest Suits For Migration of an LOGGING OLTP system to Exadata v2


Solutions

built for

You.


Platform Platform

DependencyDependencyYes Little Endian

Oracle Oracle

DependencyDependencyYes Source system should be on 11g Release 2.


Transportable Database



INITIAL & NEXT STORAGE parameters.

Migration OutageMigration Outage Medium

OthersOthers --

Best Suits ForBest Suits For Little Endian databases running on 11g Release 2


Solutions

built for

You.


Platform Platform

DependencyDependencyYes Broad

Oracle Oracle

DependencyDependencyYes


Transportable Tablespace



INITIAL & NEXT STORAGE parameters.

Migration OutageMigration Outage Medium

OthersOthers --

Best Suits ForBest Suits ForGood for large databases to be moved but requires a bit of manual

effort.


Solutions

built for

You.

Oracle Exadata


Logical Migration Paths


Solutions

built for

You.Logical Migration Paths

PathPath

SourceSource

DB DB

VersionVersion

SourceSource

PlattformPlattform

SupportSupport

Time &Time &

EffortEffort

MigrationMigration

OutageOutage

LogicalLogical

StandbyStandbyNo Limited High Very Low

Even


Golden GateGolden Gate

Even

Non-

Oracle

Broad High Very Low

Data PumpData Pump >10g Broad Medium Partial

X X –– MigratorMigrator No All* Low Partial


Solutions

built for

You.

Oracle Exadata


Migration Infrastructure


Solutions

built for

You.

Voltaire 4036E

Gateway

Migration Architecture @Turkcell

Sun M9000SPARC Solaris

Oracle Exadata V2OEL 5.3 Linux x86

2 x 10GigE 2 x IB QDR


Voltaire 4036E

Gateway

7 TB/h7 TB/h

120 TB 30 TB

2 x 10GigE 2 x IB QDR


Solutions

built for

You.

EMC DMX-4

70 TB

HITACHI USP-V

50 TB

Sun M9000 Sparc 7

176 Threads

ORACLE Exadata

V2

Migration Gain @Turkcell

OLD SYSTEM NEW SYSTEM


OLD SYSTEM NEW SYSTEM

Server Model Sun M9000 Oracle Exadata V2

Cpu Type Sun Sparc 7 2.52 GHz Xeon® E5540 Processors 2.53 GHz

Number Of CPU Threads 176 128

Total Main Memory 512 GB 576 GB

Total Storage Capacity 120 TB 30 TB

Storage Connection Technology Fiber Channel (32 x 4 Gtbit/s) Infiniband ( 8 x 40 Gbit

Storage Maximum IO Throughput Capacity 5 GB/s 21 GB/s

Server + Storage units Total Power 57 KVA 20 KVA

Server + Storage units Total Form Factor 11 Rack 1 Rack

Approximate Data Backup Duration 44 Hours 14 Hours

Number of Backup Tape Cartridges Per Backup 159 57


Solutions

built for

You.

Ethernet Switch

Migration Architecture @AVEA

IBM p570AIX 5.3


8 x 1GigE


Ethernet Switch

2 TB/h2 TB/h

120 TB 30 TB


Solutions

built for

You.Migration Architecture @E-Plus

Oracle Sun T5440SPARC Solaris


6 x 1GigE


1.81.8 TB/hTB/h

42 TB 13 TB


Solutions

built for

You.

Oracle Exadata


X-Migration Concept


Solutions

built for

You.X-Migration Overview

Layer

ce

Extra

cx


Abstraction –

xmigsourc

ction – Layer

xmigtarg

et


Solutions

built for

You.X-Migration Concept

� Abstraction Layer (Xmigsource)

� XViews based on source objects (tables|partitions|subpartitions)

� Metadata – Transfer (Xmeta)

� Exp utility – generate ddl (tables|indexes|constraints) from dumpfile

� Move tables to different tablespaces

� Modify compression on tables|partitions|subpartitions

� Data – Transfer (Xcore)


� Data – Transfer (Xcore)

� Transfer data from source database using database links

� Insert /*+ append */ into [Target Table|Partition|Subpartition] select * from XVIEW[0-X]@SourceDBLink

� Post – Migration (Xpost)

� Create index|constraint|procedures|objects using imp

� Compute database statistics

� Extraction Layer (Xmigtarget)

� Databaselinks & extract/load mappings


Solutions

built for

You.X-Migration Features

� Scaleability

� X-Migration supports scaleout and scaleup architectures to minimize

migration timeouts

� Performance

� X-Migration performs data transfers hitting the limit of the given

infrastructure

Compatibility & Flexibility


� Compatibility & Flexibility

� X-Migration is compatible with any version – from Oracle 8i onwards

� X-Migration enables metadata manipulation (move tablespaces,

change compression at table|partition|subpartition level)

� X-Migration is a method which could easily be extended with new

features

� Advantages

� X-Migration does not require any additional diskspace to the database

storage (no large export files)


Solutions

built for

You.X-Migration Baseline @E-Plus

� Source Databases

� Oracle 9i SPARC Solaris

� 6 Databases combining 42 TByte payload (34TByte Tables | 8TByte

Index)

� Target Databases

� Oracle 11gR2 on Linux x86 (Oracle Exadata V2 – Full Rack)


� Oracle 11gR2 on Linux x86 (Oracle Exadata V2 – Full Rack)

� Connectivity

� Source and target machines are connected via 6 x 1GBit Ethernet links

(cross over)


Solutions

built for

You.X-Migration Baseline @E-Plus

� Source Machine

� Oracle Sun T5440 (256 Threads)

� 6 x 1Gbit Ethernet interfaces

� Listener listening on 6 ip adresses on direct connections

� Source Storage


� DWHP|DWHKDP – FibreChannel splitt mirror from production

� SCOP|CMCP|CLMP|CLMC – 1Gbit/s NFS storage

� Target Machine

� Oracle Exadata V2 Full Rack (8 compute nodes / 14 storage cells)


Solutions

built for

You.X-Migration Facts @E-Plus

DatabaseDatabaseSourceSource

Table (GB)Table (GB)

SourceSource

Index (GB)Index (GB)

MigrationMigration

TimeTime

Target*Target*

Table (GB)Table (GB)

TargetTarget

Index (GB)Index (GB)

DWHPDWHP 14.000 4.000 10:00 h 4.500 2.000

DWHKDPDWHKDP 13.000 1.000 7:30 h 730 400


SCOPSCOP 1.800 500 6:00 h 850 300

CMCPCMCP2.000 1.000 6:30 h 800 700

CLMPCLMP 1.200 800 5:00 h 1.000 700

CLMCCLMC 450 350 3:00 h 250 200

* using OLTP and EHCC compression as well as shrinking high water mark of segments


Solutions

built for

You.

Q & A


Q & A

ise information systems engineering - oracle dwh · ise information systems engineering ... exadata...

Documents