p.2 pts odi11g odi overview

7/26/2019 p.2 Pts Odi11g Odi Overview

1/31

Copyrigh

t2010,Oracle.Allrightsreserve

d.


2/31

PTSWo

rkshop:ODI11g

OracleDataIntegrator

Overview


3/31

Agenda

DataIntegrationOve

rview

ODI:K

eyBenefits

ODIatOracle

Q&A

Copyrigh


d.


4/31

Oracle

DataIntegration

Copyrigh


d.


5/31

1.

DoMo

rewithLess

2.

CompeteGlobally24X7

Designmetadata-driveninte

gration

Leverag

eskills&dictatepatterns

Ensure

continuousuptime

Access

datainrealtime

Busin

essDriversforData

Integratio

n

AddValu

etotheCoreBusinessLines

Copyrigh


d.

3.

UseDataforCompetitive

Advan

tage

4.

Autom

ateandAdapt

BusinessProcesses

Ensure

thequalityofyourd

ata

Actively

governmostvaluab

leasset

Expose

dataservicesforreuse

OrchestrateprocessesusingSOA


6/31

ProjectDriversforDataIn

tegration

Essentia

lIngredientforInformationAgility St

rategicValueofDataIntegration

ConsistencyformajorenterpriseinitiativeslikeBI,DW,&MDM

Commontechnicalfoundationplatformacrossdatas

ilos

Centralpointfordatagovernance,availabilityandco

ntrols

Copyrigh


d.

KeyDataIntegrationUseCases

BI,DW,andOLTPDataIntegration&Replicatio

n

SOA,Enterpris

eIntegration&Modernization

Migrationsand

MasterDataManagement


7/31

OracleDataIntegrationSolution

Best-in-c

lassHeterogeneo

usPlatformforDa

taIntegration

M

DM

Applications

SOA

Platforms

Oracle

Application

s

Business

Intelligence

Activity

Monitoring

Custom

Applications

OracleGoldenGate

SOAAbs

tractionLayer

ServiceB

us

ProcessManager

DataServices

OracleDataInterator

OracleData

ualit

DataFederation

ComprehensiveDataIntegrationSolution

Copyrigh


d.

Log-basedCDC

Bi-directionalReplication

Real-timeData

ELT/ETL

DataTransformation

BulkDataMovement

OLTP

System

FlatFile

s

DataWarehouse/

DataMart

OLAPCube

Web2.0

WebandEven

t

Services,SOA

Storage

DataVerification

DataProfiling

DataParsing

DataCleansing

DataLineage

MatchandMerge


8/31

Oracle

DataIntegratorEnterp

riseEdition

Optimized

E-LTforimproved

Performance,Prod

uctivityandLowerTCO

E

-LTTransformation

vs.E-T-L

AnyData

Warehouse

Legacy

Sources

Copyrigh


d.

BestinclassforPerformance,

Sc

alability,Availability

LightweightDeployment

for

LoweringTCO

Faste

rtime-to-valuethrou

gh

DeclarativeDesign

Any

Planning

System

OLTPDB

Sources

Application

Sources

Heterogeneous,Openand

Standards-based


9/31

Oracle

GoldenGateOverview

Enterprise-wideSolutionfo

rRealTimeData

Needs

LogBa

sed,

Real-

TimeChangeData

Ca

ture

DisasterReco

very,

DataProtection

ZeroDowntime

Migrationand

Upgrade

s

Operational

Standby

(Open&Active)

StandardizeonSingle

TechnologyforMultipleNeeds

DeployforContinuou

s

Av

ailabilityandReal-t

imeData

Ac

cessforReporting/BI

Copyrigh


d.

Heterogeneous

SourceSystems

EDW

ODS

EDW

eporng

Real-timeBI

Database

O

GG

ETL

ETL

QueryOffloading

DataDis

tribution

HighlyFlexible

Fa

stDeployments

Lo

werTCO&ImprovedROI


10/31

GovernDataBe

tterwithD

ataQuality

DataMovement

E-LT&ETL

DataTrans

formation

ChangeDa

taCapture

DataAcces

s

DataServices

DataProfiling

StatisticalAnalysis

Rule-based

Validation

Monitoring&

Timeslice

Fine-grained

Auditing

DataMovem

ent

Copyrigh


d.

DataCleansing

DataValidationduringETL

DataStandardiz

ation

AddressMatchin

g&Dedup

ErrorHospital/Workflow

Data

Cleansing

D

ataProfiling

Da

taIntegration


11/31

ImprovePerformance

andScalability

1.IntegratedwithApplicationGrid

2.D

atasourceconn

ectionpooling

3.U

nifiedJDevenvironment

WhatsNewinOracleDataIntegrator11g

DesignThemes

Copyrigh


d.

ow

er

ShortenT

imetoValue

5.N

ewconnectivity

toOLAP,SAP

6.E

mbeddedAPIfo

rapplications

4.E

nterpriseManag

er


12/31

CY2009

CY2011

Unified

Team

High-L

evelDataIn

tegrationR

oadmap

NaturalUpgradePath

forExistingSo

lutions

OWB

10gR1

O

WB

1

0gR2

OWB

11gR1

O

WB

11

R2

Copyrigh


d.

ODI

10gR3

ODI

11gR1

ODI

11gR2

CY2009

C

Y

2010

Unified

Platf

orm

OWB/ODIInvestmentsare

FullyProte

cted

NoForcedMigrations

NaturalUpgra

dePath

UnifiedPlatform

aimstobe

aSupersetof

Existing

Productsnoregression


13/31

Directionsfor11g

MajorFeatures

ExecutionManagement:L

oadPlans

Paralle

lism,Restartability,ConcurrentTaskM

anagement,Task

Killing

JPSIntegration

Extern

alizedAuthenticatio

n+SSOsupport

Copyrigh


d.

Helptroubleshooting/fixing

ErrorTab

leManagement

Manag

etheerroneousrows

EMInteg

ration

Monito

ranEnterpriseArchitecture

KMEnha

ncements


14/31

WhyisODIUnique

?

Copyrigh


d.


15/31

Differen

tia

tor:E

-LTArchitecture

HighP

erformance

ConventionalETLArchitecture

Extract

Load

Transform

Conventional:SeparateETLServer

ProprietaryETLEngine

PoorPerformance

HighCostsforSeparateStandalo

neServer

IBM&Inform

aticasapproach

Oracle:NoNewServers

LowerCost:LeverageComputeR

esources&

PartitionWo

rkloadefficientl

Copyrigh


d.

N

extGenerationArch

itecture

E-LT

E-LT Load

Extract

Tr

ansform

Transform

Efficient:Ex

ploitsDatabaseOptim

izer

Fast:ExploitsNativeBulkLoad&

Other

DatabaseIn

terfaces

Scalable:ScalesasyouaddProc

essorsto

SourceorTarget

Benefits

OptimalPer

formance&Scalability

BetterHardwareLeverage

EasiertoManage&LowerCost


16/31

Differen

tia

tor:D

eclarative

Design

DeveloperProductivity

ConventionalETLD

esign

Conventional:SpecifyETLDa

taFlow

DevelopermustdefineeverystepofComplex

ETLFlowLogic

TraditionalapproachrequiresspecializedETL

skills

Andsignificantdevelopmentandmaintenance

efforts

Copyrigh


d.

race:

ecarave

e-ase

esgn

Simplifiesthenumberofsteps

AutomaticallygeneratestheDataFlowwhatever

thesourcesand

targetDB

Benefits

Significantlyre

ducethelearningcurve

Shorterimplem

entationtimes

Streamlineaccesstonon-ITpros

ODIDeclarativeDe

sign

DefineHow:Built-inTem

plates

Define

What

YouWant

Automatic

ally

Generate

Dataflow

11

22


17/31

Journalize

ReadfromCDC

Source

Load

FromSourcesto

S

taging

Check

Constraintsbefo

re

Load

Integrate

TransformandMove

toTargets

Service

ExposeDataand

Transformation

Services

Reverse

EngineerMetadata

Reverse

Journalize

Load

Check

Integrate

Services

PluggableKnowledgeModulesArchitecture

CDC

Sources

StagingTables

ErrorTables

TargetTables

WS

WS

WS

Differen

tia

tor:K

nowledge

Modules

Hot-Pluggable,Modul

ar,Extensible

Copyrigh


d.

Le

verageDatabaseOp

timizations:

NativeSQL;NativeFunctions;NativeLoad

s;NativeJournaling

/CDC

Ta

ilortoanorganizationsexistingbestpr

actices

Ea

seadministrationw

ork

Reducecostofownership

SAP/R3

SiebelL

ogMiner

DB2Journals

SQLServer

Triggers

Oracle

DBLink

DB2Exp/Imp

JMSQueues

CheckM

S

Excel

Check

Sybase

Oracle

SQL*Loader

TPump/

Multiload

TypeIISCD

OracleMerge

SiebelEIM

Schema

OracleWeb

Services

D

B2Web

Services

Sampleout-of-the-boxKnowledgeModules

Benefits


18/31

Change

Da

taCap

ture

(CDC)

allows

forrea

ltim

eda

tatobeavaila

ble

forany

typeo

fda

taintegr

ationso

lution.

Ch

ange

Da

taCap

tur

eis

accomp

lis

he

dbycap

turin

gjus

tthec

hange

drecordsan

dnot

the

fulldata

se

t,drama

tica

lly

reduc

ing

timeand

resourcesoverth

elife

oftheda

taintegra

tionso

lution.

KeyUseC

ase:RealtimeDa

taWarehouse

(con

tinuous

lyre

fres

he

dthroug

hou

tthe

day

)

Differen

tia

tor:C

hangedDataCaptur

e

Event-DrivenFramework

forRealtimeDa

taIntegration

Copyrigh


d.


19/31

SupplyRealTim

eBusinessIntellige

nce

Non-inva

siveCapture+E

-LTProcessing

Application

RealTimeBI

(usingReplica)

AnalyticBI

(Facts&Dims)

Con

sistency

W

indow

Copyrigh


d.E

-LT

(Mini-Batch+Transforms)


20/31

Unified

Management+Monitoring

CommonRuntime100%Java

CommonMonitoring

Examp

leUseCases

BulkDataTransformation(any2any)

XML/EDILargeFileH

andling

-

Unify

E-LTAgen

twithSOARuntime

BestofB

reedDataIntegrationasaShare

dSOAService

Copyrigh


d.

HighPerformance

ETL&Replication

AnyDataSource

DataWarehouse

&OLAP

LoadDWfromSOA

UnifiedDataStewardWorkflow

(ETLErrorHospitalw/BPELPM)

ERPMigration,Replication/

Loading

QueryOffloading&Ze

roDowntime

E-LTFrameworksareoptimalarchitecturesfor:

BusinessIntelligence

PerformanceManagement

Database&OLAP

EmbeddedApplications

ApplicationIntegr

ation

MiddlewareServers


21/31

DataIntegrityFirewa

ll

Auditing,cleansinga

ndrecycling

1.

Declareconstraintsattablelevel

2.

Designmappingsan

dcheckflow

integrity

3.

Audit,cleanseorrec

yclerejected

records

Message

Id

Name

City

Duplicated

Record

001

JohnDoe

New

York

Duplicated

Record

022

JohnDoe

Boston

InvalidCity

Reference

230

AlbertFresh

Maris

Differen

tia

tor:D

ataQuality

InlineE-LTDataIntegrity

Framework

Copyrigh


d.


22/31

OracleD

ataIntegrator

OracleD

ataIntegrator

Optional:Advan

cedGovernance

OracleDataQualityforDataIntegrator

BestofbreedQuality

JointdevelopmentwithTrillium

Proven,scalableDQengines

Richg

lobalcontentforcleansing,

standardization,validation

Extensiblebycustomers

with

domain-specificDataQuality

functions

Out-of-bo

xintegration

Target

Sources

IntegrationProcess

IntegrationProcess

Copyrigh


d.

viapre-builtKnowledgeM

odules

ODIM

odelmetadatapassedto

ODQatdesigntime

ODQsourceandtargetM

etadata

passe

dtoODIatDesign

Time

Out-of-boxODIToolforruntime

invoca

tionofODQprocesses

Packaged

QualityRules

Delive

redOut-of-the-Box

byOracle

For35

Countries&Doma

ins

OracleDataQualityforData

Integrator

OracleDataQualityforData

Integrator(*)(*)

GlobalData

Router

Transformer

Parser

Postal

Matcher

Relationship

Linker

(*)JointDevelopmentwithTrillium

Parsing

,Cleansing,Standardization,

Parsing

,Cleansing,Standardization,

Matchin

g

Matchin

g


23/31

Differen

tia

tor:F

lexibleErrorWorkflow

ErrorRecycling,NativeIntegrationwith

BPEL&HumanWorkflow

Target

Static

Check

Inte

gration

Process

Errors

Sales

FlowCheck

DuringIntegration

Sources

Conventional:

Rigid/Non-Exist

entWorkflow

Proprietary

workflowbaked-in

Noworkflow

/3rdpartysolution

Weakintegration,non-standard

Oracle:Open,

FlexibleWorkflo

w

FlexibleDataCorrectionWorkflow

Copyrigh


d.

BPELProcessManagerH

uman

Workflow

Flow-basedConstraintCheckinga

ndValidation

ErrorRec

ycling

Standards-B

asedProcessFlow

BPELPro

cessManager/BPEL4P

eople

ReuseStandardizedErrorHandlin

gProcedures

Integratedw

ithHumanWorkflow

ManageL

ongRunningTransactions

ManageC

omplexApprovalandOverridingPatterns

Er

rorRecycling


24/31

Differen

tia

tor:D

ataLineag

e

Large

numberofdataflowsinacomplex

enviro

nment

Howt

ogetanoverview?

Web-b

asedend-to-enddatalineage

1.U

nderstandyourdataflow

s

2.Followthepathofdata

3.D

rill-downtotransformatio

ns

?

Copyrigh


d.


25/31

ODIatOracle

Copyrigh


d.


26/31


27/31

ExtremePerformanceforDataWarehousing

ExadataV

2isthePlatformforRealTimeDataW

arehousing

OracleD

ata

Integrat

or

LoadExada

tawithGoldenG

ate;GenerateTransformsfromODI-EE

NewExadataplatformoptimizedforO

LTPandDataWarehousingsuitsRealTimeD

W

ExtremeExad

ataperformancecanhandlehugedatavolume

sthatcomewithRealT

imeDW

Copyrigh


d.

EMP

DEPT

DIM

FACT

DIM

DIM

DIM

ODSSchema

DWSchema

Oracle

GoldenGate

OracleData

base


28/31

SpeedProjectD

elivery/TimetoMark

et

E-LTuse

sDeclarativeSQ

L-styleDesign+SimpleRuntim

e

Develo

pmentProductivity

40%EfficiencyGain

s

EnvironmentSetup(ex:

BIApps)

33-50%LessComplex

NumberofSetupSteps

7

NumberofServers

1

Numberofconnectio

ns

3

Copyrigh


d.

NumberofSetupSteps

10

NumberofServers

3

Numberofconnectio

ns

7


29/31

Traditio

nalETL+CDC

TransformationsinETLengine

on

expensivem

iddletierservers

Bulkloadto

thedatawarehousewith

largenightly

/dailybatch

Nomid-tier;transformations

use

database

(mostefficient)

Mini-batc

hesthroughoutthe

dayor-

bulkproc

essingnightly

ModernDataIntegrationA

pproach

Heterogeneous,Real-time,Non-Invasive,HighPerformanceE-L

T

ModernE-LT+Real-time

Copyrigh


d.

usingcomplexAdapters

Streamingrequiresseveralhop

s

-

Continuouslowlatencyfeed

sfrom

operation

alsystems

Stag

ing

Tric

kle

Lookup

Data

Loa

d

Ex

trac

t

Lookup

Data

Xform

Xform

Bu

lk

Agent

Agent

He

terogeneous


30/31

Copyrigh


d.


31/31

Copyrigh


d.

p.2 pts odi11g odi overview

Documents