oracle goldengate real-time transactional data · pdf fileoracle goldengate provides...

18
<Insert Picture Here> Oracle GoldenGate Real-Time Transactional Data Management Shilpa Mehta Senior Systems Consultant, Data Integration Solutions

Upload: vuongkiet

Post on 23-Feb-2018

231 views

Category:

Documents


1 download

TRANSCRIPT

<Insert Picture Here>

Oracle GoldenGate

Real-Time Transactional Data Management

Shilpa Mehta

Senior Systems Consultant, Data Integration Solutions

<Insert Picture Here>

Agenda

• Why Real-Time Data for BI?

• Architectures for Real-Time BI

• Oracle GoldenGate for Real-Time Data

Integration

• Customer Examples

2

• Customer Examples

• Summary

<Insert Picture Here>

Agenda

• Describe Oracle GoldenGate architecture

• Describe Oracle GoldenGate for Real Time

Data Integration

• Oracle GoldenGate vs. Active Data Guard

• Oracle GoldenGate and Oracle Data Integrator

3

• Oracle GoldenGate and Oracle Data Integrator

• Summary

Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in

real time

Key Differentiators:

Non-intrusive, low-impact, sub-second latency

What is Oracle GoldenGate?

Performance

4

Open, modular architecture - Supports heterogeneous sources and targets

Maintains transactional integrity - Resilient against interruptions and failures

Flexible and Extensible

Reliable

Oracle GoldenGate Use CasesEnterprise-wide Solution for Real Time Data Needs

Log Based, Real-

Time Change Data

Capture

Active-Active High

Availability

Zero Downtime

Migration and

Upgrades

Fully Active

Distributed Database

ReportingQuery Offloading

New DB/

OS/HW/App

•Reduce Costs

•Lower Risks

•Achieve Operational

5

Heterogeneous

Source Systems

EDWODS

EDWReal-time BI

Reporting

Database

ETL

ETL

Query Offloading

Data DistributionGlobal Data Centers

SOA/EDA

Oracle

GoldenGate•Achieve Operational

Excellence

How Oracle GoldenGate Works

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

6

LAN/WANInternet

Capture

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

How Oracle GoldenGate Works

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

7

LAN/WANInternet

CaptureTrail

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

How Oracle GoldenGate Works

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

8

LAN/WANInternet

CaptureTrail

Pump

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

How Oracle GoldenGate Works

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed, encrypted for routing to target(s).

9

LAN/WANInternet

TCP/IP

CaptureTrail

PumpTrail

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

How Oracle GoldenGate Works

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed, encrypted for routing to target(s).

Delivery: applies data with transaction integrity, transforming the data as required.

10

LAN/WANInternet

TCP/IP

CaptureTrail

Pump DeliveryTrail

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

How Oracle GoldenGate Works

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed, encrypted for routing to target(s).

Delivery: applies data with transaction integrity, transforming the data as required.

11

LAN/WANInternet

TCP/IP

Bi-directional

CaptureTrail

Pump DeliveryTrail

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

Databases O/S and Platforms

Oracle GoldenGate Capture:

� Oracle

� DB2

� Microsoft SQL Server

� Sybase ASE

� Teradata

� Enscribe

� SQL/MP

Windows 2000, 2003, XP

Linux

Sun Solaris

HP NonStop

HP-UX

HP TRU64

Oracle GoldenGate 11g Supported Databases and OS

12

SQL/MP

� SQL/MX

�JMS message queues

Oracle GoldenGate Delivery:

� All listed above, plus:

� MySQL, TimesTen, Netezza, Greenplum,

HP Neoview and any ODBC compatible

databases

� ETL products

HP TRU64

HP OpenVMS

IBM AIX

IBM z/OS

z/linux

12

Oracle GoldenGate Topologies

UnidirectionalQuery Offloading

Zero-Downtime Migration

Bi-DirectionalHot Standby or

Active-Active for HA

Peer-to-PeerLoad Balancing, Multi-Master

13

Broadcast Data Distribution

Integration/ConsolidationData Warehouse

Data Distribution via Messaging

BPM

High Availability for Oracle Database When to Use Active Data Guard vs. GoldenGate

• Disaster Recovery / Data Protection

� Active Data Guard: simple full Oracle Database protection

� High-performance, simple, drop-in solution for HA and DR, readable at standby

� Zero data loss, integrated data corruption protection, switchover / failover

� DR for all data types & apps including packaged apps that can’t be changed

14

• Information Distribution, Flexible HA

�GoldenGate: heterogeneous, active-active, migrations

� Heterogeneous replication, transformations, subsetting, multiple topologies

� All sites fully active (read/write): avoid or manage conflicts at application level

� Enable minimal downtime app migrations with 2nd database copy

Powerful Combination!Integrated HA, DR and Active-Active Replication

Standby

Active Data Guard

- DR & Data Protection

- Real-time Query

Primary

RAC

- Scalability

- Server HA

15

GoldenGate

- Information Distribution

- Heterogeneous

Bi-directional

Replication Subsetting MySQL

Standby

DatabaseDatabase

Real-Time Data Integration for BI with ODILow-impact, change data capture, transformation, and delivery

BI Application

trans5 trans4 trans2 trans1trans3

Real-time streaming of transactions

Oracle GoldenGate

16

Production

OLTP Databases

ODS

• Sub-second latency

• No impact on source systems

• Read-consistent changed data with referential integrity

• Transformations at capture, delivery or within the database

• Certified for Oracle Applications to offload operational reporting

LAN / WAN /

InternetCapture

Source TrailTarget Trail

Delivery

Real-Time Data Integration for BI with DWFastest Real-Time Data Integration, Fastest Bulk Data Transformation

BI Application

tx6 tx5 tx4 tx2 tx1tx3

Real-time streaming of transactions

Oracle GoldenGate

ODI EE

& DQ

OBI EE

17

Production

OLTP Databases

DW

• Low-latency data for end users

• No source impact and reduced batch windows on target

• Thin middle-tier for high-performance, in-database transformations

• Complete data recoverability with persisted queuing

& DQ

LAN / WAN /

InternetCapture

Source TrailTarget Trail

Delivery

18