cern it department ch-1211 geneva 23 switzerland t lorena lobato pardavila t1s coordination meeting...

13
CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/ Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

Upload: loreen-gordon

Post on 23-Dec-2015

218 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Lorena Lobato Pardavila

T1s Coordination Meeting

Introduction to GoldenGateadministration

Page 2: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Outline

• GoldenGate overview• GoldenGate Architecture• Parameter Files

• Manager• Extract• Data Pump• Replicat

• Setting up GoldenGate processes• Steps to set up GoldenGate replication• Questions

Page 3: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

GoldenGate Overview

Introduction to GoldenGate administration3

• Installation

GG home to be installed + additional steps for deployment under RAC

• Configuration

Configuration of each component though parameter files and GG Command Line Interface (GGSCI)

Page 4: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

GoldenGate Architecture

Introduction to GoldenGate administration4

Commited changes are captured as they occur by reading the transaction logs

Trail files: Stages and queues data for routing

Applies data with transaction integrity, transforming the data as required

Distribute data for routing to multiple targets

Page 5: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Parameter File: Manager

Introduction to GoldenGate administration 5

• PORT: Port for communication between itself and other local Oracle GoldenGate process

• LAGREPORTMINUTES: To specify the interval at which manager checks for extract and replicat lag

• PURGEOLDEXTRACTS: To control the purging of files from the local trail

• USECHECKPOINTS: Triggers a purge when all processes are finished with a file as indicated by their checkpoints

• MINKEEPDAYS: To set a minimum amount of time to keep data. With USECHECKPOINTS, if checkpoints indicate that a file has been processed completely, it will be purged unless doing so would violate the MINKEEP rules

Page 6: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Parameter File: EXTRACT

Introduction to GoldenGate administration 6

• EXTTRAIL: To specify the path name of the trails• LOGALLSUPCOLS: To control the writing of supplementally logged

columns • TRANLOGOPTIONS: To control the way that Extract interacts with the

transaction log or with the API that passes transaction data• max_sga_size: Controls the amount of shared memory used by the

logmining server• parallelism: Controls the number of processes used by the logmining

server• DDLOPTIONS: To configure aspects of DDL processing• TABLE: It is limited to table-to-table mapping

Page 7: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Parameter File: Data Pump

Introduction to GoldenGate administration 7

• INCLUDE: For using a macro library• RMTHOST: Identify a remote system to which the local Extract process

connects• RMTTRAIL: To specify the location of the remote trail• DISCARDFILE: To specify the discardfile where are rejected records

will be dumped• PASSTHRU: Mode being used for the DP where the name of source and

target objects are identical and no column mapping or filtering is being performed

• TABLE: It is limited to table-to-table mapping

Page 8: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Parameter File: Replicat

Introduction to GoldenGate administration 8

• ASSUMETARGETDEFS: To indicate that the source and target tables are identical, including semantics.

• DISCARDFILE: To specify the discardfile where are rejected records will be dumped

• DBOPTIONS INTEGRATEDPARAMS: To specify database options passing settings for parameters that control the database inbound server within the target

• DDL INCLUDE ALL: Required if replicating DDL operations• MAP: To specify the mapping to be replicated between source and target

database

Page 9: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Setting up GoldenGate processes

Introduction to GoldenGate administration 9

SOURCESOURCE

MANAGERstart mgr

EXTRACTdblogin userid <username>, password <password >

register extract <extract _name> with databaseadd extract <extract _name> , integrated tranlog, begin nowadd exttrail <trail_path>, extract <extract _name> , megabytes <n>start extract <extract _name>

DATA PUMPdblogin userid <username>, password <password >

add extract <extract _name> , exttrailsource <trail_path>add rmttrail <remote_trail_path> , extract <extract _name> , megabytes <n>start extract <extract _name>

Page 10: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Setting up GoldenGate processes

Introduction to GoldenGate administration 10

TARGETTARGET

MANAGER start mgr

REPLICAT

dblogin userid <username>, password <password>

register replicat <replicat_name> databaseadd replicat <replicat_name> integrated, exttrail <remote_trail_path>start replicat <replicat_name>

EDIT PARAMATER FILESEDIT PARAMATER FILES

edit params <process_name>send <extract/replicat> <process_name> , <parameter>

Page 11: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Setting up GoldenGate processes

Introduction to GoldenGate administration 11

OVERVIEWOVERVIEW

info all

Page 12: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Steps to set up GoldenGate replication

Introduction to GoldenGate administration 12

1. Start manager on both systems

2. Create extract process

3. Start extract process

4. Create Data Pump process

5. Create Replicat process

6. Start Data Pump process

7. Copy over replicated schemas to target database (using expdp/impdp)

8. Start Replicat with HANDLECOLLISIONS

9. Remove HANDLECOLLISIONS parameter when replication lag is 0

Page 13: CERN IT Department CH-1211 Geneva 23 Switzerland  t Lorena Lobato Pardavila T1s Coordination Meeting Introduction to GoldenGate administration

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

Questions?

THANKS YOU!

QUESTIONS?