understanding oracle goldengate -...
TRANSCRIPT
Accelerating Your SuccessTM
Understanding Oracle GoldenGate
Ron Caffrey [email protected]
Oracle Product Specialist
Avnet Technology Solutions
07711-302797
Accelerating Your SuccessTM
A G E N D A
Background & context
The essence of GoldenGate
fundamental functionality
solution models exploiting GoldenGate
key facts
Latest enhancements in G/G 11gR2
Commercial considerations
Summary of opportunity
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
GoldenGate evolution
GoldenGate Software established in 1995.
Chief Technology Officer recruited from Oracle Server Technology labs
Oracle acquired GoldenGate in Oct 2009.
As in many of Oracle’s acquisitions, heterogeneity was a key factor
Under GoldenGate ownership, the main client base was typically large Finance
organisations with (too) many mainframe, Unix and Windows systems,
and considerable pains. Most engagements were consultancy-led and substantial.
Under Oracle ownership, the product has to stand as a piece of technology for all.
Major complex migration/upgrade projects around mission-critical components will still
demand considerable know-how and project control.
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Oracle Data Integration Solutions
Specialized team formed in 2010
Focus is real time movement, manipulation and management of data
Products satisfy diverse customer requirements
Oracle
GoldenGate
Heterogeneous real-
time change data
capture for
Continuous
Availability, Disaster
Tolerance and real-
time Data Integration
Heterogeneous
data integration
services for Data
Warehousing and
SOA, including
Data Quality and
Profiling options
Oracle Data
Integrator EE
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Data Integration : the challenges
Not to be confused with application integration (SOA, BPEL, AIA etc)
The dream is “One Version of the Truth”
i.e. each business entity (customer, product etc) is represented only once in an organisation
The reality…
Buying a new packaged application usually means another database
Mergers and acquisitions create more system overlaps
Consolidation often thwarted by disparate versions – application lifecycle is king
Data explosion continues (90% of data created in last 2 years : 50x growth by 2020?)
Meanwhile business continues (i.e. transactions happen)
Timescales and costs often prevent idealised re-alignment of systems
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Data Integration : the needs
Duplication (whether permanent or transient) typically cannot be eradicated
Transaction-driven data changes need to distributed and replayed
Upgrades/migrations for critical systems demand near zero downtime
Database-level
Application-level
Business Intelligence also generally needs data duplication
Keeping heavy I/O and cpu loads away from OLTP
Reflecting need for restructured data to aid analysis
Increasingly near real-time
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Data Integration : the needs
Duplication (whether permanent or transient) typically cannot be eradicated
Transaction-driven data changes need to distributed and replayed
Upgrades/migrations for critical systems demand near zero downtime
Database-level
Application-level
Business Intelligence also generally needs data duplication
Keeping heavy I/O and cpu loads away from OLTP
Reflecting need for restructured data to aid analysis
Increasingly near real-time
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Data Integration : the needs
Duplication (whether permanent or transient) typically cannot be eradicated
Transaction-driven data changes need to distributed and replayed
Upgrades/migrations for critical systems demand near zero downtime
Database-level
Application-level
Business Intelligence also generally needs data duplication
Keeping heavy I/O and cpu loads away from OLTP
Reflecting need for restructured data to aid analysis
Increasingly near real-time
NB many customers who buy GoldenGate continue to
find new reasons to use it
Accelerating Your SuccessTM
A G E N D A
Background & context
The essence of GoldenGate
fundamental functionality
solution models exploiting GoldenGate
key facts
Latest enhancements in G/G 11gR2
Commercial considerations
Summary of opportunity
Accelerating Your SuccessTM
What is GoldenGate?
Core product is simple to describe
– it captures transactional data changes and propagates them to other locations,
in a heterogeneous world
Oracle, Teradata, DB2, SQL Server, MySQL, NonStop etc etc
Unidirectional or bi-directional
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Low-Impact, Real-Time Data Integration
& Transactional Replication for many benefits
Accelerating Your SuccessTM
Additional comments
Business Continuity (HA and DR).
This is a solution that can be applied to Oracle DB SE as well EE.
And, since it is possible for replication to be bi-directional, for the first time Oracle now has
a solution for the Active/Active requirement over major distances.
(with Data Guard one side would always be passive and not accept changes.
Advanced Replication was too big a hit on performance).
NB bi-directional implementation does not increase licence costs.
Offloading reporting workloads to relieve OLTP system : scope of data can be filtered
so reporting system has only relevant tables.
Oracle has built integration between GoldenGate and Data Integrator to enable a real-time
data warehousing delivery system.
Accelerating Your SuccessTM
Things to understand about GoldenGate
Every database in the GoldenGate world is AUTONOMOUS
(not a slave clone as with Data Guard etc)
Your choices in the Configuration Files decide how the databases will interact
and the overall business goals to be achieved
Transfer is always ASYNCHRONOUS
(but if you provide an external means of mirroring the source database log files,
Goldengate can use them to complete all transactions)
Conflict resolution mechanisms are supported for multi-master systems
It captures and distributes canonical forms of data items, so it is prudent to double-check the
documentation to see that relevant application schemas do not have any issues
Accelerating Your SuccessTM
Oracle Streams positioning
From the GoldenGate Statement of Direction…
Oracle Streams continues to be supported but will not be enhanced to support
any new database features in future releases. This means that Streams will continue to
support exactly what it supports today (11.2) in future releases. It also means that any
new database features, data types, or capabilities will not be supported by Streams.
Customers who want to take advantage of the new data types and features will need to
license Oracle GoldenGate.
In a soak-test, after stopping transaction arrival, Streams continued for 45 mins.
GoldenGate completed distribution almost immediately.
Streams is of course bundled with DB EE, but it would be unwise to commence
new projects now.
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Integration of GoldenGate output
as a source for Data Integrator EE
Oracle BI Tools
Oracle GoldenGate
Capture/migrate from heterogeneous
sources
Reduce or remove reliance on batch feeds by using continuous real-time
data capture and delivery
Oracle Data Integrator
Optional DQ/DP
Batch feeds for data migration or integration
Accelerating Your SuccessTM
Data conversion / mapping
GoldenGate provides abilities to re-codify data and make minor adjustments
For wholesale re-mapping of data structures Data Integrator is the correct tool.
E.g. conversion of Third Normal Form transactional data models into Star Schemas
for Analysis.
Accelerating Your SuccessTM
Oracle Veridata
Sold independently of GoldenGate
Effective for comparing schemas regardless of the replication technology used
Heterogeneous support
Licensing is in respect of the Veridata environment, not the databases being compared
Accelerating Your SuccessTM
A G E N D A
Background & context
The essence of GoldenGate
fundamental functionality
solution models exploiting GoldenGate
key facts
Latest enhancements in G/G 11gR2
Commercial considerations
Summary of opportunity
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
GoldenGate 11gR2 Enhancements
In case of Oracle databases, choice of new Integrated Capture architecture is more tightly-
coupled with the database.
Greater scalability
Ability to capture changes from Compressed Data
(all types including the full Exadata HCC ones)
Better support for global deployments through support for UNICODE and multi-byte
character-sets.
Enhanced security of transmission with FIPS or Blowfish encryption algorithms
Simpler, enhanced conflict resolution
Enhanced feature support for other databases. DB2 for iSeries now added.
Application adapters output JMS messages or flat-file batches rather than targeting a
database.
Accelerating Your SuccessTM
A G E N D A
Background & context
The essence of GoldenGate
fundamental functionality
solution models exploiting GoldenGate
key facts
Latest enhancements in G/G 11gR2
Commercial considerations
Summary of opportunity
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
GoldenGate commercials
Be aware that Oracle has created two separate products:-
“Oracle GoldenGate” (this is for an Oracle source or target)
“Oracle GoldenGate for Non Oracle Database” (everything else)
(There are also specials for Mainframe and Teradata Replication Services)
So in a heterogeneous deployment makes sure you sell the correct products
and quantities for each source and target. Oracle doesn’t do refunds!
Currently there is no distinction in licensing rules or price between the main two.
Bi-directional replication does not influence the price.
Do not be fooled by the fact that the Processor and NUP prices appear identical
to those for Database Standard Edition. The GoldenGate variants are priced by the
calculation of cores * multi-core factor for the chip-type, and so core architecture will
influence price.
.
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
GoldenGate commercials
GoldenGate products have the same NUP minimum of 25 per Processor as the DB EE
GoldenGate pricing is not explicitly linked to database pricing, but since it has to be
installed adjacent to the database engine the licensed environment will be identical, as well
as considerations of whether NUPs are permissible.
(Note Oracle GoldenGate for Teradata Replication Services is unique in being deployed
separate from the source, but still the database environment dictates licensing).
Processors or users are counted as those using the database, not some notional subset or
group of administrators. This applies to all source and target types.
The new (11gR2) GoldenGate Application Adapters for JMS and FlatFile are licensed only
by Processor, and in respect of the source database(s).
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
GoldenGate commercials : Active Data Guard bundled
The Oracle GoldenGate product includes licence cover for Active Data Guard.
This is a little strange and needs an explanation.
Remember that Data Guard (at least the Physical Standby variant) maintains a clone of
the database by pasting changed bytes into correct file addresses. It cannot be used
actively, apart from read-only access through Active Data Guard Option, or temporarily
when converted to a Logical Standby and then subjected to Flashback Database command.
Conversely with GoldenGate all databases are always autonomous.
Therefore no DR database could be maintained by Data Guard AND GoldenGate.
The free licence is simply to avoid a turf war between Oracle’s Server Technology and
Middleware groups.
The ADG licence cover CAN be beneficial if you had Data Guard and G/G deployed
to separate copies. The source must have ADG licences so this is covered.
Accelerating Your SuccessTM
Disaster Recovery for SE v EE : price comparison
Assuming Production & DR (or Active-Active) have 2 sockets each quad-core Intel chips
With SE have to check datatype support and cope with physical DDL issues, but still
superior to Hot Standby in most respects
Still lacking all other EE benefits
Licences List Prices
DB EE 8 £254,712
DB SE 4 £46,920
GoldenGate 8 £93,840
£140,760
Accelerating Your SuccessTM
A G E N D A
Background & context
The essence of GoldenGate
fundamental functionality
solution models exploiting GoldenGate
key facts
Latest enhancements in G/G 11gR2
Commercial considerations
Summary of opportunity
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Look for the causes : new business systems, mergers &
acquisitions, geographic separation, real-time BI
http://www.ts.avnet.com/uk/vendors/oracle/
Accelerating Your SuccessTM
Collateral
http://www.oracle.com/us/products/middleware/dataintegration/overview/index.html
http://www.oracle.com/us/products/middleware/data-integration/resources/index.html
http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html
Accelerating Your SuccessTM
Understanding Oracle GoldenGate
Ron Caffrey [email protected]
Oracle Product Specialist
Avnet Technology Services
07711-302797