© talend 2013 mdm migration tools cyril sonnefraud
TRANSCRIPT
© Talend 2013
MDM Migration Tools
Cyril SONNEFRAUD
© Talend 2013
MDM Migration Tools :Different tools, for different needs
© Talend 2013 3
MDM Migration Tools
➜ Different tools are bundled with the product to ease data migration
• DB Migration Tool• Export / Import content from MDM server• DI jobs• Web UI Export
© Talend 2013 4
MDM Migration Tools Comparison
© Talend 2013
➜ There are many ways to export/import data, each with pros and cons :
DB Migr
ation
Too
l
Expor
t / Im
port
DI job
s
Web
UI Exp
ort
Performance Best Poor Good Poor
Fault Tolerance a
Rejects handling a
Adaptability to the model a (limited)
Audience Admins Admins Devs
Devs MDM Users
© Talend 2013
MDM Migration Tools :DB Migration Tool
© Talend 2013 6
MDM Migration : DBMigrationTool
Source MDM Server Destination MDM Server
DB Migration Tool
RMI RMI
1099 1199
Pros Cons- Migrates both MDM artifacts & Master Data- High-speed ! Relies on BulkLoad capabilities- Command-line tool, java bootstrap- Version independent- Can be placed on source, destination, or even
elsewhere
- All or nothing ! Can’t filter objects- No rejects handling
➜ Purpose :• Enable to completely migrate a server from A to B
© Talend 2013 7
MDM Migration : DBMigrationTool
➜ DB Migration Tool :
• Located in jboss-4.2.2.GA/bin/dbtools/migration• Needs a configuration file for source & destination binding
• Tips for large collections migration• Set a high transaction timeout in jboss-service.xml
• Increase Xmx parameter• Increase to.cluster.batch.size parameter in the configuration file
© Talend 2013
© Talend 2013© Talend 2013
MDM Migration Tools : Export / Import content from Studio
© Talend 2013 9
MDM Migration : Export/Import content
Pros Cons- Done in the Studio = Friendly GUI- Enables to filter on exported objects- Saves to an archive - Can be used by administrators or developers
- Can’t be done on big collections- Import must be done on a datacontainer
having exactly the same name- Datamodel must have remained the same- No rejects handling
➜ Purpose :• Export/Import the content of a given
datacontainer• Good solution for small to mid-size
exports (<100k records)
© Talend 2013© Talend 2013
MDM Migration Tools : DI Jobs
© Talend 2013 11
MDM Migration : DI Jobs
➜ Purpose :• Enable to comply with custom migration requirements
© Talend 2013
Pros Cons- Enables to transform data on the fly- Done in the Studio = Friendly GUI- Enables to filter on exported objects- Enables to handle rejects- Good performance (BulkLoad can be used)
- High cost compared to previous solutions !- Must be done for each entity, hard to
automate- Must be done by a developer
© Talend 2013© Talend 2013
MDM Migration Tools : Web UI Export/Import
© Talend 2013 13
MDM Migration : Web UI Export/Import
➜ Purpose :• Feature that enable to export/import a CSV or Excel file
© Talend 2013
Pros Cons- Easy to use- Accessible to every MDM User
- Partial export : Based only on Viewable Business Elements
- Works only with small volumetrics- Don’t use “import” on complex entities - Easy to do silly things in the container with it,
but hard to rollback then !
