producing standardized data using a master fme workspace

Producing Standardized Data Using a Master FME WorkspaceVictor RutherfordGIS Data Analyst, Developer

April 25, 2012

Spatial Database

GIS

DB

Geomatics

Geology

Engineering

Cartography

Vendor Vendor

Vendor Vendor

AnalysisGeophysics

GIS DB

Loading and Updating Data

- Unstandardized

- Difficult to maintain

- Confusing to use

GIS DB

Master FME Workbench

(Generic)(Custom) Standardized

Magic Formula?

1 23

Standard Data Model Data Modeling Tool+ Generic FME Workbench

PSDM PSDMManager

MasterFME

Workspace

+ +

Attribute-mappings+ Lookup table (domains)

The Right Person

Domain Expert /Data Modeling

ETL/FME

Corporate Standards Steward

QA

(Generic)Data Modeling Tool

FME Rocks!

I understand rocks, but what’s an FME?

Master FME Workspace

(Look Ma, No hands!)

Master FME Workspace

Master FME Workspace

Master FME Workspace

Master FME Workspace

Source

Target

ID

ID

Delete?

CRC

Match = No Change

Mismatch = Update

Insert

Master FME Workspace

Master FME Workspace

Easier to Maintain

Master FME Workspace

Harder to Maintain

GISDB

GIS DB

Master FME Workbench

(Generic)(Custom) StandardizedGIS DB

Thank You!

Questions?

For more information: Victor Rutherford vr@vrgs.ca victor_rutherford@nexeninc.com Nexen Inc. www.nexeninc.com VRGS Ltd. www.vrgs.ca

Source

Target

ID

ID

No ID/PK?

CRC

Match = No Change

Mismatch = Insert Mismatch = Delete?

Published Parameters

Source

PSDM Parameters

Output

Custom Transformers?