bi apps 7.9.5 - etl data lineage

Download BI Apps 7.9.5 - ETL Data Lineage

Post on 03-Jan-2016

233 views

Category:

Documents

5 download

Embed Size (px)

DESCRIPTION

data lineage

TRANSCRIPT

SummaryOracle Business Intelligence Applications Fusion EditionETL Data Lineage GuideRelease 7.9.5This document is provided for information purposes only, and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor is it subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document, and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission.Copyright 2008, Oracle. All Rights Reserved.How to use this guide1 ETL mappings are split into two main mappings, SDE mappings and SIL mappings.2 SDE mappings load the staging tables,then SIL mappings (SILOS, SIL_Vert, PLP) load the final physical warehouse tables3 SILOS SIL mappings are for all sources except Siebel Verticals. SIL_Vert SIL mappings are for Siebel Verticals only4 Staging tables are suffixed with S, so W_AP_XACTS_F is the final table and the staging table is W_AP_XACTS_FS5 In general mappings are linear, however, some include more complex logic, e.g. Post Load Processing, combining temp tables, etc.6 Start by looking at the mappings of product to DAC execution plans to physical warehouse table7 Figure out the associate staging tables and look at the specific source system tab to review where the staging tables source data from8 Select SQL Override ID and Click on "Go to SQL Override" button to navigate to SQL used to extract data which will include details on business logic, etc.9 Universal Adapter does not have SQL Overrides10 Select Target column and click on "Go to SIL" button to navigate to SIL where SDE Target = SIL Source11 Review the Coverage Matrix to understand which adapters populate which parts of the physical data warehouse schema

Oracle EBS R12Oracle BI Applications 7.9.5 ReleaseData Lineage SheetThe data lineage sheet below shows relationships between the ETL Folder, ETL Mapping, OLTP columns and Data Warehouse Columns. It only documents the Source Dependent Extract mappings (SDEs). It also displays which columns are populated with lookup, forFOLDER_NAMEMAPPING_NAMETARGET_TABLETARGET_COLTARGETSOURCE_TABLESOURCE_COLSQL_OVERRIDE_IDSDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSACTIVE_FLGW_AP_TERMS_DS.ACTIVE_FLGAP_TERMSENABLED_FLAGSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAP_TERM_CODEW_AP_TERMS_DS.AP_TERM_CODEAP_TERMSTERM_IDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAP_TERM_DESCW_AP_TERMS_DS.AP_TERM_DESCAP_TERMSDESCRIPTIONSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAP_TERM_DURATIONW_AP_TERMS_DS.AP_TERM_DURATIONNot Populated - Not ConnectedSDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAP_TERM_NAMEW_AP_TERMS_DS.AP_TERM_NAMEAP_TERMSNAMESDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAUX1_CHANGED_ON_DTW_AP_TERMS_DS.AUX1_CHANGED_ON_DTAP_TERMS_LINESLAST_UPDATE_DATESDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAUX2_CHANGED_ON_DTW_AP_TERMS_DS.AUX2_CHANGED_ON_DTNot Populated - Not ConnectedSDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAUX3_CHANGED_ON_DTW_AP_TERMS_DS.AUX3_CHANGED_ON_DTNot Populated - Not ConnectedSDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSAUX4_CHANGED_ON_DTW_AP_TERMS_DS.AUX4_CHANGED_ON_DTNot Populated - Not ConnectedSDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCHANGED_BY_IDW_AP_TERMS_DS.CHANGED_BY_IDAP_TERMSLAST_UPDATED_BYSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCHANGED_ON_DTW_AP_TERMS_DS.CHANGED_ON_DTAP_TERMSLAST_UPDATE_DATESDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMSTERM_IDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMS_LINESDUE_AMOUNTSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMS_LINESDUE_DAYSSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMS_LINESDUE_DAY_OF_MONTHSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMS_LINESDUE_MONTHS_FORWARDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMS_LINESDUE_PERCENTSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_10_TEXTW_AP_TERMS_DS.CONDITION_10_TEXTAP_TERMS_LINESSEQUENCE_NUMSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTAP_TERMSTERM_IDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTAP_TERMS_LINESDUE_AMOUNTSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTAP_TERMS_LINESDUE_DAYSSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTAP_TERMS_LINESDUE_DAY_OF_MONTHSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3SDE_ORAR12_AdaptorSDE_ORA_APTermsDimensionW_AP_TERMS_DSCONDITION_1_TEXTW_AP_TERMS_DS.CONDITION_1_TEXTAP_TERMS_LINESDUE_MONTHS_FORWARDSDE_ORAR12_Adaptor.mplt_BC_ORA_APTermsDimension.4.SQ_RA_TERMS.3

Go to SQL OverrideGo to SIL

SILOSOracle BI Applications 7.9.5 ReleaseData Lineage SheetThe data lineage sheet below shows relationships between the ETL Folder, ETL Mapping, OLTP columns and Data Warehouse Columns. It only documents the Source Dependent Extract mappings (SDEs). It also displays which columns are populated with lookup, forFOLDER_NAMEMAPPING_NAMETARGET_TABLETARGET_COLSOURCESOURCE_TABLESOURCE_COLSQL_OVERRIDE_IDSILOSSIL_ACDEventFactW_ACD_EVENT_FANI_NUMW_ACD_EVENT_FS.ANI_NUMW_ACD_EVENT_FSANI_NUMSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FAUX1_CHANGED_ON_DTW_ACD_EVENT_FS.AUX1_CHANGED_ON_DTW_ACD_EVENT_FSAUX1_CHANGED_ON_DTSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FAUX2_CHANGED_ON_DTW_ACD_EVENT_FS.AUX2_CHANGED_ON_DTW_ACD_EVENT_FSAUX2_CHANGED_ON_DTSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FAUX3_CHANGED_ON_DTW_ACD_EVENT_FS.AUX3_CHANGED_ON_DTW_ACD_EVENT_FSAUX3_CHANGED_ON_DTSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FAUX4_CHANGED_ON_DTW_ACD_EVENT_FS.AUX4_CHANGED_ON_DTW_ACD_EVENT_FSAUX4_CHANGED_ON_DTSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALLID_NUMW_ACD_EVENT_FS.CALLID_NUMW_ACD_EVENT_FSCALLID_NUMSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_EVNT_TYPE_WIDW_ACD_EVENT_FS.CALL_EVNT_TYPE_IDW_ACD_EVENT_FSCALL_EVNT_TYPE_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_EVNT_TYPE_WIDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_ACD_EVENT_FSDATASOURCE_NUM_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_EVNT_TYPE_WIDW_EVENT_TYPE_D.ROW_WIDW_EVENT_TYPE_DROW_WIDSILOS.mplt_SIL_ACDEventFact.12.Lkp_W_Event_Type_D_Call_Event_Type_Wid.11SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_REASON_WIDW_ACD_EVENT_FS.CALL_REASON_IDW_ACD_EVENT_FSCALL_REASON_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_REASON_WIDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_ACD_EVENT_FSDATASOURCE_NUM_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_REASON_WIDW_REASON_D.ROW_WIDW_REASON_DROW_WIDSILOS.mplt_SIL_ACDEventFact.9.Lkp_W_REASON_D_Call_Reason_Wid.11SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_TYPE_WIDW_ACD_EVENT_FS.CALL_TYPE_IDW_ACD_EVENT_FSCALL_TYPE_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3SILOSSIL_ACDEventFactW_ACD_EVENT_FCALL_TYPE_WIDW_ACD_EVENT_FS.DATASOURCE_NUM_IDW_ACD_EVENT_FSDATASOURCE_NUM_IDSILOS.SIL_ACDEventFact.8.Sq_W_ACD_EVENT_FS.3

Go to SQL Override

SQL OverridesOracle BI Applications 7.9.5 ReleaseSQL OverridesThis sheet below shows the full SQL Override statement contents of the SQL Override IDs from the lineage sheets.SQL_OVERRIDE_IDSQL_OVERRIDEPLP.MPLT_GET_ETL_PROC_WID.1.LKP_ETL_PROC_WID.11PLP.mplt_GLBalanceAggrByAcctSegCodes.6.SQ_W_GL_BALANCE_F.3SELECT W_GL_BALANCE_F.LEDGER_WID, W_GL_BALANCE_F.PROFIT_CENTER_WID, W_GL_BALANCE_F.COMPANY_ORG_WID, W_GL_BALANCE_F.BUSN_AREA_ORG_WID, W_GL_ACCOUNT_D.GROUP_ACCT_WID, W_GL_BALANCE_F.BALANCE_DT_WID, W_GL_BALANCE_F.BALANCE_TM_WID, W_GL_BALANCE_F.DB_CR_IND, SUM(W_GL_BALANCE_F.BALANCE_ACCT_AMT) BALANCE_ACCT_AMT, SUM(W_GL_BALANCE_F.BALANCE_LOC_AMT) BALANCE_LOC_AMT, SUM(W_GL_BALANCE_F.BALANCE_GLOBAL1_AMT) BALANCE_GLOBAL1_AMT,