detailed design-hybrid 2.0_v3.0

Upload: manjunathganguly771275

Post on 01-Jun-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    1/62

    Detailed Design

    Hybrid 2.0

    Author: Upal Chakraborty,Biju Das,Sandeepan Dey,Manoj Singh

    Version: V3.0

    Status: Final Drat

    Date: 0!"0#"$0%& Detailed Design 'e(plate Version) V3.0

    $!*+3%%3+.do

    Version V3.0-age % o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    2/62

    Document data

    Document Change History

    Version / Date uthor Setion 1ature o ChangeV0.% %*202$0%& Manoj Singh,Upal

    Chakrabortynitial drat

    V0.$ $!202$0%& Manoj Singh Data 'ype or 1e4 'ables,-urging and5etention, Statistis

    V0.3 $202$0%& Manoj Singh Modiying the table struture to sho4 detailabout data laod into tables,dding1U66B67 olu(ns inor(ations

    V0.& $202$0%& Manoj Singh Modiied +.3V0.! 30202$0%& Manoj Singh Minor hanges

    V0. 30202$0%& Manoj Singh -opulation Method Update or 1e4 'ablesV0.+ 0320+2$0%& Biju Das +.! D8MV0.* 0&20+2$0%& Biju Das Updated as per initial re9ie4V0.# 0*20+2$0%& Biju Das Minor hange in Bakup aet onigV%.0 %020+2$0%& Manoj Singh +.%.$.% UpdatedV%.% %&20+2$0%& Manoj Singh +.%.%.,+.%.$.

    $,+.%.3.%dded tabular struture or data insertionand bakup aet

    V%.$ %20+2$0%& Biju Das +.!.$ Updated. -age or(atted.V%.3 %20+2$0%& Manoj Singh Minor hangeV%.& $$20+2$0%& Manoj Singh +.%.& dding ne4 FaetV%.! 3%20+2$0%& Manoj Singh +.%.%3 ddition o ne4 olu(n in

    1C71'V7:7V71' tableV$.0 0320#2$0%& Manoj Singh +.&,+.%.&,+.%.

    %.,+.%.%.3,+.%.$,+.%.$.3

    Minor Changes)olu(n na(e hange or1C71'V7:7V71' table, Colu(n 'ypehange or Stats ;ather,-5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    3/62

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    4/62

    &.. MDE -roess.................................................................................................$#&..+ '6S lookup synhroniation........................................................................30&..* Update Ma ey 6ookup in 6egay.................................................................30&..# Soure 'arget Mapping...................................................................................30

    &..#.% 79ent Faet..............................................................................................30&..%0 6oading proess or - iles...........................................................................3%

    &.+ (pat o hanges due to introdution o ne4 ield in the -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    5/62

    . ey Deision 7(ails..................................................................................................... %

    $!*+3%%3+.do

    Version V3.0-age ! o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    6/62

    1 Introduction

    +,+ -verview

    Fle Aybrid$.0 is an i(pro9e(ent o9er the originally deployed Aybrid %.0 also kno4n as Fle %.0 ,deployed in the (onth o Hanuary $0%& .Aybrid $.0 projet (ainly ouses on the apability tointrodue (ore than one Aybrid -rie -lan and the apability to apply redued (onthly harges,based on a(paign data ro( Unia.

    lso earlier in Fle Aybrid %.0 it 4as not possible to link Data ro( Vesta syste( 4ith Data ro(Surepay ?ontaining produt id@ syste( in order to reonile and hek the (onthly harge.

    'he pay(ent inor(ation ro( Vesta does not ha9e any produt d inor(ation. Vesta pay(entshappen e4 days ater Surepay balane e9ent data o(e to '6S. 'he Surepay balane e9entsdoes not ontain the e9ent a(ount so it is not possible to reonile bet4een Surepay e9ents andVesta pay(ents.s part o hybrid $.0 it 4as needed to ha9e reerene tables 4hih 4ill allo4 reoniliation ?leprodut@ o (onthly harge 9s. (onthly bundle using prie plan id into aount.

    'he abo9e i(pro9e(ents 4ould be brought in by introduing $ eeds ro( M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    7/62

    +,0 Charcoal Diagram

    +,1 Related Documentation

    Doc

    #

    Title Document Name

    1 HLD Hybrib 2.0 HLD-HYBRID 2.0_v0..!oc "erion 00$

    %une 201&2 "o!a'one IT HLD HLD - Hybri! 2 0 - "1.0.!oc(

    ) *ni'y DDL Dei+n Document ",NL-*ni'y-DD-DDL.!oc$"erion 0.2$!ate!)0-01-2012

    & *ni'y DDL Dei+n men!mentDocument

    ",NL-*ni'y-D-DDL.!oc$"erion 2.$!ate!1&-0-2012

    / ",NL-*ni'y-IDD-DDL-TL-11-1.!oc

    ",NL-*ni'y-IDD-DDL-TL-11-1.!oc!ate! 012201)

    ",NL-D-TL Dei+n TL.!oc ",NL-D-TL Dei+n TL.!oc$verion1.2 $!ate! 1/0&201)

    3 Detaile! Dei+n-

    B*_4"5_v1.2.!oc

    Detaile! Dei+n-B*_4"5_v1.2.!oc

    $!*+3%%3+.do

    Version V3.0-age + o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    8/62

    +,2 -pen 3tems

    nterae dou(ents ?DD@ ro( MD

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    9/62

    2 Scope

    0,+ 3n Scope

    'he belo4 are the reuire(ents ro( reporting perspeti9e 4ith their easibility status )2

    '4o ne4 eeds ro( M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    10/62

    3 Interface File and KPI File

    7ah o the data ile 4ill be preisely desribed by a orresponding (etadata ile.'he (eta2data 4ill thereore ontain inor(ation about the data ile) sie, 9ersion, reord ount, et.'his data 4ill also be used to onir( the ile trans(ission. the (eta2data has been reei9ed, thedata trans(ission is o(pleted and proessing an start.

    n order to (eet the Vodaone D8M 5euire(ents eah data ile (ust be ao(panied 4ith a soalled -2ile to be used or reoniliation purposes. 'hese -s are deter(ined by Vodaone persoure.

    n total, eah daily M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    11/62

    M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    12/62

    prieplan string FleFBS string Fle:S(a:DataS-rie dei(al $+!0

    (osa:a(paign:disount:GGGGMMDD:########.dat.g

    Attribute )ype Description7!8ample

    C'1 dei(al %0++&3!&

    Ca(paignCode string Ca(paign identiiation as reei9ed 4ithinAC6 input ile. 1ot rele9ant or M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    13/62

    File 'ype) g

    File 'ranser Method) SF'- push

    File authoriation) at least read" 4rite or all ?U1N) r42r42r42@

    Colu(n deli(iter) IOJ. -lease note that there should not be any pipe in any o the data attributes.

    7ah - ile is ao(panied by a orresponding (etadata2ile.

    - iles should be deli9ered in Uni2ip or(at ?o(pressed@.

    'he (etadata iles should be deli9ered as plain tet ?not o(pressed@.

    Belo4 are the -s deided or eah soure ile)

    0,< Naming convention o* the /3 *ile

    Lsouresyste(:Lkpiilena(e:Ldate:o:ontent:Lile:se:no.dat.g

    Ehereby) Souresyste() 1a(e o the soure syste(?For e.g M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    14/62

    mosa>campaign>discount>$pi>????&&DD>

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    15/62

    Souresyste() 1a(e o the soure syste(

    Filena(e) Sa(e as na(e o the data" - ile

    Date o ontent) 'he date o the data 4hih the ile is holding. For(at) GGGGMMDD

    File se no) Seuene nu(ber o the ile 4ithin the soure syste("ilena(e deli9eries.For(at) 00000000. Seuene nu(ber starts 4ith 0000000%. 'he net ile should ha9e se nr0000000$ and so on. 'here shouldnJt be gaps in the se:noJs. or 4hate9er reason a ilehas to be re2sent the se:no should be the sa(e. ?not inreased@.

    7a(ple?s@)

    For the data iles, the na(es o the (etadata iles 4ould be

    (osa:a(paign:disount:GGGGMMDD:LS781

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    16/62

    SOURCE_SYSTEM=MOSAFILE_TYPE=DATANUM_REC=292934

    BYTES=3232324DELIMITER=|FULL_DELTA=DFIELD_NAMES=

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    17/62

    1 ETL Design

    1,+ /roject Creations:

    Sine M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    18/62

    Usage) generi:4ait:or:ile.ksh 2hT 2s Lsandbo root 2p Lprojet na(e 2(T 2F Leed prei 2SLeed sui 2M L(etadata ile suiT2D LdurationT 2 Lpolling inter9alT 2- diretory para(eterT 2A hostT

    Ehere) 2h displays this help (essage. 2s Lsandbo root the na(e o the older 4here all bnitio projets are rooted 2p Lprojet na(e the na(e o the projet 4hose para(eter is to be soured or olderinor(ation 2F Feed File na(e prei. Can take 4ild ards inluding uni o((ands in 2S Feed File 1a(e sui 2M plan,pset7/rojects7ddl7source7mosa7pset7price>re*erence>generic>batch,pset

    7/rojects7ddl7source7mosa7pset7campaign>discount>plan,pset7/rojects7ddl7source7mosa7pset7campaign>discount>generic>batch,pset

    7/rojects7ddl7source7mosa7pset7price>re*erence>$pi>plan,pset7/rojects7ddl7source7mosa7pset7price>re*erence>$pi>generic>batch,pset

    7/rojects7ddl7source7mosa7pset7campaign>discount>$pi>plan,pset7/rojects7ddl7source7mosa7pset7campaign>discount>$pi>generic>batch,pset

    'he abo9e (entioned eeds undergo the I;eneri BathJ proessing and reate respeti9e delta andsnapshot iles. Sine this proess is proessed through a generi and reusable DD6 graphs , ne4

    $!*+3%%3+.do

    Version V3.0-age %* o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    19/62

    para(eter 9alues needs to be supplied or eah o the psets (entioned abo9e . 'he details o thepara(eter 9alues or eah o the abo9e (entioned psets are pro9ided in the belo4 attahedspreadsheet .

    Mosa_interface_generic_batch_parame

    Sine urrently, or any ne4 soure the orresponding - iles 4ill be landed in the soure speiilanding diretory ro( 4here the - iles 4ill be piked up and proessed by the respeti9e pri9ateprojet proess , in this ase I(osaJ .Currently the - undergoes a singleton post proessing , 4hih (eans that there is a generi postproessing graph 4hih ollets all - delta iles ro( RC

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    20/62

    -ption . : Create separate plan and graph or Mmosa>$pi>post>procesing,mp/lan Name : 7/rojects7ddl7target7ddl>atlas7plan7atlas>mosa>$pi>post>procesing>plan,plan

    'he graph and plan should be si(ilar to the eisting - graph and plan 4ith the eeption o theollo4ing plan para(eters as sho4n belo4 )2

    /arameter Name ValueM7'D':F67:U56 RCmosa>campaign>discount>generic>post>processing>plan,pset atlas>mosa>campaign>discount>generic>post>processing,pset

    atlas>price>re*erence>generic>post>processing>plan,pset atlas>price>re*erence>generic>post>processing,pset

    ?ii@ -ara(eter 9alues or eah o the plan pset to be pro9ided as supplied in the belo4dou(ent )2

    MOSA_data_postprocessing_params.xls

    $!*+3%%3+.do

    Version V3.0-age $0 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    21/62

    1,2 DDE H-#S!!!/3N5

    1,2,+ House$eeping *or *eed *iles :

    ne4 plan needs to be reated in the path )2 "-rojets"ddl"soure"(osa"plan"housekeeping.plan . 'heplan should look so(ething like the one belo4 )2

    $!*+3%%3+.do

    Version V3.0-age $% o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    22/62

    'he sub plans prie reerene deltas and a(paign disount deltas 4ould deter(ine the purge

    date or eah o the orresponding ISubsribersJ and purge the( aordingly . 'he abo9e sub plans4ould onsist o so(ething as belo4 )2

    FiG Determining /urge date :'he irst graph task 4ould deter(ine the purge date or the subsriber and the seond graph task4ould purge the reuired data in delta iles .

    '4o ne4 psets needs to be reated as )2

    A3>/S!)7determine>ddl>data>store>purge>date>cmpgn>disc,psetA3>/S!)7determine>ddl>data>store>purge>date>price>re*,pset

    'he abo9e psets 4ould be passed in the ;raph para(eter o the abo9e (entioned deter(ine purgedate subplan .

    'he details o para(eters o the abo9e pset are as ollo4s )2;raph 1a(e alled by the psets )27/rojects7ddl7com>house$eeping7mp7determine>ddl>data>store>purge>date,mp

    Shouse$eeping7mp7data>store>copied>*iles>house$eeping,mp

    $!*+3%%3+.do

    Version V3.0-age $$ o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    23/62

    S

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    24/62

    A/S!)7determine>ddl>data>store>purge>date>cmpgn>disc>$pi,psetA3>/S!)7determine>ddl>data>store>purge>date>price>re*>$pi,pset

    Details o the para(eter 9alues as belo4 )2

    S

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    25/62

    -set na(es )2 A3>/S!)7house$eep>mosa>campaign>discount>$pi>deltas,pset A3>/S!)7house$eep>mosa>price>re*erence>$pi>deltas,pset

    1,4 A)EAS /rocessing

    'he DD6 post proessing proess 4ill stp the ile to '6S ser9er. Beore data is loaded to '6S6DM it 4ill go through Meta 9alidation and series o MDE graphs 4here business rule 4ould beapplied and e9entually data 4ill be loaded to 6DM through MDE ra(e4ork graph.

    1,4,+ /roject StructureBelo4 diagra( sho4s the proposed projet struture 4hih should eist at the atlas ser9er end. 'heboes (arked in yello4 are the ne4 projet 4hih needs to be introdued.

    $!*+3%%3+.do

    Version V3.0-age $! o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    26/62

    1,4,. /olling

    ne4 'ES job needs to be deined during de9elop(ent phase 4hih 4ill poll or the ne4 eed ilesand the orresponding - iles o Mdwh7com>atlas7bin7generic>conduct>etl>*low,$sh, needs to be used or thepolling purpose.

    1,4,0 Source ile Registration and &etadata Validation

    FiG eed *ile registration process:'he ne4 eed iles o M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    27/62

    ;raph -ara(eter Desription ?pset@)

    Name Example DescriptionS

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    28/62

    FiiG /3 *iles registration process :

    'he orresponding - iles o M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    29/62

    1,4,1 Surrogate ey e8traction

    Surrogate key o the tables Ca(paign, -rodut,-rodut:ite( and 79ent has to be etrated beorethe start o the MDE proess. 'he belo4 psets needto be reused 4ithout (aking any hange. 1one4 'ES jobs needs to be reated the eisting surrogate key etration jobs or the abo9e(entioned di(ension tables an be used .

    Details o the 'ES jobs,pro9ided in the 'ES job setion .

    1,4,2 Create &a8 ey loo$up

    Eith the etrated surrogate keys ro( the 9arious di(ension tables , a (a key lookup ile isreated , 4hih 4ill be reated through the urrent reate (a key lookup proess , so there needs nohange to this proess in this projet .

    4.6.6 &DJ /rocess

    'he MDE proesses data ro( M

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    30/62

    3. Serially. MDE proess:key reates all needed surrogate keys. Must run as a singleton to ensurekey onsisteny and pre9ent dupliates.

    &. n parallel. MDE apply:keys replae natural keys 4ith eisting surrogate keys or ne4ly reated

    surrogate keys.!. n parallel. MDE (odel:to:physial (aps all the ields in the (odel to the physial table reord

    or(at.. n parallel. MDE database:load loads all 4aiting input iles ?possibly ro( (any eeds@ targeted

    or the table and onsolidates the(. 'here 4ill be one MDE database load pset per target table.

    1,4,9 A)EAS loo$up synchroni@ation

    6ookup iles o the tables suh as 7V71' , CM-;1 , -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    31/62

    )he details o* the mapping is as described in the embedded mapping spreadsheet documentbelow :

    DetailedDesign-Hybrid 2.0_

    1,4,+= Eoading process *or /3 *iles'he onsolidated - iles reated by the registration proess as (entioned abo9e in the setion &..$4ould be piked up loading purpose. 'he - data doesnJt go through the surrogate key generationproess through the MDE ra(e4ork and diretly gets loaded in the IS

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    32/62

    Si(ilar hanges are atually taking plae in a separate projet )2 7BU:CVM , and details o thehanges an be reerred in the detailed design dou(ent o 7BU:CVM as (entioned in the relateddou(ent list setion ?Dou(ent / +@ .

    NoteK: During development phase the Hybrid .,= development team needs to coordinate withthe !'#>CV& development team *or this change so that a single change satis*ies both theprojectBs need .

    1,9 3mpact o* changes due to introduction o* new *ield in the/R-D#C)>3)!&>H3S) table

    n the urrent projet a ne4 ield IS7C

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    33/62

    'his oneti(e hange an be done by (eans o reating a oneti(e abintio graph or byusing any sripting ode .

    ?ii@ 'he abo9e hange need not be done i the table I-5dwh7utility7pset70>mdw>import,VNE,pset

    /lan Name : 7/rojects7mdw.7&DJ7plan7mdw>import,plan

    'he abo9e plan takes an eel spreadsheet as an input para(eter , the spreadsheet ontains thedi(ension list , relationship o the table 4ith respet to the di(ension , the physial d(l struture ,MDE keydes,keyseuenes,keyontets , 9alueontets et .

    sa(ple ea(ple spreadsheet is attahed belo4, ho4e9er during de9elop(ent phase the latestspreadsheet has to be auired by the de9eloper ro( the eisting Uniy tea( and hanges needs tobe built on top o the(.

    "ogical_Data_Mode

    l_20!#0$22.xls

    1,; A)EAS House$eeping

    Ho%se&eeping is re'%ired to p%rge archie and error (les generated thro%gh Meta)alidation.

    Here are the steps.

    1. Update the sql/Projects/atlas_dwh/com_atlas/sql/create_registration_table.sql to insertthese t*o '%eries.

    $!*+3%%3+.do

    Version V3.0-age 33 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    34/62

    INSERTINTO?1ATLAS_CTRL_O@NER20ATLAS_-OUSE.EEPIN/ ,ALUES(1MOSA1,1A7c8i"1,>);INSERTINTO?1ATLAS_CTRL_O@NER20ATLAS_-OUSE.EEPIN/ ,ALUES(1MOSA1,1E77o71,>);

    2. Create two psets for the graph+,roects+atlas_d*h+com_ho%se&eeping+mp+generic_ho%se&eeping.mp to p%rge MOSAarchie and error (les.

    /Projects/atlas_dwh/source/mosa/pset/generic_housekeeping_archive_les.pset/Projects/atlas_dwh/source/mosa/pset/generic_housekeeping_error_les.pset

    !raph "ame #$/Projects/atlas_dwh/com_housekeeping/mp/generic_housekeeping.mp

    Parameter "ame %alue &escription/" A1_S/1A"_A/3H1)+A1_S/1A"_//O/ Dir to be p%rged

    41"_56, D1/ se the defa%ltal%e

    S6S5M_7AM MOSA So%rce System7ame

    HOS8,179_41"_56, Archie+rror Archie dir forarchieho%se&eepingpset and rrordor for errorho%se&eepingpset

    "8,_"O3A51O7 3OM_A5"AS_S/1A"_"OO8, 8eep the defa%lt

    al%e

    $!*+3%%3+.do

    Version V3.0-age 3& o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    35/62

    5 Process Flow Diagrams

    2,+ eed ile /rocess low :

    $!*+3%%3+.do

    Version V3.0-age 3! o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    36/62

    $!*+3%%3+.do

    Version V3.0-age 3 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    37/62

    2,. &DJ /rocess low :

    $!*+3%%3+.do

    Version V3.0-age 3+ o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    38/62

    2,0 /3 ile /rocess low

    $!*+3%%3+.do

    Version V3.0-age 3* o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    39/62

    $!*+3%%3+.do

    Version V3.0-age 3# o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    40/62

    T!S sc"eduling #

    1e4 'ES jobs needs to be introdued to eeute the abo9e illustrated proess lo4s. 'he 'ESjobs an be broadly lassiied into DD6 jobs and jobs at tlas end . 'he possible list o 'ES jobs4hih 4ould be reated and their orresponding dependenies are listed do4n in the belo4attahed dou(ents as belo4 )2

    ?i@ 6ist o DD6 and post proessing jobs to be reated )

    Hybrid_DD"_ob_sc

    hed%les.xls

    ?ii@ 6ist o tlas and MDE 'ES jobs to be reated )2

    Hybrid_A5"AS_ob_sched%les.xls

    NoteK: )he jobs are named as per the testing naming conventions% the names need to be

    realigned during development as per the environment where the jobs would bescheduled to run ,

    )he job dependencies with the e8isting jobs needs to be revalidated duringdevelopment phase with the actuals running in prod i* incase there are changes to thejob stream during the development phase ,

    $!*+3%%3+.do

    Version V3.0-age &0 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    41/62

    $% Teradata Design

    s part o Aybrid $.0 -rojet, belo4 are the design o9ered in this dou(ent related to 'eradata.

    9,+ Hybrid .,= data Eoad FNewG'4o ne4 eeds ro( M -5CEASS )able

    ne4 sript ?insert:e9ent:lass.sl@ 4ill be reated to insert an entry in the 7V71':C6SS table inthe S'; en9iron(ent.

    'he deault 9alue 4ill be 2% or both CD > 6UD or all the one ti(e insert to the tables (entionedbelo4.

    '%'"(_C)*++_C&

    '%'"(_C)*++_"*,'

    '%'"(_C)*++_&'+C

    -C-& )U-&

    11ncentieeent

    1ncentie eent

    -! -!

    $!*+3%%3+.do

    Version V3.0-age &% o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    42/62

    9,+,+,. -ne time load script *or !V!N)>)A'E!>)?/! )able ne4 sript ?insert:e9ent:table:type.sl@ 4ill be reated to insert an entry in the

    7V71':'B67:'G-7 table in the S'; en9iron(ent. 'he deault 9alue 4ill be 2% or both CD > 6UD or all the one ti(e insert to the tables (entionedbelo4.

    '%'"(_(*)'_(P'_C&

    '%'"(_(*)'_(P'_"*,'

    '%'"(_(*)'_(P'_&'+C

    -C-& )U-&

    17) 1ncentie eent 1ncentie eent

    -! -!

    9,+,+,0 New )able: 3NC!N)3V!>!V!N) FS!) )A'E!G

    'his table is not present in '6S.Sript 4ill be de9eloped to reate this table in the in the S'; and -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    43/62

    Column &ata

    (0pe &escription

    "U))/"

    +ample Population

    ,ethod -nde3es

    A35A"_3HA/9 D31MA"=>?2@ 6 So%rce data from,rice 4ield .5his(eld can haedatatype asinteger+decimalb%t as the so%rcedatatype *asntaailable and nosample data *asaailable it *illbe adise dtoreisit d%ringdetail design.

    7A

    173751)_/S"5_1D

    1759/ 6 48 to1ncentie_res%lt_type.incentie_res

    %lt_cd .

    7A

    3/A51O7_SO/3_56,_3D

    )A/3HA/=B@

    7 MOS =MOSA@ 7A

    M171MM_)A"

    D31MA"=>?2@

    6 Mapped to (eldminim%m al%efrom so%rcefeed .5his (eldcan haedatatype asinteger+decimalb%t as the so%rcedatatype *asntaailable and nosample data *asaailable it *ill

    be adise dtoreisit d%ringdetail design.

    7A

    /D351O7_AMO75

    D31MA"=>?2@

    6 Mapped to (elddisco%nt al%efrom so%rcefeed .5his (eldcan haedatatype asinteger+decimalb%t as the so%rcedatatype *asntaailable and nosample data *asaailable it *illbe adise dto

    reisit d%ringdetail design.

    7A

    O/9_86 )A/3HA/=2$$@

    7 7A

    131D SMA""175 7 5hro%gh 5",rocess

    7A

    "1D SMA""175 7 5hro%gh 5",rocess

    7A

    9,+,+,1 New )able: 3NC!N)3V!>R!S#E)>)?/! FS!) )A'E!G

    'his table is not present in '6S. 'his table should be loaded one ti(e through (anual sripts.

    $!*+3%%3+.do

    Version V3.0-age &3 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    44/62

    Sript 4ill be de9eloped to reate this table in the in the S'; and -5result>id. s per theeisting standard, it should be id not ode.lso olu(n IdesJ ?s per A6D@ abo9e has been hanged to 3ncentive>result>desc.

    9,+,+,2 Copyto/rod Con*iguration *or !vent,'ase *acet

    'he generi C

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    45/62

    i(pated table in the ontrol table S';:DB.BCU-:FC7'. Sa(ple data ro( BCU-:FC7'

    table is gi9en belo4 or your reerene.

    &*(**+'"*,'

    &*(**+'"*,'

    _P4'

    &*(**+'"*,'_P5+(

    (*)'"*,'

    6*C'( *C7UP"*,'

    '8C &*(*_-"&

    C4'*('_)7P_-"&

    ,*8_%*)U'_-"&

    S59_"DM S59 "DM )75 )75_H; H_;_)75 7"" MA17 6 6

    S59_"DM S59 "DM )75_3"ASS )75_H; H_;_)75_3"ASS

    7"" /4 6 7

    S59_"DM S59 "DM )75_5A;"_56,

    )75_H; H_;_)75_5A;"_56,

    7"" /4 6 7

    S59_"DM S59 "DM 173751)_)75

    )75_173751)_

    H;

    H_;_173751)_)75

    7"" MA17 6 6

    S59_"DM S59 "DM 173751)_/S"5_56,

    )75_173751)_

    H;

    H_;_173751)_/S"

    5_56,

    7"" /4 6 6

    9,+,+,9 -neto-ne view FNewG

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    46/62

    9,+,+,< -ne time script *or 3NC!N)3V!>R!S#E)>)?/! )A'E!

    ne4 sript ?insert:stg:inenti9e:result:type.sl@ 4ill be reated to insert 9alue related to Aybrid $.0

    in the 1C71'V7:57SU6':'G-7 table in S'; en9iron(ent.

    'he deault 9alue 4ill be 2% or both CD > 6UD or all the one ti(e insert to the tables (entionedbelo4.

    -"C'"(-%'_4'+U)(_-& -"C'"(-%'_4'

    +U)(_&'+C 54!_7' -C-& )U-&

    !/ed%ction Applied

    !-! -!

    2/ed%ction 7ot

    applied? minim%m

    al%e not reached

    2-! -!

    This is the existing table, one column will be added as part of Hybrid 2.0, the new column would beSecondary_Product_d. The row highlighted in yellow shows the new column addition.

    Column &ata

    (0pe&escrip

    tion"U))/"

    +ample Population

    ,ethod -nde3es

    ,/OD35_1D 1759/ 7 B>B0# "oo&%p on,/OD35.,/OD35_7AM for So%rce(eld - priceplanid .

    ,/OD35_15M_1D 1759/ 7 /eference to the,rod%ct_item.prod%

    ct_item_id,/OD35_15M_S5A/5_D5

    DA5 7 20!B-!2-0! 4or a ne*combination of,riceplanid and4;Sid insert a ne*record *ith sysdate.1f the combinationofEpriceplanid?fbsidFfor a partic%lr pricechanges and a ne*al%e of pricecomes in then ane* record *ill bepop%lated *ith thesysdate.

    DA5 4O/MA5Gyyyy-mm-ddG

    ,/1OD_3D 3HA/=!@ 7 0D1S3O75_M5HOD_3D

    3HA/=!@ 7 :

    51/_")"_3D 3HA/=!@ 7 :A351O7_3D 3HA/=!@ 7 :

    $!*+3%%3+.do

    Version V3.0-age & o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    47/62

    Column &ata

    (0pe&escrip

    tion"U))/"

    +ample Population

    ,ethod -nde3es

    ,/OD35_15M_S5A

    /5_5M

    51M=0@ 7 4or a ne*

    combination of,riceplanid and4;Sid insert a ne*record *ith systime.1f the combinationofEpriceplanid?fbsidFfor a partic%lr pricechanges and a ne*al% of price comesin then a ne*record *ill bepop%lated *ith thesystime.

    ,/OD35_15M_7D_D5

    DA5 6 !2+B!+!>II 4or a ne*combination of

    ,riceplanid and4;S1D insert a ne*record *ith 7"" .1fthe combination ofEpriceplanid?fbsidFfor a partic%lr pricechanges and a ne*al%e of pricecomes in then ane* record *ill bepop%lated *ith the7"" ?5he olderrecord *ill beclosed *ithsysdate.

    ,/OD35_15M_7D_5M

    51M=0@ 6 4or a ne*combination of,riceplan1d and4;S1d insert a ne*record *ith 7"" .1fthe combination ofEpriceplan1d?fbs1dF for a partic%lrprice changes anda ne* al%e ofprice comes in thena ne* record *illbe pop%lated *iththe 7"" ?5he olderrecord *ill beclosed *ithsysdate.

    ,/OD35_15M_3HA/9_56,_3D

    3HA/=!@ 6 :

    ,/OD35_15M_MO75A/6_AM5 D31MA"=

    !>?J@

    6 So%rce - ,rice (eld

    MO75A/6_715_O4_MAS/_3D

    3HA/=#@ 6 K/L

    ,/"1M17A/6_3HA/9

    D31MA"=!2?$@

    6 7A

    715_D/A51O7 1759/ 6 7AD/A51O7_715_O4_MAS/_3D

    3HA/=#@ 6 7""

    131D SMA""175 7 5hro%gh 5",rocess

    "1D SMA""175 7 5hro%gh 5"

    ,rocess

    $!*+3%%3+.do

    Version V3.0-age &+ o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    48/62

    Column &ata

    (0pe&escrip

    tion"U))/"

    +ample Population

    ,ethod -nde3es

    +'C5"&*4_P45

    &UC(_-&

    1759/ 6 "oo&%p on

    ,/OD35.,/OD35_7AM for So%rce(eld fbs

    !ote" The changes needs to be made in both the staging and target database. # $erify sample data whether it would be %&' or %&'(

    9,+,. -**er,/roduct *acet: ED& tables data load

    Belo4 is the list o tables that 4ill be i(pated or this aetin S';:6DM > -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    49/62

    Column &ata

    (0pe&escrip

    tion"U))/"

    +ample Population

    ,ethod -nde3es

    ,/1OD_3D 3HA/=!@ 7 0

    D1S3O75_M5HOD_3D

    3HA/=!@ 7 :

    51/_")"_3D 3HA/=!@ 7 :A351O7_3D 3HA/=!@ 7 :,/OD35_15M_S5A/5_5M

    51M=0@ 7 4or a ne*combination of,riceplanid and4;Sid insert a ne*record *ith systime.1f the combinationofEpriceplanid?fbsidFfor a partic%lr pricechanges and a ne*al% of price comesin then a ne*record *ill bepop%lated *ith thesystime.

    ,/OD35_15M_7D_D5

    DA5 6 !2+B!+!>II 4or a ne*combination of,riceplanid and4;S1D insert a ne*record *ith 7"" .1fthe combination ofEpriceplanid?fbsidFfor a partic%lr pricechanges and a ne*al%e of pricecomes in then ane* record *ill bepop%lated *ith the7"" ?5he olderrecord *ill beclosed *ithsysdate.

    ,/OD35_15M_7D_5M

    51M=0@ 6 4or a ne*combination of,riceplan1d and4;S1d insert a ne*record *ith 7"" .1fthe combination ofEpriceplan1d?fbs1dF for a partic%lrprice changes anda ne* al%e ofprice comes in then

    a ne* record *illbe pop%lated *iththe 7"" ?5he olderrecord *ill beclosed *ithsysdate.

    ,/OD35_15M_3HA/9_56,_3D

    3HA/=!@ 6 :

    ,/OD35_15M_MO75A/6_AM5 D31MA"=

    !>?J@

    6 So%rce - ,rice (eld

    MO75A/6_715_O4_MAS/_3D

    3HA/=#@ 6 K/L

    ,/"1M17A/6_3HA/9

    D31MA"=!2?$@

    6 7A

    715_D/A51O7 1759/ 6 7A

    D/A51O7_715_O4_MAS/_3D

    3HA/=#@ 6 7""

    $!*+3%%3+.do

    Version V3.0-age o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    50/62

    Column &ata

    (0pe&escrip

    tion"U))/"

    +ample Population

    ,ethod -nde3es

    131D SMA""175 7 5hro%gh 5"

    ,rocess"1D SMA""175 7 5hro%gh 5"

    ,rocess+'C5"&*4_P45&UC(_-&

    1759/ 6 "oo&%p on,/OD35.,/OD35_7AM for So%rce(eld fbs

    !ote" The changes needs to be made in both the staging and target database. # $erify sample data whether it would be %&' or %&'(

    $!*+3%%3+.do

    Version V3.0-age !0 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    51/62

    9,+,.,. Data 'ac$up LCon*igure 'ac$up *acet Script

    'he generi aet bakup sript 4ill ha9e to be etended or all the i(pated tables or this aet.

    'his aet bakup sript baks up the tables in S';:6DM database to the S';:BCU- database on a daily basis.

    1o hange 4ill be reuired in the aet bakup shell sript. Ao4e9er, there 4ill be entries or all the i(pated table in the ontrol table

    S';:DB.BCU-:FC7'. Sa(ple data ro( BCU-:FC7' table is gi9en belo4 or your reerene.

    &*(**+'"*,'

    &*(**+'"*,'

    _P4'

    &*(**+'"*,'_P5+(

    (*)'"*,' 6*C'(

    *C7UP"*,'

    '8C

    &*(*_-"&

    C4'*('_)7P_-"&

    ,*8_%*)U'_-"&

    ,*8_7'

    %4_-"&P*4(-(-5"_7'

    P4-,*4_7'

    S59_"DM S59 "DM ,/OD35_15M_H1S

    5

    O44/_H;

    H_;_,/OD35_15M_H1S5

    7"" H1S5 6 7 7 ,/OD35_1DN,/OD35_15M_1DN,/OD3

    5_15M_S5A/5_D5N

    ,/1OD_3DND1S3O75_M5HOD_3DN51/_")"_3D?A351O7_3d

    S59_"DM S59 "DM ,/OD35_15M

    O44/_H;

    H_;_,/OD35_15

    M

    7"" MA17 6 6 ,/OD35_15M_1D

    7 ,/OD35_15M_1D

    $!*+3%%3+.do

    Version V3.0-age !% o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    52/62

    9,+,.,0 -ne time script *or /R-D#C)>3)!& )A'E!

    ne4 sript ?insert:produt:ite(.sl@ 4ill be reated to insert 9alue related to Aybrid $.0 in the

    -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    53/62

    9,+,0,+ Data 'ac$up LCon*igure 'ac$up *acet Script

    'he generi aet bakup sript 4ill ha9e to be etended or all the i(pated tables or this aet.

    'his aet bakup sript baks up the tables in S';:6DM database to the S';:BCU- database on a daily basis.

    1o hange 4ill be reuired in the aet bakup shell sript. Ao4e9er, there 4ill be entries or all the i(pated table in the ontrol table

    S';:DB.BCU-:FC7'. Sa(ple data ro( BCU-:FC7' table is gi9en belo4 or your reerene.

    &*(**+'"*,'

    &*(**+'"*,'_P4

    '

    &*(**+'"*,'_P5

    +(

    (*)'"*,' 6*C'(

    *C7UP"*,

    ' '8C

    &*(*_-"&

    C4'*('_)7P_-"&

    ,*8_%*)U'_-"&

    ,*8_7'

    %4_-"&

    P*4(-(-5"_7'

    P4-,*4_7'

    S59_"DM S59 "DM 3/A51O7_SO/3_56,

    M1S3_H;

    H_;_3/A51O7_SO/3_56,

    7"" /4 6 7 7 3/A51O7_SO/3_56,

    _3D

    $!*+3%%3+.do

    Version V3.0-age !3 o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    54/62

    9,+,0,. -ne time script *or CR!A)3-N>S-#RC!>)?/! )A'E!

    ne4 sript ?insert:reation:soure:type.sl@ 4ill be reated to insert 9alue related to Aybrid $.0 in

    the C57' 6UD or all the one ti(e insert to the tables (entioned

    belo4.

    C4'*(-5"_+5U4C'_(P'_C&

    C4'*(-5"_+5U4C'_(P'_"*,'

    C4'*(-5"_+5U4C'_(P'_&'+C

    -C-& )U-&

    MOS MOSA MOSA -! -!

    9,+,1 Campaign *acet: ED& tables data load

    Belo4 is the list o tables that 4ill be i(pated or this aetin S';:6DM > -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    55/62

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    56/62

    9,+,1,. -ne time load script *or CA&/A35N>S)RA)!5? )able

    ne4 sript ?insert:o(aping:strategy.sl@ 4ill be reated to insert an entry or the Aybrid $.0 in theCM-;1:S'5'7;G table in the S'; en9iron(ent.

    'he deault 9alue 4ill be 2% or both CD > 6UD or all the one ti(e insert to the tables (entionedbelo4.

    C*,P*-!"_+(4*('!_C&

    C*,P*-!"_+(4*('!_"*,'

    C*,P*-!"_+(4*('!_&'+C

    -C-& )U-&

    H3"Hybrid3ampaign "ist

    3ampaign "ist forHybrid c%stomers

    -! -!

    9,. Data 'ac$up

    Database le9el bakup is done by the DB tea( on a daily basis

    9,0 Data Retention and /urging

    &ata 4etention &ata Purging

    Database level )able Eevel Database Eevel )able level

    Online bac&%p is ta&enat database leel.

    7o History/e'%irement

    ,%rging is nothappening atdatabase leel.

    7ot in scope

    9,1 Statistics 5athering

    Statistis needs to be gathered on the olu(ns identiied as - or the ne4 tables introdued orAybrid $.0 data load.

    'he ontrol table C

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    57/62

    &*(**+'"*,'

    (*)'"*,'

    C5)U,"(P'

    C5)U,""*,'

    )-+(

    +*,P)'_+(*(

    +-"('4%

    *)95"*

    ,'*C(-%'

    RWDB:71V%:6DM -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    58/62

    $ ;5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    59/62

    9,2,. D!)A3E!D /3 CAEC#EA)3-NS

    For the ne4 -s, reerene data needs to be added in the ollo4ing table.'he ne4 - details need to be added in -5

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    60/62

    9,2,1 Campaign Discount eed

    9,2,1,+ Number o* records per Result Code% Campaign

    ;et the total nu(ber o reords ro( the ollo4ing staging tables.

    S';:V7E.1C71'V7:7V71' 7T

    S';:V7E.N6$:6

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    61/62

    $!*+3%%3+.do

    Version V$.0-age % o $

  • 8/9/2019 Detailed Design-Hybrid 2.0_v3.0

    62/62

    &% 'ppendi(

    A, ey Decision !mails