how to perform hana archiving process

Upload: sree-ge

Post on 05-Jul-2018

225 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/16/2019 How to Perform HANA Archiving Process

    1/17

     

    How to Create and Perform HANA Archiving Process03/02/2016

    HDFC SLIC

    Gandhinagar Branch 

    Mitul Jhaveri

    [email protected]

  • 8/16/2019 How to Perform HANA Archiving Process

    2/17

     

    Confidentiality Statement

    Include the confidentiality statement within the box provided. This has to be legally

    approved

    Confidentiality and Non-Disclosure Notice The information contained in this document is confidential and proprietary to TATA

    Consultancy Services. This information may not be disclosed, duplicated or used for any

    other purposes. The information contained in this document may not be released in

    whole or in part outside TCS for any purpose without the express written permission of

     TATA Consultancy Services.

    Tata Code of Conduct

    We, in our dealings, are self-regulated by a Code of Conduct as enshrined in the TataCode of Conduct. We request your support in helping us adhere to the Code in letter and

    spirit. We request that any violation or potential violation of the Code by any person be

    promptly brought to the notice of the Local Ethics Counsellor or the Principal Ethics

    Counsellor or the CEO of TCS. All communication received in this regard will be treated

    and kept as confidential.

  • 8/16/2019 How to Perform HANA Archiving Process

    3/17

    Table of Content

    1. Introduction .............................................................................................................................................................. 4

    2. Pre – requisites ......................................................................................................................................................... 4

    3. Procedure .................................................................................................................................................................. 5

    3.1 DB Connection (T-Code: DBCO) ........................................................................................................................ 5

    3.2 Configuration of NLS in BW system (T-Code: SPRO) ......................................................................................... 5

    3.3 Creation of Data Archiving Process (DAP) ......................................................................................................... 7

    3.4 Archiving Data for Cube and DSO ..................................................................................................................... 8

    3.5 Read NLS data ................................................................................................................................................. 11

    3.5.1 Cube or DSO Property ............................................................................................................................. 11

    3.5.2 Query Property ........................................................................................................................................ 11

    3.6 Testing of Archiving Data ................................................................................................................................ 12

    3.6.1 Through Manage Cube ............................................................................................................................ 123.6.2 Using BEx Query ...................................................................................................................................... 13

    3.7 Unload Archiving Request ............................................................................................................................... 16

    3.7.1 Unlock and Re-lock the Archiving Request ............................................................................................. 16

  • 8/16/2019 How to Perform HANA Archiving Process

    4/17

    1.  Introduction

      Without archiving, data volumes in BW database will increase. Due to huge amount of data available in

    BW database, system performance will degrade and can take a longer time to result in a large volume of

    data.

      Increasing amounts of data that need to be available for further analysis or reporting but that are rarely

    required to place a load on BW system. If you want to keep the amount of data in BW system constant

    without deleting data, you can use data archiving.

      Archiving data from Info Cubes and Data Store objects is the process to store data in near-line storage.

     The data is first moved to an archive or near-line storage and then deleted from the BW system. You can

    either access the data directly or load it back as and when require, depending on how you archived the

    data.

      When defining the data archiving process, you can choose between classic ADK archiving, storing in

    near-line storage, or a mix of both solutions.

      ADK (Archive Development Kit) Based Archiving:

    •  ADK based archiving is recommended for data that is no longer relevant to any current analysis

    processes or not needed for reporting, but must remain archived for the storage period. Data

    which has been archived will be deleted from the InfoProvider and have to re-load them through

    flat file if we need archived data again in the report.

    •  ADK based Archiving solution can be afforded and cost reduction can be done using alternative

    storage media.

     

    NLS (Near-Line Storage) Based Archiving:

    •  Near-line storage is recommended for the data that we may still require. Storing historical data in

    near-line storage reduces the data volume of BW database; however, the data is still be available

    for BEx queries without re-loading process.

    •  SAP BW has direct access to NLS data. We can access archived data of near-line storage from the

    query monitor.

    2. 

    Pre – requisites

      NLS-IQ must be set up by respective team (Analyse IQ team) for further database connection with BW

    server.

      Before archiving data, Cube data must be compressed. Though system will allow us to archive non-

    compressed data but as a best practice we must compress data first. If compression is running, we are

    not allow to do archiving.

       To archive the data, an Info provider must have time characteristics / date field.

  • 8/16/2019 How to Perform HANA Archiving Process

    5/17

     

    3. 

    Procedure

    3.1 DB Connection (T-Code: DBCO)

    Create a database connection with Sybase IQ. In our system, we are using Sybase IQ as a near line storage. This

    connection was created by SAP BASIS consultant and the parameter values were provided by IQ team.

    3.2 Configuration of NLS in BW system (T-Code: SPRO)

    Once the connection has been created, we need to configure the connection of NLS with BW system.

     T-Code – SPRO →  SAP Reference IMG (F5) →  SAP NetWeaver →  Business Warehouse →  General Setting → 

    Process Near-Line Storage Connection→ Continue.

    Note:  One Sybase IQ server can talk to multiple BW systems. You should only need to create separate

    databases in IQ for the different BW systems.

  • 8/16/2019 How to Perform HANA Archiving Process

    6/17

     

    Establish new connection between BW and NLS:

      Near Line Conn.: Give appropriate name for new NLS.

      Name of Class: There are standard classes available to create connection with different database.In our

    case, we are using the Sybase IQ so we will use “CL_RSDA_SYB_CONNECTION” class.

      Connection Mode:  Productive Mode is the recommended mode for normal (productive) operation.

    Every operation on the near-line connection will be passed to the near-line provider. In query processing

    especially, a query will terminate with an error message due to the unavailability of near-line storage,unless a pruning mechanism could exclude near-line access in advance.

      DB Connection: Pass the DB connection name that has been created through DBCO T-code  by BASIS

     Team.

      Conn. Parameter: The connection string generally comprises a list of name/value pairs, separated by a

    semi-colon. DBCON is also one of the supported parameter.

    =

    Green Light in status indicates that connection has been established successfully.

  • 8/16/2019 How to Perform HANA Archiving Process

    7/17

     

    3.3 Creation of Data Archiving Process (DAP)

    Once this NLS connection has been established successfully with BW, we can see one additional process by right

    click on cube or DSO.

    General Settings: Mention the NLS connection name in Near-Line Connection.

    Selection Profile:

    In this tab, select the primary time characteristics for partitioning. To archive the data, an Info provider must

    have time characteristics / date field.  Without time characteristics system will not allow us to perform

    archiving.

  • 8/16/2019 How to Perform HANA Archiving Process

    8/17

     

    As a best practice, Cube data must be first compressed before performing archiving. Though system allow us

    to also perform archiving on non-compressed data.

     There is no compression mechanism exist for DSO, so Non-compressed data archiving option is not availablefor DSO.

    Semantic Group: Along with defined time characteristics in selection profile tab, we can also select more

    granular fields for archiving.

    Nearline Storage: Near-Line storage Connection name need to maintain for this tab

    Once all the above mentioned steps will complete, Check and activate DAP connection. After the activation,

    we can display, change or delete DAP. When established DAP is deleted in BW, the corresponding tables and

    all archiving requests are deleted from the Sybase IQ database.

    3.4 Archiving Data for Cube and DSO

    After DAP creation, next step is to archive the data for cube or DSO. For this, first BW consultant and business

    SPOC mutually need to decide below points for archiving:

      Based on which time characteristics archiving can perform.

      Upto which period data can be archived.

  • 8/16/2019 How to Perform HANA Archiving Process

    9/17

    Cube or DSO→ Manage→ Archiving tab→ Click on Archiving Request.

    Primary Time Restriction:

    Define the value for the time characteristics that we considered as a primary partitioning characteristics. We can

    set the exact partition range that we want to archive by specifying relative or absolute times.

    Further Restrictions:

    We can use the characteristics that we specified as an additional partitioning characteristics to set further

    restrictions. In the case of semantically partitioned objects, we can restrict them to one partition here along with

    time characteristics.

    Process Flow Control:

    1) 

    10 Request Generated: Archiving request is only generated.

    2) 

    30 Data Area of the request is Locked Against changes (Lock Status)

    We can lock the selected data area of the archiving request to prevent any changes. This step is

    necessary before data archiving begins.

    3)  40 Write Phase completed successfully (Copy Status)

     The data to be archived is copied into near-line storage or the archive. This step is to be executedin the background.

    4)  50 Verification Phase Ended Successfully (Verification Status)

  • 8/16/2019 How to Perform HANA Archiving Process

    10/17

    In the verification phase, the system checks that the write phase was successful and that the data can be

    deleted from the Info Provider.

    5)  70 Verification Phase confirmed and Request Completed (Deletion and Overall Status)

    When the archived data is deleted from the InfoProvider, the archiving process is complete. The archived

    data is deleted from the InfoProvider with the same selection conditions used to copy the data from the

    InfoProvider.

    When all the steps of the archiving request have been completed, you can no longer change the status

    of the request. You can only reload the data.

    Status - Copy Status, Verification Status and Deletion Status:

      No icons if the corresponding phase was not yet started or if the request was invalidated

      A yellow traffic light if the corresponding phase is currently active

      A green traffic light if the corresponding phase was already completed

      A red traffic light if processing was terminated in the corresponding phase or if it ended with an

    error

    Status - Overall Status:

      A green traffic light if request reached a consistent intermediate or end state and No more active

    processes for this request

       The Activity icon if there is an active process for this request

       The Failed icon if request processing was terminated or if it ended with an error.

    Process Flow Control for DSO:

    1) 10 Request Generated

    2) 30 Data Area of the request is Locked Against changes (Lock Status)

    3) 40 Write Phase completed successfully (Copy Status & Overall Status)

  • 8/16/2019 How to Perform HANA Archiving Process

    11/17

     

    3.5 Read NLS data

    3.5.1 

    Cube or DSO Property

    CUBE or DSO→ Extras→ InfoProvider Properties→ Change.

    NLS Usage: Nearline access switched off→ X Nearline Access Switch on

    3.5.2 

    Query Property

    In Query property, we are allow to use near line storage data while executing the query. Even we are also allow to

    extract the near line storage data according to basic info provider setting. We are also allow to create the variable

    and for which user will enter the value at run time.

    BEx Designer→ Query Property→ Extended Tab→ Nearline-Storage 

    Variable Entry:

  • 8/16/2019 How to Perform HANA Archiving Process

    12/17

     

    3.6 Testing of Archiving Data

    3.6.1 

    Through Manage Cube

    1) Without selecting Read Data from NLS:

    Fiscal Period: 008.2009 – 008.2009

    Output: No data found.

  • 8/16/2019 How to Perform HANA Archiving Process

    13/17

     

    2) With selecting Read Data from NLS:

    Fiscal Period: 008.2009 – 008.2009

    Output: Data will read from NLS.

    3.6.2  Using BEx Query

    1) Do not Read near Line Storage:

    BEx Designer→ Query Properties→ Do not Read near Line Storage 

    Enter Selection parameters→ Execute (F8)

  • 8/16/2019 How to Perform HANA Archiving Process

    14/17

      Output:  No Applicable data found.

    2) Read Near Line Storage:

    BEx Designer→ Query Properties→ Read near Line Storage

    Enter Selection parameters→ Execute (F8)

    Output:

  • 8/16/2019 How to Perform HANA Archiving Process

    15/17

     

    3) Through Variable Entry: 

    BEx Designer→ Query Properties→ Extended→ Nearline-Storage→ Value Entry→ Create New Variable→ 

    Save New Variable→ Save.

    Execute Report:

    Now, user can select Near Line Storage value at report execution time and according to that system will fetch

    the data for given selection parameters.

  • 8/16/2019 How to Perform HANA Archiving Process

    16/17

     

    3.7 Unload Archiving Request

    Sometimes we archived the data and for that archived period, change data or delta will come in future during

    data loading. In this scenario, system will not allow us to load data for that particular Cube or DSO and throw

    error message “RSDA 239 - Data record locked by archiving request”.

    For this type of failure, first we need to unlock the request, load the data again through DTP and then againarchive the data for this period.

    3.7.1  Unlock and Re-lock the Archiving Request

    Step-1: Unlock the particular request by double click on Lock symbol of request in archiving tab.

    Step-2: Unlock Archive Request and Load Data again:

     To unlock the archive request, we are allow to re-load data from the Near Line Storage or Delete it from

    NLS. In Reload, data is available in both NLS and BW and while in Delete, data is getting deleted from NLS

    and available only in BW.

    If we set indicator Also Reload Subsequent Requests, all archiving requests that were created later on are

    reloaded in addition to the selected archiving request.

    Unachieved data is again available in BW with request “Request w/o info package (APO Request)”.

    Execute the DTP again and monitor the request.

    Step-3: Re-Archiving

    Once the data loading will complete successfully, Re-archiving for that particular period need to be perform.Monitor the archive request.

  • 8/16/2019 How to Perform HANA Archiving Process

    17/17

     

    Contact

    For more information, contact [email protected] (Email Id of ISU) 

    About Tata Consultancy Services (TCS)

    Tata Consultancy Services is an IT services, consulting and business solutions

    organization that delivers real results to global business, ensuring a level of certainty no

    other firm can match. TCS offers a consulting-led, integrated portfolio of IT and IT-

    enabled infrastructure, engineering and assurance services. This is delivered through its

    unique Global Network Delivery ModelTM

    , recognized as the benchmark of excellence in

    software development. A part of the Tata Group, India’s largest industrial conglomerate,

    TCS has a global footprint and is listed on the National Stock Exchange and Bombay

    Stock Exchange in India.

    For more information, visit us at www.tcs.com. 

    IT Services

    Business Solutions

    Consulting

    All content / information present here is the exclusive property of Tata Consultancy Services Li mited (TCS). The content /

    information contained here is correct at the time of publishing. No material from here may be copied, modified, reproduced,

    republished, uploaded, transmitted, posted or distributed in any form without prior written permission from TCS.

    Unauthorized use of the content / information appearing here may violate copyright, t rademark and other applicable laws,

    and could result in criminal or civil penalties. Copyright © 2011 Tata Consultancy Services Limited

    Thank You 

    mailto:[email protected]:[email protected]:[email protected]:[email protected]