operational data store(ods) functional training

www.sungardhe.com

Operational Data Store(ODS)Functional Training

Youngstown State UniversityAugust 8, 2006 – August 10, 2006

R. Joanne KeysSCT Enterprise Information Management

2www.sungardhe.com

The Objective

The objective of this training is to provide the participants with an understanding of Finance and related information within the ODS, and enough introductory experience using it so that they are able to successfully support ad hoc operational reporting needs at Youngstown State University as appropriate from the ODS.

3www.sungardhe.com

Agenda – For Today

Introductions Roles & Responsibilities Developing a Reporting Strategy What is the Operational Data Store Why use the Operational Data Store ODS Architecture ODS Administration Data Models Report Templates Questions and Concerns

4www.sungardhe.com

Agenda: The Rest of the Week

The ‘Just Getting It Done’ Workshop Identify some reports we want or need Choose a report for group study, and:

a. Confirm the associated issues and requirementsb. Identify the information needed, including reorganizing or manipulating current

datac. Identify requirements for presentationd. Create it….

1. Repeat Step 22. Independent Work

5www.sungardhe.com

Introductions

Name Responsibility at University Future Involvement with the

Operational Data Store What you hope to get out of the

class

6www.sungardhe.com

Your Campus Reporting Group

Do you have a plan for Reporting

Do you have a Core Reporting Group

Who belongs in the group: ODS Administrator Reporting Tool Administrator Key Report Writers Average Users Key Administrators – The people who have a broad knowledge of the

university and the ability to make or escalate key decisions regarding reporting on campus

IT Representative

7www.sungardhe.com

Roles & Responsibilities

Core Reporting Group Responsible for managing expectations of reporting community Makes recommendations on access Assist IT group with decision making involving end-users and

executives

• ODS Administrator Responsible for managing the datamart Reviews logs and checks for errors May be responsible for freezing views Is usually part of the IT group

8www.sungardhe.com

Roles & Responsibilities

Organizational Experts Who has responsibility Who to call to assist with designing new reports

Department Training Who will be responsible When will training occur

9www.sungardhe.com

Developing a Reporting Strategy

Who are the users? Power users – ad hoc Business users - managed Casual users – directed IT – omnipotent

Why do we need this report?

What is the value it adds to the organization?

Where is the data for the report coming from?

What tools do they need?

10www.sungardhe.com

Why Reporting?

It’s asking questions.- Operations- Management- Research and Planning

It’s getting the information ready for the questions.

And then answering them.

It’s putting the right ‘stuff’ together at the right time and for the right purpose.

11www.sungardhe.com

Questions in Search of Answers

What is the average gift by reunion class or constituent type?

How many constituents are donors?

Tell the right people the right things. (Giving, Active/Inactive, Scholarship Awards, Activities.)

How many constituents do I have in a particular geographic region? What trends do we see in giving?

12www.sungardhe.com

Basics for Effective Reporting

Questions focused on meaningful business issues yield the most useful answers

Answers are more easily developed when the supporting information is directly related to the business question: Content, focus, organization, presentation.

The devil, and dividend, are in the details that support consistent, easily replicable results from appropriate information

13www.sungardhe.com

Answering Questions

Transaction system: Current, detailed, transaction data

What’s going on?Tell them!

Detailed information organized and storedfor multiple events

Tell them, andcompare!

Detail organized andstored for processesand multiple events

Evaluate successand plan!

Summary informationfor multiple events

I need to compare generally and quickly!

“Current” snapshotDon’t move the target!

14www.sungardhe.com

Delivering the Answers

Transaction system: Current, detailed, transaction data

“Current” snapshot

Detailed information organized serially

Detail organized serially and

longitudinally

Summary informationorganized serially

Baseline reportsObject:AccessAd hoc reports

Operational Data Store

Enterprise Data Warehouse

Strategic Enrollment Management

15www.sungardhe.com

Banner Reporting•Standard Reports•OA: Views•Real Time Reports•Batch updates•Nested Reports

Operational Data Store•End User &•IT Reporting

Maturing the Maturity Model

InstitutionalPerformance Management


Operational Data Store•End User Reporting

Banner Reporting•Standard Reports•OA: Views•ODBC Reporting Tools

Institution Adoption

Tim

e

Level 1 Level 2 Level 4 Level 5

BaselineBaseline ReportsReports

CustomCustomReportsReports

Self-ServiceSelf-ServiceReportingReporting

•Ad-HocAd-Hoc

AnalyticalAnalyticalReportingReporting

•Historical TrendsHistorical Trends•ForecastingForecasting

InstitutionalInstitutionalPerformancePerformanceManagementManagement

•Process ImprovementProcess Improvement•Dashboard/ScorecardDashboard/Scorecard•Analytical Analytical ApplicationsApplications

Level 3

16www.sungardhe.com

Future Business Intelligence Architecture

Banner

Operational Data Store

ReportingTools

ETL Operational Data Store

EnterpriseData

Warehouse

ETL

Dashboards


Legacy

Other

SCT InstitutionalPerformanceManagement

AnalyticalApplications

BalancedScorecard

PerformanceDashboards

KPI’s

MetaData

SelfService

DataMarts

OLAPTool

ABC

Current Business Intelligence Architecture

17www.sungardhe.com

SCT Operational Data Store Functions

Simplifies information access

Provides timely information to support all levels of management

Improves information access performance

Provides access to historical and summarized information

Data refresh occurs at your specified interval

18www.sungardhe.com

SCT Operational Data Store Functions

Ensures consistent reporting results by providing a common data source and common business concepts

Data models and reports can be tailored to department-specific needs

Uses Human Resources, Finance, and Student product security

Allows use of web-based reporting tools with graphical capabilities

The ODS Administration component is web based

Allows you to share solutions in an open environment

19www.sungardhe.com

What is the Operational Data Store

ODS tables are constructed specifically for reporting

ODS resides on a separate reporting Server

ODS is populated from the source system (s) using composite views

ODS has denormalized tables called composite tables.

ODS reporting views provide access to the data Security Display rules Used to create operational and ad hoc reports

ODS tables and reporting views were constructed with the business needs of higher education administration in mind.

20www.sungardhe.com

Why use an Operational Data Store

Ability to produce reports without the overhead of a transactional system.

Built to address reporting queries not for efficiency of data capture.

Provides for the freeze of data to accommodate point in time reporting.

Most upgrades to the administrative system do not affect the ODS.

21www.sungardhe.com

Related Documentation

Banner to Operational Data Store User Guide June 2006

Operational Data Store Release Guide June 2006

Operational Data Store Handbook June 2006

GTVSDAX Handbook

22www.sungardhe.com

ODS Online Help

23www.sungardhe.com

24www.sungardhe.com

Operational Data Store Architecture

ODS Initial Load Process – Load all rows of the relevant data into the ODS

Incremental Refresh – Refresh the ODS with only the information that has changed since the last ODS refresh

25www.sungardhe.com

ODS Load Process

26www.sungardhe.com

ODS Load Process Flow

Load job submitted to execute LOAD scripts for all processes identified in the Job Submission Menu

PL/SQL script reads views via DBLINK which accesses the ODSMGR schema in Banner

Data is written to ODS composite tables on a separate database

When all jobs have completed, the log file is verified for successful load and completion of all jobs.

27www.sungardhe.com

ODS Incremental Refresh

28www.sungardhe.com

ODS Incremental Refresh Process Flow

Refresh job submitted to execute DELETE and UPDATE scripts for all identified processes.

Reads and/or updates of Banner database are performed via DBLINLK which access Banner ODSMGR user schema

DELETE processes run before UPDATES to set the update flag on records in Banner Change Tables

Data is written to, or deleted from, the ODS composite tables on separate database.

When all jobs have completed, the log file is verified for successful load and completion of all jobs.

29www.sungardhe.com

ODS Architecture

Operational Data StoreBanner

Composite Views

Person View

Gift View

Constituent View

Degree View

Pledge View Annual Giving

Security and Display Rules

Person

Gift Constituent Annual Giving

Pledge Degree

Object Access ViewObject Access ViewObject Access Views

OWB Composite Tables

Person Table

GiftTable

PledgeTable

ConstituentTable

DegreeTable

Annual GivingTable

30www.sungardhe.com

ODS Components Review

CHANGETABLE

PERSONPERSON

IDID TRIGGER

Banner

Banner tables as they exist today.

Not all tables used.TRIGGER

PERSONCOMPOSITE

VIEW

31www.sungardhe.com


CHANGETABLE

PERSONTRIGGER

TRIGGER

ID TRIGGERTRIGGER

PERSONCOMPOSITE

VIEW

Banner

New Create/Update/Delete triggers placed on the Banner tables

One trigger per table used in the ODS

Updates/Inserts records into the change table(s)

Delivered with Banner releases starting 01/31/2004

32www.sungardhe.com


CHANGETABLE

CHANGETABLE

PERSON TRIGGER

ID TRIGGER

PERSONCOMPOSITE

VIEW

Banner

Maintains information on what records/tables have been changed, inserted or deleted.

One change table per logical key group/module.

Emptied after every refresh.

33www.sungardhe.com


CHANGETABLE

PERSON TRIGGER

ID TRIGGER

PERSONCOMPOSITE

VIEW

PERSONCOMPOSITE

VIEW

Banner

View of one to many Banner tables

Built for incremental refresh but can be used for reporting.

Joined with the change tables when processing the incremental refresh.

Matches the similar table on the ODS side

34www.sungardhe.com


PL/SQLETL

PL/SQLETL

PERSONCOMPOSITE

TABLE

PL/SQLDELETE

PL/SQLDELETE

PERSONBASEVIEW

PRESEN-TATIONVIEWS

O:AVIEWS

ODS

PL/SQL scripts built and maintained by Oracle Warehouse Builder (OWB)

Two or Three per target table (Load, Delete and Update)

Ran during the initial load and incremental refresh

35www.sungardhe.com


PL/SQLETL

PERSONCOMPOSITE

TABLE

PERSONCOMPOSITE

TABLE

PL/SQLDELETE

PERSONBASEVIEW

PRESEN-TATIONVIEWS

O:AVIEWS

ODS

Physical tables located in the ODS.

Elements match those of the corresponding Composite Views on the Banner side.

Built during the initial install of the ODS

36www.sungardhe.com


PL/SQLETL

PERSONCOMPOSITE

TABLE

PL/SQLDELETE

PERSONBASEVIEW

PERSONBASEVIEW

PRESEN-TATIONVIEWS

O:AVIEWS

ODS

View of the corresponding composite table.

Elements match

37www.sungardhe.com


PL/SQLETL

PERSONCOMPOSITE

TABLE

PL/SQLDELETE

PERSONBASEVIEW

REPORTINGVIEWS

REPORTINGVIEWS O:A

VIEWS

O:AVIEWS

ODS

Primary views used for reporting from the ODS

The O:A views match the O:A views as delivered with Banner.

38www.sungardhe.com


Primary views used for reporting from the ODS

The O:A views match the O:A views as delivered with Banner and version 1 of the datamart.

CHANGETABLE

CHANGETABLE

PERSON

PERSON

TRIGGER

TRIGGER

ID

IDTRIGGER

TRIGGER

PERSONCOMPOSITE

VIEW

PERSONCOMPOSITE

VIEW

PL/SQLETL

PL/SQLETL

PERSONCOMPOSITE

TABLE

PERSONCOMPOSITE

TABLE

PL/SQLDELETE

PL/SQLDELETE

PERSONBASEVIEW

PERSONBASEVIEW

PRESEN-TATIONVIEWS

PRESEN-TATIONVIEWS O:A

VIEWS

O:AVIEWS

Banner ODS

WebAdministration

View the ODS metadata

Schedule the incremental refresh, reload

Schedule a table freeze

Review logs from the incremental refresh/load

Update user security for fine grained access

39www.sungardhe.com

ODS Components Review - Administration

Administration

Web-based administrative interface using SCT’s Web Tailor.

Used for execution and monitoring of ETL processes Preferences and Security Information Access Options Information Access Meta Data New Web Tailor Administration

Some end users need to use this

40www.sungardhe.com

SCT Operational Data Store Design

Oracle Warehouse Builder Allows you to design a complete logical model of your warehouse

Helps to plan how to EXTRACT data from the source, TRANSFORM the data, and configure the data for LOADING into the data warehouse.

That’s what we call ETL – Extract, Transform, Load

Let the IT people worry with this

41www.sungardhe.com


Report Templates ODS 2.0 provides new report templates using Oracle Discoverer reporting

tool written specifically against the ODS data model and reporting views within the ODS, rather than the Object:Access structures

Enterprise business area within Oracle Discoverer with join conditions established.

Cognos ReportNet Business views added in the 2.2 release

Included the Object:Access data structures as part of the ODS to allow for data structure compatibility with the previous releases of the solution.

42www.sungardhe.com


Tools with “Value Added” Cognos Impromptu Version 7/ Cognos ReportNet 1.1 Brio Query Designer 6.6 Information Builders WebFOCUS Version 5.2.3 and higher Microsoft Access 2000 Oracle Discoverer Version 9.0.39.02

43www.sungardhe.com

ODS Definitions

OWB – Oracle Warehouse Builder ODS – Operational Data Store (formerly EDM) EDW – Enterprise Data Warehouse EDM – Enterprise Datamart (now ODS) OLTP – Online Transaction Processing ETL – Extract, Transform and Load Source – Where the data is coming from Target – Where the data is going to

44www.sungardhe.com

ODS Naming Conventions

SCT Banner Composite view – Ax_name Object:Access view – Ax_name

SCT Operational Data Store Database tables – MxT_name Reporting views – English name reports Subset of Reporting views – English name_SLOT Object:Access view – Ax_name

45www.sungardhe.com

Operational Data Store Administration

Place where you set up and maintain the ODS

Primarily a technical responsibility BUT users be aware of

46www.sungardhe.com

47www.sungardhe.com

User Accounts and Security

Two types of users Administrative Users – to set up and maintain the ODS

Oracle Users – require an Oracle user account so that they can use a reporting tool to access the ODS and build reports.

48www.sungardhe.com

49www.sungardhe.com

50www.sungardhe.com

51www.sungardhe.com

52www.sungardhe.com

53www.sungardhe.com

Setting Up Data Display Rules

Control which data values to retrieve and how to display various types of data

Example – test scores or address types.

Set up Display rules at the “Institution” level

Stored in the MGRSDAX table which has predefined delivered values

Matches external (user-defined) codes with internal (SCT-defined) codes

Need to review all delivered Display Rules and edit them to reflect your institution’s specific code values used by your ODS reporting users.

54www.sungardhe.com

MGRSDAX fields

Internal Group – don’t change Internal Code 1 – don’t change External Code – You need to change Internal Code Sequence Number

55www.sungardhe.com

GTVSDAX in Banner

MGRSDAX table in the ODS is a copy of the Crosswalk Validation Table (GTVSDAX) in Banner.

GTVSDAX controls values a report will retrieve from Banner.

MGRSDAX specifies Display Rules that define which code values will be loaded into the ODS

Each Display Rule in the ODS matches a defined concept (or set of values) in GTVSDAX.

ODS rules and GTVSDAX concepts use the same Internal Group and Internal Code values.

56www.sungardhe.com

57www.sungardhe.com

Setting Up Security Rules for Oracle Users

Determine Data Security Requirements

Set up and maintain security rules Full Access to all data in the ODS Full Access to all data at the level of the Organizational Dimension Full Access to all data at an element level Restricted access to data at the element level based on a list or

range of values for a specific data element

58www.sungardhe.com

Security Rule

Organization Dimension Organization where rule belongs Academic, Course and Academic, Financial, Workforce

Table – Where you will secure the data

Rule Type – LIST or RANGE of values

Column – define one or two columns to secure data

59www.sungardhe.com

60www.sungardhe.com

61www.sungardhe.com

62www.sungardhe.com

63www.sungardhe.com

Loading the ODS

Makes use of OWB mappings to associate source elements to corresponding element in ODS. LOAD - Load REFRESH – Update or Delete

Schedule a process – Run a job Calls the related mappings and loads or updates data define by

them

64www.sungardhe.com

Why is my Data out of Sync

Currency of data in the ODS Timing of a query and when ODS refreshed

Display Rule Definitions Rules may differ between two systems

Security Rule Definitions Rules may differ between two systems

65www.sungardhe.com

When to Load and Update Data

Initial Load

Refresh data in ODS on a regular basis Nightly, Weekly ?

Update specific area as needed when there is a data change in source system.

66www.sungardhe.com

Composite Tables and Slotted Tables

Composite Table Include the main data that is extracted from source system and

stored in ODS

Slotted Table Store data values for a specific code related to a base table Optimizes the speed of queries

Need to keep these synchronized

67www.sungardhe.com

Updating or Freezing ODS data on a Recurring Basis

Specify a job to be run on a recurring basis

Interval Execution of job follows the previous run by a specific time interval Job executes on specific dates and times.

See Handbook (Chapter 2) for list of Interval values

68www.sungardhe.com

Freezing ODS Data

Allows the saving of snapshots of data tables and/or views at a point-in-time

Need to come up with a naming convention for frozen tables and views

Freeze multiple related tables/views at once Create list of tables/views Schedule a process to freeze them all

Freeze single table or view

69www.sungardhe.com

Freezing ODS Data

Freeze Data Maintenance – Allows for creation of lists of related tables and views for freezing.

Specify the tables/views Define a history table name for each Then schedule a process to freeze the tables

70www.sungardhe.com

Viewing Control Reports

When process runs a control report is created to show details of status of the process

Make sure someone is viewing these immediately each day

View Messages View individual error messages Select lines of report using Filter option Save report to a CSV file

71www.sungardhe.com

Set Up Process Parameters

LET IT WORRY WITH THIS

72www.sungardhe.com

73www.sungardhe.com

Meta Data Object Types

Target View – ODS views that join related information. Used for reporting.

Source Table – Database tables from administrative system

Source Function – Functions that use data from administrative system source table to create new data that will be stored in the ODS.

74www.sungardhe.com

75www.sungardhe.com

76www.sungardhe.com

77www.sungardhe.com

78www.sungardhe.com

79www.sungardhe.com

80www.sungardhe.com

81www.sungardhe.com

82www.sungardhe.com

83www.sungardhe.com

84www.sungardhe.com

85www.sungardhe.com

86www.sungardhe.com

87www.sungardhe.com

88www.sungardhe.com

Data Models

Shows the transition of each data element from its origin in the database through its location in the ODS composite tables and views.

Close to 300 reporting views containing data across seven subject areas applicable to higher education: Accounts Receivable, Advancement, Common, Finance, Financial Aid, Human Resourses and Student.

89www.sungardhe.com

Data Models

Chapter 3 of ODS Administration Guide Entity Relationship Diagrams (ERD)

A diagram that represents the data model Shows the logical relationships between the reporting views

within an ODS business concept.

90www.sungardhe.com

ERD Relationship Legend

91www.sungardhe.com

Data Models Common – 51 Reporting and Slotted Views

Entity Relationship Diagrams (ERD) Event Institution Organization Entity Person Demographic Person Role Person Supplemental Relationship

92www.sungardhe.com

Common ViewsActivity Address

Address_By_Rule Address_Current

Address_Preferred Certification

Certification_Slot Combined_Academic_Outcome

Communication (Mailing) Communication_Slot

Contact Contact_Slot

Cross_Reference_Slot Current_Employment

Employment_History Event

Geographic_Region Geographic_Region_Institution

Hold Hold_Slot

93www.sungardhe.com

Common ViewsInstitution Interest

Interest_Slot Mail

Mail_Slot Medical_Information

Medical_Information_Slot Organization_Entity

Organization_Entity_Address Past_Employment_Slot

Person Person_Address

Person_Detail Person_International

Person_Sensitive Person_Veteran

Previous_Education Previous_Education_Slot

94www.sungardhe.com

Common Views

Relationship Salutation

Secondary_School_Subject Skill

Skill_Slot Telephone

Telephone_Preferred Test

Test_Slot Validation

Visa Visa_Current

Year_Type_Definition

95www.sungardhe.com

96www.sungardhe.com

97www.sungardhe.com

98www.sungardhe.com

Data Models Advancement – 47 Reporting and Slotted Views Erwin Diagram

Advancement Prospect Advancement Rating Annual Giving Campaign Giving History Constituent Designation Giving History Gift Organizational Constituent Pledge

99www.sungardhe.com

Advancement ViewsAdvancement_Rating Advancement_Rating_Slot

Annual_Giving Annual_Giving_Slot

Campaign_Giving_History Constituent

Constituent_Contact Constituent_Entity

Constituent_Plan Constituent_Staff_Assign

Degree Degree_Slot

Designation_Giving_History Donor_Category

Donor_Category_Slot Exclusion

Exclusion_Slot Funding_Interest

100www.sungardhe.com

Advancement Views

Funding_Interest_Slot Gift

Gift_Associated_Entity Gift_Auxiliary

Gift_Matching Gift_Matching_Transaction

Gift_Memo Gift_Multiple

Gift_Society Gift_Society_Slot

Gift_Transaction Membership

Membership_Interest Orgnaiztional_Constituent

Organization_Contact Organization_Contact_Slot

Pledge Pledge_Installment

Pledge_Matching Pledge_Transaction


Advancement Views

Prospect_Info Prospect_Proposal

Solicitation Special_Activity

Special_Activity_Slot Special_Activity_Year

Special_Activity_Year_Slot Special_Purpose_Group

Special_Purpose_Slot


Address Reporting Views

Address information is contained in the following views for a person: Person Person_Address Address Address_By_Rule Address_Current Address_Preferred



Person View Contains the Preferred Address of the person as set by the

preferred address of the institution Preferred Address of the institution is set in the GTVSDAX table -

PREFADDR



Person_Address View Used to support correspondence by providing a mailing address to

a report or print a mailing label. Deceased people will not appear in this view. Organizations and companies that are active will be selected for

this view.



Address View All the addresses in the administrative system Start Date and Stop Date Address Status Indicator

Active or Inactive Geographic Region Count Address Type and Address Number Preferred Address Indicator



Address Current View All active addresses in the administrative system Geographic Region Count Address Type and Address Number Preferred Address Indicator



Address_By_Rule Addresses based on the display rule type One per person based on the display rule Only current active addresses Geographic Region Count Address Type and Address Number Preferred Address Indicator



Address_Preferred Addresses based on the Preferred Address type of the entity Only current active addresses Geographic Region Count Address Type and Address Number Preferred Address Indicator


Report Templates

The Report Templates are just that “TEMPLATES”. Use them as a starting point.

Reports against the new Reporting views delivered with Oracle Discoverer.

Delivered the Business Area for the End User Layer (EUL) in Oracle Discoverer

Delivered the Data Model for Cognos ReportNet

Encourage clients to use common data model for operational and ad hoc reporting

Reports against the Object:Access views in 4 of the tools.

For complete list of reports by application refer to ODS Handbook Chapter 4.


Layout of Report Templates

Report No. and Name Ax01 – Name

Description – Short Description Parameters Reporting Area


Advancement Reports


GTVSDAX – MGRSDAX

Advancement Alumaddr – Address Alumxref – Cross Reference Alumexrs – External Source Alumfund – Funding Alumdcst – Gift Society Alummail – Mail Alumproj – Project Alumrtgt – Rating Alumocon – Secondary Contact Alumprtp – Special Purpose Alumstft – Staff Assignment Alumphone – Telephone Alumvipc – Variable Purpose Alumexcl – Camp Exclusion, Desg Exclusion, Exclusion


Helpful Datamart information

SCT Banner Composite View owner is BANINST1

OWB Repository owner is ODSREP

OWB User is RUNUSER

ODS Owner is ODSMGR

ODSEUL owns the report templates


Questions? Suggestions? Concerns?


R. Joanne [email protected]

Thank You!

operational data store(ods) functional training

Documents