operational data store(ods) functional training
Post on 13-Jan-2016
141 Views
Preview:
DESCRIPTION
TRANSCRIPT
www.sungardhe.com
Operational Data Store(ODS)Functional Training
Youngstown State UniversityAugust 8, 2006 – August 10, 2006
R. Joanne KeysSCT Enterprise Information Management
2www.sungardhe.com
The Objective
The objective of this training is to provide the participants with an understanding of Finance and related information within the ODS, and enough introductory experience using it so that they are able to successfully support ad hoc operational reporting needs at Youngstown State University as appropriate from the ODS.
3www.sungardhe.com
Agenda – For Today
Introductions Roles & Responsibilities Developing a Reporting Strategy What is the Operational Data Store Why use the Operational Data Store ODS Architecture ODS Administration Data Models Report Templates Questions and Concerns
4www.sungardhe.com
Agenda: The Rest of the Week
The ‘Just Getting It Done’ Workshop Identify some reports we want or need Choose a report for group study, and:
a. Confirm the associated issues and requirementsb. Identify the information needed, including reorganizing or manipulating current
datac. Identify requirements for presentationd. Create it….
1. Repeat Step 22. Independent Work
5www.sungardhe.com
Introductions
Name Responsibility at University Future Involvement with the
Operational Data Store What you hope to get out of the
class
6www.sungardhe.com
Your Campus Reporting Group
Do you have a plan for Reporting
Do you have a Core Reporting Group
Who belongs in the group: ODS Administrator Reporting Tool Administrator Key Report Writers Average Users Key Administrators – The people who have a broad knowledge of the
university and the ability to make or escalate key decisions regarding reporting on campus
IT Representative
7www.sungardhe.com
Roles & Responsibilities
Core Reporting Group Responsible for managing expectations of reporting community Makes recommendations on access Assist IT group with decision making involving end-users and
executives
• ODS Administrator Responsible for managing the datamart Reviews logs and checks for errors May be responsible for freezing views Is usually part of the IT group
8www.sungardhe.com
Roles & Responsibilities
Organizational Experts Who has responsibility Who to call to assist with designing new reports
Department Training Who will be responsible When will training occur
9www.sungardhe.com
Developing a Reporting Strategy
Who are the users? Power users – ad hoc Business users - managed Casual users – directed IT – omnipotent
Why do we need this report?
What is the value it adds to the organization?
Where is the data for the report coming from?
What tools do they need?
10www.sungardhe.com
Why Reporting?
It’s asking questions.- Operations- Management- Research and Planning
It’s getting the information ready for the questions.
And then answering them.
It’s putting the right ‘stuff’ together at the right time and for the right purpose.
11www.sungardhe.com
Questions in Search of Answers
What is the average gift by reunion class or constituent type?
How many constituents are donors?
Tell the right people the right things. (Giving, Active/Inactive, Scholarship Awards, Activities.)
How many constituents do I have in a particular geographic region? What trends do we see in giving?
12www.sungardhe.com
Basics for Effective Reporting
Questions focused on meaningful business issues yield the most useful answers
Answers are more easily developed when the supporting information is directly related to the business question: Content, focus, organization, presentation.
The devil, and dividend, are in the details that support consistent, easily replicable results from appropriate information
13www.sungardhe.com
Answering Questions
Transaction system: Current, detailed, transaction data
What’s going on?Tell them!
Detailed information organized and storedfor multiple events
Tell them, andcompare!
Detail organized andstored for processesand multiple events
Evaluate successand plan!
Summary informationfor multiple events
I need to compare generally and quickly!
“Current” snapshotDon’t move the target!
14www.sungardhe.com
Delivering the Answers
Transaction system: Current, detailed, transaction data
“Current” snapshot
Detailed information organized serially
Detail organized serially and
longitudinally
Summary informationorganized serially
Baseline reportsObject:AccessAd hoc reports
Operational Data Store
Enterprise Data Warehouse
Strategic Enrollment Management
15www.sungardhe.com
Banner Reporting•Standard Reports•OA: Views•Real Time Reports•Batch updates•Nested Reports
Operational Data Store•End User &•IT Reporting
Maturing the Maturity Model
InstitutionalPerformance Management
Enterprise Data Warehouse
Operational Data Store•End User Reporting
Banner Reporting•Standard Reports•OA: Views•ODBC Reporting Tools
Institution Adoption
Tim
e
Level 1 Level 2 Level 4 Level 5
BaselineBaseline ReportsReports
CustomCustomReportsReports
Self-ServiceSelf-ServiceReportingReporting
•Ad-HocAd-Hoc
AnalyticalAnalyticalReportingReporting
•Historical TrendsHistorical Trends•ForecastingForecasting
InstitutionalInstitutionalPerformancePerformanceManagementManagement
•Process ImprovementProcess Improvement•Dashboard/ScorecardDashboard/Scorecard•Analytical Analytical ApplicationsApplications
Level 3
16www.sungardhe.com
Future Business Intelligence Architecture
Banner
Operational Data Store
ReportingTools
ETL Operational Data Store
EnterpriseData
Warehouse
ETL
Dashboards
Enterprise Data Warehouse
Legacy
Other
SCT InstitutionalPerformanceManagement
AnalyticalApplications
BalancedScorecard
PerformanceDashboards
KPI’s
MetaData
SelfService
DataMarts
OLAPTool
ABC
Current Business Intelligence Architecture
17www.sungardhe.com
SCT Operational Data Store Functions
Simplifies information access
Provides timely information to support all levels of management
Improves information access performance
Provides access to historical and summarized information
Data refresh occurs at your specified interval
18www.sungardhe.com
SCT Operational Data Store Functions
Ensures consistent reporting results by providing a common data source and common business concepts
Data models and reports can be tailored to department-specific needs
Uses Human Resources, Finance, and Student product security
Allows use of web-based reporting tools with graphical capabilities
The ODS Administration component is web based
Allows you to share solutions in an open environment
19www.sungardhe.com
What is the Operational Data Store
ODS tables are constructed specifically for reporting
ODS resides on a separate reporting Server
ODS is populated from the source system (s) using composite views
ODS has denormalized tables called composite tables.
ODS reporting views provide access to the data Security Display rules Used to create operational and ad hoc reports
ODS tables and reporting views were constructed with the business needs of higher education administration in mind.
20www.sungardhe.com
Why use an Operational Data Store
Ability to produce reports without the overhead of a transactional system.
Built to address reporting queries not for efficiency of data capture.
Provides for the freeze of data to accommodate point in time reporting.
Most upgrades to the administrative system do not affect the ODS.
21www.sungardhe.com
Related Documentation
Banner to Operational Data Store User Guide June 2006
Operational Data Store Release Guide June 2006
Operational Data Store Handbook June 2006
GTVSDAX Handbook
22www.sungardhe.com
ODS Online Help
23www.sungardhe.com
24www.sungardhe.com
Operational Data Store Architecture
ODS Initial Load Process – Load all rows of the relevant data into the ODS
Incremental Refresh – Refresh the ODS with only the information that has changed since the last ODS refresh
25www.sungardhe.com
ODS Load Process
26www.sungardhe.com
ODS Load Process Flow
Load job submitted to execute LOAD scripts for all processes identified in the Job Submission Menu
PL/SQL script reads views via DBLINK which accesses the ODSMGR schema in Banner
Data is written to ODS composite tables on a separate database
When all jobs have completed, the log file is verified for successful load and completion of all jobs.
27www.sungardhe.com
ODS Incremental Refresh
28www.sungardhe.com
ODS Incremental Refresh Process Flow
Refresh job submitted to execute DELETE and UPDATE scripts for all identified processes.
Reads and/or updates of Banner database are performed via DBLINLK which access Banner ODSMGR user schema
DELETE processes run before UPDATES to set the update flag on records in Banner Change Tables
Data is written to, or deleted from, the ODS composite tables on separate database.
When all jobs have completed, the log file is verified for successful load and completion of all jobs.
29www.sungardhe.com
ODS Architecture
Operational Data StoreBanner
Composite Views
Person View
Gift View
Constituent View
Degree View
Pledge View Annual Giving
Security and Display Rules
Person
Gift Constituent Annual Giving
Pledge Degree
Object Access ViewObject Access ViewObject Access Views
OWB Composite Tables
Person Table
GiftTable
PledgeTable
ConstituentTable
DegreeTable
Annual GivingTable
30www.sungardhe.com
ODS Components Review
CHANGETABLE
PERSONPERSON
IDID TRIGGER
Banner
Banner tables as they exist today.
Not all tables used.TRIGGER
PERSONCOMPOSITE
VIEW
31www.sungardhe.com
ODS Components Review
CHANGETABLE
PERSONTRIGGER
TRIGGER
ID TRIGGERTRIGGER
PERSONCOMPOSITE
VIEW
Banner
New Create/Update/Delete triggers placed on the Banner tables
One trigger per table used in the ODS
Updates/Inserts records into the change table(s)
Delivered with Banner releases starting 01/31/2004
32www.sungardhe.com
ODS Components Review
CHANGETABLE
CHANGETABLE
PERSON TRIGGER
ID TRIGGER
PERSONCOMPOSITE
VIEW
Banner
Maintains information on what records/tables have been changed, inserted or deleted.
One change table per logical key group/module.
Emptied after every refresh.
33www.sungardhe.com
ODS Components Review
CHANGETABLE
PERSON TRIGGER
ID TRIGGER
PERSONCOMPOSITE
VIEW
PERSONCOMPOSITE
VIEW
Banner
View of one to many Banner tables
Built for incremental refresh but can be used for reporting.
Joined with the change tables when processing the incremental refresh.
Matches the similar table on the ODS side
34www.sungardhe.com
ODS Components Review
PL/SQLETL
PL/SQLETL
PERSONCOMPOSITE
TABLE
PL/SQLDELETE
PL/SQLDELETE
PERSONBASEVIEW
PRESEN-TATIONVIEWS
O:AVIEWS
ODS
PL/SQL scripts built and maintained by Oracle Warehouse Builder (OWB)
Two or Three per target table (Load, Delete and Update)
Ran during the initial load and incremental refresh
35www.sungardhe.com
ODS Components Review
PL/SQLETL
PERSONCOMPOSITE
TABLE
PERSONCOMPOSITE
TABLE
PL/SQLDELETE
PERSONBASEVIEW
PRESEN-TATIONVIEWS
O:AVIEWS
ODS
Physical tables located in the ODS.
Elements match those of the corresponding Composite Views on the Banner side.
Built during the initial install of the ODS
36www.sungardhe.com
ODS Components Review
PL/SQLETL
PERSONCOMPOSITE
TABLE
PL/SQLDELETE
PERSONBASEVIEW
PERSONBASEVIEW
PRESEN-TATIONVIEWS
O:AVIEWS
ODS
View of the corresponding composite table.
Elements match
37www.sungardhe.com
ODS Components Review
PL/SQLETL
PERSONCOMPOSITE
TABLE
PL/SQLDELETE
PERSONBASEVIEW
REPORTINGVIEWS
REPORTINGVIEWS O:A
VIEWS
O:AVIEWS
ODS
Primary views used for reporting from the ODS
The O:A views match the O:A views as delivered with Banner.
38www.sungardhe.com
ODS Components Review
Primary views used for reporting from the ODS
The O:A views match the O:A views as delivered with Banner and version 1 of the datamart.
CHANGETABLE
CHANGETABLE
PERSON
PERSON
TRIGGER
TRIGGER
ID
IDTRIGGER
TRIGGER
PERSONCOMPOSITE
VIEW
PERSONCOMPOSITE
VIEW
PL/SQLETL
PL/SQLETL
PERSONCOMPOSITE
TABLE
PERSONCOMPOSITE
TABLE
PL/SQLDELETE
PL/SQLDELETE
PERSONBASEVIEW
PERSONBASEVIEW
PRESEN-TATIONVIEWS
PRESEN-TATIONVIEWS O:A
VIEWS
O:AVIEWS
Banner ODS
WebAdministration
View the ODS metadata
Schedule the incremental refresh, reload
Schedule a table freeze
Review logs from the incremental refresh/load
Update user security for fine grained access
39www.sungardhe.com
ODS Components Review - Administration
Administration
Web-based administrative interface using SCT’s Web Tailor.
Used for execution and monitoring of ETL processes Preferences and Security Information Access Options Information Access Meta Data New Web Tailor Administration
Some end users need to use this
40www.sungardhe.com
SCT Operational Data Store Design
Oracle Warehouse Builder Allows you to design a complete logical model of your warehouse
Helps to plan how to EXTRACT data from the source, TRANSFORM the data, and configure the data for LOADING into the data warehouse.
That’s what we call ETL – Extract, Transform, Load
Let the IT people worry with this
41www.sungardhe.com
SCT Operational Data Store Design
Report Templates ODS 2.0 provides new report templates using Oracle Discoverer reporting
tool written specifically against the ODS data model and reporting views within the ODS, rather than the Object:Access structures
Enterprise business area within Oracle Discoverer with join conditions established.
Cognos ReportNet Business views added in the 2.2 release
Included the Object:Access data structures as part of the ODS to allow for data structure compatibility with the previous releases of the solution.
42www.sungardhe.com
SCT Operational Data Store Design
Tools with “Value Added” Cognos Impromptu Version 7/ Cognos ReportNet 1.1 Brio Query Designer 6.6 Information Builders WebFOCUS Version 5.2.3 and higher Microsoft Access 2000 Oracle Discoverer Version 9.0.39.02
43www.sungardhe.com
ODS Definitions
OWB – Oracle Warehouse Builder ODS – Operational Data Store (formerly EDM) EDW – Enterprise Data Warehouse EDM – Enterprise Datamart (now ODS) OLTP – Online Transaction Processing ETL – Extract, Transform and Load Source – Where the data is coming from Target – Where the data is going to
44www.sungardhe.com
ODS Naming Conventions
SCT Banner Composite view – Ax_name Object:Access view – Ax_name
SCT Operational Data Store Database tables – MxT_name Reporting views – English name reports Subset of Reporting views – English name_SLOT Object:Access view – Ax_name
45www.sungardhe.com
Operational Data Store Administration
Place where you set up and maintain the ODS
Primarily a technical responsibility BUT users be aware of
46www.sungardhe.com
47www.sungardhe.com
User Accounts and Security
Two types of users Administrative Users – to set up and maintain the ODS
Oracle Users – require an Oracle user account so that they can use a reporting tool to access the ODS and build reports.
48www.sungardhe.com
49www.sungardhe.com
50www.sungardhe.com
51www.sungardhe.com
52www.sungardhe.com
53www.sungardhe.com
Setting Up Data Display Rules
Control which data values to retrieve and how to display various types of data
Example – test scores or address types.
Set up Display rules at the “Institution” level
Stored in the MGRSDAX table which has predefined delivered values
Matches external (user-defined) codes with internal (SCT-defined) codes
Need to review all delivered Display Rules and edit them to reflect your institution’s specific code values used by your ODS reporting users.
54www.sungardhe.com
MGRSDAX fields
Internal Group – don’t change Internal Code 1 – don’t change External Code – You need to change Internal Code Sequence Number
55www.sungardhe.com
GTVSDAX in Banner
MGRSDAX table in the ODS is a copy of the Crosswalk Validation Table (GTVSDAX) in Banner.
GTVSDAX controls values a report will retrieve from Banner.
MGRSDAX specifies Display Rules that define which code values will be loaded into the ODS
Each Display Rule in the ODS matches a defined concept (or set of values) in GTVSDAX.
ODS rules and GTVSDAX concepts use the same Internal Group and Internal Code values.
56www.sungardhe.com
57www.sungardhe.com
Setting Up Security Rules for Oracle Users
Determine Data Security Requirements
Set up and maintain security rules Full Access to all data in the ODS Full Access to all data at the level of the Organizational Dimension Full Access to all data at an element level Restricted access to data at the element level based on a list or
range of values for a specific data element
58www.sungardhe.com
Security Rule
Organization Dimension Organization where rule belongs Academic, Course and Academic, Financial, Workforce
Table – Where you will secure the data
Rule Type – LIST or RANGE of values
Column – define one or two columns to secure data
59www.sungardhe.com
60www.sungardhe.com
61www.sungardhe.com
62www.sungardhe.com
63www.sungardhe.com
Loading the ODS
Makes use of OWB mappings to associate source elements to corresponding element in ODS. LOAD - Load REFRESH – Update or Delete
Schedule a process – Run a job Calls the related mappings and loads or updates data define by
them
64www.sungardhe.com
Why is my Data out of Sync
Currency of data in the ODS Timing of a query and when ODS refreshed
Display Rule Definitions Rules may differ between two systems
Security Rule Definitions Rules may differ between two systems
65www.sungardhe.com
When to Load and Update Data
Initial Load
Refresh data in ODS on a regular basis Nightly, Weekly ?
Update specific area as needed when there is a data change in source system.
66www.sungardhe.com
Composite Tables and Slotted Tables
Composite Table Include the main data that is extracted from source system and
stored in ODS
Slotted Table Store data values for a specific code related to a base table Optimizes the speed of queries
Need to keep these synchronized
67www.sungardhe.com
Updating or Freezing ODS data on a Recurring Basis
Specify a job to be run on a recurring basis
Interval Execution of job follows the previous run by a specific time interval Job executes on specific dates and times.
See Handbook (Chapter 2) for list of Interval values
68www.sungardhe.com
Freezing ODS Data
Allows the saving of snapshots of data tables and/or views at a point-in-time
Need to come up with a naming convention for frozen tables and views
Freeze multiple related tables/views at once Create list of tables/views Schedule a process to freeze them all
Freeze single table or view
69www.sungardhe.com
Freezing ODS Data
Freeze Data Maintenance – Allows for creation of lists of related tables and views for freezing.
Specify the tables/views Define a history table name for each Then schedule a process to freeze the tables
70www.sungardhe.com
Viewing Control Reports
When process runs a control report is created to show details of status of the process
Make sure someone is viewing these immediately each day
View Messages View individual error messages Select lines of report using Filter option Save report to a CSV file
71www.sungardhe.com
Set Up Process Parameters
LET IT WORRY WITH THIS
72www.sungardhe.com
73www.sungardhe.com
Meta Data Object Types
Target View – ODS views that join related information. Used for reporting.
Source Table – Database tables from administrative system
Source Function – Functions that use data from administrative system source table to create new data that will be stored in the ODS.
74www.sungardhe.com
75www.sungardhe.com
76www.sungardhe.com
77www.sungardhe.com
78www.sungardhe.com
79www.sungardhe.com
80www.sungardhe.com
81www.sungardhe.com
82www.sungardhe.com
83www.sungardhe.com
84www.sungardhe.com
85www.sungardhe.com
86www.sungardhe.com
87www.sungardhe.com
88www.sungardhe.com
Data Models
Shows the transition of each data element from its origin in the database through its location in the ODS composite tables and views.
Close to 300 reporting views containing data across seven subject areas applicable to higher education: Accounts Receivable, Advancement, Common, Finance, Financial Aid, Human Resourses and Student.
89www.sungardhe.com
Data Models
Chapter 3 of ODS Administration Guide Entity Relationship Diagrams (ERD)
A diagram that represents the data model Shows the logical relationships between the reporting views
within an ODS business concept.
90www.sungardhe.com
ERD Relationship Legend
91www.sungardhe.com
Data Models Common – 51 Reporting and Slotted Views
Entity Relationship Diagrams (ERD) Event Institution Organization Entity Person Demographic Person Role Person Supplemental Relationship
92www.sungardhe.com
Common ViewsActivity Address
Address_By_Rule Address_Current
Address_Preferred Certification
Certification_Slot Combined_Academic_Outcome
Communication (Mailing) Communication_Slot
Contact Contact_Slot
Cross_Reference_Slot Current_Employment
Employment_History Event
Geographic_Region Geographic_Region_Institution
Hold Hold_Slot
93www.sungardhe.com
Common ViewsInstitution Interest
Interest_Slot Mail
Mail_Slot Medical_Information
Medical_Information_Slot Organization_Entity
Organization_Entity_Address Past_Employment_Slot
Person Person_Address
Person_Detail Person_International
Person_Sensitive Person_Veteran
Previous_Education Previous_Education_Slot
94www.sungardhe.com
Common Views
Relationship Salutation
Secondary_School_Subject Skill
Skill_Slot Telephone
Telephone_Preferred Test
Test_Slot Validation
Visa Visa_Current
Year_Type_Definition
95www.sungardhe.com
96www.sungardhe.com
97www.sungardhe.com
98www.sungardhe.com
Data Models Advancement – 47 Reporting and Slotted Views Erwin Diagram
Advancement Prospect Advancement Rating Annual Giving Campaign Giving History Constituent Designation Giving History Gift Organizational Constituent Pledge
99www.sungardhe.com
Advancement ViewsAdvancement_Rating Advancement_Rating_Slot
Annual_Giving Annual_Giving_Slot
Campaign_Giving_History Constituent
Constituent_Contact Constituent_Entity
Constituent_Plan Constituent_Staff_Assign
Degree Degree_Slot
Designation_Giving_History Donor_Category
Donor_Category_Slot Exclusion
Exclusion_Slot Funding_Interest
100www.sungardhe.com
Advancement Views
Funding_Interest_Slot Gift
Gift_Associated_Entity Gift_Auxiliary
Gift_Matching Gift_Matching_Transaction
Gift_Memo Gift_Multiple
Gift_Society Gift_Society_Slot
Gift_Transaction Membership
Membership_Interest Orgnaiztional_Constituent
Organization_Contact Organization_Contact_Slot
Pledge Pledge_Installment
Pledge_Matching Pledge_Transaction
101www.sungardhe.com
Advancement Views
Prospect_Info Prospect_Proposal
Solicitation Special_Activity
Special_Activity_Slot Special_Activity_Year
Special_Activity_Year_Slot Special_Purpose_Group
Special_Purpose_Slot
102www.sungardhe.com
103www.sungardhe.com
104www.sungardhe.com
105www.sungardhe.com
106www.sungardhe.com
107www.sungardhe.com
108www.sungardhe.com
109www.sungardhe.com
110www.sungardhe.com
111www.sungardhe.com
Address Reporting Views
Address information is contained in the following views for a person: Person Person_Address Address Address_By_Rule Address_Current Address_Preferred
112www.sungardhe.com
Address Reporting Views
Person View Contains the Preferred Address of the person as set by the
preferred address of the institution Preferred Address of the institution is set in the GTVSDAX table -
PREFADDR
113www.sungardhe.com
Address Reporting Views
Person_Address View Used to support correspondence by providing a mailing address to
a report or print a mailing label. Deceased people will not appear in this view. Organizations and companies that are active will be selected for
this view.
114www.sungardhe.com
Address Reporting Views
Address View All the addresses in the administrative system Start Date and Stop Date Address Status Indicator
Active or Inactive Geographic Region Count Address Type and Address Number Preferred Address Indicator
115www.sungardhe.com
Address Reporting Views
Address Current View All active addresses in the administrative system Geographic Region Count Address Type and Address Number Preferred Address Indicator
116www.sungardhe.com
Address Reporting Views
Address_By_Rule Addresses based on the display rule type One per person based on the display rule Only current active addresses Geographic Region Count Address Type and Address Number Preferred Address Indicator
117www.sungardhe.com
Address Reporting Views
Address_Preferred Addresses based on the Preferred Address type of the entity Only current active addresses Geographic Region Count Address Type and Address Number Preferred Address Indicator
118www.sungardhe.com
Report Templates
The Report Templates are just that “TEMPLATES”. Use them as a starting point.
Reports against the new Reporting views delivered with Oracle Discoverer.
Delivered the Business Area for the End User Layer (EUL) in Oracle Discoverer
Delivered the Data Model for Cognos ReportNet
Encourage clients to use common data model for operational and ad hoc reporting
Reports against the Object:Access views in 4 of the tools.
For complete list of reports by application refer to ODS Handbook Chapter 4.
119www.sungardhe.com
Layout of Report Templates
Report No. and Name Ax01 – Name
Description – Short Description Parameters Reporting Area
120www.sungardhe.com
Advancement Reports
121www.sungardhe.com
GTVSDAX – MGRSDAX
Advancement Alumaddr – Address Alumxref – Cross Reference Alumexrs – External Source Alumfund – Funding Alumdcst – Gift Society Alummail – Mail Alumproj – Project Alumrtgt – Rating Alumocon – Secondary Contact Alumprtp – Special Purpose Alumstft – Staff Assignment Alumphone – Telephone Alumvipc – Variable Purpose Alumexcl – Camp Exclusion, Desg Exclusion, Exclusion
122www.sungardhe.com
Helpful Datamart information
SCT Banner Composite View owner is BANINST1
OWB Repository owner is ODSREP
OWB User is RUNUSER
ODS Owner is ODSMGR
ODSEUL owns the report templates
123www.sungardhe.com
Questions? Suggestions? Concerns?
124www.sungardhe.com
R. Joanne KeysJoanne.Keys@sungardhe.com
Thank You!
top related