building data warehouse at rensselaer

74
Best Practices in Higher Education Student Data Warehousing Best Practices in Higher Education Student Data Warehousing Forum Forum Northwestern University Northwestern University October 20-21, 2003 October 20-21, 2003 Building Data Warehouse at Building Data Warehouse at Rensselaer Rensselaer Ora Fish Rensselaer Polytechnic Institute

Upload: saul

Post on 24-Jan-2016

27 views

Category:

Documents


0 download

DESCRIPTION

Building Data Warehouse at Rensselaer. Ora Fish Rensselaer Polytechnic Institute. Best Practices in Higher Education Student Data Warehousing Forum Northwestern University October 20-21, 2003. Agenda. Background Development Methodology Rollout Strategy - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Building Data Warehouse at Rensselaer

Best Practices in Higher Education Student Data Warehousing ForumBest Practices in Higher Education Student Data Warehousing Forum Northwestern UniversityNorthwestern University

October 20-21, 2003October 20-21, 2003

Building Data Warehouse at RensselaerBuilding Data Warehouse at Rensselaer Ora Fish

Rensselaer Polytechnic Institute

Page 2: Building Data Warehouse at Rensselaer

AgendaAgenda

BackgroundBackground Development MethodologyDevelopment Methodology Rollout Strategy Rollout Strategy Summary Status – where are we nowSummary Status – where are we now Benefits Benefits Lessons LearnedLessons Learned Demonstrations of the Financial Analysis Demonstrations of the Financial Analysis

Data Mart – Executive Information Systems Data Mart – Executive Information Systems Q & AQ & A

Page 3: Building Data Warehouse at Rensselaer

Facts about RensselaerFacts about Rensselaer (RPI) (RPI)

““We are the first degree granting We are the first degree granting technological university in the English-technological university in the English-speaking world”speaking world”Research UniversityResearch UniversityTotal Students Total Students 9,1459,145 Graduates – 4,006Graduates – 4,006 Undergraduates – 5,139Undergraduates – 5,139Faculty - 450Faculty - 450

Founded in 1824 by Stephen Van Rensselaer

Page 4: Building Data Warehouse at Rensselaer

Facts about PresenterFacts about Presenter

Bachelor in Math and Computer Science Bachelor in Math and Computer Science from Tel-Aviv University, Israelfrom Tel-Aviv University, IsraelMBA from RPIMBA from RPI23 years in system implementation and 23 years in system implementation and software development in variety of software development in variety of technical and management positionstechnical and management positionsOver 8 years in RPIOver 8 years in RPIInvolved with the Data Warehouse for the Involved with the Data Warehouse for the past five – six years past five – six years

Page 5: Building Data Warehouse at Rensselaer

Fundamental ProblemFundamental Problem

Operational systems are not designed for Operational systems are not designed for information retrieval and analytical information retrieval and analytical processingprocessing

Page 6: Building Data Warehouse at Rensselaer

First attempt to fund DW First attempt to fund DW project Failsproject Fails

Reasons for failing funding in Fall of 1997 :Reasons for failing funding in Fall of 1997 :

TimingTiming

ExpectationExpectation

Lucking business sponsorLucking business sponsor

Analytical culture Analytical culture

What does it What does it reallyreally means?? means??

Page 7: Building Data Warehouse at Rensselaer

Second Attempt to Fund DW Second Attempt to Fund DW Project is SuccessfulProject is Successful

Spring 2000 - The following changes had occurred:Spring 2000 - The following changes had occurred:

Timing – Banner does not addresses reporting; Timing – Banner does not addresses reporting; Views are too slow to be usedViews are too slow to be used

Organizational changes (New President, CIO)Organizational changes (New President, CIO)

Performance Planning Performance Planning

We have build a PrototypeWe have build a Prototype

Page 8: Building Data Warehouse at Rensselaer

Buy-in ProcessBuy-in Process

Demonstrate to those who need this Demonstrate to those who need this information desperately information desperately

The word is outThe word is out

From the CIO to the committees to the From the CIO to the committees to the cabinetcabinet

Page 9: Building Data Warehouse at Rensselaer

Buy-in ProcessBuy-in Process

We are prepared to address:We are prepared to address:

Budgets Budgets

Timelines Timelines

We are ready with the white paperWe are ready with the white paper to to communicate the key components communicate the key components (iterative development under overall (iterative development under overall planning, business users involvement, planning, business users involvement, meta data, approaches)meta data, approaches)

Page 10: Building Data Warehouse at Rensselaer

The Fundamental GoalThe Fundamental Goal

The fundamental goal of the Rensselaer Data The fundamental goal of the Rensselaer Data Warehouse Project is to integrate Warehouse Project is to integrate administrative data into a consistent administrative data into a consistent information resource that supports planning, information resource that supports planning, forecasting, and decision-making processes forecasting, and decision-making processes at Rensselaer.at Rensselaer.

Page 11: Building Data Warehouse at Rensselaer

Development methodologyDevelopment methodology

Phase I – Building FoundationPhase I – Building Foundation

Phase II – Iterative Process of Building Phase II – Iterative Process of Building Subject Oriented Data MartsSubject Oriented Data Marts

On going Operations: Support and On going Operations: Support and Training; Maintenance and Growth Training; Maintenance and Growth

Page 12: Building Data Warehouse at Rensselaer

Rolling ImplementationRolling Implementation

Infrastructure Planning/StaffingSoftwareDatabase/HardwareProduction Platform

Policy Data PolicyDatamarts Finance/Research Req

Position Cntrl/LaborHuman ResourcesEnrollmentGrad Financial AidUndergrad Fin AidContracts & GrantsAdmissions Pipeline

Operations SupportSoftware UpgradeDatabase UpgradeHardware Growth

RolloutDev & Test

FY02 FY03 FY04 FY05

Page 13: Building Data Warehouse at Rensselaer

Phase I – Building FoundationPhase I – Building Foundation

Organizational StructureOrganizational Structure

Project framework and high level Project framework and high level planplan

Building Building TechnicalTechnical Infrastructure Infrastructure

Develop Data Policies and Develop Data Policies and ProceduresProcedures

HiringHiring

Page 14: Building Data Warehouse at Rensselaer

Project Organizational StructureProject Organizational Structure

Sponsorship Group

Steering Committee

Implementation groups

Progress report

Forming Implementation groups; Defining scope and deliverables

Data Warehouse Group

Implementation issues

Business Intelligence Selection CommitteeFinancial Analysis Implementation GroupFinancial Analysis Reviewer GroupData Policy Group

Page 15: Building Data Warehouse at Rensselaer

Project FrameworkProject Framework

High Level AnalysisHigh Level Analysis

Prioritization processPrioritization process

Hire and train staff, Choose Hire and train staff, Choose consultantconsultant

Establish communication Establish communication channels channels (web site, newsletters, kickoff (web site, newsletters, kickoff event…) event…)

Page 16: Building Data Warehouse at Rensselaer

High Level Analysis and High Level Analysis and Prioritization processPrioritization process

CONSTITUENCIES

BUSINESS PROCESSES

Enrollment Analysis X X X X X X X X

Student Pipeline Analysis X X X X X

Faculty Workload Assessment X X X X X X

Financial Analysis X X X X

Contract and Grants Analysis X X X X X

Proposal Pipeline Analysis X X X X

Financial Analysis - Research X X X X X X

Graduate Financial Aid X X X

Alumni Demographics and Tracking X X X X X X

Alumni Contact Management X X

Human Resources X X X X X

Facilities Management X X X

Page 17: Building Data Warehouse at Rensselaer

Prioritization ProcessPrioritization Process

Value toRennselaer

Feasibility HighLow

High

FM

HR

PP

GF

AC

FW

FR SP

AD

EA

FA

CG

Page 18: Building Data Warehouse at Rensselaer

Brio PortalAIX

BrioODS/JF Node

production data warehouse machineAIX 4-CPU 4GB RAM

end-user machines

banner reportinginstance (clone)AIX

webserverAIX

BrioSharedMetadata

InformaticaRepository

metadata

BannerReportingInstance

Oracle 9i

transactional systems

• extraction• transformation• modeling• loading

• central repository• subject-based data marts• metadata• conformed dimensions

• user-facing applications• report generation• subject-based data cubes• data mining

• business intelligence• decision-support• OLAP• querying• reporting

DATA SOURCES DATA ACQUISITION DATA WAREHOUSE DATA DELIVERY DATA CONSUMPTION

DWDB(targets)

Oracle 8i[DWDB]

InformaticaPowerCenterETL Server

BrioInsight

analysts

Brio Portal

BrioWebClient

MicrosoftExcel

analysts

banner productionAIX

Banner

Oracle 9i[PROD]

Dash Boards

contentViewers

Building Technical ArchitectureBuilding Technical Architecture

Page 19: Building Data Warehouse at Rensselaer

Technical Architecture InventoryTechnical Architecture Inventory

ERP – Banner from SCTERP – Banner from SCT

ETL – Power Center from InformaticaETL – Power Center from Informatica

Data Base – Oracle 8iData Base – Oracle 8i

Models – Star schemas with conformed Models – Star schemas with conformed dimensionsdimensions

Web Front end tools – Brio, Dash BoardsWeb Front end tools – Brio, Dash Boards

Desktop Front End tools – Brio, ExcelDesktop Front End tools – Brio, Excel

Page 20: Building Data Warehouse at Rensselaer

Data Security, Privacy and Access PolicyData Security, Privacy and Access Policy

Can be defined as striking the “right” balance between Can be defined as striking the “right” balance between data security/privacy and data accessdata security/privacy and data access

Value of data is increased through widespread access Value of data is increased through widespread access and appropriate use, however, value is severely and appropriate use, however, value is severely compromised by misinterpretation, misuse, or abusecompromised by misinterpretation, misuse, or abuse

This policy considers security and privacy paramountThis policy considers security and privacy paramount

Key oversight principle:Key oversight principle: Cabinet members, as individuals, are responsible for overseeing Cabinet members, as individuals, are responsible for overseeing

establishment of data management policies, procedures, and establishment of data management policies, procedures, and accountability for data governed within their portfolio(s), subject accountability for data governed within their portfolio(s), subject to cabinet review and CIO approvalto cabinet review and CIO approval

Security& Privacy

Access& Use

Page 21: Building Data Warehouse at Rensselaer

Phase IIPhase IIComponents of Building Subject Components of Building Subject

Oriented Data MartsOriented Data MartsDefining Scope and TimelinesDefining Scope and TimelinesModelingModelingDevelopmentDevelopmentRecord MetadataRecord MetadataLocal TestingLocal TestingCore Administration TestingCore Administration TestingDesign and Develop SecurityDesign and Develop SecurityCore Administration live in ProductionCore Administration live in ProductionFront-End development for the campusFront-End development for the campusCampus RolloutCampus Rollout

JAD & RAD Approach

Page 22: Building Data Warehouse at Rensselaer

Defining ScopeDefining Scope

Identify Constituency Identify Constituency

Detailed Requirements Definitions Detailed Requirements Definitions

Analyze Data Sources / raise issuesAnalyze Data Sources / raise issues

Define Scope Define Scope

Acceptance/Project ReviewAcceptance/Project Review

Develop and approve specific security Develop and approve specific security policypolicy

Page 23: Building Data Warehouse at Rensselaer

ModelingModeling

Subject-based data marts

Star Schemas

Conformed dimension

Page 24: Building Data Warehouse at Rensselaer

Graduate Financial Aid Data ModelGraduate Financial Aid Data ModelOne row per student per term per support typeOne row per student per term per support type

Graduate SupportSnapshot

Student Dimension

Fund Dimension

OrganizationDimension

Account Dimension

Program Dimension

Activity Dimension

Tuition Assistance AmtTuition Assistance Fees AmtTuition Assistance Disb. AmtTuition Assistance Fees Disb. AmtTuition Assistance Expensed AmtDegree Completion AmtDegree Completion Disb. AmtStipend Amt

Student Key

Academic Term KeyPrim Program Major Grp KeySec Program Major Grp KeyStudent keyStudent Cohort KeyClass KeyFund KeyOrg KeyAccount KeyProgram KeyActivity KeyGrant KeyStudent Faculty Advisor Key

Fund Key

Org Key

Account Key

Program Key

Activity Key

Academic DegreeBridge Dimension

Student Degree Key

ACADEMIC TERMDIM

Academic Term Key

Class Key

Student CohortBridge

Student Cohort Key

Grant Dimension

Grant Key

Student FacultyAdvisor Bridge

Student Faculty AdvisorKey

Class Dimension

Cohort Key

Faculty Advisor Key

Graduate Support Snapshot

GFA Support Type Key

GFA Support TypeDimension

Page 25: Building Data Warehouse at Rensselaer

Student Enrollment Model – one Student Enrollment Model – one row per enrolled student per term row per enrolled student per term

Student EnrollmentSnapshot

Student Dimension

Class Dimension

Student countMatriculated countCredit Hours RegisteredCredit Hours AttemptedCredit Hours EarnedOverall GPATerm GPATuition Amt ChargedTuition Fees ChargedTuition Amount BilledTuition Fees Billed

Student Key

Academic Term KeyPrim Program Major Grp KeySec Program major Grp KeyStudent keyStudent Cohort KeyClass KeyStudent Faculty Advisor Key

Class KeyAcademic ProgramBridge Dimension

Student AcademicProgram Key

Academic TermDimension

Academic Term Key

Student FacultyAdvisor Bridge

Student Faculty AdvisorKey

Student CohortBridge

Student Cohort Key

Faculty Advisor Key

Cohort Key

Student Enrollment Snapshot

Page 26: Building Data Warehouse at Rensselaer

Summary GFA ModelSummary GFA Modelone row per graduate student per termone row per graduate student per term

Student EnrollmentSnapshot

Student Dimension

GFA STATUS

Student countIRA countERA countTA countFellowship countScholarship countSelf supported countCumulative terms enrolledCumulative terms affiliatedCurrent Tuition Amt ChargedCurrent GFA Stipend Amt

Student Key

Academic Term KeyPrim Program Major Grp KeySec Program major Grp KeyStudent keyStudent Cohort KeyClass KeyStudent Faculty Advisor Key

GFA KeyPrimary ProgramDimension

Student AcademicProgram Key

Academic TermDimension

Academic Term Key

Student FacultyAdvisor Bridge

Student Faculty AdvisorKey

Primary FundingSource

Funding Key

Faculty Advisor Key

Graduate Student Count Enrollment Snapshot

Page 27: Building Data Warehouse at Rensselaer

Development - ETLDevelopment - ETL

Data Staging Design and DevelopmentData Staging Design and Development

Design & Develop Aggregation ProcessDesign & Develop Aggregation Process

Develop Data Quality Assurance Develop Data Quality Assurance ProcessesProcesses

Page 28: Building Data Warehouse at Rensselaer

User testing testing and testing User testing testing and testing …..…..

Note: the Data Warehouse serves the needs Note: the Data Warehouse serves the needs for ad-hoc analysis and reporting of various for ad-hoc analysis and reporting of various groups of usersgroups of users Testers are: Deans, Cabinet, Financial Testers are: Deans, Cabinet, Financial

Managers, Core Administration offices…Managers, Core Administration offices… Testing period is an opportunity to create Testing period is an opportunity to create

more definitions, groupings, and more definitions, groupings, and transformations…transformations…

Page 29: Building Data Warehouse at Rensselaer

Identify Testing Candidates - key users identified Identify Testing Candidates - key users identified in the scopein the scopeTrain Users in Brio Train Users in Brio Transfer of Knowledge from Developer to Transfer of Knowledge from Developer to Testing GroupTesting Group Sample ReportsSample Reports Document Data Mart Description Document Data Mart Description Document Standard Naming Conventions Document Standard Naming Conventions Document Common Uses for Each Star SchemaDocument Common Uses for Each Star Schema

User Set-Up User Set-Up

Prior To User Acceptance TestingPrior To User Acceptance Testing

Page 30: Building Data Warehouse at Rensselaer

Testing sessionsTesting sessions

Allocating time slotsAllocating time slots

Targeting – aiming to produce resultsTargeting – aiming to produce results

Verifying that the models do address the Verifying that the models do address the needneed

Great opportunity to bridge diverse groups Great opportunity to bridge diverse groups

Page 31: Building Data Warehouse at Rensselaer

Defect/Enhancement LogDefect/Enhancement Log

Date ReportedDate ReportedPriority Level (i.e. High, Medium, Low)Priority Level (i.e. High, Medium, Low)Defect and/or Enhancement DescriptionDefect and/or Enhancement DescriptionUser Reporting Defect and/or Enhancement User Reporting Defect and/or Enhancement Defect/Enhancement Status Defect/Enhancement Status

IncomingIncoming PendingPending Work In ProgressWork In Progress User Acceptance TestingUser Acceptance Testing ClosedClosed Focus GroupFocus Group

Assigned ToAssigned ToResolutionResolutionUser Assigned To Test ResolutionUser Assigned To Test Resolution

Page 32: Building Data Warehouse at Rensselaer

Recording MetadataRecording Metadata

User driven effortUser driven effort

Stored in Informatica repositoryStored in Informatica repository

Accessed via BrioAccessed via Brio

Page 33: Building Data Warehouse at Rensselaer

Development - Securing Data Development - Securing Data MartsMarts

Ensure that the subject oriented Data Ensure that the subject oriented Data Policy is definedPolicy is defined

Technically feasibleTechnically feasible

ApprovedApproved

Build Security Front End applicationBuild Security Front End application

Page 34: Building Data Warehouse at Rensselaer

Data Security optionsData Security options

Securing schemasSecuring schemas

Securing facts onlySecuring facts only

Securing dimensions onlySecuring dimensions only

Securing both facts and dimensionsSecuring both facts and dimensions

Page 35: Building Data Warehouse at Rensselaer

Nuts and Bolts of the Data Base Nuts and Bolts of the Data Base Security Security

Data Base security applies to Data Base security applies to all individualsall individuals given either given either direct accessdirect access to the warehoused data or given permissions to to the warehoused data or given permissions to processprocess Brio dynamic Brio dynamic reportsreports

Organization Managers And Financial Managers will have access to Organization Managers And Financial Managers will have access to the warehoused the warehoused financial financial data based on the following criteriadata based on the following criteria

All financials posted against that OrgAll financials posted against that Org All funds listing that Org as a home Org All funds listing that Org as a home Org (in cases of research funds, this (in cases of research funds, this

defines where the research is brought into)defines where the research is brought into) All funds listing the PIs (or the Financial Manager) associated with that All funds listing the PIs (or the Financial Manager) associated with that

Org as fund financial managers. Org as fund financial managers. (Resolves the Multi-disciplinary issue)(Resolves the Multi-disciplinary issue) All funds and orgs listing that Org as a predecessor in either one of the All funds and orgs listing that Org as a predecessor in either one of the

above three cases.above three cases. Administrative role: Individuals might be granted Administrative role: Individuals might be granted accessaccess to additional to additional

funds and org based on funds and org based on their needs and their role within Rensselaertheir needs and their role within Rensselaer. .

Page 36: Building Data Warehouse at Rensselaer

Position Control and Labor Data Position Control and Labor Data Policy Overview Policy Overview

Already have access to Labor data in BannerAlready have access to Labor data in BannerCompleted DW trainingCompleted DW trainingAccess to Budgets and Labor data for all Funding, Access to Budgets and Labor data for all Funding, Employees, or Positions owned by their Organization Employees, or Positions owned by their Organization as following:as following:

Funding:Funding: All actual and budgeted labor expenses posted All actual and budgeted labor expenses posted against their Organizationagainst their Organization

Employees:Employees: All actual and budgeted labor expenses All actual and budgeted labor expenses associated with the Employees reporting to their Organization associated with the Employees reporting to their Organization within the timeframes of the employees’ employment in the within the timeframes of the employees’ employment in the Organization.Organization.

Positions:Positions: All actual and budgeted labor expenses associated All actual and budgeted labor expenses associated with Positions owned by their Organizations.with Positions owned by their Organizations.

All of the above within their Organizations’ hierarchy.All of the above within their Organizations’ hierarchy.

Page 37: Building Data Warehouse at Rensselaer

HR Security Policy OverviewHR Security Policy Overview Access to Employee Information Access to Employee Information

Page 38: Building Data Warehouse at Rensselaer

Enrollment and Graduate Financial Enrollment and Graduate Financial Aid Data Policy OverviewAid Data Policy Overview

Access to aggregate data is based on Access to aggregate data is based on “need to know”“need to know”Access to student identifiable information Access to student identifiable information is restricted as following:is restricted as following: Sponsoring graduate students Sponsoring graduate students Major Major AdvisementAdvisement Central administration/management of the Central administration/management of the

University University

Page 39: Building Data Warehouse at Rensselaer

Access to Undergraduate Financial Access to Undergraduate Financial AidAid

Restricted to very few positions within:Restricted to very few positions within:

President OfficePresident Office

Institutional ResearchInstitutional Research

Students Records and Financial ServicesStudents Records and Financial Services

Financial Aid OfficeFinancial Aid Office

Page 40: Building Data Warehouse at Rensselaer

Development – Front EndDevelopment – Front End

Dash Board Design and Development – Dash Board Design and Development – Joint effort with Core AdministrationJoint effort with Core Administration

Training testing groups in BrioTraining testing groups in Brio

Develop first version of Brio dynamic Develop first version of Brio dynamic documents and publish via Portal – Joint documents and publish via Portal – Joint effort with Core Administrationeffort with Core Administration

Page 41: Building Data Warehouse at Rensselaer

Campus RolloutCampus Rollout

Defining roles and responsibilities Defining roles and responsibilities

Who will have initial access to whatWho will have initial access to what

Develop Roll out strategyDevelop Roll out strategy

Setting expectationsSetting expectations

Designing and carrying out Training Designing and carrying out Training ProgramsPrograms

Page 42: Building Data Warehouse at Rensselaer

CommunicateCommunicate

Executive briefingsExecutive briefings

During TrainingDuring Training

Campus orientationsCampus orientations

Wed siteWed site

Any possible vehicle ….Any possible vehicle ….

Page 43: Building Data Warehouse at Rensselaer

Initial Tiered Access – Who will Initial Tiered Access – Who will have access to whathave access to what

Dash Board

Informationpublished

In Brio documents

Data in the Warehouse

Cabinet; Deans; Department Chairs; Center Directors

Finance AdministrationPortfolio Financial Managers

Department Financial Managers

Trai

ning

Hig

h

Low

Page 44: Building Data Warehouse at Rensselaer

Brio Products Overview Brio Products Overview (Brio Intelligence)(Brio Intelligence)

Brio Portal

Data Warehouse

Folders, Published Documents, Personalized

Content, Dashboards, ERD

Brio Insigh

t

Each user will have separate Portal and database usernames and passwords. The Portal login provides the user with access to published content based on a security profile. The database login is necessary to

extract data from the Data Warehouse.

Web

Connects to the DW without Portal

Brio Insight User

Brio Desktop User (i.e., Brio Explorer, or

Designer)

Connects to the DW with Insight and Portal via

the Web

Portal and Insight are also

available to Desktop users via the Web

Finance Data Mart

Graduate Financial

Aid

Position Control

Data Mart

Student Enrollmen

t

Other Data Marts

Page 45: Building Data Warehouse at Rensselaer

Brio PortalBrio Portal

Allows users to access published documents (e.g., BQYs, Brio manuals, training documents) and personalize their content

Page 46: Building Data Warehouse at Rensselaer

Executive Dashboard OverviewExecutive Dashboard Overview

Accessed via the PortalAccessed via the PortalHigh-level, graphical High-level, graphical views of Portfolio-specific views of Portfolio-specific datadataDesigned primarily for Designed primarily for executive use, though executive use, though available to other users available to other users as wellas wellComprised of monthly Comprised of monthly summary data, refreshed summary data, refreshed nightlynightly

Dashboard Help: http://www.rpi.edu/datawarehouse/dw-help-dashboards.html

Page 47: Building Data Warehouse at Rensselaer

Campus Rollout AssumptionsCampus Rollout Assumptions

Training is mandatory at all levels.Training is mandatory at all levels. Several levels of training will be offered to campus Several levels of training will be offered to campus

in Brio tools, Data, and Data Policies.in Brio tools, Data, and Data Policies. Joint effort between DW Group and Core Joint effort between DW Group and Core

AdministrationAdministration

Portfolio Financial Managers responsibilities:Portfolio Financial Managers responsibilities: Rollout within PortfolioRollout within Portfolio Training within PortfolioTraining within Portfolio

Page 48: Building Data Warehouse at Rensselaer

Data Warehouse Cascaded Data Warehouse Cascaded Rollout StrategyRollout Strategy

1. Core Administration

2. Portfolio Level (Cabinet, Deans, Portfolio Managers)

3. Department Level (Directors, Center Directors, Department Chairs, Department Financial Managers)

4. Other

Page 49: Building Data Warehouse at Rensselaer

Training MethodologyTraining Methodology

Primarily Portfolio Financial Managers who will build ad-hoc queries and reports (i.e., Brio documents) from data mart star schemas and meta topics.

Track 2

Track 3

Track 1

Department Financial Managers who will work primarily with pre-built Brio documents.

Brio 101

Brio 101Level 1:

Portfolio/Dept-Specific Pre-Built Docs

Level 1: Data Mart

Basics

Level 2: Advanced

Brio Documents

Designed for Executive users, this track focuses on Dashboards and the Brio Portal.

Dashboard & Portal trainingOne-on-one or small group formatLow

Medium

High

Training

Required

Page 50: Building Data Warehouse at Rensselaer

Setting and Communicating Setting and Communicating ExpectationsExpectations

Communicate to Institute ExecutivesCommunicate to Institute Executives Creating an Information RevolutionCreating an Information Revolution Changing cultureChanging culture Top down approach is neededTop down approach is needed Recognize BarriersRecognize Barriers Ask for commitmentAsk for commitment

Page 51: Building Data Warehouse at Rensselaer

Recognizing BarriersRecognizing Barriers

People’s resistance to a new toolPeople’s resistance to a new tool

Expectations on information availability and Expectations on information availability and usability for decision making are lowusability for decision making are low

Habit of relying on Central Administration to Habit of relying on Central Administration to provide information, or on their own sources provide information, or on their own sources (many versions of the ‘truth’)(many versions of the ‘truth’)

People will need to acquire new job skillsPeople will need to acquire new job skills

Job expectations will need to changeJob expectations will need to change

Page 52: Building Data Warehouse at Rensselaer

How to get there ….How to get there ….

Common Vision:Common Vision:

One version of the truthOne version of the truth

Data Experts across campus and across organizational Data Experts across campus and across organizational boundariesboundariesData Experts:Data Experts: Portfolio Financial Managers or Equivalents will be Portfolio Financial Managers or Equivalents will be

expected to:expected to: access dataaccess data create reportscreate reports perform analysisperform analysis enable/train Portfolio end-users enable/train Portfolio end-users

Page 53: Building Data Warehouse at Rensselaer

Training approachTraining approach

Evaluating skill levelsEvaluating skill levels: : Surveys before training Surveys before training

Measuring satisfactionMeasuring satisfaction with training with training program: program: Overall satisfaction with program content is Overall satisfaction with program content is very high: 91% gave the highest survey rating.very high: 91% gave the highest survey rating.

Partnering with HRPartnering with HR – – The DW training was The DW training was included in the appropriate Performance Evaluations / included in the appropriate Performance Evaluations / Job Descriptions and course offeringsJob Descriptions and course offerings

Measuring access levelsMeasuring access levels – generating log files – generating log filesUtilizing Web Utilizing Web – self help, registration, – self help, registration, communication communication

Page 54: Building Data Warehouse at Rensselaer

Status of the Data Warehouse Status of the Data Warehouse InitiativeInitiative

Development

Operations

Campus Rollout

Data Access Policy

Page 55: Building Data Warehouse at Rensselaer

DW Program TimelineDW Program Timeline

Infrastructure Planning/StaffingSoftwareDatabase/HardwareProduction Platform

Policy Data PolicyDatamarts Finance/Research Req

Position Cntrl/LaborHuman ResourcesEnrollmentGrad Financial AidUndergrad Fin AidContracts & GrantsAdmissions Pipeline

Operations SupportSoftware UpgradeDatabase UpgradeHardware Growth

FY02 FY03 FY04 FY05

RolloutDev & Test

Page 56: Building Data Warehouse at Rensselaer

Data Warehouse Operations Data Warehouse Operations SupportSupport

Transitioning from Development to OperationsTransitioning from Development to OperationsPortal AdministrationPortal AdministrationDash Board maintenanceDash Board maintenanceData Marts maintenance Data Marts maintenance Users supportUsers supportData Base AdministrationData Base AdministrationBrio documents development, support, and Brio documents development, support, and administrationadministrationInformatica AdministrationInformatica Administration

Page 57: Building Data Warehouse at Rensselaer

On – Going TrainingOn – Going Training

Functional TrainingFunctional Training

Brio trainingBrio training

Refreshers courses: Finance/Research, Refreshers courses: Finance/Research, Labor, HR, Enrollment, GFA, etc.Labor, HR, Enrollment, GFA, etc.

Advance cursesAdvance curses

Page 58: Building Data Warehouse at Rensselaer

DW User Support levelsDW User Support levels

Signing up for sessionsSigning up for sessionsCreating user profiles/securityCreating user profiles/securityInstallsInstallsPublishing requestsPublishing requestsGeneral problems/questionsGeneral problems/questions5-10 Emails Daily5-10 Emails Daily2-4 Calls Daily2-4 Calls Daily1-2 Major problems that need extensive work 1-2 Major problems that need extensive work from developers/front-end technical support from developers/front-end technical support on a daily basis.on a daily basis.

Page 59: Building Data Warehouse at Rensselaer

Data Policy AdministrationData Policy Administration

Each Data Policy is administered by the Each Data Policy is administered by the appropriate Committee appointed at the VP appropriate Committee appointed at the VP levellevelRequests outside the policy are submitted in Requests outside the policy are submitted in writing to the Data Warehouse groupwriting to the Data Warehouse groupThe Committee has the discretion to either The Committee has the discretion to either authorize/deny access or recommend access authorize/deny access or recommend access to the appropriate VP depending on the nature to the appropriate VP depending on the nature of the request.of the request.The respective portfolio owner are notified of The respective portfolio owner are notified of access granted.access granted.

Page 60: Building Data Warehouse at Rensselaer

MaintenanceMaintenanceDW Maintenance - DM Review

  Month in Production

Role 1-3 4-6 7+

Business Staff 10% 10% 10%

Power user 60% 45% 20%

Data Warehouse Administrator 75% 50% 30%

OLAP/Reporting Tool Administrator/Developer 80% 40% 30%

Data modeler 20% 10% 5%

ETL Specialist 75% 50% 25%

Development DBA 50% 25% 10%

Operating System Administrator 20% 10% 5%

Operations 25% 25% 10%

Production DBA 20% 10% 10%

 

DM Review 2003 Resource Guide    

Page 61: Building Data Warehouse at Rensselaer

RPI ResourcesRPI ResourcesRole  

Business Staff  

Power user  

IT Group  

Data Warehouse Management 1

OLAP/Reporting Tool Administrator/Developer 0.5

Data modeler 0.25

ETL Specialist 3.5

DBA 0.5

Operating System Administrator 0.25

Operations (Desktop, Security set-up, etc.) 0.5

Training 1

Customer Support 0.5

   

 Total 8

Page 62: Building Data Warehouse at Rensselaer

Benefits GainedBenefits Gained

Empowers decision-makersEmpowers decision-makers

RedirectsRedirects costly personnel hourscostly personnel hours

Enhances institutional Enhances institutional effectivenesseffectiveness

Improves integrity and conformity Improves integrity and conformity of campus-wide informationof campus-wide information

Promotes the “no walls” culture.Promotes the “no walls” culture. Improves data quality over timeImproves data quality over time. .

Page 63: Building Data Warehouse at Rensselaer

Kirsten M. Volpi, Kirsten M. Volpi, Assistant VP/Controller Assistant VP/Controller

““...There has been analysis that we have not been able to get ...There has been analysis that we have not been able to get at before because the data was not retrievable in a fashion at before because the data was not retrievable in a fashion conducive to perform analytics.  For instance, we have conducive to perform analytics.  For instance, we have begun utilizing the warehouse to begun utilizing the warehouse to analyzeanalyze the indirect cost the indirect cost yield on our research grants.  This data was not readily yield on our research grants.  This data was not readily available before.”available before.”

““We are also using the warehouse not only for analytics but for We are also using the warehouse not only for analytics but for reportsreports to assist with monitoring compliance with internal to assist with monitoring compliance with internal policies, assisting with data gathering for external surveys, policies, assisting with data gathering for external surveys, as well as assisting with automating certain processes as well as assisting with automating certain processes (encumbrances for graduate financial aid).”(encumbrances for graduate financial aid).”

  

Page 64: Building Data Warehouse at Rensselaer

Eileen G. McLoughlin, Eileen G. McLoughlin, Director of Financial Planning & BudgetDirector of Financial Planning & Budget

““The Budget material was consolidated The Budget material was consolidated two weeks soonertwo weeks sooner than the than the previous years.  Many factors contributed to the success, however a previous years.  Many factors contributed to the success, however a significant contributor was the data warehouse allowing the Budget significant contributor was the data warehouse allowing the Budget Office to provide data and analysis of the data to decision makers Office to provide data and analysis of the data to decision makers faster than in the past.” faster than in the past.” “…“…reinforces the “no walls” culture – i.e. as the warehouse becomes reinforces the “no walls” culture – i.e. as the warehouse becomes known as the one and only data source – this will contribute towards known as the one and only data source – this will contribute towards individuals recognizing that we are one organization with individuals recognizing that we are one organization with one one version of the truthversion of the truth.“.““…“…Improved quality over timeImproved quality over time, integrity, conformity – as data is , integrity, conformity – as data is viewed and questioned issues have and will come to the surface on viewed and questioned issues have and will come to the surface on processes that impact data.  This has occurred in the budget office, processes that impact data.  This has occurred in the budget office, accounting practices have been simplified so the resultant data is accounting practices have been simplified so the resultant data is more easily interpreted”more easily interpreted”

Page 65: Building Data Warehouse at Rensselaer

Diane Veros, Diane Veros, Director Research AccountingDirector Research Accounting

““The Data warehouse along with the BRIO software has The Data warehouse along with the BRIO software has proven to be an extremely useful tool for providing proven to be an extremely useful tool for providing information for reporting, monitoring and analysis.  BRIO information for reporting, monitoring and analysis.  BRIO queries and pivot tables have definitely helped to make queries and pivot tables have definitely helped to make some of our work more some of our work more efficient and effectiveefficient and effective.  We have .  We have developed queries for monitoring reports, verifying data developed queries for monitoring reports, verifying data integrity, and analysis that before would have required integrity, and analysis that before would have required days, weeks, or even months working with IACS to days, weeks, or even months working with IACS to program and develop.  Once developed, those older program and develop.  Once developed, those older reports (and/or the data in them) would have allowed reports (and/or the data in them) would have allowed limited access to campus, and another user might have limited access to campus, and another user might have started from scratch to produce a similar report.  The started from scratch to produce a similar report.  The data warehouse provides a consistent data stream that data warehouse provides a consistent data stream that allows allows all campus users to view and analyze the same all campus users to view and analyze the same informationinformation in many alternative ways.” in many alternative ways.”

Page 66: Building Data Warehouse at Rensselaer

Jeff Tanis, Jeff Tanis, Manager of Financial Operations Manager of Financial Operations

School of ScienceSchool of Science““The time it has taken me to gather information has been The time it has taken me to gather information has been

cut by at least half. I now query the warehouse--where cut by at least half. I now query the warehouse--where previously I had to initiate many e-mails and phone calls previously I had to initiate many e-mails and phone calls to collect what I needed. Last month while doing a to collect what I needed. Last month while doing a research expenditure analysis, it took me a matter of research expenditure analysis, it took me a matter of hourshours--where in the past it took --where in the past it took daysdays to get what I to get what I needed.”needed.”

““While doing a research expenditure analysis last month I While doing a research expenditure analysis last month I identified a substantial amount of research expenditures identified a substantial amount of research expenditures on other schools grants using School of Science Orgs. I on other schools grants using School of Science Orgs. I could not have could not have identified identified and subsequently corrected and subsequently corrected these these errorserrors without the use of the Data Warehouse.” without the use of the Data Warehouse.”

Page 67: Building Data Warehouse at Rensselaer

Helen Grzymala, Helen Grzymala, Associate Director BudgetAssociate Director Budget

““As we roll the Finance Data Mart out to all Portfolio Financial As we roll the Finance Data Mart out to all Portfolio Financial Managers, the Budget Office will be providing more and more Managers, the Budget Office will be providing more and more reports via the Data Warehouse. Portfolios will be able to see the reports via the Data Warehouse. Portfolios will be able to see the various reports that are prepared on an various reports that are prepared on an Institutional levelInstitutional level for the for the data. We will be able to have ongoing, data. We will be able to have ongoing, meaningful discussions meaningful discussions about the dataabout the data, rather than how to get the data and how to , rather than how to get the data and how to manipulate it.”manipulate it.”

““The Data Warehouse will result in a change in job expectations for The Data Warehouse will result in a change in job expectations for both the Budget Office and the Portfolio Financial Managers. The both the Budget Office and the Portfolio Financial Managers. The forecast and budget process will evolve to a more analytical review forecast and budget process will evolve to a more analytical review of history and a fact-based projection of the future. Users will move of history and a fact-based projection of the future. Users will move from simply ‘crunching the numbers’ because they will have more from simply ‘crunching the numbers’ because they will have more time and because more data is actually available. Once the time and because more data is actually available. Once the Contracts and Grants information is available, the research units will Contracts and Grants information is available, the research units will be able to track activity right from the pre-proposal stage thru the be able to track activity right from the pre-proposal stage thru the award close out. Using this data, trending and other analysis will award close out. Using this data, trending and other analysis will follow, leading to follow, leading to more accurate forecasts and budgetsmore accurate forecasts and budgets.”.”

Page 68: Building Data Warehouse at Rensselaer

BenefitsBenefits

User NameUser Name Task PerformedTask Performed Pre Data Warehouse Pre Data Warehouse ImplementationImplementation

Post Data Warehouse Post Data Warehouse ImplementationImplementation

Sandra Sandra RedemannRedemannButcherButcher

Portfolio YTD Portfolio YTD AnalysisAnalysis

Half DayHalf Day to retrieve and to retrieve and compile information compile information manually.manually.

SecondsSeconds to retrieve to retrieve information from the Data information from the Data Warehouse. Warehouse.

Gina RicciGina Ricci Report AnalysisReport Analysis Multiple TruthsMultiple Truths existed existed across campus. Multiple across campus. Multiple information sources information sources existed, which destroyed existed, which destroyed data integrity and data integrity and conformity. conformity.

One TruthOne Truth exists. One exists. One information source information source promotes a common promotes a common understanding of the data understanding of the data and allows users to derive and allows users to derive at the same conclusions. at the same conclusions.

Tanya Tanya StruzinskyStruzinsky

Available Available Balance ReportBalance Report

2 Weeks2 Weeks to retrieve and to retrieve and compile information compile information manually.manually.

30 Minutes30 Minutes to build the to build the report in the Data report in the Data Warehouse, which can be Warehouse, which can be refreshed daily in Seconds.refreshed daily in Seconds.

Donna Donna TomlinsonTomlinson

Org 3 Year Org 3 Year Comparison By Comparison By Account Group Account Group

Not Readily AvailableNot Readily Available Readily AvailableReadily Available on on demand.demand.

Page 69: Building Data Warehouse at Rensselaer

BenefitsBenefits

User NameUser Name Task PerformedTask Performed Pre Data Warehouse Pre Data Warehouse ImplementationImplementation

Post Data Warehouse Post Data Warehouse ImplementationImplementation

Jeff TanisJeff Tanis Research Research Expenditure Expenditure AnalysisAnalysis

Multiple DaysMultiple Days to retrieve to retrieve data from multiple sources data from multiple sources and compile information and compile information manually.manually.

Few HoursFew Hours to retrieve to retrieve information from the Data information from the Data Warehouse. Warehouse.

Diane Diane VerosVeros

Data Integrity Data Integrity VerificationVerification

Days, Weeks or MonthsDays, Weeks or Months to to develop reports to ensure develop reports to ensure data integrity or to perform data integrity or to perform analysis.analysis.

Few HoursFew Hours to develop to develop reports in the Data reports in the Data Warehouse to ensure data Warehouse to ensure data integrity or to perform integrity or to perform analysis.analysis.

Tanya Tanya StruzinskyStruzinsky

Credit Card Credit Card Transaction Transaction ReconciliationReconciliation

2-3 Hours2-3 Hours to compile, to compile, review and verify credit review and verify credit card transactions for each card transactions for each user. user.

5 Minutes5 Minutes to retrieve, to retrieve, review and verify credit review and verify credit card transactions for each card transactions for each user. user.

Sandra Sandra RedemannRedemannButcherButcher

Month-End Month-End Report Report

2 Days2 Days to retrieve and to retrieve and verify program and activity verify program and activity codes in order to ensure codes in order to ensure accurate results.accurate results.

2 Hours2 Hours to retrieve to retrieve information from the Data information from the Data Warehouse. No data Warehouse. No data manipulation required.manipulation required.

Page 70: Building Data Warehouse at Rensselaer

Program metricsProgram metrics

Web access only (not including desktop or Dash Boards users)Web access only (not including desktop or Dash Boards users)Timeframes: January 27 – July 31Timeframes: January 27 – July 31

Page 71: Building Data Warehouse at Rensselaer

Financial Analysis Web Access Financial Analysis Web Access

Page 72: Building Data Warehouse at Rensselaer

Lessons LearnedLessons Learned

Picture worth thousand words – prototypePicture worth thousand words – prototypeFunding (time, resources, and dollars)Funding (time, resources, and dollars)Business Sponsorship – find the Champion and promote Business Sponsorship – find the Champion and promote themthemProperly designed Organizational Structure helps to Properly designed Organizational Structure helps to navigate political obstaclesnavigate political obstaclesPartnership with the Business users – build it alone and they Partnership with the Business users – build it alone and they will never comewill never comeIdentify your Business ‘Stars’ as early as possibleIdentify your Business ‘Stars’ as early as possibleJAD and RAD approaches are best fitted for the iterative JAD and RAD approaches are best fitted for the iterative DW developmentDW developmentDash Boards – unless it is visible it is not thereDash Boards – unless it is visible it is not thereBuilding Data Warehouse is far more than a technical Building Data Warehouse is far more than a technical endeavor it is all about changing the culture endeavor it is all about changing the culture

Page 73: Building Data Warehouse at Rensselaer
Page 74: Building Data Warehouse at Rensselaer

Questions ???Questions ???Ora Fish

[email protected]

?