ay 2011 lbrt instructional program review process

AY 2011 LBRT Instructional AY 2011 LBRT Instructional Program Review ProcessProgram Review Process

Data DescriptionData DescriptionProcess – TimelineProcess – Timeline

Rev. 10-25-11Rev. 10-25-11

IntroIntroThe purpose of this presentation is describe the process we follow for both our local Comprehensive The purpose of this presentation is describe the process we follow for both our local Comprehensive and the system required Annual Program Reviews, as well as how the data is calculated.and the system required Annual Program Reviews, as well as how the data is calculated.

We have been asked to produce an annual program review for each and every one of our instructional We have been asked to produce an annual program review for each and every one of our instructional programs and units. They are required of each system CC and will be taken to the U of H Board of programs and units. They are required of each system CC and will be taken to the U of H Board of Regents for their purview.Regents for their purview.

If you are normally scheduled to do a comprehensive review or are “Jumping”, you will need to If you are normally scheduled to do a comprehensive review or are “Jumping”, you will need to complete a comprehensive review this year. Additionally, every instructional and non-instructional complete a comprehensive review this year. Additionally, every instructional and non-instructional program will do an Annual Program Review this year.program will do an Annual Program Review this year.

Not sure if you’re scheduled for a comprehensive review or not? Not sure if you’re scheduled for a comprehensive review or not?

Click here for theClick here for the

Comprehensive Program-Unit Review Cycle and Schedule

22

What are we doing to improve our program review process?What are we doing to improve our program review process?

Upon conclusion of every program/unit review cycle, the IR Office takes extra care to ensure that we are improving our Upon conclusion of every program/unit review cycle, the IR Office takes extra care to ensure that we are improving our program/unit review process on campus. This is accomplished by sending out questionnaires specific to the program/unit review process on campus. This is accomplished by sending out questionnaires specific to the groups, and by meeting with various groups across campus and collecting feedback. Your suggestions for groups, and by meeting with various groups across campus and collecting feedback. Your suggestions for improving this process are then posted on the Assessment Website and linked here for your convenience.improving this process are then posted on the Assessment Website and linked here for your convenience.

2010 Program-Unit Process Improvement Summary

Based upon the feedback we received from everyone last year from our program-unit review process improvement Based upon the feedback we received from everyone last year from our program-unit review process improvement focus groups, the following changes have been made and have been incorporated into the planning of this year’s focus groups, the following changes have been made and have been incorporated into the planning of this year’s

review:review:

Timeline for program/unit reviews reevaluated. Reviews due this year November 18Timeline for program/unit reviews reevaluated. Reviews due this year November 18 thth to Joni. to Joni.

We will continue to use our college website as the mode of delivery for your program-unit review documentation.We will continue to use our college website as the mode of delivery for your program-unit review documentation.

We will continue the practice of providing program-unit review training and presentation materials.We will continue the practice of providing program-unit review training and presentation materials.

33

What are we doing to improve our program review process cont.?What are we doing to improve our program review process cont.?

Continue practice of providing training specific to your group (i.e. a presentation just for LA)Continue practice of providing training specific to your group (i.e. a presentation just for LA)

The training you received last year regarding changes to the Instructional Program Review Comprehensive Template was helpful. We will continue to The training you received last year regarding changes to the Instructional Program Review Comprehensive Template was helpful. We will continue to provide a brief overview of the templates upon conclusion of our normally scheduled training.provide a brief overview of the templates upon conclusion of our normally scheduled training.

We will continue to schedule our trainings based on the scheduling requests we send out. We have 3 scheduled training sessions this year, one for Units, We will continue to schedule our trainings based on the scheduling requests we send out. We have 3 scheduled training sessions this year, one for Units, one for Liberal Arts, and one for CTE. We will continue to seek your scheduling input to consider room size and number of sessions.one for Liberal Arts, and one for CTE. We will continue to seek your scheduling input to consider room size and number of sessions.

Online submissions last year seemed to work quite well for most folks. Please plan to do any formatting to your report within the online tool to keep your Online submissions last year seemed to work quite well for most folks. Please plan to do any formatting to your report within the online tool to keep your formatting from getting scrubbed.formatting from getting scrubbed.

44

What are we doing to improve our program review process cont.?What are we doing to improve our program review process cont.?

There is no need to wait for the IR Office this year to copy, paste, and format your 3 years of data into the comprehensive template because all 3 years There is no need to wait for the IR Office this year to copy, paste, and format your 3 years of data into the comprehensive template because all 3 years data is now provided to you online. Additionally, the CERC made a change to the comprehensive template requiring you to paste the entire annual data is now provided to you online. Additionally, the CERC made a change to the comprehensive template requiring you to paste the entire annual review into your comprehensive review template. You may also hyperlink the annual review in if you wish. More on template changes later in the review into your comprehensive review template. You may also hyperlink the annual review in if you wish. More on template changes later in the presentation today.presentation today.

There was an interest last year to have our annual review feedback given to the program initiators. This was accomplished through email last year There was an interest last year to have our annual review feedback given to the program initiators. This was accomplished through email last year from the VCAA to the Initiators.from the VCAA to the Initiators.

There were suggestions last year that assessment needs to be better integrated into the comprehensive program reviews. The requirement for listing There were suggestions last year that assessment needs to be better integrated into the comprehensive program reviews. The requirement for listing your unit outcomes and their assessments have now been added to the Instructional Program Review Comprehensive Template.your unit outcomes and their assessments have now been added to the Instructional Program Review Comprehensive Template.

It was suggested that having writing assistance in the program review process would be helpful. Mary Goya has offered to help programs out until we It was suggested that having writing assistance in the program review process would be helpful. Mary Goya has offered to help programs out until we have our Assessment Coordinator on-board.have our Assessment Coordinator on-board.

All templates have been updated since last year based on your feedback and an evaluation of the templates by CERC.All templates have been updated since last year based on your feedback and an evaluation of the templates by CERC.

55

What is different this year?What is different this year?

Three separate training sessions will be given this year in order to focus on specific groups. Three separate training sessions will be given this year in order to focus on specific groups. They are:They are:

– 1.1. CTE ProgramsCTE Programs– 2.2. Liberal Arts Division ProgramsLiberal Arts Division Programs– 3. Units3. Units

3 full years of data provided to the LA program this year3 full years of data provided to the LA program this year

No upload capabilities with web submission tool. Your analysis should be on the data provided.No upload capabilities with web submission tool. Your analysis should be on the data provided.

There is a new tab in the online submission tool, which was requested by our VCAA’s for There is a new tab in the online submission tool, which was requested by our VCAA’s for inclusion of SLO’s. This is nowinclusion of SLO’s. This is now required required with your submission.with your submission.

The new “due to VCAA” date this year is November 18The new “due to VCAA” date this year is November 18 thth..

Your budget numbers will be made available to you this year on the Assessment website atYour budget numbers will be made available to you this year on the Assessment website at

AY 2011 Instructional Program Review Budget Table

Annual Reports of Program Data are completely on-line this year for Student Services.Annual Reports of Program Data are completely on-line this year for Student Services.

Remedial/Developmental programs have a new data element this year called, “Success at the Remedial/Developmental programs have a new data element this year called, “Success at the next level”next level”

66

What’s a Jumper?What’s a Jumper?

A Jumper is a locally defined term that is used to describe an instructional A Jumper is a locally defined term that is used to describe an instructional program or non-instructional program (unit) that has decided to jump out of program or non-instructional program (unit) that has decided to jump out of their normally scheduled slot for their comprehensive program reviews and their normally scheduled slot for their comprehensive program reviews and into this years cycle.into this years cycle.

Jumping into this years comprehensive cycle means that you will have an Jumping into this years comprehensive cycle means that you will have an opportunity to be considered for any budgetary decisions that will be made opportunity to be considered for any budgetary decisions that will be made in this years budget process.in this years budget process.

Jumpers will still have to do their comprehensive review on their next Jumpers will still have to do their comprehensive review on their next scheduled review. Jumping does not affect the existing schedule—you are scheduled review. Jumping does not affect the existing schedule—you are voluntarily doing an extra review to be considered in this budget cycle.voluntarily doing an extra review to be considered in this budget cycle.

77

I belong to the Liberal Arts Program… which form do I use?I belong to the Liberal Arts Program… which form do I use?

COMPREHENSIVE REVIEWSCOMPREHENSIVE REVIEWS

The Liberal Arts program is required to do a comprehensive review this year using the following The Liberal Arts program is required to do a comprehensive review this year using the following template:template:

Comprehensive Instruction Program Review Template

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

ANNUAL REVIEWSANNUAL REVIEWS Your programs data table is available on-line using the link below. You should have everything you Your programs data table is available on-line using the link below. You should have everything you

need to begin writing your review within the web submission tool. Plan to save your work often—need to begin writing your review within the web submission tool. Plan to save your work often—especially when switching between screens, and plan to do most of your formatting within the tool if especially when switching between screens, and plan to do most of your formatting within the tool if you are copying and pasting in from Word.you are copying and pasting in from Word.

UHCC Annual Report of Program Data Web Submission ToolUHCC Annual Report of Program Data Web Submission Tool

88

Terminology / TimingTerminology / Timing

The Census freeze event is the fifth Friday after the first day of instruction.The Census freeze event is the fifth Friday after the first day of instruction.

The End of semester freeze event is 10 weeks after the last day of instruction.The End of semester freeze event is 10 weeks after the last day of instruction.

FISCAL_YR_IRO: Fiscal year, where the value indicates the ending of the fiscal year. For FISCAL_YR_IRO: Fiscal year, where the value indicates the ending of the fiscal year. For example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004-2005 (July 1, example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004-2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 2004 to June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 semesters. semesters.

99

Instructional Program Review Data ElementsInstructional Program Review Data Elements

Student information data this year comes exclusively from the Operational Data Store Student information data this year comes exclusively from the Operational Data Store (ODS). Organizationally this means that all community colleges are getting the data from (ODS). Organizationally this means that all community colleges are getting the data from the same place and at the same snapshot in time (this is a good thing).the same place and at the same snapshot in time (this is a good thing).

The following slides will explain in detail what data has been provided to you for your The following slides will explain in detail what data has been provided to you for your annual instructional program review write up and how it has been calculated.annual instructional program review write up and how it has been calculated.

1010

#1#1 Number of MajorsNumber of Majors

Count of program majors who are home‐institution at your college. Count of program majors who are home‐institution at your college.

Count excludes students that have completely withdrawn from the semester Count excludes students that have completely withdrawn from the semester at CENSUS.at CENSUS.

This is an annual number. Programs receive a count of .5 for each term This is an annual number. Programs receive a count of .5 for each term within the academic year that the student is a major. A maximum count of within the academic year that the student is a major. A maximum count of 1.0 (one) for each student.1.0 (one) for each student.

1111

#2#2 Increase Majors from Prior Year Increase Majors from Prior Year

In alignment with UHCC Strategic Planning Goals, General and Pre‐In alignment with UHCC Strategic Planning Goals, General and Pre‐Professional Education programs are expected to grow by 3% per year.Professional Education programs are expected to grow by 3% per year.

Data Source: Difference in item #2 from prior year divided item #2 Data Source: Difference in item #2 from prior year divided item #2 current year.current year.

1212

#3#3 SSH Program majors in Program ClassesSSH Program majors in Program Classes

The sum of Fall and Spring SSH taken by program majors in The sum of Fall and Spring SSH taken by program majors in courses linked to the program. Captured at Census and excludes courses linked to the program. Captured at Census and excludes students who have already withdrawn (W) at this point.students who have already withdrawn (W) at this point.

Note: for programs where year‐round attendance is mandatory, Note: for programs where year‐round attendance is mandatory, Summer SSH are included.Summer SSH are included.

Excludes Directed Studies (99 series). Differs from MAPS as UHCC Excludes Directed Studies (99 series). Differs from MAPS as UHCC data includes Cooperative Education (93 series) as there is a data includes Cooperative Education (93 series) as there is a resource cost to the program.resource cost to the program.

Not sure what your program classes are? Click here to find out:Not sure what your program classes are? Click here to find out:

Courses Taught Aligned to Instructional Programs

1313

#4#4 SSH Non-Majors in Program ClassesSSH Non-Majors in Program Classes

The sum of Fall and Spring SSH taken by non‐program majors (not The sum of Fall and Spring SSH taken by non‐program majors (not counted in #3) in courses linked to the program. Captured at counted in #3) in courses linked to the program. Captured at Census and excludes students who have already withdrawn (W) at Census and excludes students who have already withdrawn (W) at this point.this point.

Excludes Directed Studies (99 series). Excludes Directed Studies (99 series).

Differs from MAPS as UHCC data includes Cooperative Education Differs from MAPS as UHCC data includes Cooperative Education (93 series) as there is a resource cost to the program.(93 series) as there is a resource cost to the program.

1414

#5#5 SSH in All Program ClassesSSH in All Program Classes

The sum of Fall and Spring SSH taken by all students in classes The sum of Fall and Spring SSH taken by all students in classes linked to the program. Captured at Census and excludes students linked to the program. Captured at Census and excludes students who have already withdrawn (W) at this point.who have already withdrawn (W) at this point.


Differs from MAPS as UHCC data Includes Cooperative Education Differs from MAPS as UHCC data Includes Cooperative Education (93 series) as there is a resource cost to the program.(93 series) as there is a resource cost to the program.

1515

#6#6 FTE Enrollment in Program ClassesFTE Enrollment in Program Classes

Sum of Student Semester Hours (SSH) taken by all students in Sum of Student Semester Hours (SSH) taken by all students in classes linked to the program (#5) divided by 30. Undergraduate, classes linked to the program (#5) divided by 30. Undergraduate, lower division Full Time Equivalent (FTE) is calculated as 15 credits lower division Full Time Equivalent (FTE) is calculated as 15 credits per term. per term.

Captured at Census and excludes students who have already Captured at Census and excludes students who have already withdrawn (W) at this point.withdrawn (W) at this point.

1616

#7#7 Total Number of Classes TaughtTotal Number of Classes Taught

Total number of classes taught in Fall and Spring that are linked to Total number of classes taught in Fall and Spring that are linked to the program. the program.

Concurrent and Cross listed classes are only counted once for the Concurrent and Cross listed classes are only counted once for the primary class. primary class.



1717

LA Program Scoring Rubric DefinitionsLA Program Scoring Rubric Definitions

Your program health is determined by 3 separate types of measures: Your program health is determined by 3 separate types of measures: Demand, Efficiency, and Effectiveness. This slide explains why these Demand, Efficiency, and Effectiveness. This slide explains why these measures were chosen to determine program health.measures were chosen to determine program health.

Demand: A seeking or state of being sought after.Demand: A seeking or state of being sought after.

i.e. your programs ability to attract new students every year based on i.e. your programs ability to attract new students every year based on your offering.your offering.

Efficiency: Acting or producing effectively with a minimum of waste, Efficiency: Acting or producing effectively with a minimum of waste, expense, or unnecessary effort.expense, or unnecessary effort.

i.e. your programs ability to use its resources in the best possible way.i.e. your programs ability to use its resources in the best possible way.

Effectiveness: Stresses the actual production of, or the power to produce Effectiveness: Stresses the actual production of, or the power to produce an affect.an affect.

i.e. your programs ability to produce the desired result.i.e. your programs ability to produce the desired result.

1818

Determination of program’s health based on Determination of program’s health based on demanddemand

This year the system office will calculate and report health calls for all This year the system office will calculate and report health calls for all instructional programs using academic year 2011 data. instructional programs using academic year 2011 data.

If you are interested in how the Liberal Arts Health Calls were determined, If you are interested in how the Liberal Arts Health Calls were determined, refer to the rubric linked here:refer to the rubric linked here:

Liberal Arts Health Call Scoring Rubric Liberal Arts Health Call Scoring Rubric

1919

#8#8 Average Class SizeAverage Class Size

Total number of students actively registered in Fall and Spring Total number of students actively registered in Fall and Spring program classes divided by classes taught (#7). program classes divided by classes taught (#7).


Excludes Directed Studies (99 series).Excludes Directed Studies (99 series).


2020

#9#9 Fill RateFill Rate

Total active student registrations in program classes Total active student registrations in program classes (number of seats filled) at Fall and Spring census divided (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats offered). by the maximum enrollment (number of seats offered).

Captured at Census and excludes students who have Captured at Census and excludes students who have already withdrawn (W) at this point.already withdrawn (W) at this point.

2121

#10#10 FTE BOR Appointed FacultyFTE BOR Appointed Faculty

Sum appointments (1.0, 0.5, etc.) of all BOR appointed program faculty (excludes Sum appointments (1.0, 0.5, etc.) of all BOR appointed program faculty (excludes lecturers and other non BOR appointees).lecturers and other non BOR appointees).

Uses the “hiring status” of the faculty member – not the teaching/work load.Uses the “hiring status” of the faculty member – not the teaching/work load.

Uses the Employing Agency Code (EAC) recorded in the Human Resources (HR) Uses the Employing Agency Code (EAC) recorded in the Human Resources (HR) database to determine faculty’s program home.database to determine faculty’s program home.

Faculty Teaching solely Remedial and/or Developmental Reading, Writing, or Faculty Teaching solely Remedial and/or Developmental Reading, Writing, or Mathematics are excluded from the counts in Liberal Arts and included in the Mathematics are excluded from the counts in Liberal Arts and included in the counts for the Remedial/and or Developmental programs. Faculty with “split” counts for the Remedial/and or Developmental programs. Faculty with “split” assignments among Remedial/Developmental classes and Transfer level classes assignments among Remedial/Developmental classes and Transfer level classes are reflected proportionally.are reflected proportionally.

Data as of October 31 2010.Data as of October 31 2010.

Data provided by UH Human Resources Office.Data provided by UH Human Resources Office.

Click here to find the number of BOR Appointed Program Faculty for your program:Click here to find the number of BOR Appointed Program Faculty for your program:2011 BOR Appointed Program Faculty

2222

#11 #11 Majors to FTE BOR Appointed Faculty Majors to FTE BOR Appointed Faculty

Number of majors (#1) divided by sum appointments (#10) (1.0, 0.5, Number of majors (#1) divided by sum appointments (#10) (1.0, 0.5, etc.) of all BOR appointed program faculty. etc.) of all BOR appointed program faculty.

Data show the number of student majors in the program for each Data show the number of student majors in the program for each faculty member (25 majors to 1 faculty shown as “25”)faculty member (25 majors to 1 faculty shown as “25”)

2323

#12#12 Majors to Analytic FTE FacultyMajors to Analytic FTE Faculty

Number of majors (#1) divided by number of Analytic Number of majors (#1) divided by number of Analytic FTE faculty (12a).FTE faculty (12a).

2424

#12a#12a Analytical FTE Faculty (Workload)Analytical FTE Faculty (Workload)

Calculated by sum of Semester Hours (not Student Semester Calculated by sum of Semester Hours (not Student Semester Hours) taught in program classes divided by 27.Hours) taught in program classes divided by 27.

Analytic FTE is useful as a comparison to FTE of BOR appointed Analytic FTE is useful as a comparison to FTE of BOR appointed faculty (#10). Used for analysis of program offerings covered by faculty (#10). Used for analysis of program offerings covered by lecturers.lecturers.

2525

Where can I find my budget numbers?Where can I find my budget numbers?

Again this year we will use the actual expenditures of both B-Again this year we will use the actual expenditures of both B-Budgets and salaries, as part of your overall budget.Budgets and salaries, as part of your overall budget.

The budget numbers you need for your program review are now The budget numbers you need for your program review are now available on the Assessment website at available on the Assessment website at

AY 2011 Instructional Program Review Budget Table

2626

How do I get the budget numbers into the How do I get the budget numbers into the web submission tool?web submission tool?

Go to theGo to the UHCC Annual Report of Program Data (ARPD) Web Submission Tool UHCC Annual Report of Program Data (ARPD) Web Submission Tool

Click on the 2011 Instructional ARPD(*) link.Click on the 2011 Instructional ARPD(*) link. Click on Web submission link.Click on Web submission link. Log in, using your UH username and password.Log in, using your UH username and password. Select the “Cost per SSH” tab.Select the “Cost per SSH” tab. Click the “Edit” button for your program.Click the “Edit” button for your program. Go to the link on the assessment website for your budget and…Go to the link on the assessment website for your budget and… Enter the value of general funds. (this is b-budget plus salary)Enter the value of general funds. (this is b-budget plus salary) Enter the value of federal funds.Enter the value of federal funds. Enter any other funds that you wish to add.Enter any other funds that you wish to add. Click the “Save Cost per SSH Data” button at bottom of page.Click the “Save Cost per SSH Data” button at bottom of page. Your overall budget allocation (sum of everything you entered) and the Your overall budget allocation (sum of everything you entered) and the

cost per SSH will automatically populate the data table in your review.cost per SSH will automatically populate the data table in your review.

2727

#13#13 OverallOverall Program Budget AllocationProgram Budget Allocation

The overall program budget allocation = General Funded Budget The overall program budget allocation = General Funded Budget Allocations (13a) + Special/Federal Budget Allocations (13b)Allocations (13a) + Special/Federal Budget Allocations (13b)

2828

#13a#13a General Funded Budget AllocationGeneral Funded Budget Allocation

The general funded budget allocation = actual personnel costs + b The general funded budget allocation = actual personnel costs + b budget expendituresbudget expenditures

Personnel costs this year include the salaries for : faculty, lecturers, Personnel costs this year include the salaries for : faculty, lecturers, overload, APT, student help, and clerical.overload, APT, student help, and clerical.

2929

#13b#13b Special/Federal Budget AllocationSpecial/Federal Budget Allocation

The expenditure of dollars from Federal grantsThe expenditure of dollars from Federal grants

3030

#14#14 Cost per SSHCost per SSH

Overall Program Budget Allocation (#13) divided by SSH in all Overall Program Budget Allocation (#13) divided by SSH in all program classes (#5)program classes (#5)

3131

#15#15 Number of Low Enrolled (<10) ClassesNumber of Low Enrolled (<10) Classes

Classes taught (#7) with 9 or fewer active students at Classes taught (#7) with 9 or fewer active students at Census. Census.

Excludes students who have already withdrawn (W) at Excludes students who have already withdrawn (W) at this point.this point.

Excludes Directed Studies (99 series).Excludes Directed Studies (99 series).

Includes Cooperative Education (93 series) as there is a Includes Cooperative Education (93 series) as there is a resource cost to the program.resource cost to the program.

3232

Determination of program’s health based on Determination of program’s health based on efficiencyefficiency



Liberal Arts Health Call Scoring Rubric Liberal Arts Health Call Scoring Rubric

3333

#16#16 Successful Completion Successful Completion (Equivalent C or higher) (Equivalent C or higher)

Percentage of students actively enrolled in program classes at Fall Percentage of students actively enrolled in program classes at Fall and Spring census who at end of semester have earned a grade and Spring census who at end of semester have earned a grade equivalent to C or higher.equivalent to C or higher.


3434

#17#17 Withdrawals (grade = W)Withdrawals (grade = W)

Number of students actively enrolled (at this point have not Number of students actively enrolled (at this point have not withdrawn) at Fall and Spring census who at end of semester have withdrawn) at Fall and Spring census who at end of semester have a grade of W.a grade of W.

3535

#18#18 Persistence Fall to SpringPersistence Fall to Spring

Count of students who are majors in program at fall Count of students who are majors in program at fall census (from Fall semester #1) and at subsequent census (from Fall semester #1) and at subsequent Spring semester census are enrolled and are still majors Spring semester census are enrolled and are still majors in the program.in the program.

Excludes students who have already withdrawn (W) at Excludes students who have already withdrawn (W) at this point. this point.

Example: Example: 31 majors start in Fall31 majors start in Fall

21 majors of the original 31 persist into Spring21 majors of the original 31 persist into Spring21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

3636

#19#19 Unduplicated Degrees/Certificates Awarded Unduplicated Degrees/Certificates Awarded Prior Fiscal YearPrior Fiscal Year

Unduplicated headcount of students in the fiscal year reported to whom a program Unduplicated headcount of students in the fiscal year reported to whom a program degree or any certificate has been conferred. (Sum of 19a, 19b, 19c, and 19d). degree or any certificate has been conferred. (Sum of 19a, 19b, 19c, and 19d).

Uses most recent available freeze of fiscal year data.Uses most recent available freeze of fiscal year data.

For ARPD year 2009, the most recent fiscal data on August 15, 2009, was from FY For ARPD year 2009, the most recent fiscal data on August 15, 2009, was from FY 2008. 2008.

For ARPD year 2010, the most recent fiscal data on August 15, 2010, was from FY For ARPD year 2010, the most recent fiscal data on August 15, 2010, was from FY 2010. 2010.

For ARPD year 2011, the most recent fiscal data on August 15, 2011, was from FY For ARPD year 2011, the most recent fiscal data on August 15, 2011, was from FY 2011.2011.

3737

#19a#19a Associate Degrees AwardedAssociate Degrees Awarded

Degrees conferred in the FISCAL_YEAR_IRO.Degrees conferred in the FISCAL_YEAR_IRO.

The count is of degrees and may show duplicate degrees received in the The count is of degrees and may show duplicate degrees received in the program by the same student.program by the same student.

Uses most recent available freeze of fiscal year data. Uses most recent available freeze of fiscal year data.

FISCAL_YEAR_IRO:FISCAL_YEAR_IRO:

“ “Fiscal year, where the value indicates the ending of the fiscal year. For Fiscal year, where the value indicates the ending of the fiscal year. For example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐example, a FISCAL_YR_IRO value of 2005 indicates the fiscal year 2004‐2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2005 (July 1, 2004 to June 30, 2005) which includes Summer 2004, Fall 2004, and Spring 2005 semesters…”2004, and Spring 2005 semesters…”

3838

#19b#19b Academic Subject Certificates AwardedAcademic Subject Certificates Awarded

The count is of program Academic Subject Certificates and may show The count is of program Academic Subject Certificates and may show multiple Academic Subject Certificates in the same program received by the multiple Academic Subject Certificates in the same program received by the student.student.

Uses most recent available freeze of fiscal year data. Uses most recent available freeze of fiscal year data.

3939

#19c#19c GoalGoal

The UH Community Colleges have established increasing the number of The UH Community Colleges have established increasing the number of Associate Degrees awarded as a priority.Associate Degrees awarded as a priority.

Beginning with the baseline of 2006 (see MAPS Degrees and Certificates Earned Beginning with the baseline of 2006 (see MAPS Degrees and Certificates Earned 2005‐2006) programs are expected to increase the number of Associate Degrees 2005‐2006) programs are expected to increase the number of Associate Degrees by 3% compounded annually.by 3% compounded annually.

The number in 19c reflects the goal for the appropriate year.The number in 19c reflects the goal for the appropriate year.


Example: 119 degrees was goal for 0910, 123 is goal for 1011 year (a 3% Example: 119 degrees was goal for 0910, 123 is goal for 1011 year (a 3% increase)increase)

4040

#19d#19d Difference Between Unduplicated Awarded Difference Between Unduplicated Awarded and Goaland Goal

The percent difference between the number of Associate degrees awarded The percent difference between the number of Associate degrees awarded (#19a) and the goal (#19c).(#19a) and the goal (#19c).

General Pre Professional Programs are expected to increase Associate General Pre Professional Programs are expected to increase Associate Degrees awarded by 3% compounded annually.Degrees awarded by 3% compounded annually.


Example: The program’s goal is 123 (19c). The actual number of Associate Example: The program’s goal is 123 (19c). The actual number of Associate degrees awarded (19a) is 132, which is 9 degrees more than the goal. degrees awarded (19a) is 132, which is 9 degrees more than the goal.

Nine is 7% greater than the goal.Nine is 7% greater than the goal.

4141

#20#20 Transfers to UH 4-yrTransfers to UH 4-yr

Students with home campus UH Manoa, UH Hilo, or UH West Oahu Students with home campus UH Manoa, UH Hilo, or UH West Oahu for the first time Fall 2010 who prior to Fall 2010 had UH community for the first time Fall 2010 who prior to Fall 2010 had UH community college as home campus. college as home campus.

Also includes students who for the first time in Fall 2010 show Maui Also includes students who for the first time in Fall 2010 show Maui CC, Applied Business Information Technology as home campus and CC, Applied Business Information Technology as home campus and major.major.

This is a program measure. A student is included in the count of This is a program measure. A student is included in the count of program transfers in as many programs in which they have been a program transfers in as many programs in which they have been a major at the college.major at the college.

For new programs, the baseline is calculated in the year following For new programs, the baseline is calculated in the year following the establishment of the program – specifically the year in which the establishment of the program – specifically the year in which there are a critical mass of majors reported in IRO_Base_UH.there are a critical mass of majors reported in IRO_Base_UH.

4242

#20a#20a Transfers with degree from programTransfers with degree from program

Students included in #20 who have received a degree from the Students included in #20 who have received a degree from the community college program prior to transfer. community college program prior to transfer.

Does not include any certificates. Does not include any certificates.

4343

#20b#20b Transfers without degree from programTransfers without degree from program

Students included in #20 who did not receive a degree from the Students included in #20 who did not receive a degree from the community college program prior to transfer but did transfer.community college program prior to transfer but did transfer.

4444

#20c#20c Increase by 3% Annual Transfers to UH 4-yr Increase by 3% Annual Transfers to UH 4-yr GoalGoal

The UH Community Colleges have established increasing the The UH Community Colleges have established increasing the number of students who transfer to UH 4‐year institutions as a number of students who transfer to UH 4‐year institutions as a priority. priority.

Beginning with the baseline of 2006, General Pre Professional Beginning with the baseline of 2006, General Pre Professional programs are expected to increase the number of students who programs are expected to increase the number of students who transfer by 3% compounded annually. transfer by 3% compounded annually.

The number in 20c reflects the goal for the appropriate year.The number in 20c reflects the goal for the appropriate year.

Source: UHCC Strategic Plan 2.4. Subset of all transfers, filtering for Source: UHCC Strategic Plan 2.4. Subset of all transfers, filtering for specific program.specific program.

4545

#20d#20d Difference Between Transfers and GoalDifference Between Transfers and Goal

The percent difference between the number of Transfers to UH 4‐The percent difference between the number of Transfers to UH 4‐year institutions (20) and the goal (#20c).year institutions (20) and the goal (#20c).

General Pre Professional Programs are expected to increase General Pre Professional Programs are expected to increase transfers to UH 4‐year institutions by 3% compounded annually.transfers to UH 4‐year institutions by 3% compounded annually.

Example: The program’s goal is 60 (20c). The actual number of Example: The program’s goal is 60 (20c). The actual number of transfers (20) is 96, 36 transfers more than their goal. transfers (20) is 96, 36 transfers more than their goal.

36 is 60% greater than the goal.36 is 60% greater than the goal.

4646

Determination of program’s health based on Determination of program’s health based on effectivenesseffectiveness

4747



Liberal Arts Health Call Scoring Rubric

Determination of program’s Determination of program’s overalloverall health health

4848



Liberal Arts Health Call Scoring Rubric

#21#21 Number of Distance Education Classes TaughtNumber of Distance Education Classes Taught

Measures the number of classes taught with the mode of delivery as Measures the number of classes taught with the mode of delivery as “Distance Completely Online.”“Distance Completely Online.”

In setting up the class, the college indicates the method of In setting up the class, the college indicates the method of instruction used by the instructor in conducting the class. instruction used by the instructor in conducting the class.

If the method is Distance Education, and the college indicates the If the method is Distance Education, and the college indicates the “mode” of distance delivery as “Distance Completely Online” the “mode” of distance delivery as “Distance Completely Online” the class will be included in this count.class will be included in this count.

4949

#22#22 Enrollment Distance Education ClassesEnrollment Distance Education Classes

At the Fall and Spring census, the number of students actively At the Fall and Spring census, the number of students actively enrolled in all classes owned by the program and identified as enrolled in all classes owned by the program and identified as Distance Completely On‐Line (#21).Distance Completely On‐Line (#21).

Does not include students who at Census have already withdrawn Does not include students who at Census have already withdrawn from the class.from the class.

5050

#23#23 (DE) Fill Rate(DE) Fill Rate

Total active student registrations in program distance education Total active student registrations in program distance education classes (#21) (number of seats filled) at Fall and Spring census classes (#21) (number of seats filled) at Fall and Spring census divided by the maximum enrollment (number of seats offered). divided by the maximum enrollment (number of seats offered).

Does not include students who at Census have already withdrawn Does not include students who at Census have already withdrawn from the class.from the class.

5151

#24#24 (DE) Successful Completion (Equivalent C or higher)(DE) Successful Completion (Equivalent C or higher)

Percentage of students enrolled in program Distance Education Percentage of students enrolled in program Distance Education classes (#22) at Fall and Spring census who at end of semester classes (#22) at Fall and Spring census who at end of semester have earned a grade equivalent to C or higher.have earned a grade equivalent to C or higher.

5252

#25#25 (DE) Withdrawals (Grade=W)(DE) Withdrawals (Grade=W)

Number of students actively enrolled in program Distance Education Number of students actively enrolled in program Distance Education classes (#22) at Fall and Spring census who at end of semester classes (#22) at Fall and Spring census who at end of semester have a grade of W.have a grade of W.

5353

#26#26 Persistence (Fall to Spring not limited to Distance Ed)Persistence (Fall to Spring not limited to Distance Ed)

Students enrolled in program distance education classes at Fall census Students enrolled in program distance education classes at Fall census (#22) who at subsequent Spring semester census are enrolled in the (#22) who at subsequent Spring semester census are enrolled in the college.college.

Not limited to students continuing to take program distance education Not limited to students continuing to take program distance education classes.classes.

Example: Example: 31 majors enrolled in DE classes in Fall31 majors enrolled in DE classes in Fall

21 majors of the original 31 majors persist into any Spring class21 majors of the original 31 majors persist into any Spring class21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

5454

Comprehensive & Annual Unit Review TimelineComprehensive & Annual Unit Review Timeline

Develop training materials for all LA, Instruction, and Units

Provide Annual Program Review Training to Campus

Package and Delivery of all Program & Unit Reviews to System Office

Publish all Program & Unit Reviews to Assessment Website

All program and unit reviews (Comprehensive and Annual) due to Interim VCAA or UHCC ARPD website by EOB Friday November 18th.

Collect and deliver needed data to Student Support Services

Build out 2011 program review page on the assessment website and publish all updated materials

Plan this year’s program review based on suggested improvements from last year’s review

Review and edit all PR (not CERC) documentation

Develop and administer PR Process Improvement Sessions (questionnaire, schedule meetings, collect feedback)

Work with AC and Interim VCAA to determine what feedback needs to be taken back to UHCC IPRC

Schedule Training for all LA, Instruction, and Units

Sept 22nd

Dec 15th

Oct

Sept-OctJan 27th

Dec 20th

Jan 25th

Sept Sept - Oct

Sept Nov 18Oct

5555

Collect and deliver needed data to Academic Support Services

Oct

Summarize PR Process Improvement Feedback, communicate results to groups, publish to web.

Jan 5th

AY 2011 Comprehensive & Annual LA Review ProcessAY 2011 Comprehensive & Annual LA Review Process

Step 1Step 1 Write your program review using the appropriate template or Write your program review using the appropriate template or online submission.online submission.

Step 2Step 2 Send yourSend your documents documents (one Word document per review) (one Word document per review) to to Interim VCAA Joni Onishi by email no later than end of Interim VCAA Joni Onishi by email no later than end of business, Friday November 18th, 2011. business, Friday November 18th, 2011.

Step 3Step 3 Interim VCAA will ensure that all required documents Interim VCAA will ensure that all required documents have been received and that they are adequate.have been received and that they are adequate.

Step 4Step 4 Interim VCAA will forward all approved reviews to the Interim VCAA will forward all approved reviews to the Institutional Research Office for further processing.Institutional Research Office for further processing.

Step 5Step 5 The Annual reviews will be sent to the System Office for review The Annual reviews will be sent to the System Office for review by the UH Board of Regents. Comprehensive reviews will be by the UH Board of Regents. Comprehensive reviews will be forwarded along as appropriate following CERC guidelines.forwarded along as appropriate following CERC guidelines.

Step 6Step 6 All reviews will finally be converted to PDF and posted All reviews will finally be converted to PDF and posted to the Assessment Web Site.to the Assessment Web Site.

5656

Questions?Questions?The intention of this presentation was to provide a single source for all of the The intention of this presentation was to provide a single source for all of the documentation related to the Comprehensive & Annual Unit Review documentation related to the Comprehensive & Annual Unit Review process. I have linked all of the documents you should need directly into process. I have linked all of the documents you should need directly into this presentation.this presentation.

If you need more information on this process please feel free to contact me:If you need more information on this process please feel free to contact me:

Shawn FloodShawn Flood 934-2648934-2648

Mahalo!Mahalo!

5757

CERC Comprehensive Instructional CERC Comprehensive Instructional Review Template & ProcessReview Template & Process

Mary will now discuss the comprehensive program review template, and briefly Mary will now discuss the comprehensive program review template, and briefly review the current CERC process.review the current CERC process.

Comprehensive Instruction Program Review Template

If you need assistance contact me:If you need assistance contact me:

Mary Goya, ProfessorMary Goya, ProfessorEarly Childhood EducationEarly Childhood EducationAssessment Coordinator (part time)Assessment Coordinator (part time)

Email: [email protected] (Email is best)Email: [email protected] (Email is best)

Phone: 934-2629Phone: 934-2629Mahalo!Mahalo!

5858

ay 2011 lbrt instructional program review process

Documents