dr abdul sattar al-alusi, phd previous director, peqa dean, cmis and prof shaker rizk, phd program...

Dr Abdul Sattar Al-Alusi, PhDDr Abdul Sattar Al-Alusi, PhDPrevious Director, PEQAPrevious Director, PEQA

Dean, CMISDean, CMIS

andand

Prof Shaker Rizk, PhDProf Shaker Rizk, PhD

Program Director, ELT ProgramProgram Director, ELT Program

ITTIHAD UNIVERSITY, Ras Al-Khaimah, UAEITTIHAD UNIVERSITY, Ras Al-Khaimah, UAE

A Continuous Improvement Cycle for Academic Programs: Ittihad University

Case

A Continuous Improvement Cycle for Academic Programs: Ittihad University Case

PA

ExternalInternal

IE

Mission

QA

Instruction

curriculum

Students

Employers

Alumni

Ed. & Admin. Support Service

Courses

Training

Inte

rnat

iona

l

Peer Review System

Min

istr

y /C

AA

Goals & Objectives

Instruments

Faculty

Outcomes


Phases/Purposes

Phase one

mapping measurable objectives, outcomes

Phase two

program effectiveness - feedback surveys.

Phase three

program continuous improvement


ModelsA blend of models used for PA has been adopted in light of the needs of each

phase. The eclectic model adopted by IU has comprised three major models; namely,

1. The objective/outcome-based model (comparing CAA standards with existing procedures),

2. The decision-making model (focusing on accountability to reallocate resources or decide the continuation of a program), and

3. The responsive model (focusing on learner-based and market-based concerns).


Phases of Program Assessment


Phases Purposes Models Analysis Results

Phase One

• curricula comprehensive Evaluation

• program evaluation against CAA standards and criteria

objective/outcome-based model

SWOTHolistic

Initial Accreditation

Phase Two

• reflecting IU aspirations, accountability

• addressing quality, validity & productivity in teaching and learning,

the decision-making model

Selecting Evaluators /Assessors (team leaders & members)

Full Academic Accreditation

Phase Three

informing decision-makers the responsive model

Self studyReports

Strategic Planning College/University

Improved programs, preparation for reaccreditation, &initiation on new programs


1. screening method (annual review of program against basic metrics)

2. cyclical review ( 4-year review cycle) for all programs by all colleges

3. divisional model (select divisions: faculty or administrative)

faculty-led (Faculty Committees)

administration-led (Institutional Research Office)

IU has adopted an eclectic method in assessing its programs utilizing one or all of the following methods:


Steps and processes to conduct the PA

1. Develop mission and program objectives.2. Develop Program Outcomes. 3. Devise quantitative metrics for measuring.4. Use tools and processes to gather data.5. Modify program aspects in light of mission & objectives6. Conduct SWOT analysis.

Phase One: Comprehensive Curriculum Assessment

The PA Plan includes assessing the following:

1. Academic Program 2. Educational & Administrative Support Services


Table 1: Assessment Instruments Evaluating Program Outcomes

S Items Assessed Target Assessment Instruments Administered By When Administered

1 Program Outcomes specific to course

Faculty Members

Course File (End-of-course

self-evaluation by faculty member)

Department Ongoing every semester

2 Program

OutcomesGraduates Alumni Survey Department

June, one year after graduating the first batch,

then every 5 years

3 Program

OutcomesEmployers Employers' Survey

Counseling & Career Development

Administration

June, one year after graduating the first batch,

then every 3 years.

4 Program Graduating

StudentsExit Survey Department End of every semester

5 Teaching StudentsCourse & Teaching

Evaluation QuestionnaireInstitutional Research

(IR)Every semester a course is

taught

6 Training Program

StudentsTraining Program

Evaluation by Student Survey

Department Twice a year (January and

June)


Phase Two: Program Effectiveness & Improvement The PA Plan consists of:

Mapping Matrices to evaluate course & program effectiveness using:

program objectives and outcomes, course outcomes, assessment instruments

A three-level approach that includes: Course Assessment Curriculum Assessment Program outcomes Assessment

Educational & Administrative Support Services Assessment


The Assessment Tools used for Educational and Administrative Units/Services are shown in the following table:

Table 2: Assessment Instruments for Educational Support Services

S Items Assessed Target Assessment Instruments Administered By When Administered

1 Advising StudentsAcademic Advising

Survey Department May, annually

2 Educational Support Services

StudentsEducational Support

Services SurveyInstitutional Research

(IR)May, annually

3 Administrative Support

Unit’s Administrator

Unit Annual ReportInstitutional Research

(IR)June, annually

4 Students' Affairs Services

studentsStudents Affairs Evaluation Survey

Students Affairs in coordination with IR

May, annually

5Counseling and Career Services

studentsCounseling and Career Evaluation Survey

Counseling & Career Development Administration in coordination with IR

May, annually

6Residence/ hostel Services

Hostel Students

Student Residence Evaluation Survey

Student Affairs in coordination with IR

June, annually


Phase Three: Program Continuous Improvement & Change ‘Closing the Gap’

1. Gap ClosingUsing assessment results for closing the gap:

1. Revised/new objectives/outcomes for the next cycle2. Tasks to be completed3. Resource allocation (budget) 4. Goal attainment 5. Formulating a Continuous Improvement Strategy

2. Prospective Improvement Strategy


3. Monitoring & Auditing

The aims of monitoring are to ensure that:a) Academic programs have implemented PA Plansb) Educational & administrative support units have implemented plans &

submitted Annual Reports c) Colleges and support units have submitted annual future plans d) Academic programs have achieved outcomes and accomplished objectives e) Performance Indicators are trackedf) Assessment reports are sent back to the relevant program/unit for corrections,

clarifications and/or modificationsg) Performance results and learning outcomes are kept in records for future use


Auditing is mainly associated with;

a) Gaining information about the effectiveness system of the university.b) Evaluating to ascertain the validity and reliability of information.c) Providing assessment of IU internal control. d) Constructing a link between policy-making and operational levels. e) Setting objectives, providing advance notice of the audit, organizing meetings,

conducting fieldwork, responding to Final Audit Report.


Conclusion, Implications, and

Recommendations


THANK YOU


Program Curriculum – Objectives – Outcomes – Teaching and Learning Tools

Phase I (Before Graduation):

First (Fall) Semester:This phase of the program is assessed by using different instruments as listed below.

Assessment Instruments

Semester Course Midterm exam.Semester activities (Assignments/Projects/Class participation, etc.) Semester Course Final Exam.Semester Course & Teaching Evaluation by students.Semester Course Evaluation (Course File) by Faculty.Graduation Project Report if relevantExit SurveyOverall GPA

Phase II (Before Graduation):

Second (Spring) Semester:This phase of the Program is assessed by using the instruments below.

Assessment InstrumentsSemester course Midterm Exam.Semester activities (Assignments/Projects/Class Participation, etc.)Semester Course Final Exam.Semester Course & Teaching Evaluation by students.Semester Course Evaluation (Course File) by faculty.Training Program Reports.Graduation Project Report if relevant Exit Survey.Annual Education support Services Evaluation by Students Overall GPA

Analysis of Outcomes

Program Outcomes are measured and analyzed by a review team/committee of faculty members that is formed by the College Council. The aim of this team is to analyze the collected data through using those assessment tools mentioned in this plan. Such tools are as Course Evaluation by Faculty, Employers' Survey, Alumni Survey, Exit Survey, Training Program Repots, direct observation reports by academic advisors, holistic review report, etc. The results of this analysis are reported to the College Council with a set of recommendations regarding the Business Administration curriculum. These recommendations are to be taken into account in the following academic year.

Phase III (After Graduation):

Graduates are followed up to find out job placement rate, postgraduate studies, professional achievements at work, professional test (if any), employers points of view, and feedback from external sources regarding the Business Administration graduates' performance in the market. This phase is assessed by using the instruments below.

Assessment Instruments-Employers' Survey-Alumni Survey-College Council inputs / feedback-External feedback-Holistic Review -Internal & external Report.

GraduationCareer

BACK


Figure -2 Curriculum Assessment Flowcharts

Curriculum, Outcomes, Objectives, Accreditation Standards

Students, Alumni, Business Community (Employers)

University & College Requirements Courses

ProgramFaculty Members

(Curriculum committee)

College Council

University-wide Curriculum Committee

Common Courses with other programs(Faculty Members)

BACK


Annual Plans:1. College/Program Plans2 . Administrative/ ٍ/ Services Units Plans

Annual Plans:1. College/Program Plans2 . Administrative/ ٍ/ Services Units Plans

University

Annual Plan

University

Annual Plan

PLANNINGPLANNING

University

Council

University

Council

Corrective Actions/Decisions

Corrective Actions/Decisions

ChancellorChancellor

University Overall Annual Report

Institutional Research Office (PEQA)

(Auditing /Monitoring)

Institutional Research Office (PEQA)

(Auditing /Monitoring)

ITTIHAD UNIVERSITY EFFECTIVENESS SYSTEM (IUES)(University Mission, Goals, and Objectives)

ACADEMICPROGRAM

ASSESSMENT

ACADEMICPROGRAM

ASSESSMENT

EDUCATIONAL, ADMINISTRATIVE, & SUPPORT SERVICES/ UNITS SSESSMENT

EDUCATIONAL, ADMINISTRATIVE, & SUPPORT SERVICES/ UNITS SSESSMENT

Employers’ Survey

Employers’ Survey

Exit /Graduating Survey

Exit /Graduating Survey

Alumni SurveyAlumni Survey

Training Evaluation survey

Training Evaluation survey

Academic Advising Survey

Academic Advising Survey

Course Assessment Curriculum Assessment Report

Course Assessment Curriculum Assessment Report

Course File Report (CFR)

Course File Report (CFR)

Faculty EvaluationFaculty Evaluation

Course & Teaching SurveyCourse & Teaching SurveyEdu. Support

Services SurveyEdu. Support Services Survey

Counselling & Career SurveyCounselling & Career Survey

Unit Annual Reports(Administrative Units/Services Reports)

Unit Annual Reports(Administrative Units/Services Reports)

Residence SurveyResidence Survey

Students' Activities SurveyStudents' Activities Survey

Staff Evaluation

Staff Evaluation

Faculty/Staff Job Satisfaction Faculty/Staff Job Satisfaction

Program Annual Assessment

ReportCollege Annual

Report

back

Source; Al-Alusi, 2008

BACK2


Use of the Assessment Results: Institutional Research Monograph Series/Evaluation Reports

(CLOSING THE GAP)oFor continuous improvement?oRevised/new objectives/outcomes for next cycleoTasks to be completedoResource allocation (budget) oGoal attainment? Based on the findings what is the continuous improvement plan?oImprovement Strategy: What are the proposed changes (with justification) made to the program/service as a result of data collection and analysis?o List the required resources for this improvement strategy.

Use of the Assessment Results: Institutional Research Monograph Series/Evaluation Reports

(CLOSING THE GAP)oFor continuous improvement?oRevised/new objectives/outcomes for next cycleoTasks to be completedoResource allocation (budget) oGoal attainment? Based on the findings what is the continuous improvement plan?oImprovement Strategy: What are the proposed changes (with justification) made to the program/service as a result of data collection and analysis?o List the required resources for this improvement strategy.

Assessm

ent C

ycle

Program’s /Unit’s measurable Objectives/ Outcomes: Student Learning Outcomes

Assessment Results: Measurable Goals vs assessment findings

Criteria for Assessment: Success

Method(s) of Assessment, timeframe, and resources needed

Ittihad University Mission

Planning: University Goals from the Strategic Plan

Program’s /Unit’s Mission

Source; Al-Alusi, 2008

dr abdul sattar al-alusi, phd previous director, peqa dean, cmis and prof shaker rizk, phd program...

Documents