dr. geri cochran director, institutional research, assessment and planning
TRANSCRIPT
AssessmentDr. Geri Cochran
Director, Institutional Research, Assessment and Planning
It’s all about what is important to you
◦ Identifying what is important, the values that guide what you are doing.
◦ Using those values as a basis for evaluating what you are doing
◦ Taking what you have learned from that evaluation to improve what you are doing in order to better achieve your values
Program Assessment
Program assessment is a form of evaluation by which participants in a program judge its effectiveness in achieving their values and use what they have learned to improve the program’s effectiveness in achieving those values.
Program Assessment?
PremiseAssessment is linked directly to value
Propositions1. What we assess indicates what we value2. What we value should guide what we
assess
Assessment and Value
A form of evaluation in which the values of the participants’ in a program are made explicit expectations for what should “come out” of their actions and those actions are evaluated according to the extent to which the actions achieve the expected outcomes.
Program Outcomes Assessment?
ImprovingPrograms
Outcomes Assessment
ProgramOutcomes
Program Criteria
Program Values
Focusing on the value of education shifts our attention from inputs to outcomes
What “comes out” of an educational experience must be directly or indirectly observable to be assessed.
Program assessment belongs to the program; the purpose of outcomes assessment is to improve programs by encouraging evidence-based decision-making by people in the program
Shift in Thinking
Professional Readiness:Ability to work in the professional
environment Ability to create a compelling portfolio
to profile themselves for industry opportunities.
Time management and ability to produce quality work in a specified time frame
Ability to work within industry protocols to develop and execute projects
Outcomes for D&P (BFA)
Professional Communication: Ability to use the language specific to the
area of design production or management used by working professionals.
Ability to use artistic vocabulary for collaboration
Ability to communicate ideas both verbally and through presentational material
Creative Collaboration: Ability to work effectively with a team on
projects. Ability to respect working relationships Follow set protocols according to industry
standards.
Finance & Budgeting: Ability to manage resources - time, materials,
personnel, and facilities Problem-Solving: Ability to combine research and resources in
solving production problems Ability to problem-solve within resource constraints Specialty Skills: According to their specialty, ability to apply
technical and artistic skills to elevate the effectiveness of the finished work.
What evidence should be gathered for assessing outcomes?
Evaluating Outcomes
What are the sources of the evidence for the outcomes?
How often is the evidence to be collected?
Relatively direct (SACS preferred)◦ Writing assignments◦ Oral presentations◦ Design projects◦ Artistic compositions◦ Essay exams
Two General Types of Evidence
Relatively indirect ◦ Surveys◦ Internship reports◦ Employer Surveys
Evidence should be meaningful information that is appropriate for assessing a particular outcome.
Two Standards for Evidence
Evidence should be manageable: reasonable to attain and evaluate (time, effort, availability)
List of Outcomes Evidence to be collected Source of evidence Frequency of collection of evidence
Elements of an Assessment Plan
Outcomes Evidence Source Frequency
Ability to work in a professional environment
Production evaluations, internship reports
Students, faculty, professional in the field
Semester & Annually
Ability to create a compelling portfolio
Selection of work in portfolio, sample of designs, etc
Students Annually
Partial Assessment Plan
Is the evidence specific enough in describing the form of the evidence and venue for collection?
Evaluating the Assessment Plan
Does the plan rely mainly on direct evidence?
Is the evidence meaningful for the particular outcome?
Is the evidence manageable (reasonable to collect and evaluate)?
ImprovingPrograms
Assessment Cycle
ProgramOutcomes
Program Criteria
Program Values
Goal of Assessment
Goal: To use the evidence as a basis for judging the extent to which the program is meeting the members’ values for the program.
Goal: To apply what has been learned in evaluating the program toward identifying actions to address areas of concern
Improvement of Program
As a result of your assessment, what changes if any, have you implemented to address areas of concern (in the program or in the assessment of the program)?
Reporting the Results
What outcomes are you planning to assess for the next reporting cycle?
The Cycle continues
How can I help?
Geri Cochran
As always…