faculty development day september 1, 2010
DESCRIPTION
Student Learning Outcomes: Writing Good Objectives, Gathering Good Evidence, Preparing for the Accreditation Visit. Faculty Development Day September 1, 2010. “ A University should be a place of light, of liberty, and of learning.” Benjamin Disraeli. Outline. - PowerPoint PPT PresentationTRANSCRIPT
Student Learning Outcomes:Writing Good Objectives,
Gathering Good Evidence,Preparing for the Accreditation Visit
Faculty Development DaySeptember 1, 2010
“A University should be a place
of light, of liberty,
and of learning.”
Benjamin Disraeli
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Outline
•Ice Breaker: Who’s in the room?•Student Learning at Gustavus
(What matters most?)•Student Learning Outcomes (What do we want our students to learn?)•Evidence and Assessment of Student Learning (How do we know if our students have learned?)•Accreditation and Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Who’s in the room?What is your academic division?
1 2 3 4 5
20% 20% 20%20%20%
1.Fine Arts2.Humanities3.Natural Sci/Math4.Social Sciences5.Education/Nursing
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Who’s in the room? (part 2)What is your academic rank?
1 2 3 4
25% 25%25%25%
1. Instructor2. Assistant Professor3. Associate Professor4. Professor
Student Learning Outcomes
What matters MOST to you about student learning at
Gustavus?
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
The Big Picture: Who Contributes to Student Learning?
Learning
Faculty
Tutors
Lab Assistants
Resource Staff
Coaches
Music Directors
Chaplains
Advisors
Residential LifeStaff
Support staff
Peers
Student Activities
Staff
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
STUDENT LEARNINGOUTCOMES
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
At the completion of this session, participants will:•Define “student learning outcome”.•Recognize student learning outcome statements.•Translate knowledge, skills, abilities, and dispositions into student learning outcomes.•Distinguish between student learning goal and student learning outcome.•Justify the role of student learning outcomes throughout the institution.•Formulate student learning outcomes for their program or courses.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
“Learning outcomes are statements describing our
intentions about what students should know,
understand, and be able to do with their
knowledge when they have graduated.”
Huba, M. E. & Freed, J. E. (2000). Learner-centered assessment
on college campuses: Shifting the focus from teaching to
learning. Boston: Allyn & Bacon.
Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Making connections throughout the institution
Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Gustavus has clearly articulated learning outcomes at the institutional level.
1 2 3 4 5
20% 20% 20%20%20%
1.Strongly Agree2.Agree3.Neutral4.Disagree5.Strongly Disagree
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
My department has clearly articulated learning outcomes at the program level.
1 2 3 4 5
20% 20% 20%20%20%
1.Strongly Agree2.Agree3.Neutral4.Disagree5.Strongly Disagree
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
I clearly articulate learning outcomes in my courses (on my syllabus).
1 2 3 4 5
20% 20% 20%20%20%
1.Strongly Agree2.Agree3.Neutral4.Disagree5.Strongly Disagree
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Of what value are clearly articulated Student Learning Outcomes?
•Provide direction for our instruction•Inform students about our intentions and expectations•Focus on lasting results•Form a basis for our assessment
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
What is the difference between a learning goal and a learning outcome?
Goal: “broad and long-term descriptions of
learning expectations”
Learning Outcome: “specific descriptions of
expectations that…learners can demonstrate when
they complete a course, program, or
baccalaureate degree”
Driscoll, A., & Wood, S. (2007) Developing Outcomes-Based
Assessment for Learner-centered Education. Sterling, VA:
Stylus.
Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Goals and Outcomes
Goal
Outcome Outcome Outcome Outcome
Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Goals and Outcomes
GOALS• Broad• General• Abstract• Not easily
validated
Student Learning Outcomes
OUTCOMES• Narrow• Precise• Concrete• Can be validated
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Example: Dental Health 101
GOAL:
Understands proper
dental hygiene
Student Learning Outcomes
OUTCOMES
Outcome 1: Identify the
active ingredient in
toothpaste
Outcome 2: Explain why
teeth should be cleaned
twice a year
Outcome 3: Describe how poor
dental hygiene can lead to
poor overall health
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Student Learning Outcomes
Students will ( or will be able to):
<<action verb>>
<<learning object>>
by <<criterion>>.
Student Learning Outcomes
Hatfield, S. “Going Rogue: What No One is Telling You About Assessment,” The Higher Learning Commission Annual Meeting, Chicago, IL. April 2010.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Student Learning Outcomes: Examples
Journalism:Write a news story in the proper inverted pyramid format. Machine Technology:Demonstrate basic shop safety and safe attitudes in all class activities.Graphic Arts:Create visual sketches of a variety of fundamental graphic imaging techniques.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Student Learning Outcomes
•Learner-centered•Specific•Action oriented•Cognitively appropriate for the program level•Measurable
Student Learning Outcomes
Hatfield, S. “Going Rogue: What No One is Telling You About Assessment,” The Higher Learning Commission Annual Meeting, Chicago, IL. April 2010.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Levels of the Cognitive Domain
Evaluation
Synthesis
Analysis
Application
Comprehension
Knowledge
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Levels of Cognitive Domain
• Remember or recall informationLevel 1: Knowledge
• Understanding informationLevel 2: Comprehension
• Use ideas, concepts, and actions to solve problemsLevel 3: Application
• Use critical thinkingLevel 4: Analysis
• Put together the parts to form something newLevel 5: Synthesis
• Make judgments based on evidence or defined criteriaLevel 6: Evaluation
Driscoll, A., & Wood, S. (2007) Developing Outcomes-Based
Assessment for Learner-centered Education. Sterling, VA: Stylus.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Verbs associated with each level of the cognitive domain:• ask, define, draw, fill in, identify, label, list, listen, match,
memorize, name, observe, recall, record, recite, repeat, select
Level 1: Knowledge
• defend, describe, discuss, distinguish, document, explain, estimate, express, generalize, identify, locate,
paraphrase, recognize, report, restate, review, tellLevel 2: Comprehension
• change, classify, compute, construct, dramatize, draw, demonstrate, employ, illustrate, interpret, manipulate,
operate, sequence, show, solve, test, translate, use, writeLevel 3: Application
• appraise, calculate, categorize, contrast, debate, defend, diagrams, differentiate, dissect, distinguish, experiment,
inventory, map, relate, solve, subdivide, survey, testLevel 4:Analysis
• appraise, compare, conclude, contract, criticize, decide, discriminate, justify, rate, recommend, select, state,
summarize, supportLevel 5:
Synthesis• assemble, compose, construct, create, design, formulate,
hypothesize, invent, manage, organize, plan, prepare, produce, propose, set up, speculate
Level 6: EvaluationDriscoll, A., & Wood, S. (2007) Developing Outcomes-
Based Assessment for Learner-centered Education. Sterling,
VA: Stylus.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Student Learning Outcomes
Course Outcomes• Realistic, measurable• Relate to program outcomes
• Connect courses to one another systematically
• Build upon each other to create an integrated whole
Program Outcomes• Critical, broad• Knowledge and skills develop
over time in increasing sophistication
• Integrate skills and knowledge
• Describe what all students will be able to do at completion
Pagano, N. “Defining and Assessing Program Outcomes,” The Higher Learning Commission Assessment Workshop, Lisle, IL. 22 July, 2010.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Defining Student Learning Outcomes
Initial question:
What knowledge, skills, abilities, and dispositions should the ideal student (graduating from our program or completing this course) demonstrate?
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Defining Student Learning Outcomes: Starting points
•Gustavus mission statement and core values•Departmental or Program mission statement•Professional and Disciplinary Associations•Colleges and Universities•Community members (alumni, employers)•Faculty•Students
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Defining Student Learning Outcomes Activity
The College of Lake Wobegon“where all the students are above average”
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Defining Student Learning Outcomes Activity
•Learner-centered•Specific•Action oriented•Cognitively appropriate for the program level•Measurable
Student Learning Outcomes
Hatfield, S. “Going Rogue: What No One is Telling You About Assessment,” The Higher Learning Commission Annual Meeting, Chicago, IL. April 2010.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
My department has clearly articulated learning outcomes at the program level.
1 2 3 4 5
20% 20% 20%20%20%
1.Strongly Agree2.Agree3.Neutral4.Disagree5.Strongly Disagree
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
I clearly articulate learning outcomes in my courses (on my syllabus).
1 2 3 4 5
20% 20% 20%20%20%
1.Strongly Agree2.Agree3.Neutral4.Disagree5.Strongly Disagree
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
At the completion of this session, participants will:•Define “student learning outcome”.•Recognize student learning outcome statements.•Translate knowledge, skills, abilities, and dispositions into student learning outcomes.•Distinguish between student learning goal and student learning outcome.•Justify the role of student learning outcomes throughout the institution.•Formulate student learning outcomes for their program or courses.
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Evidence and Assessment of Student Learning
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Assessment Cycle (Spiral)
Mission
adapted from Assessing for Learning (2004) by Peggy L. Maki
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Examples of Evidence of Student Learning
Direct
Performance-Based• Assignments• Projects• Portfolios• Papers
PerceptionsExams and Tests
• Standardized exams• Local exams• Licensure exams
Indirect
Surveys• National surveys• Local surveys• Program/dept surveys
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Accreditation and Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
The Higher Learning Commission Criteria for Accreditation
Criterion One: Mission and Integrity
Criterion Two: Preparing for the Future
Criterion Three: Student Learning and Effective
Teaching
Criterion Four: Acquisition, Discovery, and
Application of Knowledge
Criterion Five: Engagement and Service
SLIDE CATEGORY TITLE
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Criterion Three Statement: The organization provides evidence of student learning and teaching effectiveness that demonstrates it is fulfilling its institutional mission.
Core Component 3a. The organization’s goals for student learning outcomes are clearly stated for each educational program and make effective assessment possible.
The Higher Learning Commission Criteria for AccreditationAddressing Student Learning Outcomes
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
Student Learning Outcomes
What do we want our students to learn?
How do we know if our students are learning (what we want them to learn)?
That’s what it’s all about!!
GUSTAVUS ADOLPHUS COLLEGE gustavus.edu
STUDENT LEARNING OUTCOMES
A little learning is a dangerous thing;Drink deep, or taste not the Pierian
spring:There shallow draughts intoxicate the
brain,And drinking largely sobers us again.
Alexander Pope, An Essay on Criticism (1711)