data-informed faculty development planning howard community college august 17, 2012 shelley a....
TRANSCRIPT
Data-Informed Faculty Development Planning
Howard Community College August 17, 2012
Shelley A. Chapman, PhD
Plan for this Session
Using IDEA to helpOIndividual Faculty OGroups of Faculty
Reflective Practice using Individual Reports
Collect Feedback
Interpret Results
Read & Learn
Reflect & Discuss
Improve
Help them use IDEA resources that are keyed to reports
Invite Conversations
Suggest new ideas to try
Help them usethe FIF well
Help them interpret Individual reports
Recommended:Diagnostic Form
O More data O Specific
suggested action steps based on research
O IDEA resources (no cost) are keyed to reports
I. Individual Faculty
1. Individual Consultations
O Faculty Information Form
O How to select objectives
O Adjusted and Converted scores
O Suggested Actions
2. Help them Learn How to Log their Results on the Faculty Worksheet
Reflective Practice using Individual Reports
Collect Feedback
Interpret Results
Read & Learn
Reflect & Discuss
Improve
Help them use IDEA resources that are keyed to reports
Invite Conversations
Suggest new ideas to try
Help them usethe FIF well
Help them interpret Individual reports
Suggested Action Steps from Page 3
#16#18#19
3. Help FacultyMake Connections to Free Resources that may help them Improve
POD-IDEA Notes
OBackgroundOHelpful HintsOAssessment OReferences and
Resources
Reflective Practice using Individual Reports
Collect Feedback
Interpret Results
Read & Learn
Reflect & Discuss
Improve
Help them use IDEA resources that are keyed to reports
Invite Conversations
Suggest new ideas to try
Help them usethe FIF well
Help them interpret Individual reports
4. Encourage “Conversations” about IDEA
O Coffee and ConversationsO Paired DiscussionsO Classroom “Visitations”O Brown Bag Lunch/Supper
ConversationsO Testimonials at End-of-year Faculty
Meetings
Encourage the Use of the IDEA Help Community
Search for informationAsk specific questionsTalk to other clients who use IDEAShare ideas about how to use IDEA
II. Groups of Faculty
1. Workshops (Sample Topics)O Incorporating IDEA into a SyllabusO How to Select “Important” or “Essential”
ObjectivesO Encouraging High Response RatesO Interpreting Reports (Adjusted &
Converted Scores, Contextual data, etc.)O How to get better ratings: Focus on
learningO How to use POD IDEA Center Notes
2. Use IDEA for feedback on Faculty Development “Courses”
O Example: Faculty Summer Institute at PLNU
Using IDEA for Faculty Development at
Point Loma Nazarene University
tile
Using IDEA for Faculty Development at Point Loma Nazarene University
Integrating IDEA with the TILE Program
tile
Model the Good Use of IDEAOConsult IDEA research for
planning TILE activitiesOCorrelation Studies
ORelationship between Methods and Learning Objectives
ORelationship between Methods and Global Items (Excellence of Course and Excellence of Teacher)tile
Relationship of Teaching Methods to Learning Objectives
Click icon to add picture
Use Proactively to Plan Faculty
Development Learning Activities
tile
Relationship of Teaching Methods
to Global Items
Use Proactively to Plan Faculty
Development Learning Activities
tile
Learning ObjectivesOHow to select “important” or
“essential” IDEA objectives related to the courseO Use the Teaching Goals Inventory to help select
objectives: Use the Three Guiding QuestionsO Is this a significant part of the course?O Do you do something specific to help students
accomplish this objective?O Is progress on it part of their grade? tile
Incorporating IDEA into Syllabus
O Show examples of how faculty put IDEA Objectives in their syllabi with their specific course objectives.Example: My three objectives are for you to 1. learn to analyze and critically evaluate ideas,
arguments, and points of view. O • To do this, you will be reading and critiquing scholarly
articles and participating in class discussions.
2. develop skill in expressing yourself in writing. O • To do this, you will propose a written research project
in APA format.
3. learn how to find and use resources. O • To do this, you will use scholarly books and articles for
your research proposal.
tile
Bloom’s Taxonomy and IDEA
BLOOM’S TAXONOMYIDEA OBJECTIVES
1. Gaining factual knowledge
2. Principles, generalizations, theories
3. Application for improved thinking
4. This profession’s points of view, skills
5. Team skills
6. Creative capacities
7. Broad , liberal education
8. Expressiveness (written and oral)
9. Find & use resources
10. Personal values
11. Analyze and critically evaluate ideas
12. Learn more by asking questions
1
2, 7
3, 8, 9
10, 11
10, 11
6
Average Ratings for ObjectivesIDEA OBJECTIVES
1. Gaining factual knowledge
2. Principles, generalizations, theories
3. Application for improved thinking
4. This profession’s points of view, skills
5. Team skills
6. Creative capacities
7. Broad , liberal education
8. Expressiveness (written and oral)
9. Find & use resources
10. Personal values
11. Analyze and critically evaluate ideas
12. Learn more by asking questions
Objective # Average Rating
1 4.0
2 3.9
3 4.0
4 4.0
5 3.9
6 3.9
7 3.7
8 3.8
9 3.7
10 3.8
11 3.8
12 3.8
Week 3: CATs and Midterm Feedback
O Think about your IDEA objectives and create a midterm evaluation just for yourself.
O Ask questions that get at whether they feel they are making progress on the types of objectives you said are relevant.
tile
IDEA Response RatesO Talk about ways to boost response rates:
O Can’t “set it and forget it”O Create a culture of reflective practice
O Show sample reportO Put objectives is syllabusO Talk about how you use student feedbackO Explain its reciprocal value
tile
End-of-TILE Assessment
O Administer the Diagnostic Form to participants
O Instructors use the FIF in a way to assess team teaching
tile
3. Using IDEA in a Curriculum Caucus
General Education
Howard Community CollegeGeneral Educatino
Possible IDEA Learning Objectives1
English 121: Composition 8, 9
Biology 101: General Biology 1, 2
Math 108: Business Math 1, 2, 5
Art History 104: Art History 1 6, 4, 1, 2
History 121: The Ancient World 1, 11, 8
Psychology 101: General Psychology
1, 2, 3,
Anthropology 110: Global Archeology
7, 10,12
1Based partly on study of percent of classes selecting objectives by discipline
What learning are we targeting?
Name of Course 1 2 3 4 5 6 7 8 9 10 11 12
English 121: Composition
X X X X
Biology 101: General Biology
X X X X
Math 108: Business Math
X X X
Art History 104: Art History 1
X X
History 121: The Ancient World
X X X X
Psychology 101: General Psychology
X X X
Anthropology 110: Global Archeology
X X X
IDEA Learning Objectives
What learning are we targeting?
Name of Course 1 2 3 4 5 6 7 8 9 10 11 12
English 121: Composition
X X X X
Biology 101: General Biology
X X X X
Math 108: Business Math
X X X
Art History 104: Art History 1
X X
History 121: The Ancient World
X X X X
Psychology 101: General Psychology
X X X
Anthropology 110: Global Archeology
X X X
IDEA Learning Objectives
Using GSRs to Analyze Targeted Learning
Page 2
Percent of Classes Selecting Obj. as Important or Essential
This Group Institution IDEASystem
Objective 1 16% 70% 78%
Objective 2 13% 59% 75%
Objective 3 41% 58% 75%
Objective 4 32% 35% 55%
Objective 5 23% 19% 32%
Objective 6 32% 14% 25%
Objective 7 22% 27% 27%
Objective 8 78% 43% 47%
Objective 9 19% 23% 41%
Objective 10 7% 11% 23%
Objective 11 68% 42% 49%
Objective 12 20% 23% 41%
Average # of Obj. Selected
3.7 4.2 5.7
How do students rate their learning?GSR page 3
Do Students’ report of learning meet our expectations?
GSR,Pages 5 and 6
Raw Average
Adj.Average
# ofClasses
ThisReport
3.9 3.9 11
Institution
4.2 4.2 3,963
IDEA System
4.0 4.0 31,991
Objective 1: Gaining factual knowledge (terminology, classifications, methods, trends)
IDEA System
Institution
This report
0 10 20 30 40 50 60 70 80 90100
At least 4.0
Which Teaching Methods Should We Target for Improvement?
% of Classes Where Method was “Infrequently” Used
Teaching Method 10
Teaching Method 6
0 10 20 30 40 50 60
Frequently
4. Use Data from IDEA to Target Specific Needs
Collect Feedback
Interpret Results
Read & Learn
Reflect & Discuss
Improve
HCC General Education Goals and IDEAHoward Community College General Education Goals
IDEA Learning Goals
IDEA Teaching Methods Associated with Progress on Learning Goal
Written Communication 8 Developing skill in expressing myself orally or in writing
5, 4, 14, 15, 18
Oral Communication 7 Gaining a broader understanding and appreciation of intellectual/cultural activity
7, 8, 13, 19
Scientific and Quantitative Reasoning
2 Learning fundamental principles, generalizations, or theories11 Learning to analyze and critically evaluate ideas, arguments, and points of view
2, 7, 8, 13, 15, 16, 18, 19
Critical Thinking 9 Learning how to find and use resources for answering questions or solving problems
2, 7, 8, 9, 13, 14, 15, 18, 19
Global Competency 7. Gaining a broader understanding of intellectual/cultural activityExtra Question
7, 8, 13,19
Example: Pre-PharmacyPre-Pharmacy Goals & Outcomes IDEA data
Mastery of fundamental biological, chemical, and physical principles underlying the living systems
Learning Objective 2,Teaching Methods 2, 4, 6, 8, 10, 12, 15, 16
Apply knowledge of scientific principles and concepts to clinical/scientific problems
Learning Objective 3Teaching Methods 1, 2, 3, 4, 6, 8, 10, 11, 15
Prepare effective written reports and oral presentations to communicate science to professionals and lay persons
Learning Objective 8Teaching Methods 7, 15, 16, 18, 19
Use mathematical concepts to analyze data
Learning Objectives 2 & 3Teaching Methods 1, 2, 3, 4, 6, 8, 10, 15
Example: Pre-PharmacyPre-Pharmacy Goals & Outcomes IDEA data
Mastery of fundamental biological, chemical, and physical principles underlying the living systems
Learning Objective 2,Teaching Methods 2, 4, 6, 8, 10, 12, 15, 16
Apply knowledge of scientific principles and concepts to clinical/scientific problems
Learning Objective 3Teaching Methods 1, 2, 3, 4, 6, 8, 10, 11, 15
Prepare effective written reports and oral presentations to communicate science to professionals and lay persons
Learning Objective 8Teaching Methods 7, 15, 16, 18, 19
Use mathematical concepts to analyze data
Learning Objectives 2 & 3Teaching Methods 1, 2, 3, 4, 6, 8, 10, 15
Overall Progress Ratings (Courses) Page 3Percent of Classes at or Above the
IDEA database Average
PRO
Exce
llent
Tea
cher
Exce
llent
Cou
rse
Sum
mar
y0
20
40
60
80
RawAdjusted
Relationship of Teaching Methods
to Global Items
Plan workshops to target needs
Correlation of Teaching Method Items to Summary Items
IDEA Teaching Method ExcellentTeacher
Excellent Course
6. Make it clear how each topic fits into the course .84 .80
10. Explain course material clearly and concisely .90 .79
13. Introduce stimulating ideas about the subject
.83 .82
4. Demonstrate the importance and significance of the subject matter .83 .80
Other ConsiderationsO Consider sending faculty to the IDEA
User Group Meeting to do presentations
O Consider becoming a member of POD and joining these conversations on the international level
O Design a Faculty Development Day around some of these ideas
