designing and evaluating the process of school self-evaluations jan vanhoof
DESCRIPTION
DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof. Schools become better by engaging in self-evaluations. Do you agree ?. You share this point of view with: Policy makers Inspectors Teachers and principals Researchers. Structure of this presentation. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/1.jpg)
1
DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS
Jan Vanhoof
![Page 2: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/2.jpg)
2
Schools become better by engaging in self-evaluations
You share this point of view with:- Policy makers- Inspectors- Teachers and principals- Researchers
Do you agree?
![Page 3: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/3.jpg)
3
Structure of this presentation
1. Introduction
a. Why engage in self-evaluation?
b. What is self-evaluation?
2. When to engage in self-evaluation?
3. How to design self-evaluations? Introduction of 7 guiding principles
4. How to use the 7 principles?
![Page 4: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/4.jpg)
4
Quality care as a systematic policy making
4
PLAN
DO
CONTROL/CHECK
ADJUST
PLAN
DO
CONTROL/CHECK
ADJUST
(Bernhardt, 2004)
![Page 5: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/5.jpg)
5
Components of self-evaluation in a school improvement perspective?
• Cyclical process• On its own initiative• Itself• From a global quality assurance concept• Systematic description• Systematic assessment• Arriving at specific improvement processes
![Page 6: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/6.jpg)
6
Structure of this presentation
1. Introduction
a. Why engage in self-evaluation?
b. What is self-evaluation?
2. When to engage in self-evaluation?
3. How to design self-evaluations? Introduction of 7 guiding principles
4. How to use the 7 principles?
![Page 7: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/7.jpg)
7
When?Starting with self-evaluation: (To
what extent) are we ready?
• Failure in your preparation is to prepare your failure
• The importance of what preceeds the self-evaluation should not be underestimated
![Page 8: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/8.jpg)
8
Starting with self-evaluation: (To what extent) are we
ready?
![Page 9: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/9.jpg)
9
Starting with self-evaluation: (To what extent) are we
ready?
![Page 10: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/10.jpg)
10
Self-evaluation... Mean SD
...tells us nothing new/teaches us a great deal. 4.24 1.29
...does not result in better teaching/results in better teaching.
4.22 1.32
...takes a lot of time/takes up very little extra time. 3.27 1.38
...only involves a few people/involves everybody. 3.75 1.43
...does not lead to better management/leads to better management.
4.18 1.40
...is difficult to interpret/is easy to understand. 3.64 1.31
...is not popular with the majority of team members /is popular.
2.75 1.24
...is difficult to carry out/can be carried out relatively easily.
3.56 1.33
...is not cost-effective/is cost-effective. 3.62 1.34
...depends on chance/results in a reliable picture. 3.89 1.18
...is subjective/is objective. 3.39 1.35
...is a snapshot/represents our development correctly. 3.69 1.34
Scale score 3.68 0.95
Attitudes towards school self evaluation: Descriptive results
![Page 11: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/11.jpg)
11
Self-evaluation... Mean SD
...tells us nothing new/teaches us a great deal. 4.24 1.29
...does not result in better teaching/results in better teaching.
4.22 1.32
...does not lead to better management/leads to better management.
4.18 1.40
Descriptive results: Positive expectations
![Page 12: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/12.jpg)
12
Self-evaluation... Mean SD
...is not popular with the majority of team members /is popular.
2.75 1.24
Descriptive results: SE is not popular in schools
![Page 13: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/13.jpg)
13
Self-evaluation... Mean SD
...takes a lot of time/takes up very little extra time. 3.27 1.38
...only involves a few people/involves everybody. 3.75 1.43
...is difficult to interpret/is easy to understand. 3.64 1.31
...is difficult to carry out/can be carried out relatively easily.
3.56 1.33
...is not cost-effective/is cost-effective. 3.62 1.34
Descriptive results: The process of SE is scored most negatively
![Page 14: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/14.jpg)
14
Starting with self-evaluation: (To what extent) are we
ready?
![Page 15: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/15.jpg)
15
Starting with self-evaluation: (To what extent) are we
ready?
![Page 16: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/16.jpg)
16
Starting with self-evaluation: (To what extent) are we
ready?
![Page 17: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/17.jpg)
17
Starting with self-evaluation: (To what extent) are we
ready?
![Page 18: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/18.jpg)
18
What is your opinion? Are we/you ready?
![Page 19: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/19.jpg)
19
What if these conditions are not met?
• First work on the deficits. But how?• Self-evaluation is both the path and the
destination.• Caution should be exercised:
• Start with safe topics• Small scale• Provide sufficient time and resources
• "A path is made by walking on it“• Ensure the principles of self-evaluation as a policy
act
![Page 20: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/20.jpg)
20
Structure of this presentation
1. Introduction
a. Why engage in self-evaluation?
b. What is self-evaluation?
2. When to engage in self-evaluation?
3. How to design self-evaluations? Introduction of 7 guiding principles
4. How to use the 7 principles?
![Page 21: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/21.jpg)
21
SELF-EVALUATION AS A POLICY ACTION: THE FUNDAMENTAL
PRINCIPLES FOR DESIGNING AND EVALUATING SELF-EVALUATION
PROCESSES
![Page 22: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/22.jpg)
22
![Page 23: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/23.jpg)
23
Some background info: Empirical basis
The 7 principles are presented by using a practical approach
All statements are based on empirical evidence: Delphi-study with local Flemish experts Case-studies of schools conducting self-evaluations A survey of 2,716 respondents in 96 schools
Findings linked to other studies
![Page 24: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/24.jpg)
24
Principle 1: The school team is prepared to engage in systematic
reflection
Nobody wants to be evaluated by anybodyat anytime
House (1973)
![Page 25: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/25.jpg)
25
Principle 1: The school team is prepared to engage in systematic
reflection
• Evaluations still tend to make team members feel threatened and uncomfortable
• Be aware of differences within the school• Self-evaluation makes itself (im)possible• Dealing with resistance
• Spray the plants, not the weed• Often source of valid criticism
![Page 26: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/26.jpg)
26
Principle 2: The school team works towards shared objectives
![Page 27: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/27.jpg)
27
• There needs to be clarity about what the intentions are• Come to concrete action points• Set up a conversation with the entire team• Come to legitimate policy choices • Identify good practices• Demonstrate the role team members can play in school policy• Solve concrete problems
• Take the time to make the goals and expectations explicit • Effective self-evaluation thus begins with thinking about how
one is going to evaluate the quality of that self-evaluation
Principle 2: The school team works towards shared objectives
![Page 28: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/28.jpg)
28
Principle 3: The school team uses shared leadership as a means of
creating involvement
• Leadership is not a matter for the principal only• Use ‘Expertise’ and ‘commitment' to guide participation in
decisions• Choose an appropriate decision-making method
• Work with a steering committee
The quality of a decision =
The intrinsic quality x
Level of acceptance
![Page 29: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/29.jpg)
29
Devision of responsabilities
Responsabilities/tasks Principal
Middle mana-
gement
Steeringgroup
Strategic decisions x
Daily control x
Advise, inspire x x
Align and integrate x x x
Represent constituencies - legitimize x
Raising awareness and communicating x x x
Point of contact for team members x
Practical implementation x
Support x x x
Monitoring the process x
Evaluation of self-evaluation x
![Page 30: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/30.jpg)
30
Principle 4: The school team communicates effectively
A school principal comments:
The essence is communication. This is an attention point at the beginning, but actually all the way through. You need to allow time, in
the various phases, to make sure that everyone is on board. That everyone knows what it is about and what we want to achieve. Above
all, that it isn’t regarded as yet another form to fill in.
![Page 31: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/31.jpg)
31
Principle 4: The school team communicates effectively
• Take the viewpoint of team members in setting up communication
• Use appropriate communication channels • Pursue an open communication climate• Put effort in the self-evaluation report
![Page 32: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/32.jpg)
32
Principle 5: The school team seeks to create supportive relationships and
collaboration.
• Design the self-evaluation as a team effort• Identify your own (lacks of) knowledge and skills• Start with a stimulating timing of the self-evaluation activities • Verify whether external support is needed/appropriate
![Page 33: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/33.jpg)
33
Principle 6: The school team integrates the self-evaluation process into
existing school policy.
• Anchor the self-evaluation goals into the school policy• Use a (theoretical) framework• Identify self-evaluation priorities and coordinate initiatives• Stimulate team members to adopt a broad professional approach• Work with existing groups
![Page 34: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/34.jpg)
34
Principle 7: The school team is responsive with regard expectations
concerning the self-evaluation process.
![Page 35: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/35.jpg)
35
![Page 36: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/36.jpg)
36
Annual meeting of the school leaders of schools with self-evaluations that perfectly fits to the principles
![Page 37: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/37.jpg)
37
How to use these 7 principles
• Designing self-evaluations• Evaluating self-evaluations
• A checklist setting out a series of relevant indicators was developed for each principle
![Page 38: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/38.jpg)
38
Example: Indicators for shared leadership during the self-
evaluation• The self-evaluation procedure is not just a matter for
the school management alone.• The decision-making procedures relating to the self-
evaluation are transparent.• The task of carrying out the self-evaluation is not left
to only one person. • Team members have the chance to get involved in the
decision-making processes. • ...
![Page 39: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/39.jpg)
39
How to use these 7 principles
• Indicators can be used as a basis for reflection on how well self-evaluation processes have been carried out
• In a quantitative way• In a qualitative way
![Page 40: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/40.jpg)
40
Structure of this presentation
1. Introduction
a. Why engage in self-evaluation?
b. What is self-evaluation?
2. When to engage in self-evaluation?
3. How to design self-evaluations? Introduction of 7 guiding principles
4. How to use the 7 principles?
![Page 41: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/41.jpg)
41
Statements for discussion
Schools become better by engaging in self-evaluations
![Page 42: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/42.jpg)
42
Statements for discussion
Nobody wants to be evaluated by anybody at anytime
House (1973)
![Page 43: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/43.jpg)
43
Statements for discussion
The 7 principles are a useful framework for designing and
evaluating the process of school self evaluations
![Page 44: DESIGNING AND EVALUATING THE PROCESS OF SCHOOL SELF-EVALUATIONS Jan Vanhoof](https://reader035.vdocuments.site/reader035/viewer/2022062323/56815ac6550346895dc8932e/html5/thumbnails/44.jpg)
44
Questions? Thoughts?
Suggestions? Advice?