Measures and Evaluation

January 2015

Do - implementation• objectives agreement• Implementation of processes

Check - evaluation and assessment• evaluation• date / results

Act – review, feedback andprocedures for change

Plan - planning purpose and plan

• goals • measures

Methodology

To repeat: PDCA-Circle

GOALS – „W-Rule“To define:

Responsibility Who?Target date When?Indicator for evaluation What?o Goal data How much?

(Ressources) With what?Purpose Why?Continuation What afterwards?

MEASURES

MEASURESThe measure is the conrete definition, what must be done to

reach the goal!Who is responsible? Who is executing?What? concrete stepsWhich method?When? target data for every stepWith what? ressources

Actionplan = Measureplan

Actionplan

Subtarget (what?)

Responsibility (who?)

Ressources(with what?)

Measure(s)(how to do?)

Target data(when?)

Evaluation (Instruments)

Project: _________________________________________________________________________Goal: ___________________________________________________________________________Projectleader: _____________________________________________________________________

To communicate goals and measurescooperation - 100 % communication!

Help

Said doesn´t mean heard Information

Heard doesn´t mean realized Stimulation

Realized doesn´t mean agreed communication

Agreed doesn´t mean remembered To participate stakeholders

Remembered doesn´t mean applied Leadership

Applied doesn´t mean maintained Repeating and showing the success

EVALUATION

Evaluation …______________________________________________________________________________________________________________________________

… is the possibility, to verify an adoption by data

Evaluation helps …______________________________________________________________________________________________________________________________

… estimating processes… developing… improving… controlling of measures… comparing results

EVALUATION - DEFINITION„analysis and valuation of processes and organisations“

e.g. in education- and health-scopes„systematic, databased description and valuation of programms, projects and institutions“

Evaluation …

… makes useful and sure information available for stakeholders… orients on concrete questions of decision makers… is honest… will improve = evaluation for shaping… will value = evaluation for balancing

Types of Evaluation (1)

Selfevaluatione. g. Individual feedback

External evaluatione. g. TQM-external-AssessmentPeer Review

Types of evaluation (2)

Estimating Persons / InstitutionsMostly linked with (negativ) sanctionsTo enforce unpopular measures

Estimating measuresTo check the effetiveness of the measurescriteria und measuring devices are necassaryPersons concerned become to participantsNot for efficiency comparisons!

15

Quality Circle

Plan

DoAct

Check

Evaluation

School programme

Evaluation report

Essential characteristicsUtilityfocusing on intent and purpose – involved persons – concerned persons

Practicabilityrealistic, well thought, effectiveness

Fairnessrespectful interaction with concerned persons

Accuracyvalid information relating to the question

Utility

Identification of involved and concerned personsClarification of the evaluation purposeCredibility and competence of the evaluator Selection and extent of the informationTransparency of valuesCompletness and clarity of reportsTimeliness of the evaluation

Practicability

Appropriate procedureDiplomatic actionEfficiency

Fairness

Compliance of formal arrangements Protection of individual rightsComplete and fair assessmentImpartial procedure and reportPublication of results

Accuracy

Description of the object being evaluatedContext analysisDescription of purpose and procedureDisclosure of sources of informationSystematic fault controlAnalysis of qualitativ and quantitativ informationWell-founded conclusion

Indicators of evaluation

Clear definition of evaluation goals

What shows, that a goal, a value, …. in relation to the object of evaluation is reached?

Scopes of evaluationIntern – one school

Selfevaluatione.g. teaching actionsprojekts and special measures in a classProjects and measures in the school

Extern – more schoolse.g. inspectoratesStandards, central final exams, …International evaluations - PISA, PIRLS …

Basic framework of succesful evaluationUnstandable reasons for the choice of the objective of evaluationPositive approachRelevant questionsEffective and practical methodsView of the whole pictureSecured framework conditionsClear responsibilitiesVisible using of results

Methods und Instruments______________________________________________________________________________________________________________________________

Questionnaire InterviewObservationCard surveying, point monitoring, …or …

Question and answerQuestion

Focused on the subjectPrecise (choice of words specific to target group)Free from value judgements

Answer options openQuestion for decision (yes/no/I don´t know)Gradation „how accurate the information is“ (completly agree - . . . - strongly disagree)Scale of marks (1 bis 5/6)

Procedure of evaluation – step by stepPreparing and planing

timeframe, responsibilities, involved persons, information channels, indicators, goal, type of presentation of the results

Choice of methods in order to goals and target groupsConducting the evaluation

involved persons, responsibilities, timeframe, choice of the suitable timeCoding and analysis

protect the anonymity, timeframe; who can see the results? Summary of the results

Interpretation und consequencesprepare the context, possible consequences

Presentation of the results and outlook

… and for a successfull process I wish you …______________________________________________________________________________________________________________________________

Energy

A motivated team

Joy in experim

enting

Courage

Success

Serenity Endurance

Farsightedness

Engagement