http:// eca - code for the selection of experts rolf heusser, chairman of eca oslo, 14 february 2008

http://www.ecaconsortium.net

ECA - Code for the selection of expertsECA - Code for the selection of experts

Rolf Heusser, Chairman of ECA

Oslo, 14 February 2008

Titel van de presentatie | H.J. de Tuinman | 30 maart 2003Heusser / Oslo / 2008 | 2

Presentation by Rolf HeusserPresentation by Rolf Heusser

1. Codes of good practices for QAA‘s2. ECA principles for selection of experts3. Case study Switzerland4. Open questions and conclusions


Codes of good practices for QAA‘s - RationaleCodes of good practices for QAA‘s - Rationale

Built upon shared experiences of QAA’s Promote international consistency of external QA Guarantee reliable external QA procedures Increase transparency for HEI’s and society Basis for external reviews of QAA’s Necessary element for MR agreements


INQAAHE Guidelines of good practices (2007)INQAAHE Guidelines of good practices (2007)

Standard 8

Criteria

QAA‘s must have specifications on the characteristics, selection and training of reviewers

Non conflict of interest mechanism in work of experts; adequate training of experts; evidence based expert reports


European standards and guidelines (2005)European standards and guidelines (2005)

Standard 4 (part II)

Standards 6/8 (part III)

Care in selection of experts; appropriate training of experts; international experts; participation of students

Independency of agency in nomination and appointment of experts; non conflict of interest mechanism


ECA code of good practice (2004)ECA code of good practice (2004)

Standard 15

Reference points

The accreditation procedure must guarantee the independence and competence of the expert panels

Criteria for selection of experts and for composition of expert panels; independency statements of experts


ECA – Principles for selection of experts (2005)ECA – Principles for selection of experts (2005)

Agreed procedures for the selection of experts:• Based on policies of agency or legislation

• Selection criteria for experts must be published by the agency

• Independent and unbiased experts; disclosure of possible conflicts of interest; confidentiality statement

• Institutions have right to comment on selection of experts

• Accreditations decisions should be made by the relevant authority and not by the group of experts themselves

• Experts must be briefed adequately by the agency


ECA – Principles for composition of expert ECA – Principles for composition of expert panelspanels

Expert panels have the following mix of expertise:• Experience in quality assurance in higher education

• Appropriate academic qualifications and scientific or professional reputation in relevant area(s)

• Relevant international experience

• Knowledge on teaching and learning methods

• Expertise in development, design, provision and evaluation of higher education programmes

• Knowledge of the country-specific HE-system


ECA – Principles for composition of expert ECA – Principles for composition of expert panelspanels

Specific for institutional accreditation:• Expertise in institutional governance and management

• Leadership experience in research/academic management

Commendable:• Gender balance in the expert panel

• Student representatives

• Representatives from the labour market

• A significant proportion of experts from outside the country


ECA Road map to mutual recognitionECA Road map to mutual recognition

Activities/Tools Date

Inventory of accreditation systems 2004Mutual observations 2005

Code of good practice 2004Principles: selection of experts 2005Principles: accreditation of joint programmes 2006Common publication format/databank 2007

In depth comparisons / joint projects 2006Joint declaration ECA – ENIC/NARIC 2006External review of ECA members 2007Formal agreements of mutual recognition 2007

Mutual understanding of

accreditationorganisations

Mutual Recognition ofaccreditationprocedures

MutualRecognition ofaccreditation

results/decisions


OAQ – Independency of expertsOAQ – Independency of experts

Nomination of experts according to published selection criteria; investigations of agency

Appointment of experts by scientific advisory board Majority of experts must work/live abroad HEI can object experts Declaration of independence and confidentiality of

panel members


OAQ – Student participation in expert panelsOAQ – Student participation in expert panels

Until 2006: Limited student participation in external QA

2006: training of students ---> student expert pool built up in cooperation with Swiss student union

2007: accreditation guidelines ask for integration of students into all expert panels

New law on Swiss higher education: students will become member of Swiss accreditation council (decision making body)


OAQ – Expert panels for institutional auditsOAQ – Expert panels for institutional audits

4 international experts + 1 student member Leadership experience, QA experience, academic

expertise according to profile of institutions Language of on site visit is free choice of HEI At least one expert of previous audit in the panel

(continuity) Same panels for different Swiss universities


OAQ – Open questions about expertsOAQ – Open questions about experts

How to recruit renowned and experienced experts?

How to verify independence of experts? Optimal balance between international and

national experts? How to assure consistency of panel judgements? How to assure clarity of conclusions? Reimbursement of experts?


ConclusionsConclusions

Various codes of good practices have been established and are successfully implemented by QAA

ECA has published commonly agreed principles for the selection of experts ---> can easily be adopted to various types of quality assessments

Commonly agreed standards and principles are a necessary element for MR agreements among agencies and contribute to the convergence of the EHEA

There are many open questions about selection and work of reviewers ---> continuous exchange among QAA necessary

http:// eca - code for the selection of experts rolf heusser, chairman of eca oslo, 14 february 2008

Documents

heusser oslo

group of experts

agency slide

expert panels criteria

chairman of eca oslo

eca principles

country slide

mechanism slide