poster final april 21 pb edits...title poster final april 21 _ pb edits.pdf created date 6/5/2016...

1
MAPPING CONCEPTUALIZATIONS AND INDICATORS OF QUALITY Danielle Gabay, Abeer Siddiqui, Rebecca Lee, Melec Zeadin, Naseem Sherwani, Lori Goff McMaster Institute of Innovation and Excellence in Teaching and Learning How is quality defined in higher education? What is the relationship between institutional approach to, and the conceptualization of, quality and the indicators used to assess quality? Map specific institutional indicators of quality (Gibbs, 2010) to institutional conceptualizations of quality (Harvey & Green, 1993) BACKGROUND Institutional Culture Institutional culture : The embedded patterns and behaviors, and the shared values, beliefs and ideologies that an educational institutions possess (Kezar and Eckel, 2002). It also provides a lens through which its members assign value to the various events and efforts of their institution (Berguist and Pawlak, 2008). Institutional culture and institutional approach to quality cannot be considered in isolation: How an institution approaches and articulates quality stems from a broader cultural perspective (Harvey and Stensaker, 2008). Thus, institutional conceptualization of quality and institutional approaches to quality inform the institutional culture; and vice versa. In turn, institutional approaches to quality in conjunction with institutional culture, impacts the ways in which institutions define and assess quality teaching. Institutional Conceptualizations of Quality Lee Harvey and Diana Green (1993) describe five conceptualizations of quality in higher education: 1. Exceptional : Quality is distinctive; elitist; achieved when high standards are surpassed 2. Value for money : Quality achieved by return on investment and accountability 3. Transformation : Quality achieved through the educational gain of students. 4. Fitness for Purpose : Quality is achieved when the product/service meets stated purpose 5. Perfection & Consistency : Quality is achieved when consistent and flawless outcomes are produced. Institutional Indicators of Quality Graham Gibbs’ Dimensions of Quality (2010) examines valid indicators to assess quality. These indicators are categorized as: 1. Presage variables : describe institutional context before students begin learning. 2. Process variables : describe institutional context as students progress through learning. 3. Product variables : describe achieved educational outcomes. INTRODUCTION Current Context Increased focus on quality teaching and enhancing institutional culture amongst various educational stakeholders. Lack of literature and research that documents and explains quality teaching and institutional culture in relation to quality teaching in the Canadian context. Quality Teaching Survey (QTS) Multi-institutional project created to identify a set of indicators that would help define an institution’s teaching culture, or the perceived value placed on teaching within Canadian institutions. Conceptualizations of Quality QTS survey raised questions regarding the conceptualizations of quality within higher education. We conduct an extensive literature review in order to: This link between institutional conceptualizations of quality and institutional emphasis on specific indicators of educational quality may have, as of yet, unexplored implications for teaching practices and attitudes. QUALITY TEACHING INSTITUTIONAL APPROACH TO QUALITY INSTITUTIONAL CULTURE MAPPING CONCEPTUALIZATIONS AND INDICATORS OF QUALITY EXCELLENCE TRANSFORMATION PERFECTION AND CONSISTENCY FITNESS FOR PURPOSE PERFECTION & CONSISTENCY VALUE FOR MONEY PRESAGE Research Performance Degree of Selectivity Quality of Students Quality of Academic Staff Staff/Student Ratio PROCESS Class Size Level of Engagement Quality of Teaching Quality and Quantity of Instructor Feedback Amount of Class Contact Hours Level of Intellectual Challenge Formative Assessment and Feedback Student Support Reputations Quality Enhancement Process Peer Ratings PRODUCT Student Performance Degree Classification Student Retention/Persistence Employability Emphasis on specific indicators of quality manifests as specific conceptualizations of quality. Conversely, inherent conceptualizations of quality determine which indicators are used to assess institutional quality. Clear articulation of this relationship between conceptualizations and indicators will not only allow institutions to understand their approach to quality, but more significantly, give them the initial framework and means by which to shift their approach should they so desire. In order to streamline quality assessment, conceptualizations should have a greater influence on the indicators selected: Institutions should clearly articulate their conceptualization(s) of quality and select and indicators accordingly. CONCEPTUALIZATIONS INDICATORS REFERENCES Berquist, W. H., & Pawlak, K. (2008). Engaging the six cultures of the academy. San Francisco, CA: Jossey-Bass. Gibbs, G. (2010). Dimensions of quality (pp. 160). United Kingdom: The Higher Education Academy. Harvey, L., & Green, D. (1993). Defining quality. Assessment & Evaluation in Higher Education, 18(1), 934. Kezar, A. J., & Eckel, P. D. (2002). The effect of institutional culture on change strategies in higher education. The Journal of Higher Education, 73(4), 435460. ACKNOWLEDGEMENTS This project was funding by the Ministry of Training, Colleges and Universities. We would like to acknowledge: Dr. Erika Kustra, Dr. Ken Meadows, Ms. Paola Borin, Dr. Debra Dawson, Mr. Peter Wolf, Dr. Donna Ellis

Upload: others

Post on 27-Sep-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Poster Final April 21 pb edits...Title Poster Final April 21 _ pb edits.pdf Created Date 6/5/2016 1:11:23 AM

MAPPIN

G CON

CEPTUALIZATION

S AND IN

DICATORS O

F QUALITY

Danielle Gabay, Abeer Siddiqui, Rebecca Lee, Melec Zeadin, N

aseem Sherw

ani, Lori Goff M

cMaster Institute of Innovation and Excellence in Teaching and Learning

How is quality defined in higher education? W

hat is the relationship betw

een institutional approach to, and the conceptualization of, quality and the indicators used to

assess quality?

Map specific institutional indicators of quality (Gibbs, 2010) to

institutional conceptualizations of quality (Harvey & Green, 1993)

BACKGROU

ND

Institu

tion

al C

ultu

re �

Institutional culture: The embedded patterns and behaviors, and the shared

values, beliefs and ideologies that an educational institutions possess (Kezar and Eckel, 2002). It also provides a lens through w

hich its mem

bers assign value to the various events and efforts of their institution (Berguist and Paw

lak, 2008). �

Institutional culture and institutional approach to quality cannot be considered in isolation:

�How

an institution approaches and articulates quality stems from

a broader cultural perspective (Harvey and Stensaker, 2008). Thus, institutional conceptualization of quality and institutional approaches to quality inform

the institutional culture; and vice versa. In turn, institutional approaches to quality in conjunction w

ith institutional culture, impacts the w

ays in which institutions

define and assess quality teaching. In

stitutio

na

l Co

ncep

tua

lizatio

ns o

f Qu

ality

Lee Harvey and Diana Green (1993) describe five conceptualizations of quality in higher education: 1.

Exceptional: Quality is distinctive; elitist; achieved w

hen high standards are surpassed

2.Value for m

oney: Quality achieved by return on investm

ent and accountability

3.Transform

ation: Quality achieved through the educational gain of students.

4.

Fitness for Purpose: Quality is achieved w

hen the product/service meets stated

purpose 5.

Perfection & Consistency: Q

uality is achieved when consistent and flaw

less outcom

es are produced.

Institu

tion

al In

dica

tors o

f Qu

ality

Grah

am G

ibb

s’ Dim

ensio

ns o

f Qu

ality (20

10

) examin

es valid in

dicato

rs to assess

quality. These indicators are categorized as: 1.

Presage variables: describe institutional context before students begin learning. 2.

Process variables: describe institutional context as students progress through learning.

3. Product variables: describe achieved educational outcom

es.

INTRO

DUCTIO

N

Cu

rrent C

on

text �

Increased focus on quality teaching and enhancing institutional culture am

ongst various educational stakeholders.

�Lack of literature and research that docum

ents and explains quality teaching and institutional culture – in relation to quality teaching – in the Canadian context.

Qu

ality Tea

chin

g Su

rvey (QTS)

�M

ulti-institutional project created to identify a set of in

dicato

rs that w

ou

ld h

elp d

efine an

institu

tion

’s teachin

g culture, or the perceived value placed on teaching w

ithin Canadian institutions.

Co

ncep

tua

lizatio

ns o

f Qu

ality

�Q

TS survey raised questions regarding the conceptualizations of quality w

ithin higher education.

�W

e conduct an extensive literature review in order to:

This link between institutional conceptualizations of quality

and institutional emphasis on specific indicators of

educational quality may have, as of yet, unexplored

implications for teaching practices and attitudes.

QUALITY

TEACHING

INSTITU

TION

AL A

PPROACH TO

QUALITY

INSTITU

TION

AL C

ULTU

RE

MAPPIN

G CON

CEPTUALIZATION

S AND IN

DICATORS O

F QUALITY

EXCELLEN

CE

TRANSFO

RMATIO

N

PERFECTION

AND CO

NSISTEN

CY

FITNESS FO

R PURPO

SE PERFECTIO

N &

CON

SISTENCY

VALUE FO

R MO

NEY

PRESAGE �

Research Performance

�Degree of Selectivity

�Q

uality of Students �

Quality of Academ

ic Staff �

Staff/Student Ratio

PROCESS

�Class Size

�Level of Engagem

ent �

Quality of Teaching

�Q

uality and Quantity of

Instructor Feedback �

Amount of Class Contact Hours

�Level of Intellectual Challenge �

Formative Assessm

ent and Feedback

�Student Support �

Reputations �

Quality Enhancem

ent Process �

Peer Ratings

PRODU

CT �

Student Performance

�Degree Classification

�Student Retention/Persistence

�Em

ployability

Emphasis

on specific

indicators of

quality m

anifests as

specific conceptualizations of quality. Conversely, inherent conceptualizations of quality determ

ine which indicators are used to assess institutional quality.

Clear articulation of this relationship between conceptualizations and

indicators will not only allow

institutions to understand their approach to quality, but m

ore significantly, give them the initial fram

ework and m

eans by w

hich to shift their approach should they so desire. In order to stream

line quality assessment, conceptualizations should have a greater

influence on the indicators selected: Institutions should clearly articulate their conceptualization(s) of quality and select and indicators accordingly.

CO

NCEPTUALIZATIO

NS

INDICATO

RS

REFERENCES

Berquist, W

. H., & Paw

lak, K. (2008). Engaging the six cultures of the academy. San Francisco, CA: Jossey-Bass.

Gibbs, G. (2010). Dim

ensions of quality (pp. 1–60). U

nited Kingdom: The Higher Education Academ

y.

Harvey, L., & Green, D. (1993). Defining quality. Assessm

ent & Evaluation in Higher Education, 18(1), 9

–34.

Kezar, A. J., & Eckel, P. D. (2002). The effect of institutional culture on change strategies in higher education. The

Journal of Higher Education, 73(4), 435

–460.

ACKNO

WLEDGEM

ENTS

This project w

as funding by the Ministry of Training, Colleges and U

niversities.

We w

ould like to acknowledge: Dr. Erika Kustra, Dr. Ken M

eadows, M

s. Paola Borin, Dr. Debra Dawson, M

r. Peter Wolf, Dr. Donna Ellis