Freelance Consultant to the Minerva ODL Project & to

Leeds College of Technology

Using the revealed worldviews of e-Learning stakeholders in the design and evaluation of ODL

provision

Tim Deignan

Correspondence

timdeignan@runbox.com

• Freelance educational consultant, trainer and researcher, working mainly in UK Post-Compulsory Education and Training. Wide range of client organisations, particular interest in student support systems.

Acknowledgements

My thanks to Dr Louise Bryant, Academic Unit of Psychiatry and Behavioural Sciences,

University of Leeds, for providing materials for this presentation

The Project : “DOODLE”

Developing

Online

Open

Distance

Learning

E-models for vocational skills education

DOODLE: Participants

The ODL Providers:• Leeds • Huddersfield• Dublin• Romania• Greece• Finland

The Learners:• Print• Construction• Print• Networking• Software• Business

Project Aims

• Using Q-methodology to reveal the attitudes of various stakeholders towards e-Learning

• Using revealed attitudes to review the design and evaluation of ODL provision

• NB: Work in Progress! Final report to project sponsors due September 2004.

What is Q-methodology?

• a foundation for the systematic study of subjectivity (Steven Brown, 1991)

• a set of philosophical, psychological, statistical, and psychometric ideas oriented to research on the individual (Fred Kerlinger, 1986)

• Identifies the different stories that can be told about a topic (Rex Stainton Rogers, et al., 1996)

…a structured approach to the study of subjectivity, using the Q sorting technique……making internal beliefs observable….

What is Q-methodology?

Q-methodology ~ origins

William Stephenson (1902 - 1989)

William Stephenson, psychologist and physicist….

Stephenson, W. (1935). Correlating persons instead of tests, Character and Personality 4, 17-24.

Stephenson, W. (1953). The Study of Behavior: Q-technique and Its Methodology

Q-methodology ~ stages

1. Identifying and sampling the ‘concourse’

2. Selecting participants

3. Q sorting

4. Factor analysis

5. Factor interpretation

1. Identifying and sampling the concourse

Sampling aims* Points of view not knowledge

* Represent the concourse

Identifying the concourse*What is written and said about the topic?

*Diversity of sources

Q set

1(cntd). Sampling the flow of communicability around the topic

categoriesstatements items

ODL item examples:

E-training is not suitable for all learners.

E-training threatens the existence of traditional training providers.

2. Selecting Participants

* Participants are the variables

* Selected for diversity of views…..including directors, curriculum leaders, web developers, online tutors, and e-learners embarking on ODL programmes provided by the DOODLE partner organisations

2 (cntd). 125 participants

DOODLE• Leeds • Huddersfield• Dublin• Romania• Greece• Finland

staff students

10 26

3 16

11 21

5 7

5 6

5 10

39 86

3. Q-sorting: a sorter in action

3 (cntd). A Q-sorting matrix

Strongly Strongly

Disagree Agree

-4 -3 -2 -1 0 +1 +2 +3 +4

850

9 13352445254133431 407165437102122 23494633022615

4732311842271412483836174434

192928 620 39

11

4. Factor Analysis

* Enter the data using Q dedicated software

* Extract the initial factors

* Select and rotate the factors to calculate distinct ‘voices’ among the participants

5. Factor Interpretation Interpret the factors using:

*Factor arrays (most agree/most disagree & neutral)

*The consensus items and distinguishing items (similarities and differences between factors)

* The sorters’ comments

NB: ANALYSIS OF PROJECT DATA IS ONGOING (Final Report to sponsors due September 2004)

- SEE VISUALISER FOR INITIAL DATA / FACTORS

DOODLE www Reference

For the official project listing, see p30 of the ‘Socrates Compendium 2002’ which can be found at:

http://www3.socleoyouth.be/static/Bots/docbots/Documents/Compendium/Odl/comp_M_2002.pdf

Author References (1)

• Brown, S. R. (1980). Political Subjectivity: Applications of Q Methodology in Political Science, Yale University Press, New Haven.

• Kerlinger, F. N. (1986) Foundations of Behavioural Research, Holt, Rinehart & Winston, New York

Author References (2)

• Stainton Rogers, R. (1995). Q Methodology. In Rethinking Methods in Psychology, eds. Smith, J. A. & Van Langenhove, L., pp. 178-192. Sage, London.

• Stephenson, W. (1953). The Study of Behavior: Q-Technique and its Methodology, University of Chicago Press, Chicago

Electronic Resources

• http://www.q-sort.com an introductory website

• http://www.qmethod.org the official Q website of the International Society for the Scientific Study of Subjectivity

• http://www.rz.unibw-muenchen.de/~p41bsmk/qmethod/webq/index.html a web-based application for Q sorting questionnaire items