enhancing nominal group technique using technologies: a demonstration (id275) alt-c 11-13 september...
TRANSCRIPT
Enhancing Nominal Group Technique using technologies:
a demonstration (ID275)
ALT-C11-13 September 2012
Jaye McIsaac, Educational DevelopmentTunde Varga-Atkins, eLearning Unit
University of Liverpool
ELESIG-funded project
OUTLINE
• Introduction and purpose•What is the Nominal Group Technique?•What is the problem?•Technologies we tried
OUTCOMES
• To describe the Nominal Group Technique (NGT) as a student feedback & evaluation tool.• To evaluate the use of learning technologies in the process of a face-to-face NGT session.• To consider the value of using technologies in online settings using NGT.
WHAT ISNOMINAL GROUP TECHNIQUE?
•Structured group activity •One given topic•Facilitates groupdecision-making• Immediate results•Reduces researcher/participant bias
- Delbecq & Van de Ven (1971)
NGT: STAGES
1) Individual responses
2) Clarification and consolidation
3) Ranking responses
Example question: ‘What would you change in your course?’
STAGE 1: WHAT TO KEEP DOING (FEEDBACK TO STUDENTS)
Annotated ,personalised feedback.
Model answers
Giving model answers for essay titles
Audio feedback for everything!
Audio feedback giving extensive comments Drafts that
must be submitted and marked prior final work
1 2 3
45 6
STAGE 2 : WHAT TO KEEP DOING (FEEDBACK TO STUDENTS)
Model answers
Giving model answers for essay titles
Audio feedback for everything!
Audio feedback giving extensive comments
Drafts that must be submitted and marked prior final work
35
24
Annotated ,personalised feedback.
6
1
Audio feedback
Model answers
Personalised feedback
STAGE 3 : WHAT TO KEEP DOING (FEEDBACK)
Item no.
Item description
5 points 1 Annotated, personalised feedback
4 points 2 Giving model answers
3 points 4 Audio feedback
2 points 7 etc.
1 point 10 etc.
THE TOP FIVE QUALITIES OF GOOD FEEDBACK
Timing, quick
Detailed, on how to improve Applicabl
e to future work Personal
Consistent bw markers
1
2
3
4
5
‘PROBLEMS’
Credit by Nathan T. Baker
1) Individual responses
2) Clarification and consolidation
3) Ranking responses
TECHNOLOGIES WE TESTED
TECHNOLOGIES WE TESTED
Web-conferencing
online sticky-note: linoit.com
Polling: GoogleModerator
clickers
mobile text-entry / MCQ polling
MOBILE TEXT ENTRY (E.G. POLLEVERYWHERE.COM, TEXTWALL.CO.UK)
1) Individual response
2) Consolidation and clarification
3) Ranking
CLICKERS
1) Individual response
2) Consolidation and clarification
3) Ranking
GUIDE TO NGT & PROJECT REPORT
See References
On slideshare.net , search for Nominal Group Technique
GOOGLE MODERATOR
Live link:
GOOGLE MODERATOR
1) Individual response
2) Consolidation and clarification
3) Ranking
WEB-CONFERENCING (ELLUMINATE)
WEB-CONFERENCING
1) Individual response
2) Consolidation and clarification
3) Ranking
ONLINE STICKY-NOTES: E.G. LINOIT.COM
LINOIT.COM
1) Individual response
2) Consolidation and clarification
3) Ranking
TECHNOLOGIES TRIED FOR NOMINAL GROUP
1) Individual response
2) Consolidation and clarification
3) Ranking
so…
FOR NOW: KEEPING WITH
and…
UNINTENDED OUTCOME 1: ONLINE SETTINGS
UNINTENDED OUTCOME 2: IN OTHER STUDENT FEEDBACK
METHODS
UNINTENDED OUTCOME 3:PAPER AS TECHNOLOGY
• ubiquitous•manipulable• overlay•multi-items• text entry• legibility• visibility
Image by Paul Duvall
IT’S YOUR TURN TO TEXT
What other technologies can
you suggest?
In what other student feedback or evaluation contexts could you use
these for?
text in your thoughts if you like – see instructions
REFERENCES
• Delbecq, A., Van de Ven, Andrew, & Gustafson, D. (1975). Group techniques for program planning : a guide to nominal group and Delphi processes. Glenview Ill.: Scott Foresman.
• Luff et al (2007) Augmented Paper: Developing relationships between digital content and paper
• Oliver, M. (2012) Learning with technology as a coordinated sociomaterial practice: digital literacies as a site of praxiological study
• Varga-Atkins, McIsaac et al (2011) Using the nominal group technique with clickers to research student experiences of e-learning: a project report [http://slidesha.re/xQlBCg ]
• Varga-Atkins, McIsaac et al (2011) The Nominal Group Technique – a practical guide for facilitators [http://slidesha.re/AmYOgv]