steiner—how to improve your library instruction: assessment in five minutes
DESCRIPTION
Information literacy expert Sarah Steiner will show you how five minutes of skilled, targeted assessment is all you need to give you a precise understanding of students’ needs, learning, and retention.TRANSCRIPT
How to Improve Your Library Instruction: Assessment in Five
Minutes
Sarah SteinerJanuary 8, 2014
During Today’s Class, We Will…
• Analyze the purpose and benefits of quick assessment in one-shot instruction sessions.
• Draft learning outcomes for a session using Bloom’s Taxonomy.
• Compose assessment questions based on our learning outcomes.
• Select appropriate assessment tools based on your instruction goals and population.
http://www.flickr.com/photos/topgold/4858921901/
Our Focus
http://www.flickr.com/photos/rogersg/3814863064/
Classroom assessment (versus programmatic or institutional)
What Can Quick Classroom Assessment Do?
• It can identify instructional gaps or disconnects.• It can help you determine how you spend class
time.• It can build your confidence.• It can provide evidence of efficacy and impact.• It should be a basis for change.
http://www.flickr.com/photos/sercasey/324341982/
What Should I Assess?
• To assess:– Comprehension– Retention– Achievement of learning outcomes
• Not to assess:– Your personal shortcomings– Your speaking mistakes– Your hairstyle– The feng shui and temperature of the
classroomhttp://www.flickr.com/photos/toniblay/52445415/
Have you ever written learning objectives or outcomes?
• Nope, not yet.• Yes, a few times. • Yes, regularly.• I’m not sure.
http://www.flickr.com/photos/dadaistic_fantastic/5089525186/
Learning Outcomes
“A Learning Outcome is a statement of what the student should understand and be able to do as a result of what she has learned ... ‘the essential and enduring knowledge, abilities, and attitudes or dispositions’ that enable a learner to practice and apply her learning in the real world.”
-Valencia Community College
http://www.flickr.com/photos/gblakeley/5583354276/
A Good Learning Outcome Will…
• Set a time frame and a context.• Identify the audience.• Be jargon-free.• Be measurable.• Be action-oriented.• Be brief.• Be linked to learner needs.
“By the end of this class, you will be able to identify a scholarly source.”
http://www.flickr.com/photos/auntiep/4310267/
Determine the Class Priorities
http://www.flickr.com/photos/paloetic/4795592340/
• Choose three to five– What must the students accomplish?– What must they know in order to
accomplish it?– What do they already know/find
obvious?
Write the Learning Outcomes
Stem + Verb + Product/Outcome
http://www.flickr.com/photos/jjpacres/3293117576/
Stem
By the end of this class, you will be able to…
http://www.flickr.com/photos/47108884@N07/4594962925/
Verb: Bloom’s Taxonomy
http://www.flickr.com/photos/tryingmyhardist/1366874433/
Choose Verbs: Knowledge
Students will…define, describe, identify, know, label, list, match, name, outline, recall, recognize, reproduce, select, state
http://www.nwlink.com/~donclark/hrd/bloom.html
http://www.flickr.com/photos/reway2007/4693202935/
Choose Verbs: Comprehension
Students will…comprehend, convert, defend, distinguish, estimate, explain, extend, generalize, give an example, infer, interpret, paraphrase, predict, rewrite, summarize, translate
http://www.flickr.com/photos/bsmith4815/112307904/
Choose Verbs: Application
Students will…apply, change, compute, construct, demonstrate, discover, manipulate, modify, operate, predict, prepare, produce, relate, show, solve, use
http://www.flickr.com/photos/28478778@N05/5729009434/
Choose Verbs: Analysis
Students will…analyze, break down, compare, contrast, diagram, deconstruct, differentiate, discriminate, distinguish, identify, illustrate, infer, outline, relate, select, separate
http://www.flickr.com/photos/billselak/2709756134/
Choose Verbs: Synthesis
Students will…categorize, combine, compile, compose, create, devise, design, explain, generate, modify, organize, plan, rearrange, reconstruct, relate, reorganize, revise, rewrite, summarize, tell, write
http://www.flickr.com/photos/littleredelf/3081832532/
Choose Verbs: Evaluation
Students will…appraise, compare, conclude, contrast, criticize, critique, defend, describe, discriminate, evaluate, explain, interpret, justify, relate, summarize, support
http://www.flickr.com/photos/christinamatheson/108818379/
Add Product or Outcome
What do they need? • A book on their topic• A thesis statement• Keyword search strategies (basic or advanced)
What is the context?• A class assignment• A real-world scenario
http://www.flickr.com/photos/fdecomite/2907794565/
All Together Now!
Stem + Verb + Product/Outcome
By the end of this class, you will be able to identify a scholarly source on your paper topic.
By the end of this session, you will be able to locate books on your paper topic in the library using the online catalog, GILFind.
http://www.flickr.com/photos/revlimit/2186765034/
What’s Wrong Here?
Today I’ll talk about…1. The library website.2. Database searching for peer-reviewed
journals using boolean logic and the thesaurus.3. How you can search the catalog, search
the databases, and use ILL.
http://www.flickr.com/photos/mythoto/2604818537/
Question Time
http://www.flickr.com/photos/sugarhiccuphiccup/5485691671/
Have you ever assessed students’ achievement of pre-
set learning outcomes?
• Nope, not yet.• Yes, a few times. • Yes, regularly.• I’m not sure.
http://www.flickr.com/photos/dadaistic_fantastic/5089525186/
Today’s Assessment Tools
• Polls• Quizzes (pre and post or post only)• Minute papers
http://www.flickr.com/photos/azarius/225340667/
Polls
Poll Example Questions
• How many of you have had a library instruction class here before?
• Is this an article or a journal? • Is this website reputable?• Is this source peer-reviewed? / Is this
source scholarly or popular?• Who is the author of this book? • Are you confused about topic x?
http://www.flickr.com/photos/rakka/3451170932/
Quizzes
Quiz Example Questions
The Good, the Bad, the Ugly
Minute Papers
http://www.flickr.com/photos/holtsman/4331034955/
Minute Paper Example Questions
Best Practices for Question Drafting
• Convert your learning outcomes to questions.
• Include three to five “meaty” questions, two or three general questions.
• Avoid overly easy or “all of the above” answers.
• Avoid nebulous or complicated questions.• Work in terminology to ensure it’s
understood.
http://www.flickr.com/photos/djmccrady/6118626233/
Best Practices for Question Drafting
• Get a reviewer.• If at first you don’t succeed….
More help with constructing questions: http://ets.tlt.psu.edu/learningdesign/effective_questions/why
http://www.flickr.com/photos/djmccrady/6118626233/
Review Responses
• On the spot? Yes! • Look for…• Percentage of correct answers.• Trends in missed answers.• What to change next time.
http://www.flickr.com/photos/xingty/3421423768/
Verbal Setup
http://www.flickr.com/photos/twenty_questions/2348686991/
Survey and Poll Tools
• SurveyMonkey: http://www.surveymonkey.com
• Poll Daddy: http://polldaddy.com/
• Poll Everywhere: http://www.polleverywhere.com/
• Google Forms: http://www.google.com/google-d-s/forms/
http://www.flickr.com/photos/litlnemo/5045121567/
SurveyMonkey
PollDaddy
Poll Everywhere
Google Forms in Google Drive
Review
• Write learning outcomes.• Base your questions on the
outcomes and on your needs.• Review and reflect on the answers
you get.
http://www.flickr.com/photos/demonbaby/4228327167/
Thank you!
Contact me at [email protected]
Other Resources• “Bloom’s Taxonomy of Cognitive Domain.”
http://classweb.gmu.edu/ndabbagh/Resources/Resources2/bloomstax.htm• Educational Oasis, “Framework of Learning Outcomes.”
http://www.educationoasis.com/instruction/bt/learning_objectives.htm• London Deanery, “Setting Learning Objectives.”
http://www.faculty.londondeanery.ac.uk/e-learning/setting-learning-objectives
• Penn State, “Writing Effective Questions to Promote Learning.” http://ets.tlt.psu.edu/learningdesign/effective_questions/• Utah State University Library, “Assessment.”
http://library.usu.edu/instruct/assessment/index.php• “Virginia Tech Instruction Clearinghouse.” http://www.lib.vt.edu/RIS/clearinghouse/assessments.html