methods behind the (one shot) madness: enhancing instruction through mapping, portfolios, &...

81
@ honnoldlibrary #SCILWorks12

Upload: char-booth

Post on 06-May-2015

11.609 views

Category:

Education


1 download

DESCRIPTION

Presentation given by Char Booth (Instruction Services Coordinator & E-Learning Librarian), Natalie Tagge (Instruction Librarian), and Sean Stone (Science Librarian) of the Claremont Colleges Library at the SCILWorks 2012 Conference: http://www.carl-acrl.org/ig/scil/scilworks/2012/index.html Session Description: In-class techniques and e-learning tips can undeniably improve one-shot sessions, but collaborative management and outcomes-driven assessment of an overall instruction program is key to increasing instructor effectiveness and student learning in even the briefest of interactions. This presentation explores three pilot initiatives designed to build a structured and strategic framework behind "traditional" undergraduate instruction at the Claremont Colleges Library: instructor portfolios, curriculum mapping, and information literacy rubrics. Instructor portfolios collect teaching materials, student work, and coordinated evaluations in an integrative attempt to holistically assess one-shot library instruction from the perspective of faculty, students and librarians. Curriculum and knowledge mapping is a way of visualizing the path a learner takes through a discipline, department, or degree, as well as an engaging planning and brainstorming tool. Rubrics help define specific student outcomes as well as provide a quantifiable tool for assessment of information literacy skills. When applied in tandem, these approaches can be used to gather powerful insight into the learner experience and create the impetus for more collaborative, creative, and lasting library instruction.

TRANSCRIPT

Page 1: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

@ h o n n o l d l i b r a r y

# S C I L W o r k s 1 2

Page 2: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

@ h o n n o l d l i b r a r y

t i n y u r l . c o m /c l a r e m o n t s c i l

Page 3: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

( O NE - S HOT ) M ADNESS m e t h o d s b e h i n d t h e

C H A R B O O T H N A T A L I E T A G G E S E A N S T O N E

Page 4: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

e n h a n c i n g i n s t r u c t i o n t h r o u g h

C H A R B O O T H N A T A L I E T A G G E S E A N S T O N E

Page 5: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C H A R B O O T H N A T A L I E T A G G E S E A N S T O N E

e n h a n c i n g i n s t r u c t i o n t h r o u g h

M A P P I N G

Page 6: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

e n h a n c i n g i n s t r u c t i o n t h r o u g h

M A P P I N G

P O R T F O L I O S

C H A R B O O T H N A T A L I E T A G G E S E A N S T O N E

Page 7: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

e n h a n c i n g i n s t r u c t i o n t h r o u g h

M A P P I N G

P O R T F O L I O S

R U B R I C S

C H A R B O O T H N A T A L I E T A G G E S E A N S T O N E

Page 8: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M A P P I N G

P O R T F O L I O S

R U B R I C S

M A P P I N G

P O R T F O L I O S

R U B R I C S

Page 9: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }THE CLAREMONT COLLEGES

Page 10: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }THE CLAREMONT COLLEGES

Page 11: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ } T H E L I B R A R Y

Page 12: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }

Page 13: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M A P P I N G

P O R T F O L I O S

R U B R I C S { }

Page 14: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

s u p p o r t s t r u c t u r e

M A P P I N G

P O R T F O L I O S

R U B R I C S { }

Page 15: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

s u p p o r t s t r u c t u r e

E V A L U A T I O N

Page 16: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

s u p p o r t s t r u c t u r e

E V A L U A T I O N

C O L L A B O R A T I O N

Page 17: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

s u p p o r t s t r u c t u r e

E V A L U A T I O N

C O L L A B O R A T I O N

I M P R O V E M E N T

Page 18: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M A P P I N G

P O R T F O L I O S

R U B R I C S { }1

Page 19: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }

Page 20: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }CONTEXTUA L / C U L TURA L I N VEST I GA T I ON

Page 21: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 22: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C O N C E P T / K N O W L E D G E / M I N D M A P

Page 23: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

m i n d o m o . c o m

C O N C E P T M A P P I N G S O F T W A R E

Page 24: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

A S S E S S M E N T & P L A N N I N G

Page 25: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

D I S C U S S I O N C A P T U R E

Page 26: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C O M M M U N I T Y B U I L D I N G

Page 27: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C U R R I C U L U M M A P P I N G

Page 28: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C A M P U S

Page 29: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

P R O G R A M

Page 30: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R E Q U I R E M E N T S

Page 31: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

O B J E C T I V E S / O U T C O M E S

Page 32: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

A N N O T A T I O N S

Page 33: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C U R R I C U L U M M A P P I N G P I L O T : E A

t i n y u r l . c o m / c l a r e m o n t - e a m a p

Page 34: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C A T A L O G / W E B S I T E I M M E R S I O N

Page 35: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C O U R S E I N T E G R A T I O N M A P & R U B R I C

Page 36: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C L A S S E S , M E E T I N G S & G U I D E S

Page 37: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

O P E N A C C E S S T H E S I S U P L O A D S

Page 38: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

T A R G E T E D A S S E S S M E N T

Page 39: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

T A R G E T E D A S S E S S M E N T

Page 40: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

T A R G E T E D A S S E S S M E N T

Page 41: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 42: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 43: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }

Page 44: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

T R A C K I N G O U T C O M E S

Page 45: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M A P P I N G

P O R T F O L I O S

R U B R I C S { }2

Page 46: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R U B R I C S { }P A I N ?

Page 47: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

{ }F a c u l t y m a y n o t k n o w w h a t t h e y w a n t y o u t o d o o r h o w t o d e f i n e i n f o l i t …

Page 48: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

F a c u l t y m a y n o t k n o w w h a t t h e y w a n t y o u t o d o o r h o w t o d e f i n e i n f o l i t … { }… b u t t h e y A L L k n o w w h a t t h e y w a n t f r o m s t u d e n t s .

Page 49: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R U B R I C S { }c u s t o m i z e d R O A D M A P S o f l e a r n e r C O M P E T E N C I E S

Page 50: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

!

!!

Performance Area

!Rating = 4 “Proficient”

!Rating = 3

“Competent”

!Rating = 2

“Developing”

!Rating = 1 “Beginning”

!Score

Location/Scope of Information !

--Has the student independently identified the extent of information needed for a project? !

--Has the student included multiple sources of information and /or provided evidence of having employed a search strategy?

Student develops a thorough bibliography with multiple and diverse sources of information. Search strategy is evident.

Student develops a bibliography with several sources of information but shows little attempt to diversify sources.

Student develops an incomplete bibliography that contains major errors indicative of no coherent search strategy

Student develops a bibliography using only web-based or Popular media sources. No evidence that a formal search strategy was used.

!

Evaluate Information !

--Has the student demonstrated an effort to assess the relevance of retrieved information? !

--Has the student included an evaluation of potential bias in the information being used to construct arguments?

Sources explore multiple contexts for how information is crafted and student discusses the limits of current information

Sources are all relevant to the topic and represent a wide range of viewpoints

Sources are mostly relevant to the topic of the project but represent only a narrow range of viewpoints

Sources used are not relevant or are ancillary to the topic of the project

!

Analyze Information !

--Has the student demonstrated proficiency with the appropriate tools necessary to understand how information sources are related? !

--Has the student used appropriate analysis framework to integrate information into an argument?

Effectively analyzes information from multiple sources into a project that represents new or novel information

Student attempts to perform some analysis of information but the approach is not entirely appropriate for the project

Student makes reference to the analysis used by others without performing original analysis

Project lacks fluency or student work is segmented in such a way that arguments are unstructured

!

Interpret Information !

--Has the student used information and the analysis of it to offer a unique narrative? !

--Does the student understand how to effectively communicate and interpret information for an audience?

Student organizes, synthesizes, and articulates information in a way that is accessible to intended audience

Student develops unique thoughts but communicates the new information in an oblique manner

Student develops some unique thoughts but generates some flawed interpretations

Student largely recapitulates arguments of others without an original synthesis

!

Ethics of Information !

--Does the student display an awareness and understanding of the ethical and legal guidelines for appropriate use of information?

Proper use of paraphrasing/ citations / footnotes / bibliography

Citations / bibliography are complete but inconsistent stylistically; paraphrased material is not properly cited

Some (but not all) source material is cited; paraphrased material isn't properly cited or re-stated

No or very few citations; incomplete bibliography; material is quoted without proper attribution

!

Page 51: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 52: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

Performance Area First Year Students

Second Year Students

Third Year Students

Fourth Year Students

Location/Scope of Information • Has the student independently identified the

extent of information needed for a project?

• Has the student included multiple sources of information and /or provided evidence of having employed a search strategy?

• Does the student grasp the diversity of and major

sources of EA literature?

Student is capable of developing a bibliography using more than web-based or popular media sources. They are able to able very basic and general search strategies.

Student is capable of developing a bibliography that is basic but begins to show an understanding of coherent search strategies and an understanding of how to utilize EA resources.

Student can develop a bibliography with several sources of information and is beginning to use sources and strategies that require a deeper understanding of sub-disciplines within EA.

Student can develop a thorough bibliography with multiple and diverse sources of information showing the student has developed a personal research identity within EA.

Evaluate Information • Has the student demonstrated an effort to assess

the relevance of retrieved information?

• Has the student included an evaluation of potential bias in the information being used to construct arguments?

Sources are appropriate to the topic of the project but sometimes tangential. Student only understands the most basic categories and types of information.

Sources are more relevant to the topic of the project but may be derived from the most obvious of “good” resources.

Sources are all relevant to the topic and represent a wide range of viewpoints as well as types and levels of EA information as appropriate.

Sources explore multiple contexts for how information is crafted and student can discuss the limits of current information in the context of current EA information.

Analyze Information • Has the student demonstrated proficiency with

the appropriate tools necessary to understand how information sources are related?

• Has the student used appropriate analysis framework to integrate information into an argument?

Student analysis is segmented in such a way that arguments are sometimes poorly structured due to a limited understanding in properly analyzing EA information.

Student begins to more effectively analyze EA information across disciplines and recognizes multiple approaches to analysis based on the type of information.

Student can perform original analysis of increasingly specific information and integrate the analyses into complex projects

Student effectively analyzes information from multiple, advanced sources into a project that represents significant new or novel information in their field of interest within EA.

Interpret Information • Has the student used information and the

analysis of it to offer a unique narrative? • Does the student understand how to effectively

communicate and interpret information for an audience?

Student has limited original synthesis and often recapitulates arguments of others with only minor changes.

Student expresses a greater understanding of the literature by beginning to create wholly original ideas from an original synthesis of the information.

Student develops unique thoughts on diverse EA topics and related fields and begins to recognize the importance of proper communication of their ideas.

Student organizes, synthesizes, and articulates advanced information in a way that is accessible to intended audience.

Ethics of Information • Does the student display an awareness and

understanding of the ethical and legal guidelines for appropriate use of information?

Student is responsible for appropriate attribution of basic information sources and understanding and avoiding plagiarism.

Student begins to access and cite more advanced and non-traditional information in an appropriate way.

Student can properly cite advanced and diverse resources in a variety of styles using a variety of methods.

Student exhibits proper use of paraphrasing, citations, footnotes, bibliographies, etc. in advanced original work.

!

Page 53: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 54: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R U B R I C S

{ }f a c u l t y / l i b r a r i a n c o l l a b o r a t i o n

Page 55: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R U B R I C S

{ }f a c u l t y / l i b r a r i a n c o l l a b o r a t i o n

M U T U A L U N D E R S T A N D I N G

Page 56: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R U B R I C S

{ }f a c u l t y / l i b r a r i a n c o l l a b o r a t i o n

M U T U A L U N D E R S T A N D I N G

i m m e d i a t e a s s e s s m e n t t o o l

Page 57: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

R U B R I C S

{ }f a c u l t y / l i b r a r i a n c o l l a b o r a t i o n

M U T U A L U N D E R S T A N D I N G

i m m e d i a t e a s s e s s m e n t t o o l

L O N G - T E R M F R A M E W O R K

Page 58: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M A P P I N G

P O R T F O L I O S

R U B R I C S { }3

Page 59: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

P O M O N A I D 1

…seminars for first-year students in their first semester…taught by faculty from across the disciplines and engage students in rigorous reading, writing, and discussion on varied topics. The goal of ID1 is to prepare students to participate fully and successfully in the intellectual community that is Pomona College…

Pomona College: www.pomona.edu/academics/resources/writing-center/id1.aspx

P O R T F O L I O S

Page 60: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

FALL 2011 : 29 UN IQUE SECT IONS

2 9 L I BRAR IAN COLLABORAT IONS

Page 61: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

FALL 2011 : 29 UN IQUE SECT IONS

2 9 L I BRAR IAN COLLABORAT IONS

Page 62: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

W H A T I M P A C T I S L I B R A R Y I NVOLVEMENT HAV ING ON I D1?

S T U D E N T

L I B R A R I A N F A C U L T Y

P O R T F O L I O A S S E S S M E N T = H O L I S T I C

Page 63: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

U P L O A D E D C O U R S E M A T E R I A L S T O S A K A I

P R E / P O S T R E T R E A T S

L I B R A R I A N S

Page 64: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

L I B R A R I A N S

THRE E - Q U E S T I O N R E F L E C T I O N S

Page 65: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

S T U D E N T S I N - C L A S S S U R V E Y

R E P R E S E N T A T I V E P A P E R S

Page 66: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

F A C U L T Y P O S T - I N S T R U C T I O N S U R V E Y

E N D - O F - T E R M S U R V E Y

Page 67: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

PART IC I PAT ION RATES

2 3 3 s t u d e n t s u r v e y r e s p o n s e s = 5 9 % r e s p o n s e r a t e

6 faculty post-instruction survey responses =

2 0 % r e s p o n s e r a t e

2 faculty end of term survey responses = 7 % r e s p o n s e r a t e

Page 68: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

STUDENT SURVEY RESPONSES

Page 69: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 70: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics
Page 71: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

“Identify one or more skills or other takeaways from today's session that will be useful to you”

Page 72: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

“ W h i c h o f t h e t o p i c s / c o n c e p t s could have been explained more clearly or explored in greater depth?”

Page 73: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

Administer faculty survey in class

Rubrics for: best practices for teaching skills

student learning of skills librarian performance

Library learning objectives to share with ID1 faculty

I M P R O V E M E N T

Page 74: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M E T A R E S U L T S

Low (workload) impact

Useful /posi t ive exper ience

Expansion to other f i rst year programs

Valuable archive of teaching mater ia ls

Page 75: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

o u t c o m e s

E V A L U A T I O N

C O L L A B O R A T I O N

I M P R O V E M E N T

Page 76: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

i t e r a t i v e ,

Page 77: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

c o l l e c t i v e .

Page 78: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

M A P P I N G

P O R T F O L I O S

R U B R I C S { }

Page 79: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

?M A P P I N G

P O R T F O L I O S

R U B R I C S { }

Page 80: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

C H A R B O O T H

CLAREMONT COLLEGES L I B R A R Y

S E A N S T O N E

N A T A L I E T A G G E

Page 81: Methods Behind the (One Shot) Madness: Enhancing Instruction Through Mapping, Portfolios, & Rubrics

L I N K S presentation slides tinyurl.com/claremontscil

2011-12 1st year instruction map tinyurl.com/ccl-firstyear2011

ea rubric map tinyurl.com/claremontlib-earubric

ea curriculum map tinyurl.com/claremontlib-eamap

ea thesis eval t inyurl.com/EAthesiseval2011

student survey t inyurl.com/ccl-id1studenteval

post-instruction faculty survey t inyurl.com/ccl-id1facultyeval

end-of-term faculty survey t inyurl.com/ccl-id1facultyendofterm

three question reflection t inyurl.com/3qr-pomonaID1