project outcome panel: user experiences & lessons learned · 2017 plans. project outcome &...

Project Outcome Panel:

User Experiences & Lessons Learned

June 15, 2017

Today’s Speakers

Julianne RistDirector of Public

Services

Jefferson County

(Colo.) Public Library

Emily PlagmanProject Manager

Public Library

Association

Carrie HerrmannLibrary Director

Boone County (Ky.)

Public Library

Amy MikelCoordinator of

School Outreach

Brooklyn (N.Y.)

Public Library

What we will cover today

▪ Project Outcome Speed Summary

▪ Panelist Libraries

− Boone County, KY

− Jefferson County, CO

− Brooklyn, NY

▪ Wrap-up & Questions

If yes – click “Raise Hand” icon

Poll:

Do you consider yourself as being

“new” to Project Outcome?

About Project Outcome

Surveys for 7 Service Areas

Dummy Data

Free Project Outcome Training Resources

• Getting Started

• Surveys

• Data Collection

• Data Analysis

• Taking Action

• From the Field

Webinar Archives

How to Successfully Roll Out Project Outcome in Your Library

Project Outcome Roadmap

Community of Practice

www.projectoutcome.org

Carrie HerrmannLibrary Director

Boone County (Ky.)

Public Library

www.bcpl.org

Project Outcome

Boone County (Ky.) Public Library

Boone County Public Library

Boone County Public Library

Northern Kentucky

Population: 126,000+

Fastest Growing County in Kentucky

5 locations + 1 under construction

Community Center on Wheels

Operating Budget: $7,911,958

FTE Staff: 102 (Total 148)

Boone County Public Library

Why BCPL Measures Outcomes

• Strategic Plan/Goals

• Improve/Build Partnerships

• Funding Concerns

Boone County Public Library

How Project Outcome Works

Project Outcomes

Identify Measurement Need & Goals

Survey a Program

Understand & Analyze Results

Communicate Findings

and/or Make Changes

Boone County Public Library

Have a Plan

• Who decides which programs to survey?

• Who decides when to survey?

• Who administers the surveys to customers?

• Who enters the data?

• Who reviews the data and prepares it for use?

Boone County Public Library

We MeasuredEarly Childhood Literacy

• Storytime

• Parent/Child Development

• Every Child Ready to Read/School Ready Libraries

• Reading in general

Boone County Public Library

What We Learned:Early Childhood Literacy

Boone County Public Library

What We Learned:Early Childhood Literacy

Boone County Public Library

We Measured Education/Lifelong Learning for Retired Adults

• Homebound Delivery

• Programs at Nursing Homes/Retirement Centers/Senior Centers

Boone County Public Library

What We Learned:Homebound Delivery

Boone County Public Library

What We Learned:Homebound Delivery

Boone County Public Library

What We Learned:Retired Adult Outreach Programs

Boone County Public Library

What We Learned:Retired Adult Outreach Programs

Boone County Public Library

Contact MeCarrie Herrmann

cherrman@bcpl.org

859-292-3387

Follow me at:

LinkedIn https://www.linkedin.com/in/carrie-herrmann-3929758/

Twitter https://twitter.com/CarrieHerrmann

What questions do you have for Carrie?

Please share your questions in chat

Jefferson County

(Colo.) Public Library

Julianne RistDirector of Public Services

Population of Service Area: 578,101

Annual Operating

Expenditures: $31,388,971

Number of Libraries: 10

FTE Staff: 208

About JCPL

Evidence Based Decision Making

Programs that have used Project Outcome

LibLab Kits

▪ Grant reporting

▪ Pilot Evaluation

▪ Type of kits to add

Programs that have used Project Outcome

Summer Reading 2016

▪ Over 1000 responses

▪ Changes to program

▪ Credibility when reporting to the Board

▪ Stories that enhance the data

▪ 2017 plans

Project Outcome & Strategic Planning

2017 Strategic Priority:

1000 Books Before Kindergarten

▪ Pilot evaluation

▪ System-wide implementation Fall 2017

▪ Long-term tracking

▪ Combined with school data – impact on

community

Strategic Planning

▪ Establish baselines for programs

▪ Used for success measures

▪ Tracking for larger community goals

▪ Benchmarking

▪ Impact on patron’s lives

▪ Credibility

▪ Expertise

Long-Range Planning

Triad of tools

▪ Edge Initiative

▪ Impact Survey

▪ Project Outcome

Creates a culture of constant

▪ Evaluation

▪ Measurement

▪ Reporting

Contact information:

Julianne Rist

director of public services

Jefferson County Public

Library

10200 W. 20th Avenue

Lakewood, CO 80215

p 303.275.2236

julianne.rist@jeffcolibrary.org

Contact Info

What questions do you have for Julianne?

Please share your questions in chat

Brooklyn (N.Y.)

Public Library

Amy MikelCoordinator of

School Outreach

Emily PlagmanProject Manager

Public Library

Association

Project

Outcome

For Individual

Projects

Big Library, Big Changes

Brooklyn Public Library

• One of three public library systems in New York City

• 58 branches, serving 2.5 million residents

• 46% of residents speak a language other

than English at home

• Rapid growth: 100+ new staff hired

over past three years (and still hiring)

Early Adopter

Why Project Outcome?

• BPL does not have an “official” in-house

outcome measurement system

• Opportunity to pilot for a stand-alone project

overseen by one individual

• Adopted June 2015

Piloting Outcomes

Visit bklynlibrary.org/teacherlab for more info

Teacher Lab: Library & Research Skills course

• Designed to help educators feel more confident

finding resources for their classrooms

• Summer four-day course

• Online course launches July 2017

… plus, professional learning workshops

offered year-round

Process & Results

Using Surveys

• Report: Education/Lifelong Learning

• Every educator workshop and course

surveyed as of August 2015

• Attendees must complete paper survey

before receiving their certificate of

attendance (professional credit)

Feedback

What worked well?

Ease

• Adaptable for an individual project within BPL

• Surveys easy to create & easy to take

• Simple dashboard to enter and generate reports

Consistent Results

• “Teaching to the test”

• All workshops evaluated against the same scoring system

• Affirmation of project goals

Grant Award (October 2016)

IMLS Sparks! Ignition Grant for Teacher Lab

Reviewer Feedback

“Ongoing program evaluation will be conducted through ALA's

Project Outcome Tool Kit. I felt that the utilization of this

existing measurement tool was a strength of the proposal.”

“It's great that Project Outcome is being used to assess Teacher

Lab as it's a free and open resource for all libraries to use.”

“The ongoing evaluation using PLA's Project Outcome toolkit

guarantees a high standard in language around the indicators

and process.”

Evolving Data Collection

Questions?

Amy Mikel

Coordinator of School Outreach

amikel@bklynlibrary.org

Teacher Lab Info

www.bklynlibrary.org/teacherlab

IMLS Grants and Funding

www.imls.gov/grants

Wrap-up &

Questions

Emily PlagmanProject Manager

Public Library

Association

Join Us @ ALA Annual

Next Webinar

Project Outcome Two-Year Updates & Discussion

July 20, 1-2 PM Central

Free Project Outcome Training Resources

• Getting Started

• Surveys

• Data Collection

• Data Analysis

• Taking Action

• From the Field

Community of Practice

www.projectoutcome.org

If you haven’t already…

• Sign up on the Project Outcome website

• Browse free training resources

• Continue the conversation on Community of Practice

• Create your surveys!

www.projectoutcome.org

Questions?

Please share your questions in chat

Thank you!