conducted by rsl research group · relations/marketing. the csl management team considered it a...

ColoradoStateLibrary

AnEvaluationofColorado’sLibraryServices&Technology

Act(LSTA)Program2008‐12

ConductedbyRSLResearchGroupKeithCurryLance,Consultant

March30,2012

Commissionedby

Fordeliveryto

ColoradoStateLibraryLSTAFive‐YearEvaluationReport2008‐12

Page2

TABLEOFCONTENTS

ExecutiveSummary_________________________________________________________________________________________3

QuestionsPosedbyEvaluation _________________________________________________________________________3Methods_____________________________________________________________________________________________________3KeyFindings _______________________________________________________________________________________________3StateLSTAGrant‐MakingProcess______________________________________________________________________3Key2008‐12CSLActivities______________________________________________________________________________4KeyProposed2013‐17CSLActivities__________________________________________________________________4LessonsaboutOutcome‐BasedEvaluation_____________________________________________________________4

Recommendations________________________________________________________________________________________5SampleProjects(AvailableData)_______________________________________________________________________5StateLSTAGrant‐MakingProcess______________________________________________________________________5Key2008‐12CSLActivities______________________________________________________________________________5KeyProposed2013‐17CSLActivities__________________________________________________________________5Outcome‐BasedEvaluationRecommendations________________________________________________________6

EvaluationofColorado’sLibraryServices&TechnologyActProgram2008‐12__7

Background________________________________________________________________________________________________7Methodology_______________________________________________________________________________________________7AvailableData_____________________________________________________________________________________________7Survey_______________________________________________________________________________________________________7ValidityandReliability___________________________________________________________________________________8Findings_____________________________________________________________________________________________________8AvailableDataonOutputs&Outcomes________________________________________________________________8

Goal1_________________________________________________________________________________________________9Goal2_______________________________________________________________________________________________10Goal3_______________________________________________________________________________________________12Goal4_______________________________________________________________________________________________14RecommendationsBasedonAvailableData_____________________________________________________16

SurveyFindings________________________________________________________________________________________17Evaluationofthe2008‐12StateLSTAGrantMakingProcess__________________________________17RecommendationsBasedonAssessmentofStateLSTAGrant‐MakingProcess______________19Evaluationofthe2008‐12StateProgramPlan__________________________________________________19RecommendationsBasedonAssessmentof2008‐12Performance___________________________25Inputforthe2013‐17StateProgramPlan_______________________________________________________25RecommendationsBasedonInputfor2013‐17Plan___________________________________________28

LessonsaboutOutcome‐BasedEvaluation&RecommendedChanges_______________29

Conclusion________________________________________________________________________________________________31

AppendixA:AbouttheEvaluatorsAppendixB:LogicModelsAppendixC:ReportedOutputandOutcomeDataAppendixD:SurveyRespondentsandResponseRateAppendixE:SurveyofLibraryLeadersAppendixF:FocusGroupInterviewofCSLManagementTeamAppendixG:BibliographyofSources


Page3

ExecutiveSummary

TheColoradoStateLibrary’s(CSL’s)2008‐12LSTAgoalswere:1. Coloradoresidentswillbeabletoaccessresourcesandserviceselectronicallythroughlibrariestomeettheir

informationandlearningneeds.2. Coloradostudentsandadultlearnersreceiveservicesfromlibrariesandlibrariansthatsupporteducational

achievementandlifelonglearning.3. Coloradoresidents,peoplewithdisabilities,ethnicpopulations,institutionalresidentsandthoseunderserved

bylibrariesreceiveservicesfromColoradolibrariestomeettheirtargetedneeds.4. Coloradolibrariescooperatetodevelopstrategiesandtechniquesthatassurethesharingofresourcestobest

meettheneedsofColoradoresidents.

QuestionsPosedbyEvaluationThequestionsposedbythisevaluationwere:

DidtheactivitiesundertakenthroughColorado’sLSTAplanachieveresultsrelatedtoprioritiesidentifiedintheAct?Towhatextentdidprogramsandservicesbenefittargetedindividualsandgroups?

Whatrecommendationscanbemadeforcontinuing,expandingand/oradoptingpromisingprogramsinthenextfive‐yearplan?

WhatlessonshasCSLlearnedaboutusingoutcome‐basedevaluation(OBE)thatotherstatescouldbenefitfromknowing?Whatworkedandwhatshouldbechanged?

MethodsMethodsusedtoproduceevidencewithwhichtoaddressthesequestionsincluded:availabledataanalysis,focusgroupinterviewing,andsurveyresearch.

Evidencethat2008‐12activitiesachievedresultsandbenefitedtargetedindividualsandgroupswereextractedfromindividualgranteereportsavailablefromtheonlineStateProgramReport(SPR)systemofthefederalInstituteofMuseumandLibraryServices.TheSPRsystemrequestsbothoutputandoutcomedataabouteachfundedproject.Exemplarsofsuchdatareportingwereselectedforeachofthestate’sfourLSTAgoals.Outputandoutcomedataabouteachprojectispresentedinatablefollowingabriefdescriptionoftheproject’spurposeandmajoractivities.

TheCSLManagementTeam,whosemembersrepresentthediversityofservicesandprogramsprovidedbyCSL,wereinterviewedasafocusgroup.Thepurposesofthisfocusgroupinterviewweretwo‐fold:toidentifykey2008‐12CSLactivitiesforeachLSTAgoalandpotential2013‐17CSLactivitiesforeachofthestate’sprospectiveLSTAgoalsforitsnextfive‐yearplan.ThesetwosetsofactivitieslargelydeterminedthescopeofasurveyofColoradolibraryleaders.

Viaasurvey,Coloradolibrarycommunity’sleaders—past,present,andfuture;formalandinformal—wereaskedtoassessCSL’sstateLSTAgrant‐makingpractices,itsperformanceonthekey2008‐12activitiesidentifiedbytheCSLManagementTeam,anditsprioritiesfortheproposed2013‐17activitiesidentifiedbytheManagementTeam.

KeyFindingsThisreportdetailsfindingsabouttheassessmentofCSL’sLSTAgrant‐makingprocess,itskey2008‐12activities,itsproposed2013‐17activities,anditsissueswithoutcome‐basedevaluation.

StateLSTAGrant‐MakingProcessSurveyrespondentswereaskedabouthindrancestopursuingstateLSTAgrants,theirassessmentofspecificgrant‐makingpractices,andtheirrecommendationsforimprovingthegrant‐makingprocess.

ThetwomostcommonhindrancestopursuingstateLSTAgrantswerealackofstafftimetowriteproposalsandalackofappropriateideasforstateLSTAgrantfunding.

Respondentsprovidedverypositivefeedbackaboutfourspecificgrant‐makingpractices:theapplicationguidelines,applicationtraining,communicationaboutproposalscoring,andfeedbackregardingproposalscoring.

Themostfrequentofthesmallnumberofspecificrecommendationsforimprovingthegrant‐makingprocessidentifiedbyrespondentswastoprovidemorecommunicationandinformationaboutstateLSTAgrantstargetedatthoselesslikelytoapply.


Page4

Key2008‐12CSLActivitiesForthegoalofaccessingresourcesandserviceselectronically,nineoutof10respondingColoradolibraryleadersassessedasexcellentorgoodtheLibraryJoblineandPlinkitwebsiteservicesforsmalllibraries.FouroutoffivegavesimilarassessmentsofCSL’sonlineworkshops(e.g.,CSLinSession,WebsideChats)anditssupportofe‐resourcedelivery.Excellentratingsfore‐resourcedeliverysupportwerethelowestforthisgoal’skeyactivities,butthisisnotsurprisingconsideringrecentbudgetcutbacksaffectingdatabasefunding.Forthegoalofeducationalachievementandlifelonglearning,nineoutof10surveyrespondentsassessedasexcellentorgoodCSL’ssupportofsummerreadingprogramsstatewide.FouroutoffivegavesimilarassessmentsoftheHighlyEffectiveSchoolLibrariesprogram,theStoryBlocksearlyliteracyprogram,CSLsupportofyouthservicesinpubliclibraries,andChannel2’sEverydayBookClub.Forthegoalofservicestospecificunderservedpopulations,nineoutof10respondentsassessedasexcellentorgoodboththeColoradoTalkingBookLibrary(CTBL)andCSL’sconsultingsupportofstateinstitutionallibraries.Forthegoalofresourcesharing,nineoutof10respondentsassessedasexcellentorgoodthreeofCSL’smostprominentefforts:theAskColorado/AskAcademicvirtualreferenceservice,theColoradoVirtualLibrary(includingitsColoradoHistoricNewspaperCollection)andtheStateWideInterlibraryLoanFastTrack(SWIFT).

KeyProposed2013‐17CSLActivitiesFortheproposednewgoaloflearningforallages,nineoutof10respondingColoradolibraryleadersassessedasessentialorveryimportantexpandedearlyliteracyprogramming.Notably,thisistheonlyproposedactivityforthenextfive‐yearplan,whichgarneredthesupportofamajorityofallsurveyrespondents—56%‐‐withanother29%regardingitasveryimportant.Otherproposedactivitiesforthisgoalweredevelopingstandards‐basedresourcesforK‐12schoollibrariesandcontinuingtoprovidecomputertraininginpubliclibrarycomputercenters.Strongmajoritiesalsodeemedessentialorveryimportanttheseproposedactivities—threeoutoffourandsevenoutof10,respectively.Fortheproposedcontinuinggoalofresourcesharing,fouroutoffiverespondinglibraryleadersassessedasessentialorveryimportanthostingandsupportinge‐resources,includingane‐bookplatform,collections,andaccess.Almostthreeoutoffivegavesimilarprioritytoprovidingsupportservices(e.g.,humanresources,budget,finance,purchasing)tonewpubliclibrarydistricts,whilehalfsimilarlyendorsedtheadditionofaudioandvideocollectionstotheColoradoVirtualLibrary.Fortheproposednewgoaloftrainingandrecruitinglibrarystaff,almostfouroutoffiverespondentsassessedasessentialorveryimportantCSLexercisingleadershipindiscussionsofinnovationinlibraries.AsimilarproportiongavesimilarendorsementtodevelopmentoftoolsforHighlyEffectiveSchoolLibrarians(HESL),andalmostsevenoutof10prioritizedsimilarlytraininglibrarystaffondatauseforneedsassessment,planning,evaluation,andpublicrelations/marketing.TheCSLManagementTeamconsidereditagiventhatCSL’seffortsfortheproposedcontinuinggoalofservingspecificpopulationsoftenunderservedbylibrarieswillremainfocusedontheclientsoftheColoradoTalkingBookLibraryandresidentsofstateinstitutions,asthesearemandatedinlaw.Byamarginoftwo‐to‐onetofour‐to‐one,themostfrequentrecommendationfor2013‐17identifiedbyrespondentswascopingwiththee‐bookrevolution.

LessonsaboutOutcome‐BasedEvaluationSeveralimportantlessonsaboutoutputandoutcomemeasurementaredemonstrablyclearfromthedataavailablefromsubmissionsbygranteestothefederalLSTAreportingsystem:

DatatobereportedbygranteestoCSLarenotspecifiedadequately.Levelsofdetailinreportingvariedacrossthespectrumfromminimaltoexcessive.

Manygranteesdonotunderstandwhatconstitutesoutputandoutcomedata.Somegranteesreportedinputdata(e.g.,staffhired,itemspurchased)asoutputdata,andoutputdata(e.g.,changesinvisits,circulation,programattendance)asoutcomedata.

Inevitably,thismeantalackofcomparableoutputandoutcomedataacrossprojectsfundedwithLSTAbyCSL.


Page5

RecommendationsThisreportprovidesdetaileddatatojustifythefollowingrecommendationsaboutselectedprojectsthatwereexemplaryinboththeirresultsandtheiruseofoutcome‐basedevaluationaswellas:

StateLSTAgrant‐makingprocess Key2008‐12activities Keyproposed2013‐17activities Outcome‐basedevaluation

SampleProjects(AvailableData)1. Allprojectsforwhichavailabledatawerepresentedareexemplaryandreportedsufficientevidenceof

successthatCSLshouldwelcomefutureproposalstoreplicateandtoexpanduponthem.2. Manyoftheseexemplaryprojectsdemonstratedsufficientunderstandingofoutputandoutcome

measurementthattheirrepresentativesshouldbeaskedtoplayleadershiprolesinpromotingthemorestructuredapproachtofuturestatewideoutcome‐basedevaluation(OBE)beingformulatedbyIMLS,withadditionsrecommendedlater.

StateLSTAGrant‐MakingProcess

1. CSLshouldmaintainitscurrenthighlevelsofperformanceinitsLSTAgrant‐makingprocess.CSLreceivedveryhighperformanceratings(i.e.,combinedexcellentandgoodratings)foritsapplicationguidelinesanditscommunicationwithgranteesaboutreportingrequirements.WhileCSLalsoreceivedhighratings(inexcessof80%)foritsfeedbackaboutproposalscoringanditstrainingofferingsforproposalwriters,thereisroomforimprovementintheseareas.

2. ItisrecommendedthattheLSTACoordinatorrequestmoreconstructivelycriticalcommentsfromproposalreviewers,andsharethesewithapplicants.

3. Itisfurtherrecommendedthatastrategybedevelopedforextendingmoreintensivehelpinproposalwritingtonewproposalwriters,especiallythoseassociatedwithlibrariesinisolatedareasandwithsmallstaffs.Onepossibilityistoconsiderestablishingamentoringprograminwhichnew,inexperienced,orunsuccessfulproposalwritersarematchedwithsuccessfulproposalwritersinsimilarcircumstances.

Key2008‐12CSLActivities

1. Allofthe14CSLactivitiesassessedbyColoradolibraryleadersreceivedveryhighperformanceratings(i.e.,combinedexcellentandgoodratings).Forthisreason,itisrecommendedthattheybecontinuedandthattheirfurtherdevelopment—asongoingactivitiesorasmodelsforfutureactivities—bepursuedbyCSLand,whenappropriate,itspartners.

2. Notably,leaders’assessmentsoftheperformanceofCSLonsomeoftheseprojectswerehighdespitethefactthatlittlesubstantialoutcomedataisavailableforthem.Redoubledeffortsatoutcome‐basedevaluation(OBE)—specificallycollectionofoutcomedatafromend‐users—isespeciallyrecommendedforthefollowingprojects:ColoradoVirtualLibrary,LibraryJobline,Plinkitwebsiteservices,andSWIFTinterlibraryloansupport.WithsupportfromLibraryResearchService(LRS)staff,staffassociatedwiththeseprojectscouldplayleadingrolesinimplementationofthisreport’sOBErecommendations.

KeyProposed2013‐17CSLActivities

1. Forthegoaloflearningforallages,allthreeproposedactivitiesreceivedveryhighpriorityratings(i.e.,essentialandveryimportantcombined)—rangingfrom72%to85%.ItisrecommendedthatCSLpursueallthreeoftheseactivitiesaspartofitsnextstateLSTAprogramplan.

2. Forthegoalofresourcesharing,hostingandsupportinge‐resources,primarilye‐books,wasprioritizedmorehighlythansupportingnewlibrarydistrictsandaddingCVLcollectionsforimagesandaudiofiles(77%vs.59%and50%respectively).Concernaboutcopingwiththee‐bookrevolutionalsotoppedtheprioritiesidentifiedbyrespondents,beingmentionedatleasttwiceasoftenasanyotherpotentialpriority.Itisrecommended,therefore,thattheissueofe‐booksreceivetoppriorityunderthisgoal.Ifresourcespermit,however,theotherpotentialprojectsshouldbepursued.(Notably,only5%ofrespondentsfeltthosetwoprojectswereunimportant.)

3. Forthegoaloftrainingandrecruitmentoflibrarystaff,libraryleadersgaveequallyhighprioritytotwoinitiatives:leadershipforthediscussionofinnovationinlibrariesanddevelopmentoftoolsforHighlyEffectiveSchoolLibrarians(thesuccessortoPowerLibraries).Whenrespondentswereaskedtoidentifytheirownpriorities,manymentionedspecificexamplesofdevelopingleadershipforinnovationandteaching21stCenturyskills—thoughthelatterwasbynomeanslimitedtotheK‐12publiceducationarena.Itis


Page6

recommendedthatbothoftheseinitiativesreceivehighpriorityinthenewstateplan.Theotherpotentialprojectforthisgoal‐‐offeringtrainingondatauseforneedsassessment,planningandevaluationandpublicrelationsandmarketing—alsoreceivedahighpriorityrating.Thisprojectisalsorecommendedforimplementationunderthenewplan.

4. WhileCSLhaslongstandingandongoingmandatestoservecertainspecificunderservedpopulations—blindandphysicallyhandicappedpersonsandinstitutionalresidents,mostnotably—respondentsidentifiedotherunderservedpopulationswhichlibrariescoulddoabetterjobofserving.Amongthesewereolderpeople,individualswhohavedifficultyspeakingorreadingEnglish,andtheunemployed.Arguablyanothergroupidentifiedbylibraryleaders—businessesandtheiremployees—shouldalsobementionedinthiscategory.ItisrecommendedthatCSLcontinuetosupportgroupsandprojectsthatseektobetterequiplibrarystafftoservediversepopulations.

Outcome‐BasedEvaluation(OBE)Recommendations

1. ForeachfutureLSTAgoal,CSL—eithersomeonefromtheLibraryResearchService(LRS)stafforacontractorworkingunderLRSortheLSTAcoordinator’ssupervision—shouldadoptappropriateoutputandoutcomemeasuresfromthosedevelopedbyIMLSfordatabases,digitization,employmentandsmallbusinessdevelopment,humanservices,lifelonglearning.(SeeappendixB“LogicModels”)

2. AsaconditionofreceivingastateLSTAgrant,granteesshouldberequiredtoselectappropriateoutputandoutcomemeasuresfromthelistproducedforitsLSTAgoal.Itislikelythatanindividualgranteewouldnotbeexpectedtocollectdataonallspecifiedmeasuresforitsgoal;butallthemeasuresonwhichitdoescollectandreportdatashouldbefromthelist.Ifanindividualgrantee’sprojectisdeemedsouniqueastowarrantit,orisnotaddressedbytheIMLSlogicmodels,dataonalternativemeasurescouldbecollectedandreported,butonlyifapprovedbyCSL.

3. Wheneverpossible,CSLshouldproduceorcontractfortheproductionofstandardizedoutputandoutcomedatacollectioninstruments.Mostoften,thesewilltaketheformoftallysheetsorsurveyforms.Wheneverpossible,theseshouldbemadeavailabletogranteesinappropriateelectronicformats(e.g.,spreadsheets,onlinesurveys,apps)thatminimizethedatareportingburdenonstaffofLSTA‐fundedprojects.

4. Forobservational(mostoften,output)data,granteesshouldberequiredtoidentifythetimeperiodoverwhichtransactionswerecounted,andtoprovidesummariesofsuchdataoverthegrantperiodorareasonablysubstantialportionthereof.

5. Forsurveydata,CSLshouldpromulgaterequirementsthatallofthefollowingdatabereportedinsurveyresults:a)the“universe”ofthesurvey(i.e.,numberofpotentialrespondentstowhomasurveywasadministered),b)thenumberofsurveyrespondents,c)theresponserate(respondentsasapercentofuniverse),and—forindividualsurveyitems—andd)thenumberandpercentageofrespondentsgivingeachresponseoption.Inthecaseofquasi‐experimentalandtime‐seriesanalyses(i.e.,onesmeasuringchangeovertime),alloftheaboverequirementsshouldapplyforbothorallyearsaswellasarequirementtoprovidebothnumericalandpercentchangestatisticsfromoneyeartoanother.Theviabilityofdevelopinganonlineforminwhichsuchdetailscouldbereportedshouldbeexplored,andimplemented,ifdeemedusefulandCSLresourcespermit.Again,suchresourceswouldreducethereportingburdenonLSTA‐fundedprojectstaff.

6. Ideally,alloftheserequirementsshouldbeintegratedintotheRequestforProposalsforstateLSTAgrants.Otherwise,prospectivegranteesshouldberequiredtodocumentindetailtheirplansformeetingOBErequirementsbeforeagrantisconferred.

7. TofurthercommunicatethehighvalueplacedonhavingcomparableoutputandoutcomedataforallLSTAgrantees,theperformanceofagrantee(eithertheorganizationortheindividualsinvolved,asappropriate)onpreviousgrantevaluationsshouldbeallocatedpointsintheevaluationoflaterLSTAgrantproposals.Attheveryleast,theseissuesshouldbespecifiedforconsiderationaspartofanoverall“reputational”assessmentofLSTAsub‐grantapplicants.

8. ToensurethatCSLholdsupitsendofthesenewOBE‐relatedexpectations,supportofgranteesinmeetingthemshouldbeperformedbytheLSTAcoordinatorandanystaffofLRSandotherCSLunitsassignedtosupportspecificLSTAgrants.GiventhelimitedresourcesofCSL,planningandbudgetingforthisaddedworkloadisakeycomponentofsuccess.


Page7

EvaluationofColorado’sLibraryServices&TechnologyActProgram2008‐12

BackgroundThisevaluationoftheColoradoStateLibrary(CSL)LSTAProgramPlanfor2008‐12wasdesignedtomeetrequirementsoftheInstituteofMuseumandLibraryServices(IMLS):toevaluateCSLperformanceonitslastfive‐yearLibraryServicesandTechnologyAct(LSTA)stateprogramplan;togatherinputfromstakeholdersforthenextfive‐yearplan;andtoinformCSLstakeholders,partners,andotherpotentialgranteesintheColoradolibrarycommunityregardingthelikelycontextinwhichtheymaybesubmittingstateLSTAgrantproposalsoverthenextfiveyears.Thisevaluationaddressesthreemajorsetsofissues:theextenttowhichCSLanditssub‐granteesperformedwellunderthe2008‐12plan,specifically—asfarasknowable—generatingintendedoutputsandoutcomes;howwellCSLmanagedtheprocessofmakingLSTAsub‐grantstootherlibrariesandorganizations,andhowthatprocessmightbeimproved;andhowCSLstakeholdersprioritizeavarietyofproposedactivitiesthatmightbefundedviaLSTAoverthenextfiveyears.ValuesandprinciplesguidingthisevaluationincludedallofthosepromulgatedbytheAmericanEvaluationAssociation:systematic,data‐basedinquiry;evaluatorcompetence;honestyandintegrityoftheevaluationprocess;respectfortheopinionsandprivacyofparticipants;andrespectforthediversityofinterests—inthiscase—withinthescopeofLSTAfunding.MethodologyThisevaluationreliedprimarilyontwomethodologies:availabledataandasurvey.

AvailableDataDuetothelackofcomparableoutputandoutcomedatacollectiononallLSTA‐fundedactivitiesduring2008‐12,theonlyreasonablesourceofsuchdatawasthefederalLSTAreportingsystem.OriginalcollectionofoutputandoutcomedataonmostColoradoLSTA‐fundedactivitieswasdeemedinadvisableduetoitsnon‐existence,thedifficultiesinvolvedinaccessingsuchdatafrommanyprojectssolongafter‐the‐fact,andthedeparturesoflibrarydirectors,projectdirectors,andotherprincipalplayersfromlibrariesandorganizationswhereprojectswerebased.ThefederalLSTAreportingsystem’sannualrequirementsincludereportingofoutputandoutcomedata.WhilesuchdatawerecompiledforallColoradoLSTA‐fundedactivitiesthatcompliedwiththoserequirements(seeappendixC“ReportedOutputandOutcomeData”),selectedexamplesofmoreexemplaryreportingofoutputandoutcomedataareincludedinthebodyofthisreport.Thestrengthsofthisavailabledataapproachtogatheringoutputandoutcomedatawere:1)itspracticalitygiventhetimeframe,2)itsefficiencyandlackofredundancyinexploitingdataalreadyreported,and3)itsreadyavailabilitythankstothefederalLSTAreportingsystem.Theweaknessesofthisapproachconcerneddatagapsandthetwomostapparentreasonsfortheirexistence:1)thefailureofsomefundedprojectstomakeandimplementrigorousevaluationplansthatcouldgeneratesuchdata,and2)thefailureofsomefundedprojectstocorrectlyidentifyvalidoutputandoutcomedata—reportinginputs(e.g.,staffhired,materialspurchasedordistributed)asoutputs,andoutputsasoutcomes(e.g.,changesincirculation,visits,programparticipation).

SurveyTofillsomeofthesedatagaps,totheextentpossible,andtoinvolveabroaderspectrumofstakeholdersinevaluatingthestateLSTAgrant‐makingprocessandprovidinginputforthenextfive‐yearplan,asurveyofColoradolibraryleaderswasalsoconducted.Libraryleadersincluded:past,current,andincomingoffice‐holdersforallofthestate’slibraryassociations;boardmembersandotherdirectormembersofsingle‐andmulti‐typelibraryconsortia;membersofregionallibrariangroups;otherspecialinterestgroups;andself‐identifiedinformal,emerging,andaspiringleaders.(SeeappendixD“SurveyRespondents&ResponseRate”)ToevaluateCSL’sLSTAgrant‐makingprocess,non‐applicantswereaskedtoidentifyhindrancestotheirsubmittingproposals,applicantswereaskedtoevaluatespecificaspectsoftheprocess,andallrespondentswereaskedforideasabouthowtoimprovetheprocess.Duetothevarietyofgoalsandactivitiesaddressedandthevarietyofstakeholdersinvolved,itemsusedtofillgapsinavailabledataabout2008‐12activitiesaskedrespondentstoassessCSL’sperformanceonspecificactivitiesonanexcellent/good/fair/poorscale.Inreportingtheseresults,excellentandgoodpercentagesweresummedfora


Page8

performancerating.Toprovideinputforthenextfive‐yearplan,respondentswereaskedtoidentifyspecificproposedactivitiesasessential,veryimportant,important,ornotimportant.Inreportingtheseresults,essentialandveryimportantpercentagesweresummedforapriorityrating.ThestrengthsofthissurveyapproachtogatherfurtherevaluationdataaboutColorado’sperformanceonits2008‐12planaswellasinputforthenextfive‐yearplanaretheusualstrengthsofasurvey:1)itpermittedarelativelylargenumberofindividualstoparticipateinarelativelyshorttime,2)itgatheredsystematic,comparabledataaboutthesameissuesfromallparticipants,and3)itallowedforarelativelyconciseandcomprehensiblereportofalargeamountoffeedback.Thesestrengthsofasurveywereespeciallyimportantgiventhelimitedlengthofthisreport.Thedisadvantagesofthisparticularsurveywerethat1)itwasnotreasonabletoaskforoutputoroutcomedataofthepreferredsort,and2)likeallsurveys,especiallythosetargetingadiverseaudience,ittendedtogeneratemoredataformoregeneralandmorefamiliaractivities.(SeeappendixE“SurveyofLibraryLeaders”)ToplanthesurveyofColoradolibraryleaders,theCSLManagementTeamwasinterviewedasafocusgrouptogeneratelistsof2008‐12CSLactivitiestobeevaluatedandlistsofproposedactivitiestobeprioritized.(SeeappendixF“FocusGroupInterviewofCSLManagementTeam”)

ValidityandReliabilityAvailabledataonwhichthisevaluationhadtorelywereoftenscantlyreported,sothereareconsiderableissuesofvalidityandreliability,thoughmostofthemcanbeaddressedforthenextfive‐yearplan.Asforsurveysgenerally,thesurveyformatsemployedwentalongwaytowardinsuringreliability.Forinstance,allparticipantsweregiventhesametimewindowinwhichtooffertheirresponses,allrespondedtoeachindividualitemonthesamescale.Also,asforsurveysgenerally,validitywasthelargerproblem.Necessarily,surveyitemsassumedareasonablelevelofawarenessofindividualactivitiestowhichparticipantswereaskedtorespondforbothevaluationandplanningpurposes.Toreducetheriskofcertaininvalidresponsesonevaluationitems,respondentshadtheoption“notfamiliar”toescapeevaluatinganyactivityaboutwhichtheyknewtoolittletodosoreasonably.Thetwoprimaryscalesusedinthesurvey—excellent/good/fair/poorforevaluationitems,essential/veryimportant/important/notimportantforplanningitems—whilegeneral,werechosenbecauseoftheirfamiliaritytomostrespondents.Proposalsforoutputandoutcomedatacollectionactivitiesassociatedwiththenextfive‐yearplanwilladdressmajorconcernsaboutbothvalidityandreliabilityofColorado’sfutureLSTAevaluationdata.

FindingsFindingsarereportedseparatelyfortheavailabledataandsurveyphasesofthisproject,thoughbothbyLSTAgoal.

AvailableDataonOutputs&OutcomesOutputandoutcomedatafromthefederalLSTAreportingsystemindicatethatactivitiesundertakenachievedresultsrelatedtoLSTApriorities,benefitingtargetedindividualsandgroups.Following,foreachColoradoLSTAgoal,arereportsaboutactivitiesforwhichthemostexemplaryoutputand/oroutcomedatawerereported.(SeeappendixC“ReportedOutputandOutcomeData”)These21granteesinclude6CSL‐basedprojects,5projectsledbyconsortialgroupsorpartnerships,and10localprojects.Ofallgranteesduringthe2008‐12planningperiod,theyprovidedthebestoutputand/oroutcomedatatoCSLviatheirannualreports.Whilesomegranteesreportedsuchdatamorecompletelythanothers,theyreportedthemostcompellingevidencethattheirprojectshadproducedintendedoutcomesforend‐users.Othergranteesreportedmorepiecemealdataofoneorbothtypes—evidencewhichusuallywaslesscompelling,eitherduetothelimitednatureofthereportingorthelimitedresultsreported.


Page9

Goal1:Coloradoresidentswillbeabletoaccessresourcesandserviceselectronicallythroughlibrariestomeettheirinformationandlearningneeds.

FortLewisCollege,JohnF.ReedLibrary,ResearchCommons

ReedLibraryestablishedaone‐stoprepositoryforthepublishedandunpublishedscholarlycontributionsofitsfaculty,staff,andstudentstoincreasetheirvisibilityandaccess.Activitiesoftheprojectincluded:purchasingandimplementingtheBerkeleyElectronicPressDigitalCommonsPlatform;identifyingstudentworkstobeincluded,andintroducingthedigitalcommonstotheFortLewiscommunity.Outputs OutcomesAsofApril2009,outputsassociatedwiththedigitalcommonsitselfincluded: 102samplestudentsubmissions 400+downloadsofthosesubmissionsTheApril2009eventwasattendedby: 36individuals,mostlyfaculty

Of36eventattendees,17(47%)respondedtoanevaluationsurvey,andreportedthefollowing: 17(47%)assessedthepresentationwashelpful 14(39%)anticipatedcontributingtothedigital

commons

WestminsterPublicLibrary,IrvingBranch,OnlineAccessExpansion

WestminsterPublicLibrary,IrvingBranch,providedincreasedaccesstocomputerresources,Internetconnectivity,andeducationalopportunitiestoaneconomicallydisadvantagedcommunityinWestminster.Activitiesincluded:acquiringnewequipmentandmakingitavailabletothepublic;aswellascreating,promoting,andofferingcomputerandjobsearchclasses.Outputs OutcomesClass‐relatedoutputsincluded: 37computerandjobsearchclasses 155attendeesofsuchclassesForthe7newcomputers,outputsincluded: 8,108usersessions 4,897hoursofuse 35.5minutesperaveragesession 4:51perday,averagecomputerinuse

Ofcomputerclassattendeescompletingevaluations: 61%ratedtheclassexcellentAttendeesreferredtothequalityoftheclasses,theirinterestinfurtherclasses,andthevalueoftheservice,especiallyforanyonelookingforwork.

ColoradoLibrariesforEarlyLiteracy,StoryBlocks

InJuly2010,ColoradoLibrariesforEarlyLiteracy(CLEL),inpartnershipwithRockyMountainPBS,launchedtheStoryBlockswebsite(http://www.StoryBlocks.org),anonlinevideocollectionforparents,caregivers,childcarestaffandlibrarystaff.ActivitiesandliteracytipsfromColoradolibrarianshelptodevelopliteracyskillsinearlychildhood.Outputs OutcomesWebstatistics,Aug1‐Sept19,2010 almost7,500visits averageof150timesperday averagevisitlength:22minutes eachvideopageaccessedmorethan100times mostpopularvideos:

o BabyHop(1,297views)o ChocolateChocolate(1,032views)o ChooChooTrain(982views)o YouCanStretch(960views)

Of130staffevaluatingthevideos: 59%wouldrecommendthemtoparents/caregivers 57%wouldrecommendthemtoco‐workers 48%reportedreinforcedorincreasedlikelihoodof

usingearlyliteracyactivitieswithchildren 48%anticipatedsharingtipswith

parents/caregiversOf20parents/caregiversevaluatingthevideos: 18understoodwhysongsandrhymesareimportant

tochilddevelopment 15wouldwatchmorevideosaboutreadingtotheir

child 14wouldrecommendthevideosto

parents/caregivers 13singanduserhymeswiththeirchild 10involvetheirchildmoreinbooksreadtogether 10readmoreoftentotheirchild


Page10

AdamsStateCollege(ASC),NielsenLibrary,MobileLearningCenter&LaptopLoanProgramBeginningin2007,NielsenLibraryexpandeditsoutreachprogramtomakestudentsandcommunitymembersmoreknowledgeableabouttechnology.TheMobileLearningCenter,aportablecomputerlabof10laptops,allowsstafftoofferfreetechnologyinstructionincollaborationwithpubliclibrariesinsouthernColorado’sSanLuisValley.Whenthelaptopsarenotinuseasalab,theyareavailableforcheckoutbyASCfaculty,staff,andstudents.FromJanuarytoSeptember2008,classeswereofferedonbasiccomputingskills,theInternet,MicrosoftOffice,resumebuilding,andconsumerhealth.Outputs OutcomesClassoutputsincluded: ClassesofferedinlocationsthroughouttheSanLuis

Valley 450+communitymembersattendedLaptopLoanProgramhaslogged: 100+hoursoflabusefromJanuary2008to

September2008

Outcomecommentsfromclassparticipants: Benefitsforbothseasonedofficeworkersasthose

newtotechnology Expectationsofcareeradvancement Appreciationbyseniorsoftheabilitytocommunicate

withfamilymembersOutcomecommentsfromorganizationalpartners: Breakingdownbarriersinthecommunity,and Bringingpeopleintolibrarieswhomightnothave

comeotherwise.Alamosa(formerlySouthernPeaks)PublicLibrary,SanLuisValleyLibrariesTechnologyLearningProject

Thiscontinuationgrantofferedcomputerclassestocreateanewlineofweb‐basedclassestobesharedviatheColoradoVirtualLibrary(CVL),andtoprovidetheopportunityforinterestedparticipantstotakeaseriesofclassesforcertificatesofcompletion.Majoractivitiesincludedidentifyingneededtechnologyskillswithbusinessesandcommunity‐basedorganizations;maintainingcourseson25+topicsandofferingweeklyclassesatthenineparticipatinglibraries;anddevelopingfivenewWeb‐basedonlinecourses.Outputs OutcomesAsofSeptember30,2010,classoutputsincluded: 269classsessions 1,013totalclassattendanceAsofSeptember30,2011,classoutputsinclude: 347classsessions 1,018totalclassattendance

Of95respondentstoanevaluationsurvey: 82%assessedclassesasveryhelpful,and 39%indicatedplanstoattendthefullseriesof

classestoreceiveacertificateofcompletion.

Goal2:Coloradostudentsandadultlearnersreceiveservicesfromlibrariesandlibrariansthatsupporteducationalachievementandlifelonglearning.

ColoradoStateLibrary,Power(nowHighlyEffectiveSchool)LibrariesSince1998,thisprogramhasenabledschoollibrarians,teachers,andadministratorstodevelopmentoringpartnershipsthatencourageinstructionalcollaborationandtheintegrationofwhatarenowcalled21stCenturylearningskillsintothecurriculum.In2010/11,PowerLibraries,aprogramforself‐selectedschoollibraries,beganitstransformationintoHighlyEffectiveSchoolLibraries(HESL),astatewideprograminvolvingallschools.Theprogramfacilitatescreationofmentoringpartnerships,providestrainingevents,andsupportsanonlinecommunityofparticipants.Outputs OutcomesDuringthelastyearofPowerLibraries,2010/11,therewere: 83high‐performanceschoollibraries 31developinglibraries 150teacherlibrariansattended18sessions 231participantsintheTeacher‐LibrarianNingAsofJune2011,HighlyEffectiveSchoolLibrariesbeganwith: 42highlyeffectiveparticipants 60highlyeffectiveapplicants

Evaluationsof5 2009/10trainingsessionsindicated: 90%saidinfousefultoimproveprograms 98%ofdevelopingschoolssubmittedactionplans 100%ofdevelopingschoolsreportvisitstomentor

schoolsincreasedknowledgeaboutcollaborativeplanning/teaching

100%ofdevelopingschoolsreportprogressinincreasingcollaboration

25%ofdevelopingschoolsbecamehigh‐performance 98%ofdevelopingschoollibrarianssetgoalsfor

improvementbasedonconferencewithprincipal


Page11

ArapahoeLibraryDistrict,ParentandChildLiteracyProjectManyparentsdropoutofEnglishasaSecondLanguageprogramsbecausetheycannotfindasafeplacefortheirchildrenwhiletheyattendclasses.Thisprojectaddressedthisneedbyprovidingliteracy‐basedlibraryservicesto3‐11yearoldchildrenofadultEnglishlanguagelearners,whiletheadultslearnedEnglishskills,andbyfacilitatingparentandchildtogethertime,choosingbooks,readingtogether,andwriting.Outputs OutcomesFromOct2008toMay2009: 92youthserved 358children’sbooksdistributedattwosites 2,201hoursprovidedby14volunteers

AtSheridansite—fromfirsttwotolasttwosessions—checkoutsincreased37%.AtMaysite—fromfirsttolastweekofSpringsession—checkoutsincreased89%.Youthwithlibrarycardsincreasedfrom3%to75%.AtSheridansite,adultstudentswere25%morelikelytoattendnightsessions.65%ofLevel1and2studentscompletedthoselevels.Parentscreditedchildrenwithmotivatingtheirhigherlevelsofparticipationandsuccess.

Academy20,SummitMiddleSchool,Library&LiteracyPartnershipProgramThisprojectformedapartnershipbetweentheSummitMiddleSchoollibraryprogramandthepreschoolprogramtoincreaseliteracyskillsandloveofreadingforbothmiddleandpreschoolstudents.Middleschoolstudentswereassignedpreschoolerreadingbuddieswithwhomtoreadeachmorningandafternoon.Preschoolerskeptbooksatschoolduringtheweek,andsharedthemwiththeirfamiliesathomeovertheweekend.PikesPeakLibraryDistrictchildren’sservicesstaffpartneredwithSummitMiddleSchoollibrarystaff.Eventswereheldtokick‐offandconcludetheprojectaswellastointroducemiddleschoolerstotheirpreschoolreadingbuddies.Outputs OutcomesBetweenJanandMay2009:AtBriargatepreschoollibrary,150preschoolerscheckedout1,464books.AtSummitMiddleSchoollibrary,50studentscheckedout355books.120preschoolersand50middleschoolersparticipatedinthereadingpartnersprogram.

Surveyresponses frommiddleschoolers: 71%liketoread 81%enjoyedreadingaloudtopreschoolers 37%arereadingmorethantheyusedtoSept2008toMay2009medianfluency(wordsperminute): Programparticipants:125to149 Non‐participants:130to140JantoMay2009self‐perceptionofmiddleschoolersasgoodatreadingaloudtopreschoolers:50%to65%Literacyandlanguageassessmentofpreschoolers:Majoritytestedatlevel1or275%+achievedlevels3,4,or537of40preschoolersinterviewedindicatedlikingtoread.

ColoradoLibrariesforEarlyLiteracy(CLEL),EnhancingColoradoLibraryStorytimesThisprojecttrainedandsupportedyouthserviceslibrariansinsmall‐townandrurallibrariesinthePLA/ALSCEveryChildReadytoRead(ECRR)program,enablingthemtoprovideliteracy‐enhancedstorytimestoyoungchildrenandtheirparentsorcaregivers.ParticipatinglibrarieshadCLELmentorswhohelpedthempracticeECRRtechniquesbefore,during,andafterstorytimes.Outputs OutcomesIn‐libraryprograms: 11,580programs 211,749childrenattending 109,472adultsattending 33adult‐onlyprograms 520attendingOff‐siteprograms: 5,738programs 101,974childrenattending 13,900adultsattending 67adult‐onlyprograms;1,010attending

Trainingevaluationresults(5‐pointscale): Allskillscombined:4.6 66%ratedveryhelpful(5outof5) 33%ratedhelpful(4outof5)Pre/post‐trainingstorytimeobservationscoresondialogicreading(5‐pointscale): Pre‐training:1.1 Post‐training:4.1Allpost‐trainingobservationsindicatedtraineessharedearlyliteracymessagesduringstorytimeandaddressedatleastoneearlyliteracyskillduringstorytime.


Page12

Johnson&WalesUniversity(JWU),ConnectingInformationLiteracytoLearningThisprojectdeliveredinformationliteracyinstructiontotheJWUstudents;integratedcomputer,libraryandinformationethicsskillsintoinstructionalcontent,andincreasedtheinformationliteracyskillsofnearbyDenverSchoolofScienceandTechnology(DSST)students.Libraryinstructionforstudentswasintegratedintogeneraleducationandcorecurriculumcourses,whilefacultyreceivedlibraryorientationaswellassessionsonspecificinformationsources.Outputs OutcomesJWUstudents: 19GetConnectedsessions 285studentsattendingJWUfaculty: 8newfacultyoriented 40facultytrainedoncopyrightguidelinesandfinding

casestudies 26facultyintroducedtospecificinformationsources2007/08‐2008/09statisticaltrends: Labreservations:76to171 Circulation:11,820to13,898 Studentcirculation:11,023to12,9042008/09: 49,774visitstolibrarywebsite’sResearchHelp

section 9,429visitstoClassGuidessectionofwebsite(most

visitedpartofResearchHelpsection)DSSTstudents:73studentsattended4infoliteracysessionsLibraryresource/serviceusagerates,2007/08‐2008/09: Individuallabuse,up18% Classlabreservations,up125% InfoDeskquestions,down15% Circulation,up18% Studentcirculation,up17%

GetConnectedsessionevaluation(176students): 79%moreconfidentusinglibraryresources 66%likedtourmethod 70%foundgameeffectivetolearnaboutresources 80%founddemonstrationseffectivewaytolearn

aboutlibraryresources 65%foundtutorialseffectiveInfoLiteracysessionevaluation(608students): 86%strongly/agreedinstructionwasusefulInfoLiteracyAssessmentscores,2007/08‐2008/09: Averagefreshmanscore:70‐71% Averageupperclassmanscore:73‐75% JWUaveragestudentscore:72‐73%Librarysatisfactionsurveyresults(452students): 82%very/satisfiedwithlibraryFacultycompliancewithinfoliteracyinstructionrequirements: Infoliteracyresearchsections:100% Infoliteracyinstructionsections:100% Infoliteracyassessmentsections:95%Facultyawarenesssurveyresults: 73%awareoflibraryresources 35%uselibraryresources 53%encouragestudentstouseresources 78%awareoflibraryservices 36%uselibraryservices 47%encouragestudentstouseservicesDSSTstudents:81%reportedincreasedconfidenceininfoliteracyskills

Goal3:Coloradoresidents,peoplewithdisabilities,ethnicpopulations,institutionalresidentsandthoseunderservedbylibrariesreceiveservicesfromColoradolibrariesthatmeettheirtargetedneeds.

ColoradoStateLibrary,InstitutionalLibraries,ReadtotheChildrenTheReadtotheChildrenprogramisdesignedtoincreasetheliteracylevelsofbothprisonersandtheirchildrenandtostrengthenfamilybonds.Prisonerslearntoreadsotheycanrecordabookfortheirchildren.Asaresult,relationshipsbetweenprisonersandtheirfamiliesimprove—anindicatorofre‐entrysuccessafterreleasefromprison—andchildrenofprisonersreceivebooksthatcelebratetheirheritageandculture.


Page13

Outputs OutcomesChildrenofprisonersreceivedbooksanddigitalrecordingsfromtheirincarceratedparents FY2010/11:1,700+ FY2009/10:1,300+

FY2010/11: 70%ofcaregiverstochildrenofincarceratedparents

reportimprovedrelationshipsbetweenchildandparent

66%believethechild’sreadingabilityhasimprovedAnecdotaloutcomes: increasedliteracyskillsofoffendersandchildren improvedparentingskills strengthenedparent‐childrelationship enhancedrelationshipbetweenparentandcaregiver developedinterestandenthusiasmforreading gavechildareaderandlibraryuserasarolemodel reducedoffenderidleness improvedoffenderbehavior easedfamilyreunificationuponoffender’srelease createdhomeenvironmentsupportiveofreadingand

educationDenverPublicLibrary,FreetoLearn

FreetoLearnisaDenverPublicLibraryoutreachprogramdesignedtouselibraryresourcestoimproveoutcomesinthreeareasforwomenwhohaveservedtimeinprison:computerandInternetskills,jobsearchskillsandreadiness,andlibraryawarenessandunderstanding.Activitiesincluded:one‐one‐oneteachingsessions,groupcomputerlabs,andconnectionswithcommunity‐basedorganizations(EmpowermentProgram,TheGatheringPlace),theDepartmentofCorrections,halfwayhouses,andtheDenverWomen’sCorrectionalFacility.Outputs OutcomesFY2010/11:Of40participatingwomen: 36(9/10)clientsreferredbycasemanagersor

halfwayhouses 26(3/5+)completedjobapplication 22(1/2+)usedacomputer 21(1/2+)searchedforjob 20(1/2)learnedtodownloadmusicfromwebsite 17(1/3+)usedlibrary 14(1/3)6+sessions,another10attended4‐5

All40(100%)leftprogramwithresumeandemailaccountOf31reachedforfollow‐up: 24(3/4)foundjobs 3werestillseekingjobs 2weretakingclassesatCommunityCollegeof

DenverOnly4(1/10)weresentbacktoprison

LovelandPublicLibrary,LovelandKidsLovetoReadLiteracyOutreachLovelandKidsLovetoReadisanoutreachprojectofLovelandPublicLibrarydesignedtoincreaseaccesstolibrarymaterials,resources,andprogramsforchildrenresidinginlow‐incomehousing.Activitiesincluded:on‐siteprogramsathousingcomplexes,transportationbetweenhousingcomplexesandthelibrary,partneringwithPoudreHealthyKidstoprovideon‐siteoutdoorfitnessandnutritionprogramsaswellasliteracyprograms.Outputs OutcomesMarch‐May2009: 374attendanceat31sessions(average12per

session) 750booksdistributedtochildrenat3sites

Pre/postevaluationresultsfromMapleTerracesite:Visitedalibrary:51%/100%Checkedoutalibrarybook:56%/78%Post‐project,LovelandHousingAuthoritywillcontinueprovidingtransportationbetweenhousingcomplexesandlibrary.Anecdotaloutcome:2boys(ages9and10)frequentlydisplayeddifficultbehaviors,sowereaskedtoleavetheprogramafter2warnings.After15minutesof“timeout,”theyconsistentlyreturnedtoobserveotherchildrenandactivitiesfortheremainderoftheprogram.Atprogram’send,theyoftenrequestedtoassiststaffwithclean‐upandtochooseonebook(not2booksasforcooperativeparticipants)totakehome.


Page14

AurariaLibrary,LatinosinColorado:A4thGradeColoradoSocialStudiesCurriculumProjectTheAurariaLibraryservesthethreehighereducationinstitutionsthatsharetheAurariaCampus—theCommunityCollegeofDenver,MetropolitanStateCollegeofDenver,andtheUniversityofColoradoDenver.TheLatinosinColoradoprojectstrengthenedLatinocollectionsandinformationinstructiontosupportacademicsuccessforLatinostudentsinColorado.Inadditiontocreatingadigitalphotographycollectionandvideosabouthowtouseit,theprojectcreated,disseminated,andassessedstandards‐alignedfourth‐gradeColoradosocialstudiescontentbasedonthiscollection.Outputs OutcomesFY2010‐11: 2workshops 65ruralandurbanteachersattend

FY2010‐11pre/postworkshopresults Comfortwithfindingdigitalprimarysources:58%/

100% FamiliaritywithHispanichistoryinCO:52%/88% HowtofindprimarysourcesonColoradoHispanic

history:39%/88% 88%indicatedwouldshareinfolearnedwith

colleagues

ColoradoTalkingBookLibraryCTBLservesover7,000patronswho,duetophysical,visual,orlearningdisabilities,areunabletoreadstandardprintmaterials.PartoftheColoradoStateLibrary—adivisionoftheColoradoDepartmentofEducation—itisaffiliatedwiththeLibraryofCongress’NationalLibraryServicefortheBlindandPhysicallyHandicapped.Outputs Outcomes2010‐11generaloutputs 6,392registeredpatrons 429,769circulation 23,000callsfrompatronsansweredbystaff 1,100emailsfrompatronsansweredbystaff 28,000OPACtransactionsBraille&AudioReadingDownload(BARD)outputs 34,426downloads 263BARD‐relatedcallsfrompatronsansweredby

staff

2010patronsurveyresults(805responses)Useroutcomes 85%readforpleasure 37%learnedmoreaboutapersonalinterest 20%foundinformationneededforschoolor

job/career 20%helpedconnectwithcommunity(especiallya

communityorganization)Customersatisfactionoutcomes(excellentratings) 88%courtesyofstaff 80%speedofdelivery 77%easeofcontactingCTBL 74%qualityofplaybackmachine 69%completenessandconditionofbooksreceived 68%numberofbookssent

Goal4:ColoradolibrariescooperatetodevelopstrategiesandtechniquesthatassurethesharingofresourcestobestmeettheneedsofColoradoresidents.

ColoradoStateLibrary,LibraryTechnologyConsulting,PlinkitWebsitesUsingthePlinkit(publiclibraryinterfacekit)contentmanagementsystem,theStateLibraryhostswebsitesforsmallandrurallibrariesthroughoutthestatethatotherwisewouldnothaveafunctionalwebpresence.


Page15

Outputs OutcomesFY2010/11: 37websites(totaltodate) 170,000residentsservedFY2009/10: 33websites(totaltodate) 162,000residentsserved 22Plinkittrainingsessions 177attendanceFY2008/09: 29websitescreated 158,000residentsserved 12Plinkittrainingsessions 47attendance

Plinkitsitesgiveresidentsofsmallerandruralcommunities24x7accesstotheirlibrariesthattheydidnothavebefore.ThislevelstheplayingfieldwithusersoflargerandurbanlibrariesthatprovideaccesstoonlinedatabasesandotherInternet‐basedresourcesandservices.FY2008/09:Averageincreaseinwebtrafficfromnoornon‐PlinkitwebsitetoPlinkitwebsite:81%(high223%)Googlerankstudy:18Plinkit‐sitelibrariesappearedasnumber1Googlehitforselectedterms(only2failedtoappearintop50)

ColoradoStateLibrary,AskColoradoStatewideVirtualReferenceService

Since2003,AskColoradohasprovided24x7,chat‐basedonlinereferenceservicestoColoradoresidents.Librariansfromacademic,public,school,andspeciallibrariesthroughoutthestatestaffthisservice.Notably,theremovalofAskColoradofromthestategovernmentportalbetweenFY2009/10and2010/11hasledtoananticipateddeclineintrafficandanabilitytoconcentrateontheneedsoflibrarypatrons.Outputs OutcomesFY2010/11: 75participatinglibraries 27,138totalsessions(48%K‐12;46%general;10%

highereducation)FY2009/10: 76participatinglibraries 34,150sessions(65%K‐12,18%general,10%

highereducation)FY2008/09: 78participatinglibraries 41,198sessions

Fall2008usersurveyresults: 83%likelytouseAskColoradoagaininfuture 74%foundlibrarianhelpful 72%satisfiedwithanswertoquestion 51%ofstudentrespondentsdidresearchfor

homeworkorschoolproject 40%obtainedspecificfactordocument

ColoradoStateLibrary,Networking&Technology:SWIFT(StateWideInterlibraryLoanFastTrack)

TheStateWideInterlibraryLoanFastTrack(SWIFT)istheweb‐basedelectronicinterlibraryloanrequestingandtrackingsystemthatCSLprovidesfreeofchargetoallpublic,academic,school,andspeciallibrariesinthestate.Outputs OutcomesItemsborrowedviaILL2008 Academiclibraries:330,598 Publiclibraries:430,6212006 Academiclibraries:223,285 Publiclibraries:283,4092004 Academiclibraries:196,663 Publiclibraries:254,054

Asaresultofstatewideresourcesharingefforts,Coloradoresidentsareabletodrawmorethaneveronthecollectionsoflibrariesotherthantheirown.ILLitemsborrowedasapercentofcirculation,2004‐08 Academiclibraries:5.5%to10.8% Publiclibraries:0.5%to0.7%

Marmot&Prospector:SharingLibraryResourcesAcrosstheDivide

TheMarmotnetworkhas20memberlibrariesinwesternColoradoand3millionitemsinitsdatabase.TheProspectorprojectincludes25public,academic,andspeciallibrariesontheFrontRangeandinWyomingwithmorethan26millionitems.ThisprojectaddedMarmot’sitemrecordstoProspector,increasingthenumberofitemsavailabletoresidentsinColoradoandWyomingandincreasingbyanorderofalmost10thenumberavailabletoresidentsofwesternColorado.


Page16

Outputs OutcomesMarmotpatrondatabase,2010to2011 2011:43,779newpatrons 2010:43,023newpatronsJantoSept2011patron‐initiatedholds:Total:394,429 OriginalProspector:335,168 AdditionofMarmotincreasedtrafficby18%InMarmotlibraries,circulationupmorethan10%;holdsfilled,upalmost10%.

Anecdotaloutcomes: Studentsandlifelonglearnersbenefitfromaccessto

academicandresearchlibraries. Ruralpatronsandthoseinsmallercommunitieshave

accesstolargerandmorediversecollections. Smalllibrarieswithsmallbudgetsanddecreasingtax

revenuemaintainhighlevelsofcirculation. Largerlibrariesobtainmaterialsmorequicklyand

withoutplacingstaff‐initiatedILLrequests. Bookclubsbenefitfrombookclubkitsthatcanbe

reservedandborrowedwhenneeded.AcquisitionofInformationResourcesStatewide(AIRS)Committee,StatewideDatabases

Eachfiscalyear,theAIRSCommittee—agrouprepresentingtheColoradoStateLibrary,theColoradoLibraryConsortium(CLiC),theColoradoAllianceofResearchLibraries,andindividualpublic,academic,school,andspeciallibraries—negotiatesadatabasepackagefromEBSCOandOCLCataspecialstatewiderate.Thepackageincludesdatabasescoveringgeneral,business,andK‐12information.Outputs OutcomesNumberoflibrariessubscribingtoAIRSdatabasepackage 2010:719;2009:715;2008:695AIRSdatabaseuse,2009(%increaseover2008) K‐12schoollibraries:2,436,246(114%) Publiclibraries:2,348,402(842%) College/universitylibraries:2,355,003(47%) Communitycollegelibraries:542,437(143%) Speciallibraries:68,244(167%)Sept2008‐May2009:938Coloradolibrariansreceivedtrainingin25webinarsand37livetrainingsessions(excludesviewersofarchivedwebinars)

MillionsofColoradostudentsandteachersfromK‐12throughcollege/universitylevelwereabletoaccessinformationabouthealth,history,literature,science,andawiderangeofothertopics.Changesinthecompositionofthedatabasepackageovertheyearsaddresseddramaticallyincreasingdemandfromstudentsofallagesaswellaseducators.

ColoradoLibraryConsortium(CLiC),ASCC:ThePowerofSynergyinAction

ASCC(AutomationSystemColoradoConsortium)merged30separatecatalogsintoasingle,open‐sourcecatalog,AspenCat,whichcontainsalmost500,000itemsfrom30libraries(averagecollectionsize,15,000items).Thisopen‐sourceprojectdemonstratestheviabilityofresourcesharingatlowercosts.AteachAspenCatlibrary,activitiesincluded:cleaninguprecords,profilingthelibrary,conductingsampleandfullextractionsofrecords,testingthedatabase,holdingtrainingclasseswithlocalstaff,conductingthefinalrecordextraction,andgoinglive.Outputs OutcomesGeneralstatistics 30participatinglibraries 280,622bibliographicrecords 434,913itemrecords 64,799registeredborrowersTrainingstatistics 3sessions 38attendees 17visitstolibraries 1,018hoursoftrainingbyphone

Patronsurveysummaryfindings Twicethenumberofpatronsindicatedsatisfaction

withAspenCatcomparedwithSirsiDynixHorizon(previouscatalog).

NopatronsindicateddissatisfactionwithAspenCat.Focusgroupsummaryfindings Migrationexperiencewasgenerallyverypositive. 3mosteffectiveelements:

1. Timeallottedtoworkwithpracticesystem2. Timeline3. Consultantsupportbothintrainingandon‐call

consultingRecommendationsBasedonAvailableData

1. AlloftheseexemplaryprojectsreportedsufficientevidenceofsuccessthatCSLshouldwelcomefutureproposalstoreplicateandtoexpanduponthem.

2. Manyoftheseexemplaryprojectsdemonstratedsufficientunderstandingofoutputandoutcomemeasurementthattheirrepresentativesshouldbeaskedtoplayleadershiprolesinpromotingthemorestructuredapproachtofuturestatewideoutcome‐basedevaluation(OBE)beingformulatedbyIMLS,withadditionsrecommendedlater.

C

TaC

S

HOt

O

Oa

ColoradoState

ThesurveyofassessmentofCSL’sproposed

Surveyrespon1. Ifthei

respo2. Ifresp

associ3. Allres

grantHindrancestoOfthe203surthepastfiveye

Sevennotbe

Half( Justov

andin About

exper Oneo

requirOfanaddition

13ide 11rep 10ind

and 3obs

Ofremainingcansweredthe

eLibraryLSTA

ColoradolibraCSL’sperformdactivitiesfor

Endentswereasirlibraryororndentswereapondentshadiatedwiththespondentsweprocess.oGrant‐Seekrveyrespondeearsbyidentinoutof10(71eingagrantap50%)feltthatverathirdcrensufficientstaftoneoutofsixtise(16%).utof17(6%)redtosubmital46“Other(entifiedtheirlportedbeingudicatedbeingt

servedthatthcomments,moquestionbeca

AFive‐YearEv

aryleadersadmancetowardrits2013‐17pEvaluationofskedthreequerganizationhaaskedwhichoappliedforaLeLSTAgrantfuereaskedtopr

kingIdentifiednts,115(57%fyingoneorm1%)identifiedpplicant.ttheydidnoteditedtheirnofftimetoimplxnon‐applican

feltthattheaaproposalorpleasespecifylibrariesasineunawareofthtoonewtothe

heirlibrariesdosteitherexpaausetheirlibra

valuationRepo

Survddressedthreeits2008‐12gplan.fthe2008‐12estionsaboutadnotsubmittofseveralreasLSTAgrantinundingprocesrovidespecific

dbyNon‐App%)indicatedthmorehindrancthelackofsta

haveideasthaotapplyingforlementfundedntsblamedal

amountofgrantheoddsofby)”responseseligibleforstaeavailabilityoeirjobstokno

didnotneedgrandedonearliariesweregra

ort2008‐12

Page17

veyFindingemajorsetsogoals,andasse

2StateLSTAGthestateLSTAtedaLSTAgraonshadhindethelast5yeass.crecommenda

plicantshattheirlibrarcestodoingsoafftimetowri

atwereapprorgrantstoaladprojects(37lackofneeded

ntmoneyavaieingfunded.tothisquestioateLSTAgrantofstateLSTAowiftheirlibr

rantfunding.ierresponsesantrecipients

gsfissues:thesessmentofthe

Grant‐MakingAgrant‐makinantapplicatioeredthemfroars,theywere

ationstoCSL

riesororganio.Ofthoseresiteproposalsa

opriateforstatackofstaffexp7%).dpartners(17

ilablewasnot

on:ts,grants,rarieshadapp

tothequestio.

stateLSTAgraeimportancet

gProcessngprocess:ntoCSLinthmdoingso.askedtoasse

regardingthe

zationshadnospondents:asbyfarthem

teLSTAgrantpertiseinpro

7%)andinsuff

tsufficienttow

pliedforagran

onorexplaine

ant‐makingprtotheseleade

elast5years,

esskeyCSLpr

eLSTAcompet

otappliedfor

mostpopularr

tfunding.posalwriting

ficientstaffte

warrantthee

ntinthepastf

edthattheyha

rocess,ersof

ractices

titive

agrantin

reasonfor

(39%)

chnology

ffort

fiveyears,

adnot

C

AOp

Tg

O

ColoradoState

ApplicantAssOfthe203surpastfiveyears

Twooandha

Overa(57%)

Overaoverh

Threegood)

Thesubstantivgenerallyhigh

Ifounservic

Of58substant 15rec

Represtaffedwhati

10reccapitapropo

6praigrantsproce

eLibraryLSTA

sessmentofGrveyrespondesbyassessingoutoffiverespalf(50%)rateathird(36%))rateditasgoathird(35%)half(52%)rateoutof10(30—atotalof83

veadditionalchassessments

dCSLtobefuleperformance

tiverecommencommendedmesentativesofdbyasingleiisgoingonatcommendedthalizelarge‐scaosalsweremoisedtheproces,approvingoss.

AFive‐YearEv

Grant‐Makingnts,47(23%)thefollowingpondents(44%editasgood—ratedtheLSTood—anotherratedthefeedteditasgood—0%)ratedLST3%ratingapp

commentstotofColorado’s

llyengagedwie.

ndations,41fmoretargetedruralpublic,sndividual—aseachstepinthatCSLshouldle,statewideirecompetitivessas‐is,callinoftheprocess’

valuationRepo

gPractices)indicatedthaCSLgrant‐ma%)ratedcomm—atotalof94%TAgrantapplirtotalof94%dbacktheyrec—atotalof87Agrantapplicplicationtraini

thisquestionwLSTAgrantfu

ithgrantees,o

fallintofivecacommunicatischool,institutskedthatCSLhegrantcycledmakeeitherinitiatives(e.getoensurethngparticularasscale,andgi

ort2008‐12

Page18

attheirlibrariakingpracticemunicationab%ratingsuchcationguideliratingtheguiceivedabouth%ratingpropcationtrainingingaseithere

weresummedundingproces

pentoallques

ategories.Oftonandinformtional,specialmakemoretae.rlargerorsmag.,ane‐book“shatfundingisaattentiontothivingkudosto

iesororganizaes.OfthoseresboutLSTArepcommunicationesasexcelleidelinesaseithhowtheirproposalscoringfgasexcellent,excellentorgo

dupbestbyonss:

stions,and[an

the41:mationabouttl,andothersmargetedefforts

allerLSTAgrasolution”).SeavailabletolibefactthatCSLoCSLforeach

ationshadappspondents:portingrequironaseitherexent,andalmosherexcellentoposalsweresfeedbackasei,andmorethaood.

necommentt

nexampleof]

thegrant‐makmalllibraries—stoensuretha

ants.ThreeidevenwishedsmbrariesthatmLreservesanyoftheidentifi

pliedforagra

ementsasexcxcellentorgostthreeoutoforgood.coredasexceitherexcellentanhalf(53%r

thatalsoreflec

highcustomer

kingprocess.—i.e.,thosefreattheyareaw

entifiedaneemaller‐budgetmayneedittheyLSTAfundiniedcomponen

antinthe

cellent,od.five

llent,andtorgood.rateditas

ctsthe

r

equentlywareof

edtotemost.ngatallforntsofthe

C

ColoradoState

6requpartne

4recothatm

CSLstaffa Iapprecia Capitalizin Couldther Therubric

evaluators

1. CSLshveryhcommof80%forim

2. Itisrereview

3. Itisfutonewpossibpropo

TheColora1. Colora

inform2. Colora

achiev

eLibraryLSTA

uestedmoreiners(whenwaommendedcomuchofitisal

andpartnersintethatColoranglarge,cooperebesmallergcsareveryhelpsaboutwhatt

Recommehouldmaintaihighperformamunicationwit%)foritsfeedmprovementinecommendedwers,andsharurtherrecommwproposalwrbilityistoconosalwritersar

adoStateLibradoresidentsmationandleaadostudentsavementandlif

AFive‐YearEv

ntensive,andrranted),andntinuingefforreadydoneon

ReprensureLSTAgradostilldesignerativeprojectgrantsforminipful;howevertheyarelookin

endationsBanitscurrenthanceratings(ithgranteesabdbackaboutprntheseareas.thattheLSTArethesewithamendedthatariters,especiansiderestablisrematchedwi

Evaluatio

rary’s2008‐12willbeabletoarningneeds.andadultlearfelonglearnin

valuationRepo

preferablyfacwritingproportstostreamlinline).

esentativeCoantsaredistriatesaportiontsisagreatnei‐projects?scoringbyevangforanddidn

asedonAsseshighlevelsofp.e.,combinedboutreportingroposalscorin

ACoordinatorapplicants.astrategybedllythoseassohingamentorithsuccessful

onofthe20

2LSTAgoalswoaccessresou

rnersreceivesng.

ort2008‐12

Page19

ce‐to‐face,helosals.netheproces

mmentsfrombutedtoaccomoftheLSTAfueed.

aluatorsisnotn’tseemightb

ssmentofStaperformanceiexcellentandgrequirementnganditstrain

requestmore

developedforeciatedwithlibringprogramproposalwrit

008‐12Stat

were:urcesandserv

servicesfrom

lpinconceivin

ssanditsasso

mRespondenmplishthemosundsforcomp

t quiteashelpfbeinstructive.

ateLSTAGraninitsLSTAgragoodratings)ts.WhileCSLaningofferings

econstructivel

extendingmobrariesinisolainwhichnewtersinsimilar

teProgram

viceselectroni

librariesand

ngproposalid

ciatedpaperw

ntsstgoodfortheetitivegrants.

ful.Morenarr

nt‐MakingPrant‐makingpr)foritsapplicalsoreceivedforproposalw

lycriticalcom

oreintensivehatedareasand

w,inexperiencecircumstance

mPlan

icallythrough

librarianstha

deas,findingp

work(acknow

emostpeople.

rativefromthe

ocessrocess.CSLrecationguidelinhighratings(writers,there

mmentsfromp

helpinproposdwithsmallsed,orunsuccees.

hlibrariestom

atsupportedu

roject

wledging

e

eceivednesandits(inexcesseisroom

proposal

salwritingstaffs.Oneessful

meettheir

ucational

C

RFws

Si

ColoradoState

3. Colorabylibr

4. Colorameett

RespondentFForeachofthewhichwaschospecificsubset

Aboutforlibresourespo

RespolifelonpublicfamiliStoryBspons

RespounderTalkinBlindforins

Fouro/AskAloans

Thefascopetypealibrarare,by

Surveyresponnsufficientlyf

eLibraryLSTA

adoresidents,rariesreceiveadolibrariesctheneedsofC

Familiaritywesefourgoals,osenfortheextofthem,and

tthreeoutoffbrarystaff,decrcedelivery(ndents(35%)ondentsrepornglearning.Tclibraries,andarwiththeHiBlocksearlylisoredEverydaondentsalsorrservedpopulngBookLibrarandPhysicallystitutionallibroutoffiverespAcademicvirtusupport(81%)amiliarityrankandreach.Randtheirusersies,butespeciydefinition,li

ndentswereasfamiliarwitht

AFive‐YearEv

,peoplewithdservicesfromcooperatetodColoradoresid

withActivities,respondentsxemplarynatu/oritsanticip

fourrespondecision‐makers72%).Plinkit)tedvariousleTwooutofthredjustoverhalighlyEffectiveiteracyprograayBookClub.eporteddifferations.Morery,thestate’syHandicapperaries(e.g.,inpondentswerualreferences).kingsoftheseesourcesharis.Educationaiallyschool,acimitedinscop

skedtoassessthemtodoso.

valuationRepo

disabilities,etmColoradolibdevelopstratedents.

swereaskedtoureoftheactivpatedfamiliari

entswerefams,andusers(7twebsiteservi

evelsofawareee(66%)werlf(54%)witheSchoolLibraam(43%).On

rentlevelsofathansevenouregionalaffilied.Morethancorrectionalarefamiliarwitservice(83%)

fourareasofngandelectroalachievementcademic,andppeandscaleby

sCSL’sperform

ort2008‐12

Page20

thnicpopulatirariestomeetgiesandtechn

oassessCSL’svity,itsscopeitytosomeor

iliarwithmos77%),Libraryicesforsmall

nessofactivitefamiliarwithitssupportofry(formerlyPnlyoneoutoff

awarenessofautof10(72%)iateoftheLibrtwooutoffivandotherstatththreeresou),theColorado

activityarecoonicaccessprtandlifelongpubliclibrarieythesizeofth

manceoneach

ons,institutiottheirtargeteniquesthatas

sperformanceinservingeithallpotentials

stelectronicaJobline(76%)librarieswere

tiesassociatedhCSL’ssuppofyouthservicePowerLibraryfive(22%)wa

activitiesasso)reportedbeiraryofCongreve(42%)wereteinstitutionsurcesharingacoVirtualLibra

onsistentwithrojectstendtolearningareies.Servicestohosepopulatio

hoftheseacti

onalresidentsedneeds.ssuretheshar

eontwotofivherallColorasurveyrespon

accessactivitie),andsupportefamiliartoo

dwitheducatiortofsummeresgenerally.Ty)program(4asfamiliarwit

ociatedwithseingfamiliarwiessNationalLefamiliarwith).ctivities:theAary(83%),an

hwhatisknowoimpactalllibissuesofvitalospecificundeons.

ivitiesorindic

andthoseun

ingofresourc

veactivities,eadoresidentsondents.

es:onlinewortservicesforeonlyaboutath

ionalachievemreadingprogTwooutoffiv44%)andtheththeChanne

ervicestospeiththeColoraLibraryServicehCSL’ssuppor

AskColoradondSWIFTinter

wnabouttheirbrariesregardlconcerntomoerservedpopu

catethatthey

derserved

cestobest

achofora

rkshopse‐hirdof

mentandramsinvewere

l2‐

cificdoeforthertservices

rlibrary

rrelativelessofostulations

were

C

GRli

La

ColoradoState

Goal1.AccesRespondentswibraryresourc

Librastateaforthelibrarandpadataahalfofperfor

Plinksamelibrarmore

SincedecisimayhmonthupdatLibrarDecemdeveloonline83%.

Duetoresourespoperfor

LibrariestodayacrossColorad

eLibraryLSTA

ssingResourcwereaskedtocesandservicryJoblineisaandlocalinstiebestavailabiansandothearticulartalenaboutthechanfrespondentsrmanceratingkit(publiclibra24/7webaccies.Forthesethanathird(2010,CSLhason‐makers,anhavebeenlimihlyWebsideCtedthemaboury,Statewidedmber2011,haopment.Thereworkshopsa

obudgetcutbaurcedeliveryndents(20%)rmancerating

Acceptinyareallaboutdotheopportu

AFive‐YearEv

cesandServiassessCSL’spces:afullyinteracitutions,businletalenttofillrlibraryworkntsandinteresngingstructurs(46%)ratethgof93%.aryInterfacekcesstotheirlibeservices,mor35%)asgoodsbeenexpandndactualandited.OvertheChatandCSLinutLSTA‐fundedatabasepurcaveaddressedreisroomforasexcellent,w

acksinrecent(e.g.,itsstate).Almostthregof78%.

QuotefromngColoradoAtbuildingcomnitytoputthe

valuationRepo

cesElectroniperformanceo

tivewebsitetnesses,andnolpositionsintkerstosearchsts.Also,becareofthestate’hisserviceexc

kit)websitesebrarywebsiterethanhalfofd,foraperformdingitsinteracprospectiveuepastfewyearnSession.Wedstatewidesechases,andrecustomerserimprovement

whileoverhalf

tyears,itisnowidedatabaseeeoutoffive(

PlinkitServiAssociationofmunityandbeeirlibraryonli

ort2008‐12

Page21

icallyonfouractivit

thatenablescon‐profitorgantheirlibrariesforvacantpoausetheJoblinslibraryjobmcellentandmo

ervicesenablesandonlinedfrespondentsmanceratingoctiveonlinewuserswhoseprrs,CSLhasestbsideChatshaervicessuchastorativelibrarvice,communtinthisarea,hf(54%)rated

otsurprisingteprogram)w58%),though

iceCoordinatfLibrariesPreingaccessibleneandtoconn

tiesthataddre

ommunities,snizationstocos.Italsoenablositionsthatfitnewebsiteisdmarket—dataostoftherem

epatronsofsmdatabasesasth(53%)ratedCof88%.workshopoffereviousexpostablishedtwoaveintroduceasearlyliteracarianship.CSLnityneedsasshowever,asothemasgood

thatCSL’srecewereratedexceh,stillratedth

torChristinerojectoftheYetotheirpatronecttotheirco

essedthegoal

schools,collegompeteonamlescurrentant,orbetterfit,database‐drivthatareanaly

maininghalf(4

mallerandrurhoseservedbCSL’sperform

eringstoreachsuretolibrarieregularseriesedthelibraryccy,nextgeneraLinsessionevessment,childnlythreeout—astillhighp

entlyreducedellentbyonlyheseservicesa

Kreger,YearAward2ons.…Plinkit…ommunities24

lofelectronic

gesandunivermorelevelplayndprospective,theirlevelofven,ityieldsreyzedannually7%)rateitgo

rallibrariestobylarger,urbamanceasexcel

houttolibraresandlibrarysofonlineevecommunitytoationColoradvents,begunidhoodliteracyof10(29%)rperformancer

levelsofsupponeoutoffivasgood,fora

2009…offerssmall4/7.

accessto

rsities,yingfieldeftrainingeal‐time.Almostood,fora

ohavetheanlent,and

rystaff,yissuesents,theoandoVirtualny,andstaffratedCSL’sratingof

portfore‐ve

libraries

C

GRa

ColoradoState

Goal2.EducaRespondentswachievementa

CSLsuSummprogrlifelonthird

TheHlong‐trubricrated

TheStMounrecognofCSLmore

CSLalfortheEarlypartnerange(53%)

TakinEveryAlmospartne(29%)

eLibraryLSTA

ationalAchiewereaskedtoandlifelonglea

upportssummmerProgram(ammaterialsnglearningact(36%)ratingHighlyEffectivtimePowerLic,andothertothisprogram’toryBlockseatainPBS—pronizedforhaviLandadozenthanhalf(53%lsoprovidesbeColoradostaLiteracy,CSLershipsthrougofservicesw),foraperformglibrarybookydayBookClust2,000particershipbetwee)andgoodby

AFive‐YearEv

vementandLassessCSL’sparning:

merreadingpCLSP),agrassandreducedttivitiesresponitexcellentanveSchoolLibbrariesprograoolsforimprov’sperformancarlyliteracypovidesonlineingaGreatWepubliclibrarie%),foraperfobroadersuppoatewidesummalsoencouragghtheColorad

wasratedexcelmanceratingkgroupsintotub,aregularscipantsdiscusenthelocalmyhalf(49%),fo

valuationRepo

LifelongLearperformanceo

programsinpsrootsconsorttheircostbywndentswereandthreeoutofbraries(HESLam.HESLidevingschoollibceasexcellentprogram—apavideosofliterebsiteforKidseswasratedeormanceratinortforyouthsmerreadingprgesyouthservdoLibraryCollentbythreeof82%.thesocialnetwsegmentofChssthebooksthediaandpubloraperforma

ort2008‐12

Page22

rningonfiveactiviti

publiclibrarietiumofstatesworkingtogethaskedtorate,tffive(60%)gL)programhantifiescompebraryqualityat,andalmosthartnershipinvracy‐buildingssbytheAmeriexcellentbythngof83%.servicesinpurogramandbeviceslibrariannsortiumandoutoftenresp

workingage,Channel2’sEverheyreadonthiclibrarieswanceratingof7

iesthataddre

esasamembethathasimprher.Ofthefivthisonereceivood,foraperfasextendedstaetenciesforschandimpact.Ahalf(45%)goovolvingCSL,eisongsandrhyicanLibraryAhreeoutoften

ubliclibraries.eingafoundinnstobuildtheiEarlyChildhopondents(29

CSLencouragerydayShowfoheclub’sFacebasratedexcell78%.

essedthegoal

eroftheCollabrovedthequalveeducationalvedthehighesformanceratiatewidethebhoollibrarianAboutathirdood,foraperfoightpubliclibrymesforyounAssociation.Tnrespondents

InadditiontngpartnerofCirservicecapaoodCouncilsa%)andgoodb

edpubliclibraocusingonambookpage.Thlentbythreeo

ofeducationa

borativeLibralityofsummelachievementstratings—mingof96%.enefitsofColons,anHESLevofrespondentormanceratingraries,andRongchildren.ItThispartnershs(30%)andgo

toprovidingleColoradoLibraacityandfindacrossthestatbymorethan

aryparticipatimonthlybookhisinnovativeoutoftenresp

al

aryerreadingtandorethana

orado’svaluationts(36%)gof81%.ockywashipeffortoodby

eadershipariesfor

te.Thishalf

ionintheselection.pondents

C

H(pO

[G

GCtmLSeRpr

ColoradoState

Herearesome(2)thenumberprogrampartiOurayLibrary

[POST]JustintGOTTAstaytun

[COMencouthroug

Goal3.ServicCSLhasmandathattendtobematerialsandLibrary(CTBLServices,partexemplaryweRespondentswperformancerratingitexcell

YouarlibrarySta

83%ofinding

eLibraryLSTA

ResultsfrofourfindingrofrespondencipantsfelttheDistrict

ExchangterviewedKathnedforalltheMENT]Ijustfrageanyonetghherwriting

cestoUndersatedresponsibeunderservedindividualswL)providesaut ofCSL’sLibrabsite—tolibraweredividedaratingof96%.entandathir

CremysocialcoyIhavelearneatisticfromO

ofrespondentsgaffordableh

AFive‐YearEv

romtheImpags:(1)Thenumntswholikereaeywereabett

geonEverydahrynStockett,exclusivedishfinishedthisbotoreadtheboog

servedPopulbilitytoensurdbyotherlibrawhoareincarceudiobooksandaryDevelopmariansandstaalmost50‐50Institutionalrd(33%)good

ommentfromonnection,myedsomuch.…OutforLife:R

sindicatedthahousing,budge

valuationRepo

actofSummemberofresponadingontheirterreaderafte

ayBookClubauthorof"Thh,onlyonColorookafewweekokfirst.Author

lationsretheavailabiaries:individerated.AsaNdotherspeciaentUnit,provaffatColorado(47%and49%libraryconsud,foraperform

mCTBLPatroeducationalcoYouallowme

RestorativeLi(FASTFAC

attheprisonlibeting,addiction

ort2008‐12

Page23

erReadingPrdentswhoenjrownincreasertheprogram

bFacebookPaeHelp"alsotarado's"EverydksagoandLOrdistinctively

ilityandqualitualswhoarebationalLibraralformatstothvidesconsultinocorrectional%)inassessinultingwasalsomanceratingo

onSatisfactioonnection,mytoreacharouibrarianshipCTS,May29,braryassistednrecovery,me

rogramsinCjoyreadingincedby12percenmthantheywe

age(July11,alkedtotheenday"Show.VEDit!!Ican'capturesthev

tyoflibrarysblindorotherryServiceaffilheprint‐disabngsupport—binstitutionsangCTBL’sperforatedextremof90%.

onSurveyRepyconnectiontoundtheworld.intheCODep2009)inacquisitionentalhealth,a

oloradoLibrcreasedby23ntto83percenereatthebegin

2011,9:02pntirecastofthe

'twaitforthemvoiceofthecha

ervicestotworwiseunabletliate,theColobled.Institutibothface‐to‐faaswellasotheformanceasemelywell:thre

port,2010oColorado.Be…IlovemylibpartmentofC

noflifeskills(endrecreation)

rariespercentto87nt;and(3)83nningofthesu

p.m.)eupcomingfil

movie,althougaractersinthe

ospecificpoputousetraditiooradoTalkingionalLibraryaceandviaanerstateinstituxcellentorgoeeoutoffive(

causeofthisbrary.Corrections

e.g.,jobseeking).

percent;percentofummer!

lm.You've

ghI'destory

ulationsonalprintgBookynutions.od,fora(57%)

g,

C

GRs

ColoradoState

Goal4.ResouRespondentswsharing:

SWIFTtrackiColoraasevithird

AnothAskAcmonthchalleinformreferesplitju

Thougyear.Toughasing(45%)

Ijustwant Itwasreal Notonlyd

ideathisis Ihavenev

veryusefu

eLibraryLSTA

urceSharingwereaskedto

T(StatewideIingsystemthaado.Thislyncdencedbyits(36%),forapherwell‐estabcademicvirtuhly,providingengingresearcmationandimenceservicesfustunderhalfghlong‐establRe‐launchedwhTimes—thisglesearch)isa)good—fora

ttothankallollycool,beingdidIgetmyanss.erusedoneofltoolinarese

AFive‐YearEv

assessCSL’sp

InterlibraryLatCSLprovidechpininthestbeingratedexperformancerlishedsharedualreferencesg24/7accesstchquestionthmprovingthecforcollegeandfeach(45%)rlished,theColwiththreehigsite(whichalalsohighlyratperformance

QuotesfroofyouatAskCoonlinewithaswerbutIlear

f thesewebsitesearchproject.I

valuationRepo

performanceo

oanFastTracesfreeofchartate’sresourcexcellentbythratingof95%.resourceforCservice.Overtousers’questatmaytake2aller’sinformduniversityliratingthisserloradoVirtuagh‐demandvirlsoenableslibedbyrespondratingof88%

omUsersabooloradobecaulivelibrarian,rnedsomethin

sbeforebutmIwillbeusing

ort2008‐12

Page24

onthreesetso

k)istheweb‐getoallpubliesharinginfrareeoutoffive

Coloradolibra200AskColortions,ranging5minutesbecationliteracybraryusers,srviceexcellentalLibraryhasrtualcollectiobraryuserstodents—twoou%.

outAskColoraseyouhavehebetterthansengnewaboutu

myprofessorsuthisinthefutu

ofactivitiesth

‐basedelectroc,academic,sastructureisberespondents

ariesandtheirradolibrariangfromanaftercauseitinvolvskills.AskAcastudentsaswetandgood,forsundergoneans—Coloradotapthecollecutoffive(43%

ado/AskAcaelpedmegetmearchingtheInusingthelibra

uggestedittomureandberefe

hataddressed

onicinterlibraschool,andspebothwell‐esta(59%)andgo

rusersistheAsfield2,000tr‐hoursqueryvestrackingdoademicprovidellasfacultyaraperformanadramaticredoHistories,Tectionsofmost%)rateditexc

ademicmyfirstA.nternetalone.ry’sresources

meandIcansferringmypee

thegoalofre

ryloanrequeseciallibrariesablishedandeoodbymoret

AskColoradoto3,000questytaking5minuowndifficult‐tdesspecializedandstaff.Respceratingof90designovertheechHelp,andTtColoradolibrcellentandalm

aswell.What

seewhyshedidrstoit.

source

stingandinffective,thana

o/tionsutestoato‐finddvirtualpondents0%.epastToolsforrariesviamosthalf

tagreat

d.It’sa

C

SLpstgLFo

ColoradoState

1. A(ianby

2. Nfaevfointhth

SurveyresponLSTAovertheproposedgoalskills,andlifeltrainingandregivenanoppor

LearningforAFortheproposofproposedCS

Tosurliteraanoth

Theselibrarpriori

ThethCurreSeptemimpor

eLibraryLSTA

Recllofthe14CS.e.,combinedndthattheirfyCSLand,whotably,leaderactthatlittlesvaluation(OBorthefollowinnterlibraryloaheseprojectschisreport.

ndentswereasnextfiveyearsforthe2013onglearning)ecruitmentofrtunitytopro

AllAgessed2013‐18gSLactivities:rveyrespondeacyprogrammherthreeoutoecondmostimries.Twoouttyratingof75hirdmostimpntly,theBroamber2013.Artant,forapri

AFive‐YearEv

commendatioSLactivitiesasexcellentandfurtherdevelohenappropriatrs’assessmentubstantialoutE)—specificalngprojects:Coansupport.Wcouldplaylea

Inputfskedtoassessrs.Theseprop3‐17statepro;2)resourceslibrarystaff;aposeaddition

goaloflearnin

ents,themostming.Almostof10(29%)asmportantproptoffive(41%)5%.portantideawdbandTechnoAthirdofresporityratingof

valuationRepo

onsBasedonssessedbyColgoodratings)

opment—asonte,itspartnerstsoftheperfotcomedataisllycollectionooloradoVirtua

Withsupportfrdingrolesini

forthe201stheimportanposedactivitiegramplan:1)sharing(incluand4)servicenalinitiativesb

ngforallages,

timportantofthreeoutoffisveryimportaposalwasdeve)regardedthis

wastosustaincologyOpportuondents(33%f72%.

ort2008‐12

Page25

Assessmentloradolibrary).Forthisreangoingactivitis.rmanceofCSLavailablefortofoutcomedaalLibrary,LibromLibraryRmplementatio

3‐17Statenceofspecificesareassociat)learningforaudingelectronestounderserbeyondthose

respondentsw

f theseproposive(56%)respant,forapriorelopingstandsasessential,

computertraunityProgram%)regardedth

of2008‐12Pyleadersreceivason,itisrecomiesorasmode

Lonsomeoftthem.Redoubatafromend‐ubraryJobline,PResearchServionoftheOBE

ProgramPproposedCSLtedwiththefiallages(inclunicaccesstoshrvedpopulatiobeingconside

wereaskedto

edCSLactivitpondentsregarityratingof8dards‐basedrandanothert

aininginpubm(BTOP)isfunhisasessentia

Performancevedveryhighmmendedthaelsforfuturea

theseprojectsbledeffortsatusers—isespePlinkitwebsitce(LRS)staff,recommenda

PlanLinitiativesthfirstthreeofthudingearlyliteharedresourcons.InadditioeredbyCSL.

oassesstheim

tieswastoconardedthisact85%.resourcesforthird(34%)a

liclibrarycondingthisactal,andtwoout

hperformanceattheybecontactivities—be

swerehighdeoutcome‐baseciallyrecommteservices,anf,staffassociatationsoffered

hatmightbefuhefollowingfoeracy,21stCencesandserviceon,responden

mportanceoft

ntinuetodevetivityasessent

rK‐12schoolsveryimport

omputercentivitythroughtoffive(39%)

eratingstinuedepursued

espitetheedmendedndSWIFTtedwithlaterin

undedbyournturyes);3)ntswere

threesets

elopearlytial,and

tant,fora

ers.

)asvery

C

RFs

ColoradoState

ResourceShaForthepropossetsofpropos

Byfarissuesplatfofivereatota

AdistWhenfrequeoffiveregardonlyo

ThirdVirtuasetof

eLibraryLSTA

aringsed2013‐18gedCSLactivitrthemostimpsinvolvedinhorm,developinespondents(4lpriorityratintantsecondwenapubliclibraentlylosessucerespondentsdeditasveryonelibrarytypplaceamongalLibraryforactivitiesesse

AFive‐YearEv

goalofresourcies:portantresourhostingandsngsharedcolle43%)regardedngof79%.enttoapropoarymovesfromchcentralserv(20%)regardimportant,forpedoubtlessaCSL’sresourcrimagesandential,andonl

valuationRepo

cesharing,sur

rce‐sharingprupportingacectionsofe‐redthisactivity

osalthatCSLpmbeingacityvicesashumadedthissetofrapriorityraaccountsforthcesharingproaudiohistorlyanotherthir

ort2008‐12

Page26

rveyresponde

roposaltosurvccesstoe‐resesources,andasessential,a

provideforsupyorcountydepanresources,bfactivitiesasetingof59%.Nheserelativelyposalswenttory.Onlyoneord(35%)very

entswereask

veyrespondeources.Thisprovidingaccandmorethan

pportservicepartmenttoabudgetandfinessential,butaNotably,thefaylowfigures.oaddingnewoutofsevenreyimportant,fo

kedtoassessth

ntswastofinwouldinvolvcesstothem.Mnathird(36%

esfornewpunindependennance,andpuranothertwooactthatthispr

wcollectionsespondents(1orapriorityra

heimportance

dawaytoaddeselectinganMorethantwo%)asveryimp

ubliclibrarydntunitofgoverchasing.Onlyoutoffive(39%roposalwould

totheColora5%)consideratingof50%.

eofthree

dressthee‐bookooutofortant,for

districts.rnment,ityoneout%)daffect

adoredthis

C

TFth

2Itc

ColoradoState

TrainingandForthepropostheimportanchighlevelsofs

Oneoleadeessent

TheotSchooessent

CSL’sdataumarkethant

2013‐17Prionadditiontotothreeprioricategoriesasf

Byfarexprestatewbooksalibra

AdistRecomAssoclibrarrolesi

AlmosexempProgrlibrar

Eight(CLEL

eLibraryLSTA

Recruitmentsed2013‐18geofthreesetssupport.ftheCSLtrainershipfordisctial,andmorethermostimpolLibraries(ttialandtwoothirdmostimuse,specificaleting.Morethtwooutoffive

ritiesIdentifpotentialpriotiesonwhichfollows:rthemostfreqssedconcernwide—e‐booksforthepooraaryenvironmetantsecond,idmmendationsiationofLibraianstomeettinexplainingtsttiedforsecoplaryprogramam—butrespies.respondentsrL),anotherexe

AFive‐YearEv

tofLibrarySgoaloftrainingsofproposed

ning‐and‐recrucussionofinnethanathird(portantCSLprthesuccessor/utoffive(41%

mportanttrainillyforthepurphanaquartere(42%)asver

fiedbyRespooritiesforthentheywishCSL

quenttopic,idabout:e‐bookplatformandandthoseservent.dentifiedby11onthistopiciariesLeadershtheirstandardtodecision‐mond,with10rmsupportingtpondentswoul

recommendedemplarymode

valuationRepo

taffgandrecruitmCSLactivities

uitmentproponovationinl(37%)asveryroposalassoci/expansionof%)asveryimping‐and‐recruposesofneedofrespondentryimportant,f

ondentsnextfive‐yearLtofocus.Of

dentifiedby20klicensing,owitsaccess,colvedbysmalla

1respondentsincluded:exphipInstitute;pds;andequippakersandtherespondents,wthisissueinscldalsoliketo

dencouragineleffort,alrea

ort2008‐12

Page27

mentoflibrary.Notably,allt

osalsmostimibraries.Twoyimportant,foiatedwiththisfPowerLibrarportant,foranuitmentproposassessment,ts(27%)regaforapriorityr

rplanidentifie95substantiv

0respondentswnership,andllectiondeveloandrurallibra

s,waspromotandingeffortsprovidingsuppingembattledepublicthenewasteachingchoollibrariesseemoreatte

gearlyliteradyencourage

ystaff,surveythreeofthese

portanttoresooutoffivereorapriorityrasgoalwasdevries).Morethnotherprioritsaltorespond,planningandardedthissetoratingof69%

edbyCSL,respverecommend

s,wascopingdrights;develoopment,andoaries;andtrai

tingleadershstodevelopnpportforactividschoollibrarewerrolesofli21stCenturys—theHighlyentiontothisi

acyefforts.Cospubliclibrar

yrespondentseproposedeff

spondentswaespondents(4atingof78%.velopingtoolshanathird(37tyratingof78dentswastradevaluation,aofactivitiesas

%.

pondentswerdations,76fel

withthee‐boopmentofacootherpolicies;ningforstafft

hipandinnovnewleaders,suitiesthatequiriansinparticibrariansinpskills.ColorEffective(formissueinacade

oloradoLibrariestoembrac

wereaskedtofortsreceived

sthatCSLexe41%)regarde

sforHighlyE7%)regarded%.ininglibraryandpublicrelasessential,and

reaskedtoidellintoninema

ookrevolutioonsortium—p;ensuringacctodealwithe

vation.uchastheColipacademicanulartotakeleubliceducatioradoalreadyhmerlyPower)micandschoo

ariesforEarlycetheEveryC

oassessequally

ercisedthisas

Effectivethisas

ystaffonationsanddmore

entifyupajor

on.Theypreferablyesstoe‐‐booksin

oradondschooleadingon.hasan)Librariesol

LiteracyChild

C

Nrpsy

ColoradoState

ReadyServicindivi

ImprogenerthoseSpecifneedf

Fiverrelatemarke

Notably,mostrespondentswplan.Thisfactstate’slibraryyearplan,they

1. Forthessentthree

2. Forthhighly59%aidentirecomhowevprojec

3. ForthinitiatEffecttheiro21stCrecomprojec

eLibraryLSTA

ytoRead(ECRcetoChildren.dualsofallagovinglibraryalconcernsabwhohavediffficconcernswfortraininginespondentseaedservicesinletingoflibraryofthesepropwererelatedsttindicatesthacommunity.Iyarelikelyto

Rhegoaloflearntialandveryioftheseactivhegoalofresoythansupportand50%respifiedbyresponmmended,therver,theotherctswereunimhegoaloftraintives:leadershtiveSchoolLibownprioritiesenturyskills—mmendedthatctforthisgoal

AFive‐YearEv

RR)programe.Respondentges.yservicestotboutthisissueficultyspeakinwereexpressedndatausetobachrecommenlibraries,faciliyservices,andosedprioritietronglyto,orhattheCSLManIftheothermobeexcellentto

Recommendningforallagimportantcomitiesaspartofourcesharing,tingnewlibraectively).Conndents,beingrefore,thatthpotentialpro

mportant.)ningandrecruhipforthedisbrarians(thess,manymenti—thoughthelabothofthesel‐‐offeringtrai

valuationRepo

endorsedbythsexpressedp

theunderserve,specificconngorreadingdabouttheneetterassessthndedfourothitatingstatewdpromotingies—andcertaihighlycompatnagementTeamoreinnovativeopicsforsub‐

dationsBases,allthreeprmbined)—rangfitsnextstatehostingandsarydistrictsanncernaboutcomentionedateissueofe‐bojectsshouldb

uitmentoflibrscussionofinnsuccessortoPonedspecificatterwasbyninitiativesreciningondata

ort2008‐12

Page28

hePublicLibrarticularinter

vedwasapricernswereexEnglish,theueedtotrainanheneedsofunerpriorities,i

widepublicpronterlibrarycoinlythemost‐ftiblewith,CSLmandstaffareideasarenogranteepropo

sedonInpuroposedactivigingfrom72%eLSTAprograupportinge‐rndaddingCVLopingwiththetleasttwiceasooksreceivetbepursued.(N

rarystaff,libranovationinlibowerLibrarieexamplesofdnomeanslimitceivehighpriouseforneeds

raryAssociatiorestinefforts

orityforsevenxpressedabouunemployed,andhireamorenderservedusincludingexpaograms,increaooperation.frequentlysugL‐recommendrewellin‐toucotundertakenosalsinfuture

utfor2013itiesreceived%to85%.Itiamplan.resources,primLcollectionsfoee‐bookrevolsoftenasanytoppriorityunNotably,only5

aryleadersgabrariesanddees).WhenresdevelopingleatedtotheK‐1orityintheneassessment,p

onandtheAssthatinvolvet

nrespondentutdisabledindandchildrenoediverselibrasers.andingbusineasingcapacity

ggestedones—dedactivitiesfchwiththepebyCSLitselfaestateLSTAg

3‐17Planveryhighpriosrecommend

marilye‐bookorimagesandlutionalsotopotherpotentinderthisgoal.5%ofrespond

aveequallyhigevelopmentofspondentsweradershipforin2publiceducewstateplan.planningande

sociationforLthewholefam

s.Inadditiondividuals,oldefincarceratedaryworkforce

essandemployfordata‐base

—identifiedbyforthenewfiverceivedneedsaspartofthenrant‐makingr

orityratings(dedthatCSLpu

ks,wasprioritidaudiofiles(7ppedthepriorialpriority.ItIfresourcesdentsfeltthos

ghprioritytotftoolsforHighreaskedtoidennovationandationarena.ITheotherpoevaluationan

Librarymilyand

toerpeople,dpersons.andthe

oyment‐ed

yve‐yearsofthenextfive‐rounds.

(i.e.,ursueall

izedmore77%vs.ritiesispermit,setwo

twohlyentifydteachingItisotentialdpublic


Page29

relationsandmarketing—alsoreceivedahighpriorityrating.Thisprojectisalsorecommendedforimplementationunderthenewplan.

4. WhileCSLhaslongstandingandongoingmandatestoservecertainspecificunderservedpopulations—blindandphysicallyhandicappedpersonsandinstitutionalresidents,mostnotably—respondentsidentifiedotherunderservedpopulationswhichlibrariescoulddoabetterjobofserving.Amongthesewereolderpeople,individualswhohavedifficultyspeakingorreadingEnglish,andtheunemployed.Arguablyanothergroupidentifiedbylibraryleaders—businessesandtheiremployees—shouldalsobementionedinthiscategory.ItisrecommendedthatCSLcontinuetosupportgroupsandprojectsthatseektobetterequiplibrarystafftoservediversepopulations.

LessonsaboutOutcome‐BasedEvaluation&RecommendedChanges

SeveralimportantlessonsaboutoutputandoutcomemeasurementaredemonstrablyclearfromthedataavailablefromsubmissionsbygranteestothefederalLSTAreportingsystem:SpecificationsforDataReportingTheapproachestooutputandoutcomemeasurementbuiltintothestate’sLSTAgrant‐makingprocessdidnotspecifyadequatelywhatdataofbothtypesshouldbereportedorhow.EachLSTA‐fundedprojectoractivitywaslefttoitsowndevicesindecidingwhattocountandhowtoreportitwithoutanyknowledgeofwhatotherprojectsandactivitiespursuingthesameLSTAgoalweredoing.Inevitably,thisresultedinacrazy‐quiltofdata.Further,reportsvariedtremendouslyintermsoftheiramountofrelevantdetail.Forinstance,whenasurveywasconducted,somereportsincludedonlythemostcursoryresultsinpercentages,whileothersincludedwhenthesurveywasconducted,numbersofsurveyrecipientsandrespondents,theresponserate,andnumbersaswellaspercentagesofrespondentsgivingeachanswer.Forquasi‐experimentalandtime‐seriesanalyses,somereportsincludedonlythepercentagechangeinsomeoutcomemeasureliketestscores,whileveryoccasionalothersidentifiedactualscoresorachievementlevelsontestsforbothendsofsometimeintervalaswellasthepercentagechangeassociatedwiththoseunderlyingfigures.UnderstandingWhatConstitutesOutput&OutcomeDataMany,ifnotmost,granteessubmittingreportsdidnotunderstandsufficientlywhatoutputsandoutcomesare,eitherconceptuallyoroperationally.Notably,thisistruedespiteyearsoffederalandstateeffortstoinformandtrainpeopleonthesematters.Consequently,overthepastfiveyears,datareportershaveoftenwastedconsiderabletimeandeffortinreportingeitherirrelevantdata(e.g.,inputsmasqueradingasoutputs)orsimplytoomuchdata(e.g.,tablesorspreadsheetsfullofmonthlydetailsratherthansummarydataacrossthelifeofaproject).Alotofanecdotalandrhetoricalclaimsaboutoutcomeswerealsoreportedinlieuofanyrealdata.ComparableOutput&OutcomeDataAsaresultoftheseconditions,theoutputandoutcomedatareportedbygranteeswereusuallymeagerandpiecemealand,intheabsenceofanycoordinatedstateeffort,weresonon‐comparablefromoneprojecttoanotherthatthedatacouldnotbecompiledtoprovideacoherentstatewidepictureofhowandhowwellthestateperformedtowarditsLSTAstateprogramplangoals.TheoverarchinglessonfromthesecircumstancesisthatCSL’sexpectationsaboutoutputandoutcomemeasurementareinsufficientlyclearandprecisetogeneratethekindsofrigorouslycollecteddataneededbyfederalandstatepolicymakersandotherstakeholders.Toremedythissituation,CSLandIMLSmustconfrontthechallengeandopportunityofdevelopingnewoutputandoutcomemeasurementsforitsnextfive‐yearplan.Theprocessofbuildingsuchmeasuresaroundeachofthestate’s2013‐17goalsshouldalsohaveotherpositiveconsequencesassociatedwithbettercommunicationbetweenIMLS,CSLandgranteesworkingtowardthesamegoal.CSLandIMLSshouldprovidetheleadershiprequiredtoestablishsuchcommunication.Theresulting,morecoordinatedefforttocollectandreportrelevantandcomparabledatawillbothminimizethedatareportingdemandsongranteesandprovidepolicymakersandstakeholderswiththekindsofdatatheyneed.


Page30

RecommendationsaboutOutcome‐BasedEvaluationThefollowingchangesinCSL’sapproachtooutputandoutcomedatacollectionanditsuseinoutcome‐basedevaluation(OBE)arearguablythemostimportantrecommendationsofthisreport.Theserecommendationsareintendedtoencouragethedevelopmentofmore,morevalid,andmorecomparabledataneededfortrueOBE.

1. ForeachfutureLSTAgoal,CSL—eithersomeonefromtheLibraryResearchService(LRS)stafforacontractorworkingunderLRSortheLSTAcoordinator’ssupervision—shouldadoptappropriateoutputandoutcomemeasuresfromthosedevelopedbyIMLSfordatabases,digitization,employmentandsmallbusinessdevelopment,humanservices,lifelonglearning.(SeeappendixB“LogicModels”)

2. AsaconditionofreceivingastateLSTAgrant,granteesshouldberequiredtoselectappropriateoutputandoutcomemeasuresfromthelistproducedforitsLSTAgoal.Itislikelythatanindividualgranteewouldnotbeexpectedtocollectdataonallspecifiedmeasuresforitsgoal;butallthemeasuresonwhichitdoescollectandreportdatashouldbefromthelist.Ifanindividualgrantee’sprojectisdeemedsouniqueastowarrantit,orisnotaddressedbytheIMLSlogicmodels,dataonalternativemeasurescouldbecollectedandreported,butonlyifapprovedbyCSL.

3. Wheneverpossible,CSLshouldproduceorcontractfortheproductionofstandardizedoutputandoutcomedatacollectioninstruments.Mostoften,thesewilltaketheformoftallysheetsorsurveyforms.Wheneverpossible,theseshouldbemadeavailabletogranteesinappropriateelectronicformats(e.g.,spreadsheets,onlinesurveys,apps)thatminimizethedatareportingburdenonstaffofLSTA‐fundedprojects.

4. Forobservational(mostoften,output)data,granteesshouldberequiredtoidentifythetimeperiodoverwhichtransactionswerecounted,andtoprovidesummariesofsuchdataoverthegrantperiodorareasonablysubstantialportionthereof.

5. Forsurveydata,CSLshouldpromulgaterequirementsthatallofthefollowingdatabereportedinsurveyresults:a)the“universe”ofthesurvey(i.e.,numberofpotentialrespondentstowhomasurveywasadministered),b)thenumberofsurveyrespondents,c)theresponserate(respondentsasapercentofuniverse),and—forindividualsurveyitems—andd)thenumberandpercentageofrespondentsgivingeachresponseoption.Inthecaseofquasi‐experimentalandtime‐seriesanalyses(i.e.,onesmeasuringchangeovertime),alloftheaboverequirementsshouldapplyforbothorallyearsaswellasarequirementtoprovidebothnumericalandpercentchangestatisticsfromoneyeartoanother.Theviabilityofdevelopinganonlineforminwhichsuchdetailscouldbereportedshouldbeexplored,andimplemented,ifdeemedusefulandCSLresourcespermit.Again,suchresourceswouldreducethereportingburdenonLSTA‐fundedprojectstaff.

6. Ideally,alloftheserequirementsshouldbeintegratedintotheRequestforProposalsforstateLSTAgrants.Otherwise,prospectivegranteesshouldberequiredtodocumentindetailtheirplansformeetingOBErequirementsbeforeagrantisconferred.

7. TofurthercommunicatethehighvalueplacedonhavingcomparableoutputandoutcomedataforallLSTAgrantees,theperformanceofagrantee(eithertheorganizationortheindividualsinvolved,asappropriate)onpreviousgrantevaluationsshouldbeallocatedpointsintheevaluationoflaterLSTAgrantproposals.Attheveryleast,theseissuesshouldbespecifiedforconsiderationaspartofanoverall“reputational”assessmentofLSTAsub‐grantapplicants.

8. ToensurethatCSLholdsupitsendofthesenewOBE‐relatedexpectations,supportofgranteesinmeetingthemshouldbeperformedbytheLSTAcoordinatorandanystaffofLRSandotherCSLunitsassignedtosupportspecificLSTAgrants.GiventhelimitedresourcesofCSL,planningandbudgetingforthisaddedworkloadisakeycomponentofsuccess.


Page31

Conclusion

Inconclusion,thisevaluationgeneratedseveralsetsofactionablefindings: SeveralstateLSTAgranteesdidanexemplaryjobofmarshalingbothoutputandoutcomedatato

demonstratethevalueandimpactoftheirprojects.Thesearesuccessesuponwhichtobuild. Coloradolibraryleaderswhorespondedtoawide‐rangingsurveyassessedCSL’sperformanceduring2008‐

12andplansfor2013‐17,indicatingthat:o ThestateLSTAgrantprocessiswell‐run,encouragingbroadlyinclusiveparticipationand

communicatinggenerallyinwaysthatareregardedastimely,fair,andhelpful.Thestrongestrecommendationforimprovingtheprocessistotargetmoreintensiveinformationandassistanceatthoseleastlikelytoapplyforgrantsintherecentpast.

o Selected2008‐12CSLactivitieschosenfortheirexemplarynatureaswellastheirscopeandimpactweregenerallyperceivedtobesuccessful,receivinghighperformanceratingsfromlargemajoritiesofrespondents.

o Selectedproposed2013‐17activities,alsochosenfortheirexemplarynatureaswellastheirintendedscopeandimpact,weregenerallyassignedhighpriorityratingsbylargemajoritiesofrespondents.

Finally,theevaluatorofferedspecificrecommendationsforhowCSLcanmovetotheforefrontofoutcome‐basedevaluationeffortsbyembracingthenewmodelbeingdevelopedbyIMLSandtakingspecificstepstoensurethatstateLSTAgranteesdo,too.

AppendixAAbouttheEvaluatorsTheColoradoStateLibraryensuredarigorous,objective,andindependentevaluationbyselectingtheRSLResearchGrouptoconductthisevaluationofitsfive‐yearLSTAstateprogramplanfor2008‐12.TheRSLResearchGroupisawell‐establishedconsultingfirmwithextensiveexperienceworkingwithstate,public,andschoollibraries.Bestknownfortheirlandmarkstatestudiesoftheimpactofschoollibraryprograms,theyrecentlyconductedastatewideneedsassessmentfortheArkansasStateLibraryandareconductingindependentevaluationsofseveralLSTA‐andotherfederally‐fundedprojectsforstateandpubliclibraries.Alloftheseprojectsdemonstratetheiracknowledgedexpertiseinsecondaryanalysisofavailabledata,surveyresearch,andfocusgroupand/orkeyinformantinterviewing.BecausetheleadRSLconsultantforthisevaluationisKeithCurryLance,theRSLResearchGroup’sselectionasourindependentevaluatorcombinedtheadvantagesofinternalandexternalevaluators.HavingretiredfromtheColoradoStateLibraryinFebruary2007(i.e.,beforethebeginningofthe2007‐08fiscalyear—thefirstcoveredbythelatestplan),Lancehasenough“distance”fromCSLtobeobjective,whilestillretainingsomedegreeofan“insider’s”perspective—beingfamiliarwiththestaff,community,issues,andresources.Asthelong‐timeandfoundingDirectorofCSL’sLibraryResearchService(LRS),Lancepossessesalevelofcredibilityandarangeofevaluationresearchskillsandexperienceusuallyavailableonlyfromexternalconsultants.DuetohisfamiliaritywithCSL,hewasabletoapproachthisprojectinanexpeditiousmanner,beingwellawareoftheprogramsandpoliciesinvolvedandthusnotneedingasubstantialperiodoftimetoacquainthimselfwiththeLSTAstategrantprogramaswellasCSLanditsprogramsandprojects.BecauseofLance’slong‐timeconnectionwithLRS,however,notablelong‐termLRSprojectsfromthe2008‐12timeframewithwhichhehadextensivepreviousinvolvementwerenotselectedforspecialfocusinthisevaluation.

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

Appendix B

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

carlson_m

Typewritten Text

AppendixC

ReportedOutputandOutcomeDataFY2008‐12LSTAProjectsGoal1:Coloradoresidentswillbeabletoaccessresourcesandserviceselectronicallythroughlibrariestomeettheirinformationandlearningneeds.ProjectCode/ProjectTitle OutputData OutcomeData2008‐CO‐31601StatePublicationsLibrary

41,775visitstowebpages 23,788OPACsearches 695circulation 213reference 401interlibrary/Prospectorloans 8,020usesofdigitaldocuments 7,801blogvisits

$291,000catalogingcostssavedforeachdepository

2008‐CO‐31604LibraryTechnologyandConsulting

29Plinkitwebsitesserving158kpopulation

47librarystaffattend12Plinkittrainingsessions

156Plinkitsupportphonecalls 15attendCALPlinkitsession 80+attendeesof3CLiCWeb2.0

workshops

Jan‐July2008/9 Averagewebsitevisitincrease81%

(Nederland223%) Googlerankfor22Plinkitlibraries:18

=#1hit,only2librariesfailedtoappearintop50hits

$837,727ine‐ratefundsto44libraries/consortia

Smalllibrariesnowhavewebpresencewithwhichtoextendservices24/7,includingdatabases

2008‐CO‐31603LibraryResearchService

115(100%)PLannualreports 829/1,400SLsurveys LRS.org:106kvisits,313kpageviews,

7kvisitors/month,2kusesofinteractivetools

5,251responsesto19surveys

364kJoblineposts 12,599PLannualstatistics 9,603SLannualstatistics 2,901SLprofiles 395ALstatistics 91,238wagecalculator 3,432personalROIcalculator(average:

$88.43‐to‐$1) 8,901FASTFACTS 8,500blogvisits 100+Facebookfans 56JoblineTwittersubscribers Web2.0study DARTreferencetracker

2008‐CO‐32240InstructionalDesignandTechnology

COCorrectionalintranet:50staff,500‐750hits/day

CLELwebsite:avg.20posts/month YouTube:GaminginLibraries,119

views;CSLvideoblog,578viewsof4parts

CLEL.org:increaseinvisitorinteractionof625%,42newmembers

KeepingUpwithGoogle:91%strongly/agreedlikelytousetechpresented

TechTrainingMadesimple:100%strongly/agreedlearnednewskills,90%rated4‐5/5scale

2008‐CO‐32790FtLewisCollegeResearchCommons

102studentsubmissionstodigitalcommons

Over400downloads 30attendCommonslaunch 36attendCommonsevents

17evaluations Presentationhelpful 6/17needmoreawarenessoncampus 14/17yestowouldyoucontributeto

digitalcommons

ProjectCode/ProjectTitle OutputData OutcomeData2008‐CO‐31608AskColoradoVRS

Livehelpsessions:41,198 AskCOworkshop:60 Statetrainings:20,122attended Other:300+attend15events

64%relatedtoK12 38%K‐8 26%9‐12 All64countiesserved

2009‐CO‐36924StatePublicationsLibrary(CSL)

Webpagevisits:43,479 OPACsearches:19,745 Circulation:491 Reference:211 ILL/Prospector:374 Digitaldocuse:20,124 Blogvisits:5,739

Cataloged1251items(savinglocallibrariesmoney)

2009‐CO‐36757OnlineAccessExpansion(Westminster,CollegeHill)

37computerclasses 155attendance7computers used4,897hours 8,108sessions Avg.session36minutes Avg.use/computer4:51day

Evaluationresults Studentclassratings:61%excellent,

38%good

2009‐CO‐36927LibraryTechnologyandConsulting(CSL)

Plinkitstats 33librarywebsites 162kCOresidents 22trainingsessions 177attendance

Websitesas24/7virtualbranches

2009‐CO‐36926LibraryResearchService(CSL)

114PLannualreports 710/1,400SLsurveysLRS.orgstats 124kvisits 495kpageviews 6kmonthlyvisitors 2,932responsesto21surveys DARTreferencetracker 20libraries,52outlets 145kreftransactions

Joblineviews:454k PLstats:16,564 SLstats:4,109 SLprofiles:1,597 ALstats:1,069 Wagecalculator:100,981 ROIcalculator:1,748 Avg.ROI:$90.71 FF:8,400views LRSblog:5,700 FBpage:150fans JoblineTwittersubscribers:80

2009‐CO‐36934InstructionalDesignandTechnology(CSL)

7webchats,162attendees CLELwebsite:4,300visits,17,400page

views Storyblocks:avg.100visits/month,6k+

pageviews BeyondF2F(ALApreconference) 30attendees

98%strongly/agreeprovideusefulinfo 90%learnedsomethingnewaboutCSL ¾rated4‐5/5 F2Fevaluations:100%contentmetor

exceededexpectations,80%excellent(4/4)

Goal2:Coloradostudentsandadultlearnersreceiveservicesfromlibrariesandlibrariansthatsupporteducationalachievementandlifelonglearning.ProjectCode/ProjectTitle OutputData OutcomeData2008‐CO‐31600SchoolLibraryDevelopment

24workshops,averageattendance30 Est.100LISstudentsannually

impactedbynewSchoolLibraryEndorsementstandards

95%+ofworkshopparticipantshighlysatisfiedwithoutcomesofworkshops

100%ofattendeesofPowerLibrariesandBetterLIUsingAssessmentworkshopshavetoolstoimprove21Centuryskillsofstudentsandteachers

2008‐CO‐32802Ready,Set,Read!(PPLD)

200pre‐projecttutor/parentsurveys(32%responserate)

Mostcomfortablematchingbookstochild’sreadinglevel

1/3valueknowledgeablestaff 1/3suggestimprovementsto

organizationalsystem 50post‐projectsurveysreturned 10%MOREknewwheretofindbooks

matchingreadinglevel Libraryseenasliteracyresourcefor

community Teachersdirectlypromotinglibraryto

students Staffgainednewknowledgebase Tutorsmakebetteruseof1‐1

instructiontime Childrenhavingmoresuccessful

readingexperiences.2008‐CO‐31607PLDevelopment–YouthServices

181YSlibrariansregisteredfor6YSworkshops

Represent50CO&2NMlibraries(43%ofCOlibraries—60%wastarget)

80%ofattendeesgetwhatneededtoconductqualityprogram

75%reportpartnershiporconnectionwithpublicschools

34%reportregularafter‐schoolprogramming,usuallyteenorhomeworkhelpprogram

2008‐CO‐31599PowerLibraries

47high‐performance,31developing:total78schools

100%ofhighperformancereceivebanner,recognizedonwebsite

98%ofdevelopingsubmitfinalwrittenreportincludinggoal‐settingbasedonconferencewithprincipal

90%reportinfoandmaterialsusefulinimprovingprograms

98%ofdevelopingschoolsdevelopandsubmitcollaborationplan

100%ofdevelopingreportvisittomentorschoolresultedinadditionalknowledgeaboutcollaborativeplanningandteaching

25%ofdevelopingbecamehighperformance

ProjectCode/ProjectTitle OutputData OutcomeData2008‐CO‐32801ParentandChildLiteracyProject(ArapahoeLD)

92youth 358children’sbooksdistributedto2

sites 14volunteers,2,201hours 37%increaseincheckoutsfrom1st2to

last2sessionsatSheridan 89%increasefrom1sttolastweekat

May 75%ofyouthwithlibrarycards 25%increaseinadultESLattendance

atnightsessions

65%ofLevel1and2completedthoselevels

Improvedreadingandlanguageskills Relationshipsbetweenadultsand

childrenformed Parentsreportedgreatereffortfor

nightattendancebecauseofchildren’smotivation

CorrelatedwithincreasedsuccessforadultESLstudents

2008‐CO‐32795LovelandKidsLovetoRead

March‐May2009: 374contacts 31sessions Avg.children/session:12 750booksdistributed 460volunteerhours,6volunteers

MapleTerrace:51%to100%visitedlibrary

MapleTerrace:56%‐78%checkedoutbooks

2008‐CO‐32797Library&LiteracyPartnershipProgram(Academy20SummitMS)

Briargatepreschool,Jan‐May2009:1,464bookschecked‐outby150students

SummitMS,Jan‐May2009:355bookscheckedoutby50students

Readingpartnersprogram:120preschool,50MSstudents

71%ofMSstudentsliketoread 81%enjoyreadingaloudto

preschoolers 37%readingmore Sept’08medianfluency:124.5wpm,

May’09:148.5 Controls:130‐140 MS:selfperceptionasgoodreader

50%‐65%,Jan‐May Majoritytestedlevels1‐2,75%

achieved3‐5 37/40preschoolers:liketoread

2008‐CO‐31605InstitutionalLibraries

ReadtoChildren:8‐16CDOClibraries 22libraries,411,126visits,566,348

circ 89%ofprisonersuselibraries 28kyouthcheckedout25,199items 100%ofCDOClibrariescomplywith

ACAlibrarystandards Re‐entrybeginsatDay1initiative:

prisonersread4booksin10weeks

RTCincreasesliteracyofprisonersandchildren,andstrengthensfamilybonds

Alsoimprovedaccesstoparentinginfo,importanceofearlyliteracy,loveofreading

Re‐entryinitiativebookschosentopromotereading,cognitiveskillscorrelatedwithreducedrecidivism

2008‐CO‐32788GEDattheLibrary–AGatewaytoMore(BoulderValleySD)

2‐hrGEDclasses,2/wkatLafayette&BoulderPLs

156classes 17adultstudentsgetcard,use3+times

tocheckout 53adultlearners,14khrsofinstruction

75%reportmorepositivefeelings,reading&literacy

9adultstudentshelpedchildrengetcards,visitedatleast3times

42adultstudentsreportincreasedlibraryvisitsoutsideclasstime

61%ofadultlearnersincreasedliteracyatleast1TABElevel

Childrenreportedmorepositivefeelingstowardparentslearningatlibrary

ProjectCode/ProjectTitle OutputData OutcomeData2008‐CO‐32789EstesValleyPartnershiptoExpand&EnrichInformalEducation

22events 1,200+attendees

8inmathenrichmentimprovedCSAPscores

3inhomeworkhelpimprovedCSAPscores

2008‐CO‐32248EnhancingCOLibraryStorytimes(CLEL)

11sets,30picturebooks,5eachfor6ECRRskills

66%considerskillstrainingveryhelpful(5/5)

33%helpful(4/5) Participantsdemonstratedatleastone

skill(4.5/5) Trainingforverbalsharingwith

handouts(4.5/5) Modelingthrustorytime(4.6/5) Sharinginfow/parents/caregivers

(4.2/5) Allpost‐trainingobservationsindicate

traineessharedmessagesduringstorytimeandcoveredatleast1skill

2008‐CO‐32796ConnectingInfoLiteracytoLearning(J&WU)

285studentsat19GetConnectedsessions

Faculty:orientations,8;copyright,40 Pre/post(’07‐08to’08‐09):labuse,

28,130to33,189;reservations,76to171;circ,11,820to13,898;studentcirc,11,023to12,894

Researchhelpsite:49,774 Classguidessite:9,429visits Exceededgoalofincreasingusageby

10% Individuallabuseup18% Classlabreservationsup125% Circup18% Studentcircup17%

GetConnectedevaluation(176):79%ofstudentsmoreconfidentusingresources 66%likedCephaloniantourmethod 70%gameeffectivetolearnservices 80%demoseffectivetolearnservices 86%strongly/agreeinfolitsessions

usefulInfoLitevaluation,’07‐08to’08‐09(608) Freshmen:70%to71% Upperclassmen:73%to75% All:72%to73%Satisfactionsurvey(452/1289—35%) 82%very/satisfiedw/libraryFacultyawarenesssurvey 73%‐78%awareofresources 35‐36%%useresources 54%‐47%encouragestudentstouse Met75%goalforawareness;fellshort

onothersILskillsoffacultytestedusingNILRCILtest Avg.score:94% StudentILsessionsw/DSSTstudents:

81%increasedconfidenceinILskills(researchquestions,keywords)

2008‐CO‐32247BookStart(DougCoLibsFoundation)

8events 94attendees

Beneficiaries: almost2,000children almost200childcareworkers

2009‐CO‐36939SummerReadingProgram(CSL)

103/113(91%)ofPLshadSRP—66%forteens,33%foradults

88%ofthosewithSRPusedstatewide/Collaborativetheme

217,735participants—154,394children,43,689teens,19,652adults

Workshopevaluation 65%presenterexcellent,31%okay 55%positiveaboutscheduling,dates,

locations 66%madelocalconnectionsw/schools

ProjectCode/ProjectTitle OutputData OutcomeData2009‐CO‐36123SummerReadingMini‐Grants

73grantsto49jurisdictions $200withcashmatch$50

67(92%)wroteviableOBEstatements 73(100%)gathereddata,usedonline

survey 73(100%)madeconnectionswith

communities 73(100%)submittedstoriesonline

2009‐CO‐36923SchoolLibraryDevelopment(CSL)

15workshops Avg.attendance18

95%highlysatisfiedw/outcomesofworksessions

100%havetoolstoimprove21stCenturyskillsofstudents/teachers

2009‐CO‐36930PublicLibraryDevelopment–YouthServices(CSL)

YSworkshops 155librarians,51libraries Earlyliteracyworkshop,Montrose,20

librarians2009‐CO‐36922PowerLibraries

5sessions 47TLs 207Ningparticipants 79HiPerformance 35Developing 114total

90%info/materialsuseful 98%ofDevsubmitactionplanfor

collaboration 100%ofDevvisitmentor 100%ofDevevaluateprogress

favorablyinincreasingcollaboration 25%ofDevbecomeHiPerformance

2009‐CO‐36749Play&Learn–CO(PPLD)

Web‐basedgametoteach4thgradehistorystandards

LettersandPRto114schools,342teachers

Webstatistics(’09‐10) Homepageup16% CObiosup136% Webpicksup42%

Surveyof65teachers 45%rategamepotentialhigh,39%

veryuseful,16%moderatelyuseful

Goal3:Coloradoresidents,peoplewithdisabilities,ethnicpopulations,institutionalresidentsandthoseunderservedbylibrariesreceiveservicesfromColoradolibrariesthatmeettheirtargetedneeds.ProjectCode/ProjectTitle OutputData OutcomeData2008‐CO‐32241SpecialPopulationsCommittee:CommunityConversations

51communitypartners 32volunteers 1,687programattendance 2,340diversitycalendarsdistributed 1,000+partnerpiecesondisabilities

distributed 800webresourcesflyersdistributed 6statewidebulletins(news,

partnerships,resources)issuedtopubliclibraries

6/10projectsreportdiversepatronsusingcollections/participatinginprogramsfor1sttimetogreatextent

8/10projectsreportdiversepatronsusingtailoredcollectionstogreatormoderateextent

8/10projectsreportabilitytoengageincivildiscoursetogreatormoderateextent

8/10projectsreportexpandingpartnershipstogreatormoderateextent

6/10projectsreportincreaseincommunityunderstandingoflibraryroleinservingall

halfofstaffreporthighercomfortservingdiversepatrons

9/10projectsreportlikelytoofferadditionaldiverseprogrammingwithpartners

Majorityofattendeesreport:firsttimeattendinglibraryevent,wouldattendsimilarprogram,learnedfromprogram

92%ofattendeesplantouselibrarytoday

90%perceivelibraryascommunityresource

2008‐CO‐31606COTalkingBookLibrary

329,961circs 8,595registeredpatrons 656,040itemsprocessedthru

mailroom 67outreachevents 1,700schoolsreceivepublication

2008‐CO‐32246BookExpress(PoudreRiverPLD,FtCollins)

Ruralaccessemphasis

SRPregistrationupfrom158in’08to171in’09,despiteshorterSRPin‘09

SRPcompletionratesdownfrom62%to59%

Goal:circ3500 Actualcirc454(Apr‐Aug)

Goal:50%increaseinNsteadyorgainingonDevelopmentalReadingAssessment2(DRA2)test

Outcome:Resultsfor21students,90%steadyorgainedin‘09

Controlgroup:81%

Goal:90%satisfactionrateforparents/family,80%willingnesstoparticipateagain

Outcome:87%definitely/mostlysatisfied,80%plantoparticipateagain

Goal:50%increaseinawarenessoflibraryservices

Outcome:48%awareofupto4services

ProjectCode/ProjectTitle OutputData OutcomeData2009‐CO‐36755SanLuisValleyTechLearning

Ruralaccess MigrantEdconnectionlimited 269classes 1,000+attendance nowcirculatinglaptopsin‐house

204surveyresults 1,013beneficiaries Asresultofclasses,increased

confidenceandknowledgeofcomputeruse

2009‐CO‐36928InstitutionalLibraries(CSL)

ReadtoChildrenstats 1,300childrenreceived

book/recordingIntranetstats: 2‐3kpageviews/week,10pervisit(i.e.,

200‐300visits/wk) 121web,phone1‐1,workshop

trainings,479attendeesPrisonlibrarystats: 447,594visits 561,773circulation 89%use 30,380youthcheckedout26,719items

RTCincreasesliteracylevelsofprisonersandtheirchildren(data?)

Goal4:ColoradolibrariescooperatetodevelopstrategiesandtechniquesthatassurethesharingofresourcestobestmeettheneedsofColoradoresidents.ProjectCode/ProjectTitle OutputData OutcomeData20089‐CO‐31595PLDevelopment&CommunityPrograms

350participantsin24meetings 55participantsinSWconference 10librarydigitalconsortium

75%ofmeetingparticipantslearnedalotofnewinfo

100%rateSWconferenceverygoodorexcellent

10librarydigitalconsortiumsavedlibrariesover$70k

2008‐CO‐31602NetworkingandTechnology–ResourceSharingServices

CVL/CVL‐for‐Kids:2.2Mhits,257kvisitors

117kSWIFTILLrequestsfrom390libraries

115librarystaffattend26trainingsessions

CVLstaffrespondto2,414emailsand375phonecalls

94attendSWIFTUserGroupmeeting 169attend17regionalSWIFTmeetings COHistoricNewspaperCollection:

26.5Mhits,205kvisitors 29Plinkitsitesserve220kCOresidents

Accessspeedstoallserversimproved Networkassessment/newsystem

softwareevaluation/securityauditstarted

2009‐CO‐36925NetworkingandTechnology:ResourceSharingServices

SWIFTstats 400libraries 120krequests Staff:37sessions,168staff 2,856emails 312phonecallsCOHistoricNewspapersstats 28.3Mhits,214,365visits,up5%Plinkitstats 33libraries serving220kCOresidents

SBCIh

MtTiL

Ow

As

SurveyRespo

BothformalanColoradolibra

nviteesincludholdersforall

Colora Colora Colora Colora

(CoAS Specia

Chapt Colora Colora REFO

Membersofththeheadofthe

TowardtheendentifiedinfoLibnet.Individ

Ofthe150respwhichtheyare

Twoo Over Oneo Oneo

Anadditionalscienceeducat

ondents&Re

ndinformallearyleaders.

dedpast,curreofthestate’sadoAssociatioadoAcademicadoPublicLibadoAssociatioSL)alLibrariesAster(RMSLA)adoAssociatioadoCouncilofRMA

hesegroupswegroup,itslis

ndofthesurvermal,emergindualmembers

pondentswhoeaffiliated:outoffive(40aquarter(26outofsix(16%outofseven(1

18respondentionprograms

sponseRate

adersintheC

ent,andincomlibraryassocionofLibrariescLibraryAssobraryAssociatonofSchoolL

ssociation,Ro

onofLawLibrfMedicalLibr

wereinvitedtotmanager,or

eyperiod,areng,andaspirinsoftheCSLst

Typochosetoresp

0%)areaffiliat%)withschoo%)withinstitu15%)withaca

ntsidentifiedas.

Ap

Coloradolibrar

mingoffice‐ations:s(CAL)ciation(CALAtion(CPLA)ibrarians

ckyMountain

raries(CoALLarians(CCML

participateinamemberof

eminderaboutngleaderswasaffwereinvite

peofLibrarypondtothequ

tedwithpubliollibrariesutionallibrarieademiclibrari

affiliationswit

ppendixD

rycommunity

A)

n

))

Theinvandothlibraryc

Membewereals

nthesurveyvitheCSLstaffw

tthesurveydssentviathesedtoparticipa

orLibraryOuestionabout

iclibraries

eses

thspeciallibra

ywereinvited

vitationincludherinterestedconsortia,incColoradoLibColoradoAllColoradoAllMarmotLibr

rsofstateandsoaskedtopaColoradoPubCommunityCFrontRangeSoutheastArSouthwestPSanLuisVall

iatheirofficiawhodoesliais

irectedatallostatewideemaateinthesurv

Organizationthetypeoflib

aries,libraryc

dtoparticipate

eddirectors,smembersofsluding:braryConsortiianceofReseaiance)raryNetwork

dregionallibrarticipate.ThblicLibraryDCollegeLibrarPublicLibrarreaLibraryDiublicLibrarieleyLibraries

alemaildistribsondutywith

oftheseindiviaildistributioveyasformal

braryorlibrar

consortia,libr

einthesurvey

staff,boardmsingle‐andmu

ium(CLiC)archLibraries

rarydirectorsisincluded:DirectorsryDirectorsryDirectorsirectorses

butionlists,eithatgroup.

idualsaswellnlistforlibraorinformalle

ryorganizatio

raryandinform

yof

members,ulti‐type

s(aka

groups

itherby

asself‐aries,eaders.

onwith

mation

Tlir

OoWra

OgstLLtLs

Theseproportibraryorganizrelianceon,LS

Ofthe163respoffive(60%)lWestSlope,anrelatedorganiandtheirrelia

Ofthe113respgroup—unsurstatewidelibratopicofLSTAfLibrarians,17LibrariesAssotheColoradoALibrarians(2).suchastheAm

tionsreflectthzations(e.g.,cSTAfunds.

pondentswholocatedthemsndoneoutofszationsineacnceonLSTAf

pondentswhorprisingly—waaryassociatiofunds:30fromfromtheColoociation.TwoAssociationof.The18respomericanLibrar

hesizeofthevconsortia,LISp

orevealedtheelvesintheFrsix(17%)ontchregion,thesfunds.

oidentifiedthasleadersandn.TherelativemtheColoradoradoAcademtosixresponsSpecialLibraronseslumpedryAssociation

variouslibraryprograms),th

GeogregeographicsrontRangeretheEasternPlasizeoftheirst

AssociahelibraryassodmembersoferankingsoftdoPublicLibramicLibraryAssseseachwereries(4),REFOdtogetherundnanditsdivisi

y‐typesectorsheirlevelsofin

raphicSettinettinginwhicgion,aboutonains.Theseprtaffanduserp

ationAffiliaticiation(s)wittheColoradothefourmajoraryAssociatiosociation,10freceivedfrom

ORMAColoradderOthermosons.

s,thenumbernvolvementw

ngchtheirlibraryneoutoffourroportionsrefpopulations,th

ionthwhichtheyAssociationordivisionsofon,26fromthefromtheRockmtheColoradodo(4),andthetlyincludedr

andsizeofthwithCSL,andt

yororganizat(23%)intheflectthenumbheirlevelsofi

areaffiliated,fLibraries(CACALwerealsoeColoradoAskyMountainChoAssociationeColoradoCoueferenceston

evariousancitheireligibility

tionislocatedMountainsorbersoflibrariinvolvementw

byfarthelargAL),themultiopredictable,sociationofSchapteroftheofLawLibraruncilofMedicnationalorgan

illaryyfor,and

d,threeoutrontheesandwithCSL,

gest‐division,giventhechoolSpecialries(6),calnizations

Rr

Oiifr

Dlrsibs

Respondentswresponsestoth

Front South South Colora Marm Colora SanLu

Ofthesurvey’sncludingtheirnformationwfollow‐upfromreportedtoCS

Duetoacommeadershiproleresponsesfromsomekeyidenmpossibletocboostedsomewstakeholdergr

werealsoaskehisitemincluRangePublic

hwestAreaLibheastAreaLibradoLibraryCimotLibraryNeadoNexusConuisValleyLibr

s203respondrnames,affiliawasrequestedmaCSLstaffmSLforpossible

monproblemies)—thebestm203individntifyinginformcalculaterespwhatbyvolunroups,butwho

Rediftheywereded:LibraryDirecbrariansGroupraryDirectorsirculationNetetwork(aMounsortium(asorariansGroup

dents,56—sligations,andcofromanyrespmember,theidefurtheractio

nsmallerstatestimateofthuals,thatisanmation(e.g.,asponseratesfornteer“replaceorespondedt

Regional&Speaffiliatedwit

ctors(FRPLD)ps(SEADS)twork(CCLN)untains/WestSoutheasternCp

Personaghtlymorethantactinformapondentwhoodeassharedbyn.

Surveytes—“overlapphe“universe”onestimatedresociationaffilrindividualstments”whowtothereminde

pecialInteresthanyofseve

SlopeconsortColoradoconso

alIdentificatanaquarter(2ation(emailadofferedaspecytheserespon

yResponseRapingdirectoraofColoradolibesponserateoliation,regiontakeholdergrowerenottargeernoticeviath

stGroupseralregionala

1412116

tium) 3ortium)2

1

tion28%)—volunddressand/orcificcommentndentsandthe

ateates”(e.g.,indbraryleadersof81%.Asmaalandspecialoups.Thisestetedintheorighestatewidel

ndspecialint

nteeredpersonrphonenumborsuggestioneirpersonalid

dividualsoccupisapproximaanyrespondenlinterestgroutimatedrespoginalappealslibraryemaild

terestgroups.

nalidentificatiber).Asthisnthatmightredentificationw

pyingmultipletely250.Withntsdeclinedtoupaffiliation,),nserateisdoudirectedatpadistributionli

The49

ion,

equirewillbe

ehoreport,itisubtlessarticularist.

AppendixESurveyofLibraryLeadersSurveyFormwithResponseFrequencies(Numbers&Percentages)InstructionsTheColoradoStateLibrary(CSL)hascontractedwiththeRSLResearchGrouptoconductanindependentevaluationofitsFY2008‐12stateprogramplanforLibraryServicesandTechnologyAct(LSTA)fundingfromtheInstituteofMuseumandLibraryServices(IMLS).http://www.cde.state.co.us/cdelib/LSTA/download/pdf/LSTA_FiveYearPlan2008‐2012.pdfRSLwillalsoincludesuggestionsforCSL’snext5yearplan.ThisanalysisisrequiredofallstatesthatreceiveLSTAfunding.ThefirstpartofthissurveyasksforyourhelpinassessingCSL'suseofLSTAfundsduringthislatestfive‐yearperiod.Thesecondpartasksforyourhelpinshapingthefive‐yearplanfor2013‐17.YourinputwillassistCSLinprioritizingprojectstobefundedunderfourbroadgoalareas:1)learningforallages,2)resourcesharing,3)recruitmentandtrainingoflibrarystaff,and4)libraryservicestospecificpopulations.Pleaserespondtothissurveyonlyonce,evenifyouoccupymultipleleadershiprolesinthestate'slibrarycommunity.Whileidentifyingyourselfisoptional,weaskthatyoudo,soyoumaybecontactedtofollowuponyourresponsestothesurvey.Ifyouhaveanyquestionsaboutthesurveyoranydifficultyrespondingtoit,pleasecontactRSLResearchGroupcontractorKeithCurryLanceatkeithlance@comcast.netor720‐232‐5866.PartI.LSTAGrantFundingProcessThefollowingitemsaredesignedtoassessyourexperiencewiththeColoradoStateLibrary'sLSTAgrantfundingprocess.1.IfyourlibraryororganizationhasnotsubmittedaLSTAgrantapplicationtoCSLinthelast5years,whichofthefollowinghashinderedyoufromdoingso?Markallthatapply.IfyourlibraryororganizationhassubmittedaLSTAgrantapplication,skiptothenextquestion.Hindrance Number PercentProjectideasappropriateforLSTAfunding 57 50%Stafftimetowriteproposals 82 71%Staffexpertiseinproposalwriting 45 39%Partnerlibrariesororganizationsneededtopursuedesiredproject 20 17%Stafftimetoimplementgrant‐fundedprojects 43 37%Stafftechnologyexpertisetopursuegrant‐fundedprojects 18 16%Grantamountnotsufficienttowarrantaproposal 7 6%Other(pleasespecify) 48Otherresponses:noteligibleforLSTAgrants,notawareofLSTAsub‐grantprogram,don’tknowifapplied(newtojob)

2.IfyouhaveappliedforaLSTAgrantinthelast5years,howwouldyouassesstheseCSLservicesassociatedwiththeLSTAgrantfundingprocess?Markoneperrow.IfyouhavenotappliedforaLSTAgrant,skiptothenextquestion.Number/Percent Excellent Good Fair PoorLSTAgrantapplicationguidelines 17

36%2757%

36%

00%

LSTAgrantapplicationtraining 1430%

2553%

715%

12%

Feedbackregardingapplicationscoring 1635%

2452%

511%

12%

CommunicationaboutLSTAreportingrequirements

2044%

2350%

24%

12%

3.WhatrecommendationscanyouprovidetoCSLregardingtheLSTAcompetitivegrantprocess?Beasspecificandconciseaspossible.Respondent‐identifiedrecommendations NumberTargetedcommunication/informationtosmall/rurallibraries 15Larger/smallergrantamounts 10Approvalofprocessas‐is 6Moreintensiveface‐to‐facehelp 6Morestreamlinedprocess/paperwork 4PartII.TheCurrent5‐YearPlan,FY2008‐2012ThefollowingitemsaredesignedtoassessCSLactivitiesfundedbyLSTAunderthecurrentplan.PleaseassessCSLactivitiesineachareabasedonyourownknowledgeandexperience.1.Forthegoalofprovidingelectronicaccesstolibraryresourcesandservices,howwouldyouassessCSL'soverallperformanceonthefollowingactivities?Markoneperrow.Number/PercentofTotal/PercentofFamiliar Excellent Good Fair Poor

Notfamiliar

LibraryJobline 5835%46%

5936%47%

74%6%

21%2%

3924%

Onlineworkshops 3722%29%

7042%54%

1811%14%

42%3%

3823%

Plinkitwebsiteservices 3018%53%

2012%35%

64%11%

11%2%

10665%

Supportofe‐resourcedelivery(e.g.,databases,e‐books)

2415%20%

7042%58%

1613%10%

106%8%

4628%‐‐‐‐‐‐‐

2.Forthegoalofsupportingeducationalattainmentandlifelonglearning,howwouldyouassessCSL'soverallperformanceonthefollowingactivities?(Includes:earlyliteracy,K‐12throughhighereducation,21stCenturylearningskills,andlifelonglearning.)Markoneperrow.Number/PercentofTotal/PercentofFamiliar Excellent Good Fair Poor NotfamiliarChannel2‐EverydayBookClub

106%29%

1711%49%

53%14%

32%9%

12778%‐‐‐‐‐‐‐

HighlyEffectiveSchoolLibraries

2616%36%

3320%45%

85%11%

64%8%

9456%‐‐‐‐‐‐‐

StoryBlocks‐EarlyLiteracyProgram

2113%30%

3723%53%

106%14%

21%3%

9257%‐‐‐‐‐‐‐

Summerreadingprogramsupport

3923%35%

6640%60%

53%5%

00%0%

5734%‐‐‐‐‐‐‐

Youthservicessupport 2616%29%

4729%53%

148%16%

21%2%

7646%‐‐‐‐‐‐‐

3.Forthegoalofservicetospecificunderservedpopulations,howwouldyouassessCSL'soverallperformanceonthefollowingactivities?Markoneperrow.Number/PercentofTotal/PercentofFamiliar Excellent Good Fair Poor

Notfamiliar

ColoradoTalkingBookLibrary

5634%47%

5936%49%

21%2%

21%2%

4728%‐‐‐‐‐‐‐

Institutionallibraryconsulting

4024%57%

2314%33%

53%7%

21%3%

9758%‐‐‐‐‐‐‐

4.Forthegoalofresourcesharing,howwouldyouassessCSL'soverallperformanceonthefollowingactivities?Markoneperrow.Number/PercentofTotal/PercentofFamiliar Excellent Good Fair Poor

Notfamiliar

ColoradoVirtualLibrary(includingHistoricNewspapers)

6036%43%

6337%45%

1610%12%

00%0%

2917%‐‐‐‐‐‐‐

Supportforlocalinterlibraryloanservices(SWIFT)

8048%59%

4929%36%

64%4%

11%1%

3119%‐‐‐‐‐‐‐

Virtualreferenceservice(AskColorado/AskAcademic)

6337%45%

6337%45%

138%9%

21%1%

2817%‐‐‐‐‐‐‐

PartIII.TheNext5‐YearPlan,FY2013‐2017ThefollowingareasofCSLactivityarebeingconsideredfordevelopmentorexpansionduringthenext5‐yearplanningperiod.Pleaseindicatetheirimportancetoyou,consideringyourclienteleaswellasthegenerallibraryusercommunity.1.Forthegoaloflearningforallages,howwouldyouratethefollowingpossibleareasoffutureCSLactivity?Markoneperrow.Number/PercentofTotal/PercentofRanking Essential

Veryimportant Important

Notimportant Don’tknow

Earlyliteracyprogramming

8149%56%

4226%29%

2113%14%

11%1%

1912%‐‐‐‐‐‐‐

Computertraininginpubliclibrarycomputercenters

4829%33%

5735%39%

3622%24%

64%4%

1610%‐‐‐‐‐‐‐

Standards‐basedresourcesforK‐12libraries

5131%41%

4326%34%

2515%20%

64%5%

3924%‐‐‐‐‐‐‐

2.Forthegoalofresourcesharing,howwouldyouratethefollowingpossibleareasoffutureCSLactivity?Markoneperrow.Number/PercentofTotal/PercentofRanking Essential


Notimportant Don’tknow

DevelopmentofadditionalcollectionsfortheColoradoVirtualLibrary(i.e.,images,audiohistory)

2113%15%

5031%35%

6540%45%

74%5%

1912%‐‐‐‐‐‐‐

Provideconsultingonsupportservicesfornewlibrarydistricts(i.e.,humanresources,budget,finance,purchasing)

2817%20%

5433%39%

5131%36%

74%5%

2314%‐‐‐‐‐‐‐

Hostingandsupportofe‐resources(i.e.,e‐bookplatform,collections,access

6338%43%

5333%36%

2716%19%

32%2%

1811%‐‐‐‐‐‐‐

3.Forthegoalofrecruitmentandtrainingoflibrariansandlibrarystaff,howwouldyouratethefollowingpossibleareasoffutureCSLactivity?Markoneperrow.Number/PercentofTotal/PercentofRanking Essential


Notimportant

Don’tknow

Createtoolsfordevelopinghighlyeffectiveschoollibrarians

4930%37%

5433%41%

2616%20%

32%2%

3119%‐‐‐‐‐‐‐

Provideleadershipfordiscussionofinnovationinlibraries

6439%41%

5835%37%

2817%18%

74%4%

85%‐‐‐‐‐‐‐

Trainonuseoflibraryandcommunitydata(e.g.,localneedsassessment,planning,evaluation,p.r./marketing)

4125%27%

6338%42%

4225%28%

53%3%

149%‐‐‐‐‐‐‐

4.ArethereotheractivitiesyouwouldliketoseeCSLimplement?RememberthatLSTA‐fundedactivitiesmustfallwithinoneormoreofthefollowingLSTApriorities:1)learningforallages,2)resourcesharing,3)recruitmentandtrainingoflibrariansandlibrarystaff,and4)servicestospecificunderservedpopulations.Beasspecificaspossible.(Identifyupto3priorities.)Respondent‐identifiedpriorities NumberCopingwithe‐bookrevolution 20Promotingleadershipandinnovation 11Teaching21stCenturyskills 10Encouragingearlyliteracyefforts 8Improvingservicestounderservedpopulations 7Expandingbusinessandemployment‐relatedservices 5Facilitatingstatewidepublicprograms 5Increasingcapacityfordata‐basedmarketingoflibraryservices 5Promotinginterlibrarycooperation 5PartIV.AboutYouThefollowingitemsaredesignedtotellusaboutyou,sothesurvey'sfindingscanbegroupedandanalyzedappropriately.Whiletheitemsaskingyoutoidentifyyourselfandprovidecontactinformationareoptional,youranswerstotheseitemswouldbeappreciated,astheywillmakeitpossibletofollowupwithyouaboutyourcommentsandideas.If,however,youchoosenottoidentifyyourself,yourcommentsandideaswillbevaluedequallywiththosefromidentifiedindividuals.1.Whattypeoflibraryorlibraryorganizationareyoumostcloselyaffiliatedwith?Markone.Typeoflibrary/orgnaization Number PercentCollegeoruniversitylibrary 22 15%Publiclibrary 60 40%Schoollibrary 40 27%Institutionallibrary 24 16%Libraryconsortium 2 1%Libraryandinformationscienceeducationprogram 2 1%Other(pleasespecify) 18Skipped 53Otherlibrary/organizationtypesincludedcorrectionallibrary,CSL,governmentagency,lawlibrary,andspeciallibrary..

2.Inwhatsettingisthislibraryororganizationlocated?Markone.Region Number PercentEasternPlains 28 17%FrontRange 97 60%Mountains/WestSlope 38 23%Skipped 403.Withwhich,ifany,ofthefollowingassociationsareyouinvolved,andhow?Markallthatapply,ornone,ifappropriate.

AffiliationLeader Member TotalNumber Percent Number Percent Number Percent

ColoradoAssociationofLibraries(CAL) 25 62% 86 51% 100 52%ColoradoPublicLibraryAssociation(CoPLA) 4 10% 26 15% 28 15%ColoradoAssociationofSchoolLibraries(CASL) 5 13% 21 12% 23 12%ColoradoAcademicLibraryAssociation(CoALA) 3 8% 14 8% 16 8%RockyMountainChapter,SpecialLibrariesAssociation(RMSLA) 1 2% 9 5% 9 5%ColoradoAssociationofSpecialLibraries(CoASL) 0 0% 4 2% 4 2%ColoradoAssociationofLawLibraries(CoALL) 2 5% 4 2% 5 3%ColoradoCouncilofMedicalLibrarians(CCML) 0 0% 2 1% 2 1%REFORMAColorado 0 0% 4 2% 4 2%Other(pleasespecify) 18 Skipped 90 Otheraffiliationsincluded:ArchdioceseofDenverCatholicSchoolLibraryAssociation,COAllianceofResearchLibraries(Alliance),COCouncilofInternationalReadingAssociation(CCIRA),COLibrariesforEarlyLiteracy(CLEL),COLibraryConsortium(CLiC),COSchoolLibraryLeaders(CoSLL),SocietyofRockyMountainArchivists(SRMA)4.Withwhich,ifany,ofthefollowingregionalandspecialinterestgroupsareyouassociated?Markallthatapply,ornone,ifappropriate.Affiliation Number PercentColoradoLibraryCirculationNetwork 5 13%FrontRangePublicLibraryDirectors(FRPLD) 13 33%SanLuisValleyLibrariansGroup 1 3%SouthEastAreaLibraryDirectors(SEADS) 9 23SouthwestAreaLibrariansGroup 12 5Otherorganizationalaffiliation 19 31%Skipped 164OtheraffiliationsincludedFrontRangePublicLibraryFinanceDirectorsaswellasMarmotandNexus,bothnetworkingconsortia.

AppendixF

FocusGroupInterviewofCSLManagementTeamNotesfromDecember13,2011Participants:

EugeneHainer,AssistantCommissionerofEducation,StateLibrarian JimDuncan,Director,NetworkingandResourceSharing JeanM.Heilig,FiscalOfficerandLSTACoordinator DeborahMacLeod,Director,COTalkingBookLibraryandCOStatePublicationsLibrary SharonMorris,Director,LibraryDevelopmentandInnovation NicolleSteffen,Director,LibraryResearchService,andStateDataCoordinator ShelleyWalchak,Sr.Consultant,LibraryCommunityPrograms

Purpose: Inputfrommanagementteamtoshapesurveyfromlibraryleadershipcommunity,notaboutjustificationof

whatstaffdoes Partofevaluationisforward‐looking,focusedonwhatwewanttodointhenextfiveyears

ColoradoLSTAGoals: Goalareasfor2008‐12:electronicaccess(1);academicachievementandstudentlearning(2);servicesto

specialpopulations(3);resourcesharing(4) Goalareasfor2013‐17:learningforallages(1);resourcesharing(2),recruitmentandtraining(3);services

tospecialpopulations(4);OBE(5) Changefromlast5‐yearplan:cannowhaveasagoalrecruitmentandtraining

Whathasyourunitbeendoingtowardthe2008‐12LSTAgoals?

o 1:Electronicaccesstoresourcesandservices

LibraryJobline LEA–departmentofEdpresentations CALLI(CALleadershipinstitute) Onlineworkshops(inadditiontoin‐persontraining)

Examplesofin‐persontraining:stafftrainingdays,NRSroadshow Online:WebsideChat,CSLinSession

CTBL Boardtraining Publiclibraryconsulting(libraryadminsupport) StatePubs–outreachtodepartmentagencycontacts Studiesanddatareports ILDintranetandconsulting

o 2:Academicachievementandstudentlearning Highlyeffectiveschoollibraries 21stcenturyskillstraining Earlyliteracy Youthservicesworkshops REACHprojects EarlyLitMLIS Water2012partnership Re‐entry(institutions) Adulted./GED(partnerships) Summerreading COhumanities–riverofwords(partnership) Surveys&datareports StatePubs–researchcontent CTBL–foralternateformats StoryBlocks EverydayBookClub

o 3:Servicestospecialpopulations

StatePubs–ruralviaonline CTBL ReadtotheChildren Evaluations(e.g.CTBL) Librarymaterialsforinmates Incarceratedkids(newILDconsultantisdoingalotoftalkswithkids)

o 4:Resourcesharing

Summerreading SupportforILLservices Supportforvirtualreferenceservices Supportforwebservices Evaluation(e.g.AskColorado) StatePubs–depositories CTBL–largeprintborrowedbyotherlibraries Supportfore‐Resourcedelivery(licensedorpurchased)

ReferenceUSA AIRS Overdrive

Supportfore‐resourcedelivery–createdinColorado(ex.CHNC,CVL) Wattmeters(partnership)

PartnershipsmadethroughBTOPthatmayneedtocontinueafteroriginalfundingendsWhatwouldyoulikeyourunittodotowardtheproposed2013‐17goals?

o 1:Learningforallages K12standardsbasedresourcesfunded(goalongwithnewCDEstandards–workwiththem) Digitizestatedocuments–moreandmore Annualacademicdatareporting(nowdoneevery2or3years) Babylibrarycard Teenadvisoryboard–publiclibrarycontext Computertraininginpubliccomputercenters

Mini‐grantforearlyliteracy

o 2:Resourcesharing Librarydistrictsforall Supportservicesfornewlibrarydistricts(aftertheylosethingslikeHR,purchasingandother

services) Increasedsupportfore‐resourcedelivery–licensedandpurchased(e‐books) Increasedsupportfore‐resourcedelivery–createdinCO(voicepreserve,moreCHNC,COimage

preserve,moreCVLcollections) Digitizegovernmentdocs ShiftILLservicestomaterialsdiscoveryservices Irresistibleschoollibrary Public&schoollibrarypartnerships Bettere‐data

o 3:Recruitmentandtraining

Budget/financeconsulting Trainingandlearningcenter(one‐stopplaceforCE) PartnershipMLISandprincipaleducationprograms(BeckyRussellidea) Highlyeffectiveassessmenttest Leaddiscussiononinnovation(remainleaderinthisarea) Datacollectionautomation Data/statstraining Serveasalegalresource Stafftraining

o 4:Servicestospecialpopulations

Youthincarceratedschoollibraries Sponsordisabilityconsultants Techlearningforincarcerated Onlinecomputermodulesfornewcomputerlearners Morestaffforduplicationondemand(CTBL)

WhatyouthinksomeorganizationotherthanCSLshoulddo(e.g.,CLiC,CAL)becauseitisnotappropriateforCSLtodo?

o Advocacy:CAL/CLiCo Marketing:CAL/CLiCo Servicestoimmigrants:CALo Legalservices:CDEo CE:CLiC&CSLo Supportservicesfornewdistricts:CSL&CLiCo Promotionofe‐resourceforSTEM(educationinK12):CDE

Whatdoesthisleavetobedonethroughcompetitivegrantprojects?

Servicestospecialpopulations Servicestoagingpopulations SharedlicensingofhostedILSforschoollibraries Seedmoney(forcompetitivegrantsorbetaprojects) Coordinatedlibraryservices(cataloging,collectionmanagement,displays,programs)‐partnerships

withlargerlibraries E‐bookpurchase,hosting,DRM

RFIDconversionsupportforlibraries Fundraising

HowcouldCSL’soutcome‐basedevaluationeffortsbeimprovedduringthenextplan?

o Therearenotthatmanydifferentoutcomesoroutputsfromreadingprojectreports,sowhennewgoalsareconfirmed,outputandoutcomemeasuresforeachgoalshouldbedeterminedandnotlefttoindividualprojectstodevelop Systematize,standardize Collectdatainmorestructuredway,easiertomarshaldatainthefuture Makethedatamoreuseful

o Ideasfromtodaywillbesentinsurveyformto:

OfficersofCALanditsdivisions FRPLD Consortia(e.g.,CLiC,Marmot,COAlliance) Reforma

Regionalandspecialinterestgroups

AppendixG BibliographyofSourcesforBackground,AvailableData,andQuoteswithWebLinksAskColorado[website],AboutUs.Availableat:http://www.askcolorado.org/info/about.html.ColoradoLibraries[blog],PlinkitWins[ColoradoAssociationofLibraries]ProjectoftheYear,December7,2009.Availableat:http://www.coloradolibraries.org/2009/12/07/plinkit‐wins‐project‐of‐the‐year/.ColoradoStateLibrary,CSLinSession:anonlinelearningseriesfromtheColoradoStateLibrary.Availableat:http://cslinsession.cvlsites.org/.ColoradoStateLibrary,WebsideChatswiththeColoradoStateLibrary.Availableat:http://www.cde.state.co.us/cdelib/webinars/WebsideChat.htm.ColoradoStateLibrary,WelcometotheColoradoStateLibrary.Availableat:http://www.coloradostatelibrary.org.Facebook,EverydayBookClub,JustinterviewedKathrynStockett,authorof"TheHelp!"July11,2011,9:02p.m.InstituteofMuseumandLibraryServices(IMLS).IMLSStateProgramReports.Accessedonline.InstitutionalLibraryDevelopment,ColoradoStateLibrary,LSTAProject–ReadtotheChildren(RTC),May2010.Availableat:http://www.cde.state.co.us/cdelib/prisonlibraries/download/pdf/ReadToTheChildrenProgram.pdf.LibraryResearchService,ColoradoStateLibrary.ACLOSERLOOK.

PublicLibraries–AWiseInvestment:AReturnonInvestmentStudyofColoradoLibraries,March2009.Availableat:http://www.lrs.org/documents/closer_look/roi.pdf.

U.S.PublicLibrariesandtheUseofWebTechnologies[2008],October2009.Availableat:http://www.lrs.org/documents/closer_look/WebTech_2008_Closer_Look.pdf.

U.S.PublicLibrariesandtheUseofWebTechnologies,2010,April2011.Availableat:http://www.lrs.org/documents/web20/WebTech2010_CloserLookReport_Final.pdf.

ColoradoTalkingBookLibraryPatronSatisfactionSurveyReport,2010,June2011.Availableat:http://www.lrs.org/documents/closer_look/CTBL_2010_Closer_Look.pdf.

LibraryResearchService,ColoradoStateLibrary,Data&ToolsandReports.Availableat:http://www.LRS.org.LibraryResearchService,ColoradoStateLibrary.FASTFACTS:RecentStatisticsfromtheLibraryResearchService.

No.257,LibraryJobline.org‐TheFirstYear,May16,2008.Availableat:http://www.lrs.org/documents/fastfacts/257_jobline.pdf.

No.258,ColoradoPublicLibrariesHelpChildrenGetReadytoRead,May22,2008.Availableat:http://www.lrs.org/documents/fastfacts/258_CLEL.pdf.

No.263,ColoradoSummerReadingProgramsMorePopularThanEver,September3,2008.Availableat:http://www.lrs.org/documents/fastfacts/263_summer_reading.pdf.

No.272,OutforLife:RestorativeLibrarianshipintheColoradoDepartmentofCorrections,May28,2009.Availableat:http://www.lrs.org/documents/fastfacts/272_Out_For_Life.pdf.

No.274,PatronsContinuetoLoveCTBLService,July22,2009.Availableat:http://www.lrs.org/documents/fastfacts/274_Colorado_Talking_Book_Library.pdf.

No.275,LibraryJobsinColorado:WhatDoesLibraryJobline.orgTellUs?,July24,2009.Availableat:http://www.lrs.org/documents/fastfacts/275_Library_Jobline.pdf.

No.281,State'sCollaborativeClimateFostersInterlibraryLoaninColorado,December04,2009.Availableat:http://www.lrs.org/documents/fastfacts/281_ILL_Use.pdf.

No.282,UseofStatewideDatabasesSkyrocketsin2009:LibraryPatronsBenefitfromAdditionalDatabases&Training,December11,2009.Availableat:http://www.lrs.org/documents/fastfacts/282_Airs_Database_Use.pdf.

No.284,MoreJobSeekers,FewerJos:FindingsfromLibraryJobline,YearThree,March30,2010.Availableat:http://www.lrs.org/documents/fastfacts/284_Jobline_Year_Three.pdf.

No.295,Colorado’sLibraryJobClimate:2007‐2010,InsightsfromLibraryJobline.org,May26,2011.Availableat:http://www.lrs.org/documents/fastfacts/295_Library_Jobline.pdf.

No.301,CTBLContinuestoEarnHighMarksfromPatrons,December27,2011.Availableat:http://www.lrs.org/documents/fastfacts/301_CTBL.pdf.

Lietzau,Zeth,U.S.PublicLibrariesandWeb2.0:What'sReallyHappening,ComputersinLibraries,October2009.Availableat:http://www.lrs.org/documents/Webtech_Lietzau.pdf.

conducted by rsl research group · relations/marketing. the csl management team considered it a...

Documents