“i’m sorry, but we didn’t know we wanted to know that !”

“I’m sorry, but we didn’t know we wanted to know that!”

Building Frameworks of Organizational Intelligence

Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries

NISO Usage Data ForumNovember 1-2, 2007Dallas, TX

Home, May 2006


New Library Home Page: The “Hindrance” Effect


Use of Electronic Resources, Spring 2005 and 2006 Comparison [local not vendor counts]

1 2 3 4 5 6 7 8 9 10 11 12 13 15 16 17 25 37 41 58 79 166 Total (row)

Bookmark old home 7 2 7 1 1 181 34 5 36 9 8 5 5 6 2 1 1 1 2 1 1 1172 3 5 4 2 1 1 163 5 2 2 2 1 1 134 4 1 1 1 1 85 2 1 36 1 1 1 37 1 1 28 2 2

16 1 122 1 126 1 1

Total (column) 7 36 15 46 19 10 10 7 11 3 2 4 4 3 1 1 1 1 1 1 1 1 185

12,827 sessions logged (this 24-hour snap shoot, minus ‘bots)

185 (1.4%) sessions opted for old home

20 sessions opting for old home involved Safari

135 old home sessions (1.1% of total) -- bookmarks or first clicks on new home: no tolerance

No. of clicks before visitor left new for old home

Total clicks logged

New Library Home Page: User Intolerance


What are the properties of these structures?

How versatile are they?

Are we able to adapt or repurpose them to facilitate

measurement?

What resources (tools, dollars, staff) are required to harvest, transform, and manage the data that now live all around us?

Data live all around us in structures.


Information Loop

Data Farm Environment

Clean | Anonymize Normalize

Data Streams

Integrate Inform

Report Builder

Dashboard

Data Bureau

Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

People and Network Data

Ref|Instruct

Working with data structures


E-Resource Use Reference ContactCirculation

Acquisitions Funds

Holdings

Copier | Printer Use

Gate Swipes

Resolve Resource

Resolve People

Resolve Places

Web Analytics

Image Collection Use

Data Farm Oracle Space-Overview

18+ gb, in 139 tables, for collecting and disseminating management info

Staff Census

LDAP

Tech Processing Workflow

Digital Library

Voyager-Supported Services

Building Use

Resolution Services

Administration

Reference & Instruction (dynamic)


Consortia ILL/DocDel

70-Member ILL Coop.

Interacting with data: dashboard pages



Interacting with data: report builders

DATA FARM

Submit for asynchronous

processingand delivery

Scheduled reports

Research[rmediated]

[e.g., record consultations,request ID resolution using the library intranet]


Interacting with data: “data bureau”

Auto-survey

Sample Data Structure I - Voyager

Invoice_line_item

invoice_status

purchase_order

line_item

invoice_line_item_funds

fund

invoice

vendor

bib_master

bib_text


Sample Data Structure II - Data Farm Table


Sample Data Structure III – Data Farm Funds Report


“…but we didn’t know we wanted to know that!”


Slide of report by fund and publisher (casalini) deleted

Data Farm: Operational Parameters

Raw Data In | Minimally Processed Data Out

Modules to Normalize, Resolve, Anonymize, and Format Data

Self-Executing—Dashboards, Cron’d Processes

Mediated Services: Report Builders, Resolvers, Research

Synchronous & Asynchronous Processing

Backup and Security

Data Harvest, Retention, and Storage Policies


Data Farm: Example Applications

Reference & instruction measures: • assess “market penetration”,• track changes in the modality and focus of service• account for liaison activities in annual reviews

Web page analytics: navigation, use frequencies, browser functionality, search functionality

Fund tracking and collection metrics, current and historical, for:• annual budget allocation, • stacks management,• storage decisions

E-resource tracking: monitor customer interest, use analysis

ILL consortial traffic: facilitate local collection analysis

Proxy log analysis, current study of interdisciplinary research behavior


A different take on a management information framework


xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

Sample Data Structure: EZ-Proxy Log


xxx.xx.xxx.xxx |-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

xxx.xx.xxx.xxx = .edu | on-campus | Van Pelt Library | staff office

July 26, 2007: 3:41 p.m.

Device= Mac | OSX Browser= Safari




Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer




zucca [Penn authentication key] = Provost cntr | LIBRARY | staff




SessionID 10335905=PsycInfo (resource identifier 7014)




sfx_session_id=Journal of Experimental Child Psychology,

“Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children.”



xxx.xx.xxx.xxx|-|zucca|[26/Jul/2007:15:41:01 -0500]| GET https://proxy.library.upenn.edu:443/login?proxySessionID=10335905&url= http://www.csa.com/htbin/dbrng.cgi?username=upenn3&access=upenn34&cat=psycinfo&adv=1 HTTP/1.1| 302|0|http://www.library.upenn.edu/cgi-bin/res/sr.cgi?community=59| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/418.9.1 (KHTML, like Gecko) Safari/419.3| NGpmb6dT6JXswQH|__utmc=94565761; ezproxy=NGpmb6dT6JXswQH; hp=/; proxySessionID=10335514; __utmc=247612227; __utmz=247612227.1184251774.1.1.utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPennLibrary=AAAAAUaWP5oAACa4AwOOAg==; sfx_session_id=s6A37A3E0-3B8E-11DC-80E9-85076F88F67F

TRANSLATION:

• Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.

• Logged into PsychInfo (CSA)

• Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library

• A library staff (Provost’s center affiliate)

• July 26, 2007 at 3:41 pm

and in the same session,



EVENT

Org|ProgramStaff

ServiceGenre

LibraryProgram

CampusLocation

Date|Time

IP-Domain

Environment

URL

Budget

Restricted

Unrestricted

Expnd Amt

Fund Code

Events: a Structure for

Library Decision Metrics

Dept

SchoolClient

Rank

Major

Biblio-graphicContent

School

Reqmnt

Dept

Dept

LevelCourseDescriptor

ClientProgram


Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct

Data Farm Silos

funds


DATA STORE

query (xsql)parse, resolve,

anonymize,secure!

store asmetridoc.xml

Data Farm Framework

oracle

logs

oracle

XML

Sources

Repository processes

Analysis

perl

XL

Service Environment

Catalog

Funds

Circulation

ERED

DYNIX BorrowDirect

SFX | ERM?

WEBApacheezproxy

Ref|Instruct


Event Elements Articulated in an XML Schema

EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

<ENVIRONMENTAL><v.domain><p.domain><date><time><session><url>

</ENVIRONMENTAL>

<CLIENT><school><dept><rank>

</CLIENT>

<LIBRARY PRGRM><service genre><staff_name><staff_org><staff_prgm>

</LIBRARY PRGRM>

<CONTENT><title><author><holdings><call_no><isbn><issn><url><res_id><sfx_id>

</CONTENT>

METRIDOC



</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>



CampusLocation

Date|Time

IP-Domain

Environment

URL

EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

METRIDOC


Dept

School

Client

Rank

Major


</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

METRIDOC



</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

Org|Program

Staff

Service Genre

LibraryProgram

METRIDOC



</ENVIRONMENTAL>


</CLIENT>


</LIBRARY PRGRM>


</CONTENT>


EVENT

LibraryProgram

EnvironmentClient

Content

ClientProgram

Budget

Biblio-graphicContent

METRIDOC


Data Source

instructions

Eventschema

metridoc.xml

voyager

Penn Community

Staff db

Java-based

processes

Data Store

<ENVIRONMENTAL><van_pelt><p.location><26-jul-2007><15:41:01><10335905>< http://www.csa… >< http://www.library.upe..><macOSX><safari2.0.4>

</ENVIRONMENTAL>

<CLIENT><LIB><admin><staff>

</CLIENT>

<LIBRARY PRGRM><urs><olson><5035><colldev>

</LIBRARY PRGRM>

<CONTENT><psycinfo><CSA><1017-7041><1901-3425><1452845903>< http://www.csa… ><sfx_id>

</CONTENT>

Schematic Workflow


Summary:

Exploring new frameworks to achieve greater data integration.

Taking advantage of xml extensibility to enrich the descriptive power of library data resources.

Aligning management information technology with the broader direction in digital library design.

Evaluating the potential for shared, open-source solutions thatmight promote collaborative data gathering and assessment.


Joe [email protected] 215-573-4643

University of Pennsylvania Library Office of Planning and Communication

Questions?


mailto:[email protected]

“i’m sorry, but we didn’t know we wanted to know that !”

Documents