www.gu.se håkan carlsson gothenburg university library bibliometrics – a tool in the evaluation...

www.gu.se

Håkan Carlsson

Gothenburg University Library

Bibliometrics – A Tool in the Evaluation of Science

www.gu.se

Table of Contents

• Introduction and definition• Different applications of bibliometrics• Bibliometric indicators• Financial allocaton models based on bibliometrics• Conclusions

www.gu.se

What is bibliometrics?

Definition:

“"Bibliometrics can be defined as the quantification of bibliographic

information for use in analysis “– Garfield

Statistical bibliography

www.gu.se

• Authors

• Affiliation

• Source (journal)

• Title, Abstract, Keywords

• Year

Metadata

www.gu.se

• Authors

• Affiliation

• Source (journal)

• Title, Abstract, Keywords

• Year

• References

Metadata

www.gu.se

Major areas of bibliometric research

• Fundamental statistical relationships• Citation analysis• Publication indicators for evaluation purposes

www.gu.se

Statistical Metods

Pioneer: Derek de Solla Price

1963: Little Science, Big Science

”We can say that 80 to 90 percent of all the

scientists that have ever lived are alive now”

www.gu.se

www.gu.se

Power-law

www.gu.se

Lotka’s Law

Antal författare med ett visst antal publikationer

0

2000

4000

6000

8000

10000

12000

14000

16000

0 20 40 60 80 100

Antal publikationer

An

tal

förf

atta

re

Serie1

www.gu.se

www.gu.se

Rosvall M, CT, Maps of Information Flow Reveal Community Structure In Complex Networks

www.gu.se

Why Publish?

www.gu.se

Research evaluation indicators

• Production (number of publications, number of collaborators, …)• Demand, Impact, Quality (number of citations, number of publications

in quality channels, …)• Excellence (compared to the field, ratio top5% cited publications)• Collaboration (network properties estimated by co-authorships)• Internationalization (number of publications in international

journals, number of international collaborators)• Interdisciplinarity (number of publications in channels in other

fields or with co-authors from other fields) • …

Changes over time or in comparison with the field or specific others

www.gu.se

Producation-Based Indicators

• Straight-forward and fast• Time, organisational and document-type limitations• Fractionalisation

www.gu.se

1985 1990 1995 2000 20050

500

1000

1500

2000

Ant

al p

ublik

atio

ner

Karolinska inst.

Chalmers

Göteborgs univ.

Linköpings univ.

Luleå tekn. univ.

Lunds univ.

Kungl. tekn. högsk.Stockholms univ.

SLUUmeå univ.

Uppsala univ.

Övriga

Publications (fractionalized, source: Web of Science/VR)

www.gu.se

0,0

200,0

400,0

600,0

800,0

1000,0

1200,0

Busin

ess,

Econo

mics

and

Law

Facult

y of

Arts

IT F

acult

y

Fine A

pplie

d an

d Per

form

ing A

rts

Facult

y of

Science

Sahlgr

ensk

a Aca

demy

Facult

y of

Social S

cience

s

Facult

y of

Educa

tion

2004

2005

2006

2007

2008

2009

Fractionalized publications Gothenburg University (research articles, chapters, books) GUP Februray 2010

www.gu.se

How do we publish?

www.gu.se

Citation-based indicators

• Paying homage to pioneers.• Giving credit for related work (homage to peers).• Identifying methodology, equipment, etc.• Providing background reading.• Correcting one's own work.• Correcting the work of others.• Criticizing previous work.• Substantiating claims.• Alerting to forthcoming work.• Providing leads to poorly disseminated, poorly indexed, or uncited work.• Identifying original publications in which an idea or concept was discussed.• Identifying original publications or other work describing an eponymic concept

or term.• Disclaiming work or ideas of others (negative claims).• Disputing priority claims of others (negative homage).

Why cite?

www.gu.se

Average citation per publication type and year (Source: Web of Science/VR/2008)

www.gu.se

Citation rate of different fields (source: VR)

www.gu.se

Citation window

0 5 10 15 20 250

5

10

15

20

Ant

al c

iterin

gar

(% a

v su

mm

a)

År efter publicering

EngineeringEnvironmental studiesPsychology, biologicalSociology

www.gu.se

Field normalized citation (”crown indicator”)

CPP (cites per publication) _____________

FCS (Field Citation Score)

world average for a specific field,

year and article type

’

www.gu.se

Endocrinology Letter 2003

CPP (cites per publication) 10_____________ ________

FCS (Field Citation Score) 10

world average for a specific field,

year and article type

CPP/FCS 1

Field normalized citation (”crown indicator”)

www.gu.se

Endocrinology Letter 2003 Oncology Review 2004

CPP (cites per publication) 10 20_____________ ________ ________

FCS (Field Citation Score) 10 40

world average for a specific field,

year and article type

CPP/FCS 1 0,5

Field normalized citation (”crown indicator”)

www.gu.se

Field normalized citation score, 1986-2006

Source: Swedish production of highly cited scientific publikactions (VR, 2010)

www.gu.se

Allocation Systems for University Funding

www.gu.se

• Publications in the database Web of Science (WoS) are aggregated for each university

• Number of publications and number of citations to the publications are normalized and multiplied together to form the publication indicator

”The Swedish Model”

www.gu.se

Coverage GUP in WoS, Scopus and Scholar

www.gu.se

”The Norweigan Model”

Publications (books, articles, book chapters) are registered in a national database by the researcher

A quality indicator is added where extra credit is given to publications in certain publication channels (i.e. journal or publisher determines the extra credit)

Publication type Level 1 Level 2

Article 1 3

Book chapter 0,7 1

Book 5 8

www.gu.se

Local Developments

• The university has decided to allocate part of its funding to the faculties based on publications in GUP and external funds.

• Faculties have made similar decisions:- Humanities- Social sciences- Medicine- Science- Business school

• New inquiry may give new system

www.gu.se

What can we learn?

• What have you learned from this session that you would bring back and tell a colleague?

• How would you think strategically about your own publications?

• Journal choice (target audience, indexing, Web of Science)• Visibility (access, promotion, personal webpage)

www.gu.se

www.gu.se

Håkan Carlsson or Karin Henningbibliometri@ub.gu.se

www.ub.gu.se/bibliometri