overview of citation metrics
DESCRIPTION
An over view of various bibliometric indicators, how they are computed, and where they can be found.TRANSCRIPT
![Page 1: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/1.jpg)
BASIC CITATION METRICS: AN OVERVIEW
![Page 2: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/2.jpg)
WHAT DO BIBLIOMETRICS MEASURE?
Eugene Garfield“Father of Citation
Analysis”
• Scholarly communication: tracing the history and evolution of ideas from one scholar to another
• Measures the scholarly influence of articles, journals, scholars, institutions
Photo: http://www.chemheritage.org/Discover/Collections/Oral-Histories/Details/asset_upload_file66_69008_thumbnail.jpg
![Page 3: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/3.jpg)
SOURCES OF CITATION DATA AT UALBANY
• UAlbany subscription is 1993-present• Pre-1993 data is available in print volumes – Ask A Librarian!• Currently covers over 12,000 journals • Journals undergo quality review process prior to inclusion• Weak in conference proceedings, books, data repositories• Master Journal List of Web of Science
![Page 4: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/4.jpg)
• Many subject specific databases also include cited reference information.
• There will be overlap in coverage of different databases on a cover, take care to identify/remove duplicate citations.
• See Subject Specific Databases on this guide for more information on these resources.
SOURCES OF CITATION DATA
![Page 5: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/5.jpg)
• Journal coverage unknown, sporadic– Whatever the web crawler can “read”
• No quality control process• Better coverage of
– conference proceedings– foreign language articles– Nontraditional publication sources (blogs, reports, white papers)– Theses and dissertations
• Coverage roughly from 1996-present; some older but inconsistent
SOURCES OF CITATION DATA
![Page 6: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/6.jpg)
• Citation data overlaps in all sources, but not completely
• Unique citing references in all databases
• Unique metrics developed using each major database
WHAT’S THE DIFFERENCE?
![Page 7: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/7.jpg)
• Citation Count• Journal Impact
Factor• Eigenfactor• H-index• SNIP• SJR
METRICS
![Page 8: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/8.jpg)
• Number of times cited in scholarly journals indexed in a particular resources
• Citation count metric does not take into account:– Materials not included in
citation database– Sometimes self citations
are eliminated from count
CITATION COUNT
![Page 9: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/9.jpg)
• Found in: Web of Science – Journal Citation Reports
• Essential concept: “how fast are ideas spreading from this journal to other publications?”
• Formula:
JOURNAL IMPACT FACTOR
Number of citations to a journal in a given year from articles occurring in the past 2
years, divided by the number of scholarly
articles published in the journal in the past 2 years
![Page 10: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/10.jpg)
Journal of Hypothetical Examples
JOURNAL IMPACT FACTOR
Citing references appearing in 2010, to articles published in Journal in 2009 and 2008
100200
Total number of articles in Journal published in 2009 and 2008
0.50 JIF
![Page 11: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/11.jpg)
• Cannot be used to compare across disciplines
• Two year time frame not adequate for social sciences, humanities
• Coverage of some disciplines not sufficient in Web of Science
• Is a measure of “impact” a measure of “quality”?
CONCERNS WITH JIF
![Page 12: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/12.jpg)
• Found in: – eigenfactor.org – Web of Science:
Journal Citation Reports
• Essential concept: Takes into account the total amount of “citation traffic” appearing in JCR
• Formula:
EIGENFACTOR
Influence of the citing journal, Divided by the total number of citations appearing in that journal.
![Page 13: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/13.jpg)
• Journal Impact Factor: – All citing references weighted
equally
• Eigenfactor: – SOME CITING REFERENCES ARE
MORE IMPORTANT THAN OTHERS• The citing articles from
journals that are heavily cited themselves demonstrate greater influence
ESSENTIAL DIFFERENCES: JIF & EIGENFACTOR
![Page 14: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/14.jpg)
• Eigenfactor will always be bigger if a journal is larger, i.e., publishes more articles
• Article Influence Score: corrects for journal size– takes the journal’s
Eigenfactor score and further divides it by the number of articles in the journal.
– Correlated to the JIF
CONSIDERTHE FOLLOWING
![Page 15: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/15.jpg)
H-INDEX
http://proj.ncku.edu.tw/research/commentary/e/20080815/images/0808110317430yfDpK.jpg
• Found in:• Many citation analytics
sources • Web of Science• Google Scholar Citations• Etc…
• Essential Concept: Identifies a sustained record of multiple publications that have been cited frequently
• Formula:The maximum number of articles h, such that each has received at least h citations.
Jorge E. Hirsch
![Page 16: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/16.jpg)
1 2 3 4 5 6 70
5
10
15
20
25
30
H-indexScholar AScholar B
Article Number
Num
ber
of
Cit
ati
ons
H-INDEX EXAMPLE
Scholar A Scholar B
10 2710 129 58 47 46 26 2
56 citations 56 citations6 h-index 4 h-index
![Page 17: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/17.jpg)
• Found in: – www.journalmetrics.c
om– Scopus
• Essential concept: Citation Potential: total number of citing references in all journals which have cited this journal
• Formula:
SNIP: SOURCE NORMALIZED IMPACT PER PAPER
The ratio of the journal’s average citation count per paper to the citation potential in its subject field
![Page 18: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/18.jpg)
• Can compare SNIP scores across disciplines
• Aggregate of a journal, so larger journals automatically have higher scores than smaller journals
PROS AND CONS OF SNIP
![Page 19: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/19.jpg)
• Found in: – www.scimagojr.com– Scopus data
• Essential Concept: measures “current average prestige per paper”
• Formula:
SJR: SCIMAGO JOURNAL RANKING
Prestige factors include: # of journals in the Scopus database, # of articles in Scopus from this journal, citation count, eigenvector analysis of important citing references, corrections for self-citations, and normalization by the number of significant works published in the journal.
![Page 20: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/20.jpg)
• Corrects for self citations• Correlated to JIF• Scores can be compared
across disciplines• Web version provides
data on countries• Three year window not
good for social sciences
PROS AND CONS OF SJR
![Page 21: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/21.jpg)
• Journal quality ≠ article quality
• Citing a work ≠ agreement with that work
• Self citations: including them is controversial
• Variance in citation patterns from domain to domain
KEEP IN MIND
![Page 22: Overview of Citation Metrics](https://reader037.vdocuments.site/reader037/viewer/2022110118/554cc4dfb4c905a5208b490d/html5/thumbnails/22.jpg)
• Is a trend analysis of scholarly influence over time needed, or simply a count of total citations?
• Does the database adequately cover the key journals in my subject domain?
• Are there significant works in my domain that are not peer reviewed, scholarly journals (such as conference proceedings, government reports, etc.)
KEEP IN MIND