how much does $1.7 billion buy?
TRANSCRIPT
![Page 1: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/1.jpg)
How Much Does $1.7 Billion Buy?A Comparison of Scientific Journal Articles to Their Pre-print Versions
![Page 2: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/2.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20152
Research Team
Peter Broadwell @peterbroadwellSharon E. Farb @farbthinkTodd R. Grappone @liber8erMartin Klein @mart1nkle1n
![Page 3: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/3.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20153
• Global STM publishing market $25.2 billion• 55% of STM comes from USA• 40% of STM is for journals ($10 billion)
• 68-75% is coming out of libraries’ budgets
Explosion of data intensive research
Increase in Open Access
USA is the largest contributor in terms of global output of research papers: 23%
Global Trends in Scientific Output
![Page 4: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/4.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20154
UC Publication Impact
![Page 5: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/5.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20155
What is the $ of Knowledge?
Source: ARL Statistics, Association of Research Libraries, Washington, D.C.
Prices Set by Profit Maximizing
Publishers are Determined NOT by costs, but by what the market
will bear.
![Page 6: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/6.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20156
OA by Disciplines
![Page 7: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/7.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20157
Pre-print v. Final Published?
arXiv• The annual
budget for arXiv is circa $826,000 for 2013 - 2017
Final Published• English language
STM journals: $10 billion in 2013
![Page 8: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/8.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20158
Role of Publisher*
• Entrepreneur• Copyediting• Tagging• Marketer• Distributor• E-Host
*STM Report 2015: An Overview of Scientific and Scholarly PublishingMichael Ware and Michael Mabe
![Page 9: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/9.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/20159
Working Assumptions
• If the publishers’ argument is valid, the text of a pre-print paper should vary significantly from its corresponding post-print version
• By applying standard similarity measures, we should be able to detect and quantify such differences.
![Page 10: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/10.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201510
Methodology
![Page 11: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/11.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201511
Data Gathering
Assembling a pre-print corpus
• Source: arXiv.org• 1.1 million publication records • metadata (typical DC, including DOI) obtained
via OAI-PMH interface• PDF versions of articles available via Amazon’s
S3 service (using “requester pays” option)• Latest version used if multiple available
![Page 12: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/12.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201512
Data Gathering
Finding a matching post-print corpus
• Extract DOIs from arXiv metadata• 44.5% or articles have DOI
• CrossRef’s Metadata Search API• Match by DOI: download XML marked up or
PDF full-text version of article• Metadata included in XML• Access based on UCLA’s serial subscriptions
![Page 13: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/13.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201513
Data Processing
Both pre-print and post-print corpora
• Convert PDF to XML where needed
• Extract sections from XML• Title, authors, abstract, body, references, publication
date• Occasionally, sections are missing
• Also try extraction from arXiv’s OAI-PMH interface• Data provided by authors: abstracts, titles• Texts often have markup, complicating comparisons
![Page 14: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/14.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201514
Text Comparison Methods
• Length ratio• Levenshtein ratio• Cosine similarity• Simhash• Jaccard coefficient• Sorensen similarity
![Page 15: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/15.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201515
Text Comparison Methods 1/3
Length ratio:Ratio of the shorter text’s length to the longer text’s length
Example“Four score and seven” “Four score and seven years ago“
Four score and seven (20 characters)Four score and seven years ago (30 characters)
Length ratio: 20/30 = .667
![Page 16: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/16.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201516
Text Comparison Methods 2/3
Levenshtein edit distance:Number of operations (insert, delete, substitute) needed to transform one string into the other
Example“The rose is red” “The roose is rot”
• rose -> roose (1 insertion)• red -> rod (1 substitution, ‘o’ for ‘e’)• rod -> rot (1 substitution, ‘t’ for ‘d’)
Levenshtein distance: 1 + 1 + 1 = 3
![Page 17: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/17.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201517
Text Comparison Methods 2/3
Levenshtein edit distance:Number of operations (insert, delete, substitute) needed to transform one string into the other
Example“The rose is red” “The roose is rot” (edit distance: 3)
Levenshtein ratio:
length of text 1 + length of text 2 – edit distance length of text 1 + length of text 2
15 + 16 – 3 = .903 15 + 16
![Page 18: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/18.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201518
Text Comparison Methods 3/3
Cosine similarity:Two texts have a high similarity (max value: 1) if they share many of the same words in the same proportions.
In practice, common words (“and,” “the,” “is”) are ignored, and words that are more characteristic of a given text have greater importance.
Example“QCD sum rule approach for scalar mesons as four-quark states”“QCD sum rule approach for the light scalar mesons as four-quark states”
![Page 19: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/19.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201519
Text Comparison Methods 3/3
Cosine similarity:Two texts have a high similarity (max value: 1) if they share many of the same words in the same proportions.
In practice, common words (“and,” “the,” “is”) are ignored, and words that are more characteristic of a given text have greater importance.
Exampleqcd sum rule approach for scalar mesons as four quark statesqcd sum rule approach for the light scalar mesons as four quark states
![Page 20: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/20.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201520
Text Comparison Methods 3/3
Cosine similarity:Two texts have a high similarity (max value: 1) if they share many of the same words in the same proportions.
In practice, common words (“and,” “the,” “is”) are ignored, and words that are more characteristic of a given text have greater importance.
Exampleqcd sum rule approach for scalar mesons as four quark statesqcd sum rule approach for the light scalar mesons as four quark states
Cosine similarity: 0.8955
![Page 21: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/21.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201521
Comparison of Sections
![Page 22: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/22.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201522
Comparison of Sections
Title
Abstract
![Page 23: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/23.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201523
Comparison of Sections
Body
![Page 24: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/24.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201524
Comparison of Sections
(Authors) References(future work)
![Page 25: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/25.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201525
Preliminary Findings
![Page 26: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/26.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201526
Data Gathering Results
Both pre-print and post-print corpora
• 11,017 full text articles matched by DOI
• Most papers within date range 2003 – 2015
• 96% of post-prints published by Elsevier
• “Physics Letters B” top journal
![Page 27: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/27.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201527
Number of Papers by Category (arXiv)
![Page 28: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/28.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201528
Title Comparison
Browse findings at http://sologlo.library.ucla.edu/prepost
Pape
rs
Similarity (1 = most similar)
% of all papers
![Page 29: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/29.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201529
Abstract Comparison
Browse findings at http://sologlo.library.ucla.edu/prepost
Pape
rs
Similarity (1 = most similar)
% of all papers
![Page 30: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/30.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201530
Body Comparison
Browse findings at http://sologlo.library.ucla.edu/prepost
Pape
rs
Similarity (1 = most similar)
% of all papers
![Page 31: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/31.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201531
10.1016/j.physletb.2006.10.068Physics Letters B
![Page 32: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/32.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201532
Publication DatesPa
pers
![Page 33: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/33.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201533
Author Similarity (very preliminary)
• Not trivial to determine due to• Different name formatting• Varying metadata quality
“Save” statement: 7,731/9,935 articles (78%) have identical author lists (number and ranks of authors)
![Page 34: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/34.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201534
Next Steps
![Page 35: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/35.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201535
More to Come!• Refine extraction/comparison of authors and
references
• Overlay with ISI Impact factor and usage statistics
• Expand to other disciplines/publishers• Social Sciences• Humanities• Economy• Linguistics
• Operate at scale• Seeking collaboration• Enable other institutions to conduct similar experiments
![Page 36: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/36.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201536
Discussion
![Page 37: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/37.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201537
Questions
• Collecting imperative• New forms of scholarly communication• Developing data collections
• UC faculty is contributing to 1/12 of Elsevier publications, yet we license back 100%
• Open Access• Not even APCs added to the calculations • Revenue: $182 million in 2012, growing
30% per year
• What about preservation?
![Page 38: How much does $1.7 billion buy?](https://reader034.vdocuments.site/reader034/viewer/2022042706/58841c7e1a28ab485c8b48df/html5/thumbnails/38.jpg)
How Much Does $1.7 Billion Buy?@farbthink, @liber8er, @peterbroadwell, @mart1nkle1n
#CNI15F, Washington, DC, 12/15/201538
How Much Does $1.7 Billion Buy?A Comparison of Scientific Journal Articles to Their Pre-print Versions
Sharon E. Farb @farbthinkPeter Broadwell @peterbroadwellMartin Klein @mart1nkle1nTodd R. Grappone @liber8er