academic publishing is evolving… article level metrics looking backwards / looking forwards pete...

Academic Publishing is Evolving…

Article Level MetricsLooking Backwards / Looking

Forwards

Pete Binfield Co-Founder and Publisher PeerJ

The PLOS ALM Workshop

10/10/2013

@ThePeerJhttps://peerj.com

@[email protected]


Q2 13

Q1 13

Q4 12

Q3 12

Q2 12

Q1 12

Q4 11

Q3 11

Q2 11

Q1 11

Q4 10

Q3 10

Q2 10

Q1 10

Q4 09

Q3 09

Q2 09

Q1 09

Q4 08

Q3 08

Q2 08

Q1 08

Q4 07

Q3 07

Q2 07

Q1 07

Q4 06

0

1000

2000

3000

4000

5000

6000

7000

8000

Year Pubs Notes2007

1,200 Larger than ~ 95% of all journals

2008

2,800 Largest OA journal in world

2009

4,400 3rd largest journal in world

2010

6,750 Largest journal in world

2011

13,800 ~1.4% of PubMed output in that year

2012

23,500 ~2.4% of PubMed output in that year

2013

~31,000

>3% of the literature

PLOS ONE Quarterly Published Output

http://figshare.com/articles/Scale_of_OA_Publishing/650794

Stacked area graph of the contribution ofmajor ‘APC’ OA publishers (articles per year)

http://figshare.com/articles/Scale_of_OA_Publishing/650794

Academic Publishing is Evolving…Screenshot from ~ Nov 2009 but Way Back Machine has examples from April 2008

PLOS Didn’t Invent Article Level Metrics


Launched in May 2007 http://journalofvision.org/7/7/i/http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2

Academic Publishing is Evolving…June 2007


~ May 2009 (NISO presentation)http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2


So How Did We Get Here:


Bill Hooker, Sep 30th 2008. In Comments on http://thewobblingmind.wordpress.com/2008/08/31/feasibility-of-plos-ones-peer-review-model/

http://thewobblingmind.wordpress.com/2008/08/31/feasibility-of-plos-ones-peer-review-model/




Internal to PLOS Mid-2008(thanks to J Lin for providing)


• A test ALM Email was sent to Authors, in ~ August 2008• at which point PLOS ONE had published ~3,100 articles

• The mailing was merged to all corresponding authors whose articles exceeded certain thresholds for having ALMs to report on

• We provided info which was scraped / obtained from• Google Scholar• Google Analytics• PLOS Commenting functionality• CiteULike• Google News

• Response was 100% positive – giving us reassurance about messaging

Testing the Concept

August 2008


Presentation at Raleigh, November 2008


http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/Mar 31st 2009. It wasn’t called ALMs in this ‘official’ post…

http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/

http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/


http://www.myplick.com/user/PLoS

http://blogs.plos.org/everyone/2009/03/31/newly-launched-features-on-our-online-platform/1st use of the phrase by us?

http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/ Possible first public use of the phrase ‘article level metrics’ by PLOS



http://blogs.plos.org/everyone/2009/03/31/newly-launched-features-on-our-online-platform/



http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/

http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/


http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2?from_search=27

May 2009 to NISO






http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/and http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/ by Rich CaveSept 16th 2009. Note: it was now called ALMs…

http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/

http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/

http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/

http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/


Any Effects?


Michael Habib, Elsevier, Oct 2009


“This paper is featured in a commentary in the Journal of XXX and has been evaluated as “must read” by XXX for the Faculty of 1000 Biology.”

“Top downloaded paper in XXX in 2011”

“PLoS ONE metrics show that this article had 6,358 online views and 1,318 downloads within 3 months of publication. These compare with annual average life-time views of papers ranging from 400 to 2,800 in all PLoS journals, and 600 in PLoS ONE. In early December 2011, its usage was 10,400 versus an average of 900/paper for the journal. It is the 3rd most highly cited paper amongst the XXX papers in the journal.“

Quotes from 3 Resumes (in the Last Few Days)

Note: No one ever mentions tweets, likes, bookmarks etc…


http://www.nature.com/naturejobs/science/articles/10.1038/nj7463-491a


http://scholarlykitchen.sspnet.org/2013/09/03/what-does-a-scientist-want/#comment-109084


Looking Forwards


Have they fulfilled their original aims?


Is Anyone Using them Fully?


To What Extent AreWe Talking To Ourselves?


Is this the best usage display we can do?

c.f. Frontiers in 2008…


Why has no publisher equaled / surpassed this?


Access to the Data?



Science Online Jan 2010

What Is STILL Missing?


Thank You

Pete BinfieldCo-Founder and Publisher

@[email protected] @ThePeerJ

academic publishing is evolving… article level metrics looking backwards / looking forwards pete...

Documents

plos slide

academic publishing

year slide

plosjournals http

model slide

niso slide

plos mid

plos ones