more than citations and impact factor:...

51
#alctsce More Than Citations and Impact Factor: Altmetric.com November 12, 2014 Terri E. Moffitt - Alyson Williams - Sara Rouhi - Duke University Inter-American Development Bank Altmetric.com

Upload: others

Post on 21-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

#alctsce

More Than Citations and Impact Factor: Altmetric.com

November 12, 2014

Terri E. Moffitt -

Alyson Williams -

Sara Rouhi -

Duke University

Inter-American Development Bank

Altmetric.com

Page 2: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Our Presenters …

Sara Rouhi

Altmetric.com

Terrie Moffitt

Duke University

Alyson Williams

Inter-American

Development Bank

Page 3: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

ALCTS Webinar Logistics

• All attendees are muted.

• To comment on today’s presentation, you may wish to use Twitter: #alctsce

• If you have questions for our presenter(s), please type them into the question box on your screen.

• This webinar is being recorded and all will receive an email with links to the recording, the presentation slides, and an evaluation.

Page 4: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Today we’ll cover

• Overview of Altmetric– Sara Rouhi , Product Specialist, Altmetric

• Case study: Principal Investigator/Lab– Dr. Terrie Moffitt, Professor of Psychology, Duke University

• Case study: Special Library/Bank– Alyson Williams, Knowledge and Learning Specialist at Inter-

American Development Bank

Hosted by ALCTS, the Association for Library

Collections & Technical Services

Page 5: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Researchers talk: Let’s listen.

An introduction to #altmetrics and Altmetric.com

– Sara Rouhi– November 12, 2014– [email protected]

– @RouhiRoo

Hosted by ALCTS, the Association for Library

Collections & Technical Services

Page 6: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

35Konline mentions of scholarly articles every day.

1 mention every 2.5 seconds!

137K unique articles are shared each week.

>2M articles with tracked attention data.

The conversation is moving online...

Source: Altmetric internal data, June 2014

Page 7: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Traditional metrics lag behind…

Page 8: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Funders are noticing…

Grant funders looking for proof of “broader impacts” often defined as “an effect, change, or benefit to the economy, society, culture, public policies, health, the environment, etc.”

Research Excellence Framework, http://www.ref.ac.uk/panels/assessmentcriteriaandleveldefinitions/

Broaden dissemination to enhance scientific and technological understanding, for example, by presenting results of research and education projects in formats useful to students, scientists and engineers, members of Congress, teachers, and the general public.

http://www.nsf.gov/pubs/2007/nsf07046/nsf07046.jsp

Page 9: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Our definition…

Not a replacement but a complement

Policy documents, blogs, mainstream news, social media

#altmetrics can help provide a broader view

An alternative,

more immediate measure of

impact

An alternative,

more immediate measure of

impact

From non-traditional sources

From non-traditional sources

To provide a larger context

To provide a larger context

Page 10: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Altmetric is a data science company that tracks attention to research outputs, delivering article level metrics via visually engaging, intuitive interfaces.

In other words, we help give credit where credit is due .

Who are we?

Page 11: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Science of data: high quality, highly relevance sources

News outlets

Social media

and blogs

Reference managers

Other sources

Post-pub peer

review

Page 12: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Other sources: policy documents• ASHA Practice Policy • AWMF - Association of Scientific Medical Societies • European Food Safety Authority (EFSA) • Food and Agriculture Organization • GOV.UK - Policy papers, Research & Analysis• Intergovernmental Panel on Climate Change (IPCC)• International Committee of the Red Cross (ICRC)• International Monetary Fund • (IMF) – (Tracking working papers)• Medicins sans Frontieres (MSF) • Mental Health Foundation (UK)• NICE Evidence • UNESCO • World Health Organization (WHO)And more being added each week…

Page 13: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Intuitive interfaces: details, donut, score

Page 14: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Wait, what’s that donut?

Page 15: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!
Page 16: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Demographics Tab

Demographic data is about providing CONTEXT.

Who is reading your work?

Where are they?

What stage of their career are they in?

Page 17: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

The score: Benchmarking

Page 18: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Telling a story: What can the data tell you?

What type of attention is this research receiving?

Where has this article received the most traction?

Which countries are engaging most with the content?

Has this article influenced policy, spurred new research, or engaged a new audience?

Are reactions to this article positive or negative?

Page 19: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

What the data doesn’t tell you

The quality of the paper

The quality of the researchers

The whole story

Context matters!

Page 20: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

• Research institutes

• Government agencies

• Top research universities

• Corporations

• Think tanks

Who uses Altmetric data? Institutions

Page 21: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

• Institutional repository badge embeds

• Badge integration with discovery systems

• Altmetric for Institutions

How have Institutions used the data

Page 22: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Introducing Altmetric for Institutions

Page 23: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Thank you!

• altmetric.com• @altmetric

Page 24: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

• Principal Investigator Case Study: Demonstrating “broader impacts”

• Terrie Moffitt, PhD• Nannerl O. Keohane Professor• Professor, Duke Psychology and Neuroscience

Psychiatry & Behavioral Sciences• Duke University

• Professor of Psychiatry• Kings College London

• 12 November 2014

Hosted by ALCTS, the Association forLibrary Collections & Technical Services

Page 25: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

“Try the bookmarklet, it’s ultra cool”

Page 26: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!
Page 27: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Article by article wasn’t enough

Page 28: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Article by article wasn’t enough

Page 29: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Article by article wasn’t enough

Page 30: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Making the case for demonstrating broader impact

How well does the activity advance discovery and understanding while promoting teaching, training, and learning? How well does the proposed activity broaden the participation of underrepresented groups (e.g., gender, ethnicity, disability, geographic, etc.)? To what extent will it enhance the infrastructure for research and education, such as facilities, instrumentation, networks, and partnerships? Will the results be disseminated broadly to enhance scientific and technological understanding? What may be the benefits of the proposed activity to society? “

http://www.nsf.gov/pubs/2007/nsf07046/nsf07046.jsp NSF Broader Impacts Criterion

Page 31: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Here’s what the Altmetric for Institutions showed me about my own data

Page 32: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Policy documents? Who knew?

Page 33: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

38

12

3 2

6

2 2

25

12

3 2

6

2 2

0

5

10

15

20

25

30

35

40

Ar cle 1 Ar cle 2 Ar cle 3 Ar cle 4 Ar cle 5 Ar cle 6 Ar cle 7 Ar cle 8 Ar cle 9 Ar cle 10

Total No. of stories

Total No. of outlets

No. Interna onal outlets

38

12

3 2

6

2 2

25

12

3 2

6

2 2

0

5

10

15

20

25

30

35

40

Ar cle 1 Ar cle 2 Ar cle 3 Ar cle 4 Ar cle 5 Ar cle 6 Ar cle 7 Ar cle 8 Ar cle 9 Ar cle 10

Total No. of stories

Total No. of outlets

No. Interna onal outlets

Demonstrating “broader impact” with International News coverage = 60%

Data from Article Details Pages

Page 34: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Demonstrating “broader impact” with International Blog coverage = 40%

Data from Article Details Pages

Page 35: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

New communities, new conversations

From Article Details Pages

Page 36: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Many many more eyeballs – my T10

3,941,227

634,343

190,593 187,480263,719

70,617 137,926 115,455 84,1585,121

0

500,000

1,000,000

1,500,000

2,000,000

2,500,000

3,000,000

3,500,000

4,000,000

4,500,000

Article 1 Article 2 Article 3 Article 4 Article 5 Article 6 Article 7 Article 8 Article 9 Article 10

Twitter reach by article - Total upward bound: 5,630,639

Data from Article Details Pages

Even if 1% click on the article, that’s 56,000 eyes that never would have seen it before Twitter.

Page 37: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Bottom line? #altmetrics make me look better

From NIH Program Manager“[This altmetric data is] fantastic information for [our] budget report.”

I save a tremendous amount time for my lab and me having to demonstrate “evidence of impact” to various funders via “researchfish.”

Page 38: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

And we’re always learning

• No idea that our methods papers were getting so much attention– Too boring for news– Long time to get citations– But young researchers care and are tweeting

extensively!• Altmetrics can help me teach undergraduates

– Students will be asked to find top papers (in terms of attention) in different areas

– See first hand the impact of the internet and online media in disseminating important, life changing research

Page 39: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Thank you!

• Terrie Moffitt, PhD

• Nannerl O. Keohane Professor• Professor, Duke Psychology and

Neuroscience Psychiatry & Behavioral Sciences

• Duke University

• Professor of Psychiatry• Kings College London

Page 40: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Hosted by ALCTS, the Association for Library

Collections & Technical Services

Page 41: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

http://www.iadb.org

The Inter-American Development Bank Discussion Papers and Presentations are documents prepared by both Bank and non-Bank personnel as

supporting materials for events and are often produced on an expedited publication schedule without formal editing or review. The information and

opinions presented in these publications are entirely those of the author(s), and no endorsement by the Inter-American Development Bank, its Board of

Executive Directors, or the countries they represent is expressed or implied.

This presentation may be reproduced with prior written consent of the author.

Page 42: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

IDB Background• Leading lender to Latin America

& the Caribbean

• Focus on development in the

region

• 48 member countries

– 26 borrowing members

Page 43: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Felipe Herrera Library & the Institutional Repository

• Bank Repository of

Institutional Knowledge

• Manage Publications Process

Page 44: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

IDB & Altmetric: the beginning

Page 45: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

IDB & Altmetric: the story so far

Page 46: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

IDB & Altmetric: the story so far

Page 47: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

IDB & Altmetric: the story so far

Page 48: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

IDB & Altmetric: the present & the future

• Presentations to department

• Up to 300 publications

• Exploring New Sources

• Interest from specialists just beginning

Page 49: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

QUESTIONS? ¿PREGUNTAS?

Alyson Williams

[email protected]

@alysonkwilliams

Page 50: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Upcoming ALCTS CE Opportunitieshttp://www.ala.org/alcts/confevents

November 19 Authority Records and Copyright Determination

December 3 Can I Copyright My Data?

December 10 Use of Social Media in the Library

December 17 How to Host a Preservation Week Event

Coming Spring 2015: Series on Continuing Resources, Transforming MARC Using XSLT,

LibGuides in TS, Time Management, etc.

Webinars

Page 51: More Than Citations and Impact Factor: Altmetricdownloads.alcts.ala.org/ce/...citations_impact_factor_Altmetric_slide… · – But young researchers care and are tweeting extensively!

Upcoming ALCTS CE Opportunitieshttp://www.ala.org/alcts/confevents

Web Courses

Scheduled throughout the year

• Acquisitions

• Cataloging

• Collection Assessment

• Collection Development and

Management

• Electronic Resource Acquisitions

e-Forums

• Being scheduled

Submit a proposal:

https://alctsprogram.wufoo.com/forms/p7x3x5/