qs 5 group c melinda kenneway
TRANSCRIPT
Reputation MattersTowards an author economy
Melinda KennewayDirector Director and co-founderTBI Communications [email protected] [email protected]
Topics
1. Once upon a time …
2. What is reputation?
3. How is it measured?- publications and other digital assets
- researchers
- institutions
4. What this means
5. 3 predictions
Once upon a time …
Every day, a miracle …
Distance selling …
Wake up call: NAR goes OA
Seeing the bigger picture
Libraries
Publishers
Universities
Government
ResearchersFunders
Intermediaries
Learned societies
Why submit? Two views…
what is reputation?
A definition
reputationrɛpjʊˈteɪʃ(ə)n/
noun: reputation; plural noun: reputations
1. the beliefs or opinions that are generally held about someone or something.
Publication performance
Institutional performance
Researcher performance
Publication performance
Institutional performance
Researcher performance
Publication performance
• Rise of article level metrics
article-level-metrics.plos.org
Publication performance
• Rise of article level metrics• Introduction of altmetrics
www.altmetric.com
www.impactstory.org
Publication performance
• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images/blogs
www.datadryad.org
www.figshare.com
Publication performance
• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images/blogs• Pre-publication evaluation
www.rubruq.com
www.peerageofscience.org
Publication performance
• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images/blogs• Pre-publication evaluation• Tools for institutional assessment
www.plumanalytics.com
Publication performance
• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images• Tools for institutional assessment • Anti-impact factor: DORA
am.ascb.org/dora
Publication performance
Institutional performance
Researcher performance
Researcher performance
• Publication output• Publication impact• Funding• Other income (e.g. patents)• Affiliations (institutional reputation)• ‘Esteem factors’
• Membership of societies/ed boards etc• Conference activity• Awards and prizes
www.google.com/scholar
www.klout.com
www.researchgate.com
www.peerindex.com
The problem with single score systems…
www.researchcorecard.com
Publication performance
Institutional performance
Researcher performance
Institutional performance
UK Research Excellence Framework
Outputs 65%: “originality, significance and rigor”
Impact sub-profile 20%: “unit’s reach and significance”
Environment sub-profile 15%: “research environment vitality and sustainability”
Research assessment
“13 carefully calibrated performance indicators”
“subjective judgment of senior, published academics”
http://www.snowballmetrics.com
https://becker.wustl.edu/impact-assessment/model
www.researchfish.com
convergence
what this means
Metrics are here to stay
Metrics are here to stay“If you measure something
people change their behaviour.”
3 predictions
1. Emergence of scoring and reward systems for all kinds of academic activity
www.publons.com
2. Complex algorithms for assessment of publication
and author impact“what happened next”
www.frontiersin.org
3. Emergence of systems and tools to influence performance metrics
www.growkudos.com
Thank you
Melinda KennewayDirector Director and co-founderTBI Communications [email protected] [email protected]