qs 5 group c melinda kenneway

Reputation MattersTowards an author economy

Melinda KennewayDirector Director and co-founderTBI Communications KudosMelinda.Kenneway@tbicommunications.com melinda@growkudos.com

Topics

1. Once upon a time …

2. What is reputation?

3. How is it measured?- publications and other digital assets

- researchers

- institutions

4. What this means

5. 3 predictions

Once upon a time …

Every day, a miracle …

Distance selling …

Wake up call: NAR goes OA

Seeing the bigger picture

Libraries

Publishers

Universities

Government

ResearchersFunders

Intermediaries

Learned societies

Why submit? Two views…

what is reputation?

A definition

reputationrɛpjʊˈteɪʃ(ə)n/

noun: reputation; plural noun: reputations

1. the beliefs or opinions that are generally held about someone or something.

Publication performance

Institutional performance

Researcher performance

Publication performance

Institutional performance

Researcher performance

Publication performance

• Rise of article level metrics

article-level-metrics.plos.org

Publication performance

• Rise of article level metrics• Introduction of altmetrics

www.altmetric.com

www.impactstory.org

Publication performance

• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images/blogs

www.datadryad.org

www.figshare.com

Publication performance

• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images/blogs• Pre-publication evaluation

www.rubruq.com

www.peerageofscience.org

Publication performance

• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images/blogs• Pre-publication evaluation• Tools for institutional assessment

www.plumanalytics.com

Publication performance

• Rise of article level metrics• Introduction of altmetrics• New units of publishing: data/images• Tools for institutional assessment • Anti-impact factor: DORA

am.ascb.org/dora

Publication performance

Institutional performance

Researcher performance

Researcher performance

• Publication output• Publication impact• Funding• Other income (e.g. patents)• Affiliations (institutional reputation)• ‘Esteem factors’

• Membership of societies/ed boards etc• Conference activity• Awards and prizes

www.google.com/scholar

www.klout.com

www.researchgate.com

www.peerindex.com

The problem with single score systems…

www.researchcorecard.com

Publication performance

Institutional performance

Researcher performance

Institutional performance

UK Research Excellence Framework

Outputs 65%: “originality, significance and rigor”

Impact sub-profile 20%: “unit’s reach and significance”

Environment sub-profile 15%: “research environment vitality and sustainability”

Research assessment

“13 carefully calibrated performance indicators”

“subjective judgment of senior, published academics”

http://www.snowballmetrics.com

https://becker.wustl.edu/impact-assessment/model

www.researchfish.com

convergence

what this means

Metrics are here to stay

Metrics are here to stay“If you measure something

people change their behaviour.”

3 predictions

1. Emergence of scoring and reward systems for all kinds of academic activity

www.publons.com

2. Complex algorithms for assessment of publication

and author impact“what happened next”

www.frontiersin.org

3. Emergence of systems and tools to influence performance metrics

www.growkudos.com

Thank you

Melinda KennewayDirector Director and co-founderTBI Communications KudosMelinda.Kenneway@tbicommunications.com melinda@growkudos.com