journal quality improvement & benchmarkingmycc.my/document/files/dju-lyn chng - journal...
TRANSCRIPT
![Page 1: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/1.jpg)
Journal Quality
Improvement &
BenchmarkingPractical Tools and Tips
Dju-Lyn Chng
Solution Consultant, ASEAN
![Page 2: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/2.jpg)
2
Web of Science Content Curation Criteria
Citation Analysis
International Diversity
Editorial Content
Journal Publishing Standard
SCIESSCI AHCI
ESCI
Publishing Quality Publishing Impact
WOS CORE
![Page 3: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/3.jpg)
3
Publishing Quality
Improved
Publishing Quality
Identify Emerging
Trends
Attracting highly cited
authors
Improve peer review standards
![Page 4: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/4.jpg)
Identifying Emerging
Trends Using
Web of Science
![Page 5: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/5.jpg)
5
Data in Web of Science is used to determine….
• Highly Cited Paper
– A paper published in the past 10 years that belongs to the
top 1% of papers in a research field published in a
specified year.
• Hot paper
– A paper published in the past 2 years that received a
number of citations in the most recent two-month period
that places it in the top 0.1% of papers in the same field.
![Page 6: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/6.jpg)
6
Identify Emerging Trends in your Field
DEMO
![Page 7: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/7.jpg)
Analysing your journal’s
Author Diversity
![Page 8: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/8.jpg)
8
Improving Author Diversity
• Is your Journal National/ Regionally/ Internationally focused?
• Analyze your author diversity based on your scope
![Page 9: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/9.jpg)
9
What is the author diversity make-up of your journal?
International
focus
44 Countries/territories
DEMO
![Page 10: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/10.jpg)
Attracting High Quality
Authors, Reviewers and
Editorial Members
![Page 11: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/11.jpg)
11
Using WOS to find potential authors
DEMO
![Page 12: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/12.jpg)
![Page 13: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/13.jpg)
13
Publons provides free profiles for researchers and lets them effortlessly
track, verify and showcase their peer review and editorial contributions
across the world's journals.
● Cross-publisher
recognition for
peer review
● Verified record of
review and
editorial work
● Reviewer
anonymity
maintained
according to
journal policy
Recognise your Reviewers
Public reviewer profile
![Page 14: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/14.jpg)
14
Researchers will be more likely to review for, and submit to, your
journals
"Publons has definitely made the reviewing
process more rewarding and enjoyable!”
- Sadaf Atarod, Postdoctoral Associate -
Center for Regenerative Medicine, Boston
University
“I’m more likely to submit papers to and more
likely to review papers for [partnered journal]. ”
- Rob W. Briddon
"It was a little easier spending [the morning] on
manuscript review knowing, even if comments are
ignored - I still get some credit...I also believe I am
much more constructive and spend more time
explaining issues and offering solutions. Thanks
Publons.”
- Steven B. Roberts, University of Washington
Editorial Board - Scientific Data
""Yes, I am more likely to carry out a review now.
I feel that Publons does deliver on helping me
get credit for peer review.”
- Alex Bateman, Head of Protein Sequence
Resources - EMBL European
Bioinformatics Institute - Present
48% Just as likely
as before
20% Far more
likely
30% More
likely
![Page 15: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/15.jpg)
15
Create your own Journal’s Dashboard on Publons – Free!
![Page 16: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/16.jpg)
16
Use a Robust Reviewer Search Tool
![Page 17: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/17.jpg)
17
![Page 18: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/18.jpg)
18
![Page 19: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/19.jpg)
19
![Page 20: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/20.jpg)
Conduct a Citation
Health Check
The Difference Between Good and Great
![Page 21: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/21.jpg)
21
o Journal self-citations?
o Author/EB self-citations?
o Is the journal Cited?
o Is authors' prior work cited?
o Is Editorial Board members' prior work cited?
o Rank in category (by JIF/Quartile)
Conduct a Citation Health Check
DEMO
![Page 22: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/22.jpg)
22
Citation Analysis – How to calculate your journal’s impact factor?
2015 2016 2017
IF2017 =Citations in 2017 to items published in 2015 + 2016
Number of citable items in 2015 + 2016
![Page 23: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/23.jpg)
23
o 2017 Citations for 2015 + 2016
content = 76
o Total 2015 + 2016 Citable Items =
173
o 2017 Impact Factor = 76/173 =
0.439
Example: Estimated JIF for “Australasian Medical Journal”
DEMO
![Page 24: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/24.jpg)
24
Now It’s your turn to calculate your journal’s Impact Factor for 2017
2015 2016 2017
IF2017 =Citations in 2017 to items published in 2015 + 2016
Number of citable items in 2015 + 2016
![Page 25: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/25.jpg)
Journals Benchmarking
using InCites
![Page 26: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/26.jpg)
26
What data is available in InCites™ Benchmarking & Analytics
InCites™
Benchmarking &
Analytics is built upon
a comprehensive set
of data from the Web
of Science™
![Page 27: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/27.jpg)
27
Full cover-to-cover
indexing with every
author and their
affiliations captured
The default InCites
dataset spans 1980 to
the present day
(updated every two
months)
![Page 28: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/28.jpg)
28
Article and
journal-level
indicators
include
![Page 29: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/29.jpg)
And offer a wide range of possible
analyses such as
With InCites™ Benchmarking & Analytics
Understand the impact of authors and their papers
Analyse competitors and peers, find strengths and weaknesses
Contextualise performance with normalization and benchmarking
Compare publications, articles, institutions, funders, on a wide range of criteria
Demonstrate the effectiveness of a publishing strategy
![Page 30: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/30.jpg)
30
The focus today…
o Where is my journal’s relative position in the subject category?
o What is my journal’s estimated quartile?
![Page 31: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/31.jpg)
31
Before we dive deep… Normalizing & Benchmarking 101
25
0
100
0
GOOD
BAD
Is Good or Bad?
Context is Everything
Indicators must be put in context to be useful:
Category, Journal, Peers, Global
Normalized Indicators: for relative performance comparisons
Percentiles: where does it fall in the range of values?
Benchmarks: how does it compare in a group or globally?
![Page 32: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/32.jpg)
32
Journal ranking is subject dependent
min
max
25%
25%
25%
25%median
Q1
Q2
Q3
Q4
Imp
act
Fa
cto
r
![Page 33: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/33.jpg)
33
Let’s get started…
o Sample journal: “AUSTRALASIAN MEDICAL JOURNAL”
o Self Calculated 2017 Journal Impact Factor: 0.439
![Page 34: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/34.jpg)
34
Where is my journal’s relative position in the subject category?
• Search for your journal in InCites and identify the subject category it is indexed in
• Search for all journals in your subject category
• Sort by Journal Impact Factor
DEMO
![Page 35: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/35.jpg)
35
Further understand your journal
• Find out who are your contributing authors
• Where else are they publishing in? (Thus identifying competing journals)
• Which of papers are contributing to your journal’s citation counts?
![Page 36: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/36.jpg)
36
Who are the highly cited authors contributing to my journal?
![Page 37: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/37.jpg)
37
Where are your authors publishing? And identify competing
journals?
• Search for your author name in Web of Science
• Analyze his/her output to see what journals they are publishing in
![Page 38: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/38.jpg)
38
Conduct Article-Level Analytics
• Which articles are cited more?
• Gives insight into what content appeals to your readers
![Page 39: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/39.jpg)
39
In Summary
• Make use of tools like the Web of Science to gain insights and identify
areas of improvement for your journal
• Attract good peer reviewers and authors by recognizing their peer review
work using Publons
• Adjust your publishing strategies after using benchmarking tools like
InCites to gauge your journal’s standing within category
![Page 40: Journal Quality Improvement & Benchmarkingmycc.my/document/files/Dju-Lyn Chng - Journal Quality...Journal Quality Improvement & Benchmarking Practical Tools and Tips Dju-Lyn Chng Solution](https://reader034.vdocuments.site/reader034/viewer/2022050308/5f705aad147bc57aee7cc22c/html5/thumbnails/40.jpg)