how unsw leverages scival to enable research excellence and align strategic ... · 2018. 10. 4. ·...
TRANSCRIPT
How UNSW leverages SciVal to enable research excellence and align strategic initiatives with the university’s goals03 October 2018
Thomas ChowDirector – Research Analysis, Data and Reporting
© University of New South Wales 2018. All rights reserved. No part of this presentation may be reproduced for any purpose without the prior written consent of UNSW. Information provided for research purposes only and is not professional advice. Contact: [email protected].
Agenda
1. Why metrics?2. How is SciVal utilised?3. Building a metricated culture at UNSW
2
FAST FACTS
8 Faculties
Art & DesignArts & Social Sciences
Built EnvironmentBusiness School
EngineeringLaw
MedicineScience
59,781 Total Students
20,204 International Students
35,679 Undergraduate Students
18,226 Postgraduate Students
300,000 Alumni as of July 2018
47Schools
125Centres and
Institutes
18Colleges and student
accommodation
$215minvested in campus infrastructure across
123 projects
4,200wireless stations on campus and tripling of network speed
1 University College
UNSW Canberra at the Australian Defence
Force Academy
UNSW 2025 Strategy
UNSW aspires to be Australia’s global university, improving and transforming lives through excellence in research,
outstanding education and a commitment to advancing a just society.
Research Quality
“UNSW will be among the leading research-intensive universities
worldwide, known for innovative, pioneering research that has a global
impact.”
4
UNSW performance in rankings
5
QS
THE
ARWU
UNSW Ranking – Average
6
Average
2025 Target
Why metrics?
Measurement improves performance
7
? ? ? ? ? ?
Metrics are not the only answer
8
San Francisco Declaration on Research Assessment
https://responsiblemetrics.org/the-metric-tide/ https://sfdora.org/
https://www.nature.com/news/bibliometrics-the-leiden-manifesto-for-research-metrics-1.17351
“Basket of Metrics”
All Outputs Articles and Reviews h-index m-index
FWCI Top 1/5/10% cited
International Collaboration CNCI
Citations per publication
Nature and Science articles
Highly Cited Papers Citation Count
Publications in top percentiles
by SNIP
Publications in top percentiles
by SJR
Publications in top percentiles by CiteScore
Publications in top percentiles
by JIF
“Basket of (SciVal) Metrics”
All Outputs Articles and Reviews h-index m-index
FWCI Top 1/5/10% cited
International Collaboration CNCI
Citations per publication
Nature and Science articles
Highly Cited Papers Citation Count
Publications in top percentiles
by SNIP
Publications in top percentiles
by SJR
Publications in top percentiles by CiteScore
Publications in top percentiles
by JIF
Approach
Individual Performance
Management Reporting
SciV
alM
etric
s
Oth
er c
itatio
n pr
ovid
ers
Management Reporting
• Unbiased view of performance compared to peers
• Size-adjusted indicators
• Subject classifications (ASJC, FoR, QS, THE)
• Granularity and Reproducibility
• Low maintenance & regular updates
aka “top-down” approach
SciVal Overview of UNSW – Overall
SciVal Overview of UNSW – Research Topics
UNSW Topics of Prominence - All
UNSW Topics of Prominence – Top 10%
UNSW Topics of Prominence – Top 1%
SciVal Overview of UNSW – Performance indicators
SciVal Benchmarking – Outputs vs Year
SciVal Benchmarking – Outputs vs FWCI
SciVal Benchmarking – Outputs in top 10% SJR Journals
Quality + Quantity (2013 – 2017)
QUALITY
QUA
NTI
TY
UNSW
SciVal as at 18 September 2018Scholarly Outputs (All Publications)FWCI (self-citations included, All Publications)2013 – 2017 Publications
Quality outputs + journals (2013 – 2017)
UNSW SciVal as at 18 September 2018Outputs in Top 10% by citations (self-citations incl., All Pubs)Publications in Top 10% Journals by SJR2013 – 2017 Publications
Individual Performance
• Gateway to the world of metrics
• Data availability
• Aligning individuals to university goals
• Dispelling the fog of metrics
aka “bottom-up” approach
BORIS“UNSW’s Research Performance Metrics Tool”
BORIS
BORIS
Outputs
Income
Students
Metrics
Staff
Groups
BORIS
BORIS
Outputs
Income
Students
Metrics
Staff
Groups
ActivityBORIS launched to UNSW academic community!
Finding out for themselves
Embedding SciVal
• Meaningful metrics
• Regular exposure
• Consistency and transparency
aka “stickiness”
Common metrics
SciVal BORIS
“Basket of (SciVal) Metrics”
All Outputs Articles and Reviews h-index m-index
FWCI Top 1/5/10% cited
International Collaboration CNCI
Citations per publication
Nature and Science articles
Highly Cited Papers Citation Count
Publications in top percentiles
by SNIP
Publications in top percentiles
by SJR
Publications in top percentiles by CiteScore
Publications in top percentiles
by JIF
Extracting data from SciVal
SciVal to BORIS – Manual
Refresh BORIS
Tag New Researchers
Download metrics
Maintain “My SciVal” list
Refresh Process
Extract / Transform /
Load
Quality Assurance
SciVal to BORIS – API
How does it fit together?
Creating a metricated culture at UNSW
Soft introduction
Easy to access
… and consume
Common language
Transparent
Saves academic’s time
Limitations
• Limited coverage of Humanities, Arts, and Social Sciences.
• Local vs international research
• Metrics are not the only answer
• Engagement and Impact
• Research Opportunity and Performance Evidence (ROPE)
Break 中場休息