open access …….(title) access polic… · policy criterion positive correlation significant...

20
PASTEUR4OA Regional Workshop (funders), Brussels, 10 February 2016 Open Access policies: policy effectiveness Alma Swan

Upload: others

Post on 26-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

PASTEUR4OA Regional Workshop (funders), Brussels, 10 February 2016

Open Access policies: policy effectiveness

Alma Swan

Page 2: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

ROARMAP: http://roarmap.eprints.org

Page 3: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Policies: worldwide numbers

Page 4: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Open Access policies worldwide

Europe (468)

North America (157)

Central & South America (40)

Africa (19)Asia (45)

Oceania (40)

Page 5: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Number of OA policymakers worldwide

Research funders (79)

Research institutions (553)

Research funder and institutions

(54)

Multiple research organisations (9)

Sub-units of institutions (74)

Page 6: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Policy effectiveness

ROARMAP rebuild: Sought out existing policies that were not registered in

ROARMAP to ensure comprehensiveness

Developed a new, detailed classification scheme

Classified all policies according to this scheme

Re-launched with 660+ policies fully classified

Effectiveness study: 122 mandatory policies (institutions)

Repository content measured

Regression analysis carried out using policy criteria

Set out to look at deposit

Page 7: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Policy conditions recorded in ROARMAP:

original set of 13

Condition

Must deposit

Cannot waive deposit

Deposit immediately

Must make item OA

Cannot waive making item OA

Link deposit with research assessment / evaluation

Must make item OA immediately

Permitted embargo period specified (STEM)

Permitted embargo period specified (HaSS)

Must retain rights to make item OA

Cannot waive retention of rights

Age of mandatory policy

Requirement for open licensing

Page 8: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Policy conditions: eliminated those with

small numbers > working set of 6 policy

conditions

Condition

Must deposit

Cannot waive deposit

Must make item OA

Cannot waive making item OA

Link deposit with research assessment / evaluation

Cannot waive retention of rights

Page 9: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Regression analysis

Statistical tool

Looks at the relationships between variables in

an experiment

Can measure effect of more than one variable at

a time

Can infer causal relationship (though care

needed!)

Correlation versus significance

In this study we were looking for both

Page 10: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Correlation with deposit action

Policy criterion Positive

correlation

Significant

correlation

Must deposit ✔ ✔

Cannot waive deposit ✔ ✔

Link deposit to research evaluation ✔ ✔

Must make deposit Open Access ✔

Cannot waive making item Open Access ✔

Where policy stipulates authors should retain

relevant rights, this cannot be waived

Page 11: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Significant correlations with deposit rate

Must deposit

Cannot waive deposit

Research evaluation

Must make deposit Open Access

Cannot waive making item Open Access

Where rights are retained, this cannot be waived

Page 12: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Policies with the significant criteria

25 policies

5 funders

20 institutions

Must deposit

Cannot waive deposit

Research evaluation

Page 13: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Funders

European Commission: Horizon 2020 policy

Austria: FWF (Fonds zur Foederung der Wissenschaftlichen

Forschung; Austrian Science Fund )

UK: HEFCE (Higher Education Funding Councils)

US: NIH (National Institutes of Health)

South Africa: National Research Foundation of South Africa

Canada: International Development Research Centre (IDRC)

Page 14: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Research institutions Adiyaman Universitesi (Turkey)

Arts et Metiers Paris Tech

Ghent University (Belgium)

INRIA (France)

Ifremer (France)

International Hellenic University (Greece)

Laboratoire de psychologie et neurosciences cognitives (France)

Pwani University (Kenya)

Saint-Louis University Brussels (Belgium)

Universidade do Minho (Portugal)

Universita degli studi di Trieste (Italy)

University of Birmingham (UK)

University of Bouira (Algeria)

University of Liege (Belgium)

University of Luxembourg (Luxembourg)

University of Mons (Belgium)

University of Reading (UK)

University of Southampton (UK)

University of Strathclyde (UK)

University of Trento (Italy)

Page 15: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Highest deposit rates (research-

intensive institutions*)

Institution Number of articles

published 2011-2013

% articles deposited

in the repository

University of Liege (Belgium) 4240 87 %

Universidade do Minho (Portugal) 3021 62 %

University of Pretoria (South Africa) 3335 60 %

Queensland University of

Technology (Australia)

3558 49 %

* Published more than 3000 articles in the 3-year test period

Page 16: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Highest deposit rates (research-

intensive institutions*)

Institution Number of articles

published 2011-

2013

% articles

deposited in

the repository

Policy has all critical criteria?

University of Liege (Belgium) 4240 87 % ✔

Universidade do Minho (Portugal) 3021 62 % ✔

University of Pretoria (South

Africa)

3335 60 %

Queensland University of

Technology (Australia)

3558 49 %

* Published more than 3000 articles in the 3-year test period

Page 17: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Other things that help policy success

Policy champion

Library activism in support of the policy (Research

Office?)

Department/faculty strategy

Training programme

Promotional events (e.g. Open Access Week)

Promotional materials

Technical tools (e.g. impact tools, etc)

Other suggestions to share

Page 18: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Policy alignment

http://roarmap.eprints.org/dataviz.html

Page 19: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must
Page 20: Open access …….(title) Access polic… · Policy criterion Positive correlation Significant correlation Must deposit Cannot waive deposit Link deposit to research evaluation Must

Thank you

[email protected]

Skype: almaswan

Tel: +44 1392 879702

Logo

area