the potential drawbacks of open peer review. a simulation ... · building on the 'peer review...
TRANSCRIPT
![Page 1: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/1.jpg)
The potential drawbacks of open peer review.
A simulation model of scientist behaviour
Flaminio Squazzoni & Federico BianchiGECS-Department of Economics and Management
University of Brescia, Italy
www.gecs.unibs.it/squazzoni.html
PEERE Valencia 2016
![Page 2: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/2.jpg)
Research question
� Transparency is viewed as a means to avoid selfish behaviour
by scientists and increase science accountability and
credibility
� This is true, in principle, but the devil is in the detail!
PEERE Valencia 2016
![Page 3: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/3.jpg)
The basic model
� A population of N agents (authors & referees)
� Resources, productivity and quality
� Evaluation process: intrinsic vs. perceived quality
� Publish or perish
PEERE Valencia 2016
![Page 4: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/4.jpg)
Play with our NetLogo model!
https://www.openabm.org/model/4718/version/1/view
PEERE Valencia 2016
![Page 5: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/5.jpg)
Transparency implications
PEERE Valencia 2016
![Page 6: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/6.jpg)
Dynamics
PEERE Valencia 2016
![Page 7: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/7.jpg)
A conflict of values?
� Is science community a society of peers or is it based on a
hierarchical stratification?
� Next step: adding reciprocity strategies that are sensitive to
hierarchy and status
� Does transparency challenge justice?
� Does “respect” question the “truth”?
� Is transparency a dangerous social experiment imposed
without any control factors?
PEERE Valencia 2016
![Page 8: The potential drawbacks of open peer review. A simulation ... · Building on the 'Peer Review Model", this ABM looks at the effect of multiple reviewers and their behavior on the](https://reader033.vdocuments.site/reader033/viewer/2022052102/603c8328d5d9114ff615a5e8/html5/thumbnails/8.jpg)
PEERE Valencia 2016