if you can't be kind, be scholarly. constructive peer reviewing - emma coonan
TRANSCRIPT
![Page 1: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/1.jpg)
If you can’t be kind, be scholarlyConstructive peer reviewing
EMMA COONANJOURNAL OF INFORMATION
LITERACY
Group hug by Joris Louw
es, CC BY 2.0
![Page 2: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/2.jpg)
![Page 3: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/3.jpg)
Aims
• Explore what peer review is and what it’s for• Demystify what it involves• Foster constructive reviewers and critical
friends to scholarship
![Page 4: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/4.jpg)
What is peer review anyway?
![Page 5: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/5.jpg)
Discussion
1. What is peer review?2. What’s it for?3. What does it not do?
![Page 6: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/6.jpg)
Discussion
1. What is peer review?
![Page 7: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/7.jpg)
Discussion
1. What is peer review?Appraisal of reported research by expert in the fieldMay be ‘double blind’ – author’s name is not revealedMay be 2 or more reviewers
![Page 8: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/8.jpg)
Discussion
2. What’s it for?
![Page 9: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/9.jpg)
Discussion
2. What’s it for?Verification of reported results as far as possible
Guide the editor in a decision on whether to publishHelp authors make the best possible presentation of their research to their community of practice
![Page 10: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/10.jpg)
The $64,000 question
“What’s needed to bring this up to publishable standard?”
The point is not to eliminate but to include
![Page 11: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/11.jpg)
Discussion
3. What does it not do?
![Page 12: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/12.jpg)
Discussion
3. What does it not do?ProofreadReplicate resultsGuarantee truth
![Page 13: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/13.jpg)
What does it involve?
![Page 14: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/14.jpg)
What to look for
• Research informed and evidence based• Designed around an arguable research question• Contextualised with reference to previous and current
advances in IL thinking• Methodologically robust with a demonstrable research design• Investigation not description
![Page 15: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/15.jpg)
Guess the headings (there are 6!)
![Page 16: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/16.jpg)
Guess the headings
• Relevance to JIL• Originality and interest to audience• Title and abstract• Methodology• Use of literature and referencing• Clarity of expression and structure
![Page 17: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/17.jpg)
Outcomes for each criterion
• Appropriate• Needs amendment• Needs major rewriting or adjustment
![Page 18: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/18.jpg)
Overall recommendation
• Accept for publication without amendment• Revisions required• Major revisions required followed by peer review• Decline submission
![Page 19: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/19.jpg)
How to look
• Critically and analytically - not descriptively / not at sentence level
• Test for weakness in argument and structure- use the what/why/how framework
• Detached mindset- evaluate integrity of argument, not how far it matches your own view of IL
• Don’t just review what you see- what is the author not saying? What literature hasn’t been cited?
![Page 20: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/20.jpg)
Reviewer’s toolkit
![Page 21: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/21.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet points
![Page 22: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/22.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet pointsQuestion-led, evidence-based investigation
![Page 23: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/23.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet pointsQuestion-led, evidence-basd investigation
• The $64,000 question
![Page 24: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/24.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet pointsQuestion-led, evidence-based investigation
• The $64,000 question “What’s needed to bring this up to publishable standard?”
![Page 25: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/25.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet pointsQuestion-led, evidence-based investigation
• The $64,000 question “What’s needed to bring this up to publishable standard?”
• Strategic reading techniques
![Page 26: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/26.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet pointsQuestion-led, evidence-based investigation
• The $64,000 question “What’s needed to bring this up to publishable standard?”
• Strategic reading techniquesIncluding reverse outlining
![Page 27: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/27.jpg)
Reviewer’s toolkit
• JIL’s 4 bullet pointsQuestion-led, evidence-based investigation
• The $64,000 question “What’s needed to bring this up to publishable standard?”
• Strategic reading techniquesIncluding reverse outlining
• What/why/how
![Page 28: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/28.jpg)
What/why/how
• What is the research?What questions does it address? What contribution does it make?
• Why has it been done?Why does it matter? What will it change?
• How has it been done?What’s the method? How does it frame the findings? How has it helped the researcher mitigate bias?
![Page 29: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/29.jpg)
Being constructively critical
![Page 30: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/30.jpg)
“I would like to thank you again for all the constructive and benevolent effort that you and your reviewers put into this review and for the graciousness with which you did it. “I have been through several submission processes that have been quite impersonal and where the critical feedback has been either on the verge of cruelty or entirely neglectful. You and your reviewers stand apart …”
![Page 31: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/31.jpg)
Discussion
How can we be helpful and humane?
![Page 32: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/32.jpg)
On being helpful and humane
• Check your privilege - unequal power relationship• You don’t have to agree, just to check if the position is
adequately grounded and defended
![Page 33: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/33.jpg)
On being helpful and humane
• Use what’s well done as a yardstick• “What I think would make this even better is …”
![Page 34: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/34.jpg)
On being helpful and humane
• “Show your workings” (be evidence-based!)• Give practical and workable suggestions for how to
implement your amendments
![Page 35: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/35.jpg)
![Page 36: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/36.jpg)
1. “This article is riddled with assumptions.”2. “The writing is often arrestingly pedestrian.”3. “It is clear that the author has read way too much and
understood way too little.”4. “Something is missing.”5. “Not only does this strike me as the worst kind of
postmodern legerdemain, but if true the statement would transform ethics into a hopelessly muddled enterprise.”
From http://shitmyreviewerssay.tumblr.com/
![Page 37: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/37.jpg)
Further reading
JIL author guidelinesLowell, Seri (2002) Helpful hints for effective peer reviewingRaff, Jennifer (2013) How to become good at peer reviewSchneiderhan, Erik (2013) Why you gotta be so mean?
![Page 38: If you can't be kind, be scholarly. Constructive peer reviewing - Emma Coonan](https://reader036.vdocuments.site/reader036/viewer/2022081604/58a7b0c61a28ab70368b4caf/html5/thumbnails/38.jpg)
Emma Coonan, Editor-in-Chief
Journal of Information Literacy
Twitter: LibGoddess