2015 csulb peer review responsible conduct of...
Post on 25-Mar-2018
216 Views
Preview:
TRANSCRIPT
http://www.eufic.org
2015 CSULB
Responsible Conduct of Research
Spring Workshop
Friday, August 21
Peer Review
Dr. Ashley Carter
Associate Professor
Biological Sciences
Undergraduate Advisor
How we communicate ideas.
- Talking/lectures/oral presentations
No real quality control (e.g., MBE conference)
- Posters
No real quality control
- Books
Some quality control: editors (academic publishers)
No quality control (self publishing, commercial publishers)
- Journals
High quality control: editors and peer-review
Plan
experiment
Have an idea
Perform
experiment
Analyze
data
animal welfare
biostats
Write
manuscript
proper citing
Submit
manuscript
journal choice
Peer-review
of manuscript
Publication
of manuscript
Advance
knowledge
Submit
manuscript
journal choice
Peer-review
of manuscript
Publication
of manuscript
Choose journal (be careful)
Submit to editor
- Include list of suggested reviewers (and enemies)
Editor sends copies out for review
Who reviews papers?
Blinded?
- Reviewers know authors
- Authors can sometimes guess reviewers
Reviewers read
- Make comments
- Recommend a decision
Editor collects reviews and adds own opinion
- Makes decision
- Accept without revision
- Accept with minor revision
- Accept with major revision
- Reject with invitation to resubmit
- Reject without invitation to resubmit
Choose journal (be careful)
Submit to editor
- Include list of suggested reviewers (and enemies)
Editor sends copies out for review
Who reviews papers?
Submit
manuscript
journal choice
Peer-review
of manuscript
Publication
of manuscript
Choose journal (be careful)
Submit to editor
- Include list of suggested reviewers (and enemies)
Editor sends copies out for review
Who reviews papers?
Blinded?
- Reviewers know authors
- Authors can sometimes guess reviewers
Reviewers read
- Make comments
- Recommend a decision
Editor collects reviews and adds own opinion
- Makes decision
- Accept without revision
- Accept with minor revision
- Accept with major revision
- Reject with invitation to resubmit
- Reject without invitation to resubmit
Editor sends copies out for review
Blinded?
- Reviewers know authors
- Authors can sometimes guess reviewers
Reviewers read
- Make comments
Submit
manuscript
journal choice
Peer-review
of manuscript
Publication
of manuscript
Choose journal (be careful)
Submit to editor
- Include list of suggested reviewers (and enemies)
Editor sends copies out for review
Who reviews papers?
Blinded?
- Reviewers know authors
- Authors can sometimes guess reviewers
Reviewers read
- Make comments
- Recommend a decision
Editor collects reviews and adds own opinion
- Makes decision
- Accept without revision
- Accept with minor revision
- Accept with major revision
- Reject with invitation to resubmit
- Reject without invitation to resubmit
Editor collects reviews and adds own opinion
- Makes decision
- Accept without revision
- Accept with minor revision
- Accept with major revision
- Reject with invitation to resubmit
- Reject without invitation to resubmit
Submit
manuscript
journal choice
Peer-review
of manuscript
Publication
of manuscript
Choose journal (be careful)
Submit to editor
- Include list of suggested reviewers (and enemies)
Editor sends copies out for review
Who reviews papers?
Blinded?
- Reviewers know authors
- Authors can sometimes guess reviewers
Reviewers read
- Make comments
- Recommend a decision
Editor collects reviews and adds own opinion
- Makes decision
- Accept without revision
- Accept with minor revision
- Accept with major revision
- Reject with invitation to resubmit
- Reject without invitation to resubmit
The process is altruistic (by the scientists)
No money is paid for reviewing or publishing (directly) which
insulates science from bribery and the corrupting power of money.
It's not perfect, but much better than all the alternatives.
Plan
experiment
Have an idea
Plan
budget
animal welfare
Write
grant proposal
proper citing Submit
grant proposal
agency choice
Peer-review of
grant proposal
Funding
of grant
Perform
experiment
Submit
grant proposal
agency choice
Peer-review of
grant proposal
Funding
of grant
Researcher submits to an agency and category
Agency reviewer checks proposals for suitability
Agency reviewer sends copies out for detailed
review by a subset of panel members
Reviewers read
- Make comments
- Determine a rating (e, vg, g, f, p)
Reviewer convenes panel meeting
- Panel discusses
- Panel ranks
- Agency reviewer uses panel rankings to rank
- >50% "Non-competitive"
- ~25% invited for full proposal
- ~7% funded (25% of 25%)
Weaknesses of peer review
Not anonymous or double blinded (and very hard to make it so).
Hard to publish controversial results (journal's motivation counters though).
- Journal impact factors
Performed by fallible humans (hence multiple reviewers).
May allow theft of ideas before publication/funding.
Not designed to detect fraud or deception
top related