peer-reviewed process tensions. -...

46
Peer-reviewed process tensions. Dr. Elaine van Ommen Kloeke Elsevier Agronomy & Remote Sensing

Upload: others

Post on 11-Sep-2019

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Peer-reviewed process tensions.

Dr. Elaine van Ommen KloekeElsevier Agronomy & Remote Sensing

Page 2: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

En consecuencia…

Emilio Chuvieco - Universidad de Alcalá

Dr. Elaine van Ommen KloekeElsevier Agronomy & Remote Sensing

Page 3: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Articles Published vs. Impact Factors, 2013Im

pact

Fac

tor

RSE

TGARSISPRS JSTARSOpen RSJ

IntJApplEarthObs&RSPERS

GeoSci&RSLettersGISsci&RS RS Letters IJRS

CJRSEurJRS

GeoCarto

J.ApplRS

JInRSSoc

0

1

2

3

4

5

6

0 100 200 300 400 500 600

Number of Papers

Marvin Bauer, Former EiC Remote Sensing of Environment

Page 4: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

El modelo de escrito científico: IMRAD

• Introducción / Métodos / Resultados / Discusión.• ¿Qué quiere estudiarse? Introducción • ¿Cómo se ha estudiado? Métodos• ¿Qué se ha obtenido? Resultados• ¿Qué implican esos resultados? Discusión.

Emilio Chuvieco - Universidad de Alcalá

Page 5: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Ethical issues• Publish poor papers: Open-access journals.• Sending same paper to different journals:• One journal at a time (it saves your time, but increases others).• One journal after another (take proper note of evaluators’ comments).

• Creating auto-reviewers.• Ghost/gift/exchange authorship• Inventing/manipulating results.• Publishing several times the same paper.• Plagiarism.

Page 6: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Tipos de plagiarismo

Emilio Chuvieco - Universidad de AlcaláDr. Elaine van Ommen KloekeElsevier Agronomy & Remote Sensing

Page 7: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

The worst case so far!!

Emilio Chuvieco - Universidad de Alcalá

Page 8: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Emilio Chuvieco - Universidad de Alcalá

Page 9: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Consequences of Plagiarism• Potential consequences can vary according to the severity of the

misconduct and the standards set by the journal editors, institutions and funding bodies.• Before the publication:• Immediate Rejection.

• After the publication:• Written letters of concern and reprimand.• Article retractions• Some form of disciplinary action on the part of the researcher’s institute or

funding body.

Page 10: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Tipos de revistas científicasPor suscripción(paga el lector)

Open Access (paga el autor)

• El negocio está en publicarcalidad.• Los artículos están menos

disponibles (y serán másdifíciles de citar).• Si no se citan no sube el

limpacto.• Pueden ser OA pagando.

• El negocio está en publicar: menor control editorial.• Los artículos están más

disponibles: más fácilmentecitables.• Más disponibles para países

en desarrollo.

En los H2020 todos tienen que ser Open access

Page 11: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

¿En qué revista?• Seleccionar en función del cuál es el punto de innovación

principal:• Perfil de la audiencia interesada en ese resultado.• Revista con adecuado impacto a la relevancia del artículo.

• Indicadores de calidad.• Índice de impacto (CI) de la revista:• Posición dentro del rango de las revistas del campo (tercio superior /

medio / inferior).• Otros indicadores de calidad: número de citas (citas / año).

Page 12: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Before writing the paper...• Have you done something new and interesting?• Have you provided solutions to any difficult problems?• Have you checked the latest results in the field?• Have you verified the findings?• Did you perform the appropriate controls?• Do your results fit - is the story complete?

Dr. Elaine van Ommen KloekeElsevier Agronomy & Remote Sensing

Page 13: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Focus• Thank you for submitting your paper to Remote Sensing of

Environment; we appreciate your interest in publishing it in RSE. However, the main scope of the paper and the input datasets are not appropriate for RSE as the main focus of your work is not the analysis of remote sensing images, and therefore we recommend you to submit it to another journal with a closer orientation to your main topic of interest. With the large number of papers we are receiving we must be very selective and are unable to fully review all submitted papers.

Page 14: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Innovation• Clearly show that your paper merits publication:• New methods.• New interpretation of data.• New scopes-mixes…

• “Simple comparison of a decision tree classifier to maximum likelihood does not sufficiently add to the remote sensing literature”.• Regression models without physical understanding.• Are you aware of recent literature?

Page 15: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Structure• 1 Introduction• 2 Study Site and Materials (have as many sub-headings as needed to

introduce all the datasets used, their pre-processing)• 3 Methods• 3.1 Objective 1 (4-8 words to summarise objective 1)• 3.2 Objective 2 (4-8 words to summarise objective 2)• 3.3 Objective 3 (and so on)

• 4 Results• 4.1 Objective 1 (same words as 4.1)• 4.2 Objective 2 (same words as 4.1 and so on)• 4.3 Objective 3

• 5 Discussion• 5.1 Objective 1• 5.2 Objective 2• 5.3 Objective 3

• 6 Conclusion

Page 16: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Formal issues• Follow strictly the author guide. Length.• Be sure that ALL references are included.• Be sure that ALL quotations are exact (the original authors

support what you support).• Be consistent in your terms, once they are clearly identified.• Use IS units (m2 better than ha).

Page 17: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Language• Good papers are rejected for poor grammar.• Use native English speaker if you are not confident:• Check technical terms.

• Use scientific style: • Short sentences.• Be consistent with verb tense.• Impersonal style is more common.• Avoid using loose statements ('seems to be due to').

• Avoid use of many acronyms and indicate what ALL mean.

Page 18: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Figures• Include legends, scale in maps. Name axis in graphs. • Useful workflow figure:• “It would be extremely beneficial for readers follow text because the

methodology is new and involves multiple steps. The figure would also help visually describe how multiple remotely sensed data are integrated”.

Page 19: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Paper content• Cover letter• Tiltle• Highlights.• Abstract.• Keywords• Introduction: relevance and literature review• Objectives• Methods.• Results.• Discussion

Page 20: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Título• Que sea descriptivo del contenido:• ¿Cuál es el mensaje principal?

• No excesivamente largo:• Para eso está el resumen.

• Adaptado al medio:• Evitar títulos sensacionalistas en revistas científicas (ojo a las preguntas).• Indicativo (qué has hecho?) mejor que informativo (de qué va?).

• A veces se solicita también un título abreviado (para el encabezado).

Page 21: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Resumen• Clave para que el artículo se lea (el 95% de los que buscan en

internet sólo leen el abstract).• Definir con precisión:• Qué se pretendía.• Qué se consiguió.• Cómo.• Resultados más relevantes.• Limitaciones.

• Algunas revistas piden abstract estructurados.

Page 22: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Introduction• Provide a brief context to the readers:• Why this topic is relevant?• Why this topic is relevant for this journal?

• Address the problem• Literature review:• It is critical!!!• Demonstrate that you know well what others did.• Literature review is not a collection of citations!! Interpret, summarize,

relate to…

Page 23: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Introduction• “Significantly reduce the Introduction and focus on the

introductory topics that are directly related to your study. The review of other classification systems is interesting but tangential to your study”.• “the present state of the art is weak: Nothing is said about

previous works addressing the multi-track approach. How novel is this methodology?”• “I am concerned that all the relevant (including recent papers)

previous international scientific literature on your topic has not been reviewed in sufficient depth. It is essential (I mean ESSENTIAL) that you place your objective/aims and results into a broader scientific context”

Page 24: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Objectives• Clearly identify what you try to achieve:• 1 – 2 objectives, no more.

• Why are they relevant.• Relate them to the state of the art:• Limitations – problems that your work will address / improve.

Page 25: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Explanation of Methods• Describe how the problem was studied.• Include description of input data.• Include detailed information of how you did whatever you did.Other researchers should be able to reproduce your work using the method description• Include brief description of critical techniques even if they are

not yours (the reviewer does not need to read other papers to understand yours!).• References to commercial programs are generally not required:

explain the algorithms.• Include validation strategies.

Page 26: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Explanation of Methods• “While the methods are explained in detail in some places, this

isn't consistent, and I couldn't find details on how you formed your decision trees”.• “This section needs improvement - the authors should focus on

presenting the methods and the thresholds used in the study without digressing. Describe your methods, explain all terms, and list the specific tests used”.• “Methods poorly documented”• “Further, the justification for using so many texture and spectral

variables in the NN algorithm is not presented (it reads like a fishing expedition)” (too many topics implie confusion).

Page 27: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Results• Be clear & easy to understand.• Link to objectives.• Highlight the main findings:• But not repeat whatever is evident in the tables!

• Feature unexpected findings• Provide proper statistical interpretation.• Include clear illustrations & figures:• Wherever they are quoted.• At the end of the paper.

Page 28: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Results• “The presentation of the results is very weak (figures and text),

the author should at least enter into more details to explain the results if there were some interesting things to show regarding the comparison of methods”.• “the results section is written poorly; the authors simply point

the reader to tables, rather than synthesizing and presenting the relevant results”.

Page 29: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Accuracy assessment• Is critical in any research paper.• Statistically design sample:• Guided sampling is not adequate, not probabilistic.

• Adequate use of validation metrics.• Sometimes simulated images are very useful:• “I am surprised that they did not use simulated gap image to evaluate the

performance of their method. They claim "our recovery results can't be tested by simulated SLC-off images", but I do not know why did not do it.

Page 30: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Discussion• Most important section!• What do your results mean / imply?• Are your conclusions well grounded in your results?

• Demonstrate why your paper goes beyond the current knowledge• Align discussion to results AND to objectives.• What is the ‘bigger picture’?• Go beyond your results: Compare your own results with published work• Show applicability to other sites-conditions…

Page 31: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Discussion• “The discussion section contains very little new information and

only one citation. Here, the authors need to clearly show how their findings fit into the existing literature”.• “There is no real discussion to compare results with

bibliography”.• The Discussion section is where you 'give back' to the

international readership of RSE and place your findings into a broader scientific context. It is where you allow others to learn from your analysis. As such the Discussion section should contain many references and dovetail back to the issues raised in the Introduction section.

Page 32: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Conclusion• Should be clear & concise• Provide justification for the work• Advance the present state of knowledge• Provide suggested future experiments• Quantitative guidance on what was achieved is important to

highlight in conclusions.• “Please re-write conclusions. In the present form it is sounding

like literature review all over again”.

Page 33: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Acknowledgements• Advisors• Financial Supporters & Funders• Proofreaders & Typists• Suppliers who may have donated materials

Page 34: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

References• Do not use too many references (some limit to 40/50)• Always ensure you have fully absorbed material you are

referencing• Use published work – not grey literature• Avoid excessive self-citations• Avoid excessive citations of publications from the same

region/country• Conform strictly to the style in the guide for authors (Endnote

/Procite styles).

Page 35: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Sistemas de gestión editorial• Se utilizan para facilitar la tramitación de los artículos.• Casi todas las revistas prestigiosas cuentan con algún sistema

propietario: Elsevier, Springer…• Hay algunos de dominio público: OJS, Open Journal System.

Page 36: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

http://ees.elsevier.com/rse/default.asp

Emilio Chuvieco - Universidad de Alcalá

Page 37: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Emilio Chuvieco - Universidad de Alcalá

Page 38: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Peer-reviewed process

Revisor1

Associate Editor

Recomendation

Revisor2Minor revision

Editing process

RejectSubmit paper

Editor in chief

Major revision

AceptanceRevisor 3

Screeningprocess

Proof correction

Emilio Chuvieco - Universidad de Alcalá

Page 39: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

How reviewers are selected• Very difficult to get good reviewers! Critical for the journal

success!!• 1-2 suggested by the author (if they are solid enough).• Different regional origins.• Recent authors of that topic:• Journal database.• External databases: JCR, Scopus, Google scholar…

• Take into account recent reviews (avoid overloading).

Page 40: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Criterios para evaluar un artículo

• Contenido científico:• Originalidad y relevancia del tema.• Objetivos bien presentados.• Diseño experimental sólido.• Resultados bien interpretados.• Conclusiones siguen a los resultados.

• Redacción:• Redacción adecuada.• Redacción acorde con lo que se expone.• Sin errores matemáticos o lógicos.

Page 41: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Editor decisions• Desk-rejection by EiC, based on his/her own review or AE

evaluation.• Decision after reviewers’ and EiC opinions:• Accept as it is: very rare in my experience• Minor revision• Major revision. OK if the reviews are constructive and you make rigorous

changes.• Subject not appropriate: unfocused.• Reject and resubmit is becoming more common: there is potential for the

paper, but not in its current form.• Reject (not always the end of the world).

Page 42: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Editor decisions• This is not a democracy.• Example:• 4 reviews received, 3 minor revision, 1 reject• The editor may reject the paper if the fourth reviewer found a fundamental

flaw that the other reviewers failed to notice• Or the editor may make a revise decision

• The interpretation of what constitutes minor and major revision can vary considerably among reviewers and editors.• Example:• Subject not appropriate: different topic / low quality for RSE

Page 43: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Submitting a new version• Respond to all points - even if you disagree• Write a polite, scientifically solid rebuttal: avoid personal

arguments.• State specifically what changes you have made to address the

reviewers’ comments, mentioning the page and line numbers where changes have been made• Perform additional calculations, computations, or experiments if

required; these usually serve to make the final paper stronger• Revision is not guarantee of approval!

Page 44: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

When the paper is rejected• Complain to the editor, including only scientific arguments.• If evidences of bad reviewing are found, the editor usually

decides to send it to other reviewers.• The author may decide to modify the paper and submit it again

to the same (unusual) or another journal.• Some authors decide to submit the paper without changes:• It is a publication: always our name will be associated to the paper

contents.

Page 45: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Artículos rechazados

Page 46: Peer-reviewed process tensions. - congresotig2016.uma.escongresotig2016.uma.es/wp-content/uploads/2016/06/peer-publication...• Plagiarism. Tipos de plagiarismo Emilio Chuvieco -

Length of the whole process• Depends on the journal quality.• Desk-rejection: 1-2 weeks.• Reviewing process: 4-8 weeks.• Resubmission (it depends on the author)• Publication:• Online publication: immediate.• Paper publication (if any): 2-10 weeks.