Reviews Guidelines
Reviewers
The quality of the conference is profoundly dependent on the review process, the papers are distributed to reviewers who evaluate, give remarks and feedback on the paper. An associate editor collects the reviews for each paper and gives a recommendation for the paper to be accepted or rejected.
You don’t need to have many years of experience to be a reviewer. Since the Associate Editor base their decision on several reviews, it is good help for them to both experienced and less experienced researchers.
Most of the reviewers are authors of other papers submitted to the conference and helping with reviewing other paper submissions is community work to help improve the quality of the conference.
Hence the quality of the review process is dependent on that enough authors take a solidaric responsibility in helping in this process. If you are several co-authors to a paper, please, have a discussion among you, who of you will be participating in the review process so that you can refer to them when a review request is arrived. More experienced researchers can also help the less experienced in reviewing, and you learn a lot by critically reading other’s work. Review invitations are also often sent to participants of earlier versions of the conference and based on the references in the paper. Most Associate Editors also invite reviewers from their personal scientific network.
Reviewer Duties
Once you get the reviewing assignment, please go through papers assigned and check:
- There is no conflict of interest.
- The paper falls reasonably well within your field of expertise.
If the answer is “no” to any of these questions, please inform the Associate Editor and reject the review request. The Associate Editor will probably find another paper where you can help.
How to proceed with the review
Each accepted paper must be technically sound and make a contribution to the field of Intelligent Vehicles. Contribution to the field includes novelty of approach or breaking concept as well as strong experimental results. However, a fresh new vision or approach can be a contribution even if it does not improve on state-of-the-art (SOTA) and less than SOTA performance should not be used for rejection on its own. Similarly, minor errors that are easily corrected are not reasons to reject an article.
Writing the review report
The reviewer has to identify the most relevant aspects of the article in a specific and detailed way by identifying the manuscript strengths and weaknesses. Although bullet points may be used, these must be explained in an appropriate manner, they must help the AE to make a final decision about the article. Remember that the AE will make the decision based mainly on your comments, rather than the assigned grade, so it must be properly argued. In addition, the review should provide sufficient feedback to authors to revise the paper for future submissions. In reference to the review of the state-of-the-art, references to specific publications should be given rather than vague references such as “this is well known” or “it has been used before”.
Ethical Considerations
Confidentiality
It is the responsibility of the IV reviewers to respect and protect the confidentiality of the papers assigned. The papers submitted to IV are not published, thus the work is proprietary of the authors. As it is possible that it is not accepted, it can be further refined or submitted to another conference or journal. Furthermore, in some organizations and companies, it can still be considered confidential/proprietary. For all this the confidentiality of the papers under review means:
- It is not allowed to show the article (including results, videos, images, code or any other supplementary material) to anyone, unless they have been included in the review process (AE or reviewers).
- You should not use the ideas or code from the articles for your own benefit (articles, proposals, or code) until it has been published.
- Upon completion of the review, all copies and materials related to the article must be deleted, including any supplementary materials.
Conflict of Interest
It is vital for the conference that conflicts of interest are avoided, so it is important that there is no doubt about the impartiality of the reviewers. Although the organizers make an effort to avoid these cases, sometimes they can occur. If you have been assigned a paper with a potential conflict of interest, you should contact the assigning Associate Editor or Program Chair as soon as possible to resolve the issue. Conflicts of interest include (but are not limited to):
- You work at the same institution as one of the authors.
- If you’ve been involved in any way in the work presented, e.g. as thesis advisor, member of the committee, as an external advisor.
- You have collaborated with one of the authors in the recent years (3 to 5 years). The definition of collaboration is broad; it is left to the reviewer’s judgment to determine this degree.
- If you were thesis advisor or advisee of one of the authors. This type of relationship is generally associated with a lifelong conflict of interest. Again, it is left to the reviewer’s discretion to identify the degree of conflict.
- If it may be perceived by others as a conflict of interest.
The Report
Derogatory comments are not welcome in peer reviews. It is important that the comments help in the decision-making process and that they allow authors to understand the shortcomings of their work for improvement in the future. The good reviewer should write gentle, incisive and helpful comments that allow the AE to immediately identify the merits (advantages and disadvantages) of an article, rather than rely solely on the summary score given. Keep in mind that the reviews are read by colleagues (other reviewers and AEs), thus being a helpful reviewer will benefit you in the research community.
Here there are some helpful tips for reviewers:
- A good review should not be done in a hurry. It is recommended to take several days from the reading of the article and the completion of the report.
- Short reviews are not useful, neither for authors nor for AE, the acceptance of the review of an article entails sufficient dedication to write a properly substantiated review.
- Reviewers are requested to be specific; when they indicate that certain parts of an article require revision or are not clear enough, indications and suggestions on how to clarify them should be given.
- It is not recommended to give clues about your identity, indicating that articles of your own authorship should be cited.
- Likewise, when referring to the novelties of an article, claims such as “this has been done before” or “it is well known” should be accompanied by references that justify this statement. Positive indications must also be accompanied by details.
- Articles should not be rejected for the simple reason that they do not contain citations or comparisons with un-reviewed published articles, such as arXiv.
- If you feel that the topic is unrelated to the congress, please explain it concisely in the review, and suggest alternative conferences or journals. In any case, it is advisable to keep an open mind in this regard, as articles that broaden the spectrum of action of the congress are welcome.
- Always be constructive in your reviews, using assertive and respectful language. Your colleagues will appreciate it and will accept criticism in a more positive way.
Papercept Instructions
Once you’ve been notified by email that papers have been assigned to you, please log into the Papercept site (https://its.papercept.net/conferences/scripts/start.pl), Log in, and choose the “Reviewer”, and follow the steps below.
1. Download your papers.
To download individual papers, you can click the links Download for the corresponding paper in the Reviewer’s Workspace. It will give you access to the download menu, where you can select to download the paper (“First submission”) or any other supplementary file to the paper that will be available in this menu.
2. Check for possible conflict or submission rule violations.
Contact the Program Chairs immediately if:
- You think you are conflicted with the paper.
- You think the paper violates submission rules regarding plagiarism. In the meantime, go ahead and review the paper as if there is no violation. The Associate Editor will follow up, but it may take a bit of time.
3. Review papers and assign ratings.
For a paper, under the review column, click “Review” in the Reviewers Workspace to get to the review form. Proceed with the review and save it to continue in the future, or click submit once the form is ready.
Associate Editors
As Associate Editor (AE) you are asked to manage the review of 4-8 papers, and to collect at least 3 independent reviews for each paper.
All the review process is made through Papercept which is an efficient and well-organized conference management system, and will help you in ensuring that the assigned reviewers will be timely reminded about their commitments.
The papers assigned to you are made available it the paper administration system, please check for potential conflicts of interest or papers that you do not feel comfortable handling at the Papercept site (https://its.papercept.net/conferences/scripts/start.pl) and click enter in “Associate Editor for Contributed Papers”.
When assigning reviewers:
- Start assigning reviewers as soon as possible. To manage all activities in time before the conference, it is important not to delay the review process.
- Some of your review requests will be declined and you need to send out more review requests. Its good to do this promptly.
- Try to cover several aspects among the reviewers, eg, scientific specialty and experience of the reviewer.
- Avoid selecting reviewers who are associate editors, like yourself they already have a number of papers to take care of.
- Be prepared to select yourself as one of the reviewers.
To ensure a fair review process in accordance with IEEE-ITSS standards, Associate Editors must verify that the following premises are met:
- Acting as an AE is a very important role for the IEEE-ITSS congresses, the scientific quality of congress depends on their engaged performance. That is why it is expected that they will be dedicated and professional in the performance of their duties.
- The reviews received must be properly documented and justified (with special relevance to those that are negative). If a review is received and is not properly justified, it is the task of the associated editor to ask the reviewer for clarification or to seek a new review.
- AEs should be familiar with the paper and should not make a final decision without a documented judgment of the paper.
- AEs should remember the IEEE’s policy with respect to no unilateral decisions. This means that decisions made must be supported by at least two reviewers, including the AE.
- AEs, either when assigning reviewers, or with respect to their assigned papers, must ensure that there is no conflict of interest that would compromise the impartiality of the review.