To build the rating grid, go to the menu Journal management/Review/Rating grids.
Before any reviewing can be performed, a rating grid has to be defined. It includes a variety of pre-set points to guide your reviewers and results in more consistent feedback.
A rating grid consists of a name and a set of criteria.
There is a default grid, which the editorial board must set up prior to any reviewing activities. Additional rating grids can be added, targeting specific section needs or distinguishing between normal volumes and conference proceedings. When creating a new rating grid, it is possible to copy the default grid and modify it or to start the grid from scratch. The different criteria can be sorted manually by drag and drop.
A grid consists of as many criteria as needed.
To define a criterion, a name must be provided, (e.g. scientific relevance) as well as a description (some guidelines that help reviewers understand what is expected from them). Further settings can also be defined.
If criteria are not considered equally important, a coefficient can be set up. Higher coefficients have a higher weighting. The different weighting will determine the final grade.
Comments can be enabled or disabled to allow the reviewer to justify the grading or give more precise assessment. A general comment function is available when the reviewer sends out his review, but it might be relevant to have comments about a specific criterion.
File upload can also be activated or de-activated in the corresponding box. If you wish the reviewer to be able to comment on the original text and include the annotated version in his/her review, this option should be selected.
Finally the rating type has to be set up. There are three rating types:
- Grading on a 1-10 scale: the criterion is assessed by a grade between 0 to 10
- Customised rating: the rating can be personalised. It can be a quantitative rating (e.g. 0 to 5), a qualitative rating (bad, average, good, excellent) or a simple yes/no rating.[in both cases, the reviewers are limited to a single answer]
- None: there is no rating, neither qualitative nor quantitative. In this case, the reviewer will have to provide detailed written assessment in a text box.
Once all fields have been filled, click the submit button to create the new criterion.