Judges portal
Abin Andrews avatar
Written by Abin Andrews
Updated over a week ago

After the judging round(s) have been setup it is now time to start judging entries. Once a judging round has started an email will be sent to all judges who have been assigned to that round.

The judge can then select the judging URL which will take the judge to the judging contest judging page where they will have to login to get access to the judging gallery.

Once the judge logs into the judging site the judge will be presented with the judging gallery to begin scoring the entries. The type of judging gallery presented will depend on the type of judging round created by the administrator.

Rating

For the rating round type judges will be presented with a gallery with starts under each entry depending on the scale that was set for the judging round. These are for rating the entries from 1 up to 10 stars.

To rate the videos just hover the mouse pointer over the stars and when the star count is as per the desired rating press the left mouse button. This will automatically save the score. If the contest has multiple contest categories as per the illustration then these will be selectable on the left. This will filter the gallery list.

You can also filter the list to only show the "Pending" entries that have not been scored yet and also the "Completed" entries which have been scored.

Entries can also be searched and also sorted by highest to lowest score, lowest to highest score, oldest to newest entries and newest to oldest entries.

The judge can also select into the entry and rate from the individual entry page. This allows for the entry to be played if it is a video so that it can be rated based on the video content.

You can also move from entry to entry using the arrow buttons.

You can logout and log back in again at any point and all previous ratings will be saved. Judges can also change scores at any time prior to the end of the round.

If the round has been setup to allow judges to submit scores manually for individual entries a "Submit Score" button will also be enabled in the entry details page.

If this is selected this entries score will be permanently submitted and the entry will no longer be visible to the judge.

The judge can still cancel at this point and go back and rate the other entries.

Once the “Finalise” button is selected again the scores are submitted against the entry and the entry will no longer be visible and cannot be changed.

If the round is not setup to submit score individually, once the round is complete all scores will be submitted and calculated for all entries automatically and the judge can no longer change their scores unless the round is reopened by the administrator.

Ranking

When the round is set to ranking, the judges gallery will be presented slightly differently. The ranking option allows judges to order videos from best to worst. This can be done by selecting the rank of each entry from the drop down ranking under each entry. This type of scoring is typically only suitable for judging smaller quantities of entries.

If ranking is required and there are many entries it is advised to split up the entries in the judging setup across multiple individual judges or judges groups.

Note also that the ordering and pending and completed filters are not available with the ranking option.

Judges can also select on the entry and select the position of each entry.

Again the judge can scroll through the different entries using the arrow buttons.

Once the round is complete all scores will be submitted and calculated for all entries automatically and the judge can no longer change their scores unless the round is reopened by the administrator.

Note: Individual score submission is also not available for ranking.

Assessment Rating

When the round is set to Assessment Rating, the judges gallery will be presented very similar to Rating however you will need to select the entry to start scoring. The Assessment Rating option allows judges to traverse each of the entries providing ratings against each of the assessment criteria.

When an entry is scored the gallery will display the entry in a dark colour and the total score applied to the entry will be displayed at the bottom of the entry thumbnail.

To score an individual entry this can be done similar to rating in which each of the criteria are judged from 1 to up to 10 with 1 being the lowest for each of the criteria. To select the rating remember to hit your mouse left mouse button when the rating level is hovered over and highlighted.

The rating are saved in real time as the score is selected. It is important to note that weightings are not displayed to the judges.

You can logout and log back in again at any point and all previous scores will be saved. Judges can also change scores at any time prior to the end of the round.

If the round has been setup to allow judges to submit scores manually for individual entries a "Submit Score" button will also be enabled in the entry details page.

If this is selected this entries score will be permanently submitted and the entry will no longer be visible to the judge.

The judge can still cancel at this point and go back and score the other entries.

Once the “Finalise” button is selected again the scores are submitted against the entry and the entry will no longer be visible and cannot be changed.

If the round is not setup to submit score individually, once the round is complete all scores will be submitted and calculated for all entries automatically and the judge can no longer change their scores unless the round is reopened by the administrator.

Judging Comments

It is also possible to capture comments from the judges for each of the scoring types.

When judging is turned on the judging portal will include a comments entry area for the judge to capture their comments.

When a comment is made and saved this is captured against the entry and judge who submitted the comment.
This will then appear in the Judging Results tab of the judging setup area of the dashboard.

This can then be exported to CSV for further review and analysis.

Did this answer your question?