Qualifying tests

Qualifying tests are written papers, used to shortlist candidates for the Selection Day stage of most exercises. They are designed to assess candidates' ability to perform in a judicial role, by analysing case studies, identifying issues and applying the law.

Use of qualifying tests
The JAC has adopted qualifying tests as an objective method for taking shortlisting decisions. However, we tailor our processes appropriately and might not always use qualifying tests. For example, when there are a small number of vacancies or in other limited circumstances we may instead choose to use a paper sift.
 

Marking and moderation
The tests are marked by experienced judges and the results are carefully moderated by the Judge markers and the JAC to ensure consistency in the marking. Marking and moderation is done in such away that the marker cannot identify the candidate from the answer script.

Any change to candidates' results as an outcome of the moderation process is made with the explicit agreement of the marking judges to ensure consistency of approach and application.

Results at the testing stage may be made available to the selection panel to help inform, alongside all the other information gathered, the Panel's discussion regarding the candidate.

Quality assurance
Qualifying tests are subject to a quality assurance process to ensure that tests are fit for purpose and that there has been consistency and accuracy of marking.

Test papers are generally prepared and marked by serving judges, equality proofed by external experts and trialled in a mock environment. The results are analysed for any anomalies and any necessary corrective action is taken.  Once candidates have sat the tests and the papers have been marked by the marking judges, judges and the JAC Assigned Commissioner sample check 10 per cent and 20 per cent are subject to sample checking by JAC Directors.

If any marking discrepancies are identified the 'sample check' may be extended up to and including a 100 per cent check of all test papers if necessary.

In light of this robust moderation and quality assurance process the JAC does not consider that a formal process for revisiting qualifying test papers for individual candidates is appropriate or necessary.