What an unexpectedly low result can mean
Sometimes, a candidate that has been perceived as promising comes in with an unexpectedly low result on the logic test. There can be several different explanations for this. One is of course that the result reflects the candidate’s true score. In that case, a low result indicates that the candidate might have some difficulty interpreting complex information and solving difficult problems. There might, however, also be other reasons for a low score:
The candidate somehow misinterpreted the task or had technical problems with the test or their device.
The candidate was extremely nervous or tense, producing a ‘performance freeze’.
The candidate took the test under very bad conditions, for instance while being ill, very tired, or very stressed.
The candidate was disturbed or interrupted while taking the test.
Setting candidates up for a fair test
In order to avoid the above scenarios, make sure to instruct candidates to take the test under good circumstances:
Set aside enough time.
Find a place where one is not disturbed.
Pick a moment when one is not overly stressed or worn out.
Read the instructions carefully and make sure the task is understood before beginning.
💡Good to know: Candidates also receive guidance on creating good test conditions in the instructions shown before the test begins.
If the result looks valid
If there are no clear indications that the testing situation was affected by any of the above-mentioned factors, the result should be interpreted as valid. In that case, given that you consider the candidate otherwise suitable and qualified, the next step is to see if there are other data points that might outweigh the results.
Other assessments. For instance, if the candidate does very well at a work sample test or case exercise, this could be viewed as overruling the logic result.
References. You may also add questions in a potential reference taking to better understand how the candidate has handled complex information or solved difficult problems in the past. If former managers or colleagues do not at all recognise this capacity as a problem, the candidate might have developed compensatory strategies that offset a low logical ability.
Before you allow a retake
Please note that a retake of the logic test should not be allowed lightly. This is for two reasons:
Fairness. First, there is a fairness problem involved in giving one candidate the possibility to improve his or her result, while other candidates are judged on only one trial.
It cannot be undone. Second, Allow retaking test removes your organisation’s access to the candidate’s current logic test result for every job they have applied to. The candidate has to redo the test before you get access to a new result, and any Role fit calculations are redone once it arrives.
💡 Tip: If you want to check whether a result is valid rather than replace it, send the candidate a validation test instead. It uses tasks they have not seen before, and their original result is kept. See Validate Logic Test for more information.
Any Questions?
Use the chat in the bottom right corner to connect with a member of our support team.
