The test-retest reliability of Alva’s logic test was estimated using a sample of 117 participants who completed the test twice with 14-15 days in between. The observed correlation was r=0.81, which is considered Excellent by the European Federation of Psychologists’ Associations (EFPA).

Sample
The sample consisted of 58% males and 42% females. The age ranged from 20 to 63 with an average of 35.1 and a standard deviation of 9.4. The education level of the participants was high. 63% had completed a Bachelor’s degree or equivalent, 6% a Master’s degree or equivalent, 29% secondary education or high school and 2% other educational background.

Instrument
Alva’s logic test is a computerized adaptive test aimed for professional assessments in recruitment settings.

Study
Participants were recruited using Amazon Mechanical Turk. They were asked to complete a set of 39 tasks from Alva’s item bank twice, with two weeks in between. This is standard practice for test-retest reliability studies.