In our field, we refer to an ‘at random test’ when it comes to the random structure of an exam. This results in a unique exam for each candidate. At random is currently the most commonly used form of digital testing. However, there are still plenty of organisations that have not yet (fully) made the transition from written to digital testing or that use digital (fixed) version exams. In this blog, we explain the advantages of randomised tests.   

What is the difference between ‘fixed’ and ‘at random’ testing?

In a fixed (version) examination, every candidate receives the same questions in the same order. This method is generally used for written examinations, but sometimes also for digital examinations.

However, the most common type of digital test is randomised. In randomised tests, questions are placed separately from each other in a database according to a specific structure, also known as a test matrix. For example, the structure of the course material or the book. This creates a question bank. Questions are then randomly selected from this question bank for each section. This means that every candidate takes a unique exam.

Random testing: the five main advantages

1. A well-organised question bank

The questions in the database are divided into different topics. This allows you to easily see whether there are enough exam questions included for each topic. If, for example, you need to change the questions for a particular topic due to a change in current events, you can easily look up these questions.

2. The development process is less vulnerable and more precise.

With random testing, it is simple and obvious to have questions developed for each subject by multiple authors. This significantly speeds up the development process, improves control over the progress of the development process and reduces dependence on a single author. It also forces authors to adhere to the examination requirements. If you deviate from these, there may be overlap in an examination. And if you do not adhere precisely to the level of the examination requirement, the equivalence of tests is compromised. Long live precision, but it does require some effort.

3. Quality examination requirements quickly clarified

You can see exactly which exam requirements are met or cause problems, often during the development of the exam questions. Authors have little leeway and find it difficult to circumvent exam requirements that are difficult to develop. Therefore, ask authors about their experiences in working with the exam requirements.

4. Limited development costs and time

It is considerably cheaper to maintain individual questions than to maintain entire versions of tests; why is that? If changes are required to an examination, the examination is temporarily deactivated. It makes a huge difference, of course, whether one question or an entire examination is deactivated. In the first case, only a replacement question is needed, while in the second case, an entire examination is required.

Incidentally, setting up a random question bank generally takes a little more time. Think of it as a long-term investment.

5. Easier automatic reuse of questions

If the database still contains few questions, a small portion of the questions can be reused in a retake. In a random test, questions are selected individually from the database and automatically mixed with ‘new’ questions. By also changing the order, the candidate is less likely to recognise the ‘old’ questions in a retake.  Furthermore, by playing with different variables, the same question can be placed in a different context, further reducing the chance that the candidate will recognise the question.

Choices to be made in random tests

Are you about to start using digital testing and want to develop a randomised test? Bear in mind that the aim is not to copy a written test to a digital format. When development of a digital test There is much more to consider. Therefore, take the time to make the right choices.

For example, what types of questions would you like to use? What is the best ratio between knowledge, insight and application questions? Are there other things you need to take into account when formulating questions?

All in all, it makes sense to discuss the structure of the question bank with experts who have a good command of the relevant subject area. They are well placed to assess how much weight a subject should carry and how it can best be assessed.

Get in touch

Want to know more about this topic? Contact us for an informal discussion.