Creating a digital test: easy, quick and balanced

In the past, tests were mostly composed manually. Nowadays, digital test composition may be more obvious. Here, the (smart) software creates a balanced exam in no time and at the same time any human errors are eliminated. Are you already composing your test digitally? Read more about the advantages of digital test composition in this blog!   

Manually composing a key

When compiling a test manually, the test developer or test constructor(s) determines, using the test matrix, which questions will go into the test. The basic assumption here is that one test is equivalent to the next when they basically test the same thing. In addition, it is logically obvious that important topics recur in each test.

These aspects make constructing tests a labour-intensive and error-prone job. Which items (questions) end up in the test remains more or less dependent on the values and test developer preferences. Even if the test matrix is followed, some topics may not be covered. This can make a test unintentionally predictable for candidates and you want to avoid that at all costs.

What is digital composing?

When a test is composed digitally, it is automatically, based on various criteria (related topic(s), number of questions, level of questions, etc.) corresponding to the test matrix, from the database (item bank) drawn. You set these criteria in advance by mutual agreement. Each test is then guaranteed to have the same composition. The advantage is that you can very easily make fine-tuned selections (at the lowest level in the test matrix). After all, the software does the work. Of course, the items in the bank must have been defined, checked and fit into the test matrix.

Example

See the diagram below for a simplified example. The left shows the structure of the database and the right shows the number of questions drawn. The number of questions per subject has a minimum (left number) and a maximum (right number). The structure corresponds to the structure of the test matrix. The number of questions also corresponds to the test matrix and/or is a further refinement of it. In the example below, each test has 16 questions, so a minimum of 16 and a maximum of 16. All topics and cases are part of each drawn test. Each subtopic is covered at least once. In addition, some subtopics recur in each test, in this case 1.1.3. The cases each cover a topic A, B or C and contain 3 or 4 questions, depending on the topic.

Advantages of digital test composition

Compiling a key manually means searching through (loose) files to view items. It can happen that you accidentally select the wrong item. By choosing to compile a test digitally, you not only save a lot of time, but also minimise the chance of mistakes and guarantee objectivity in item selection.

When composing a test digitally, you can not only ensure that certain questions are covered in each test, given their importance, but also that some questions should not be included (excluded) together in one exam. For example, because they overlap or because one question contains the answer to another question.

Conclusion

With digital (automatic) test pulling from a database, you can optimally control weighted test taking according to the test matrix. This ensures that all tests are comparable and equivalent. In addition, digital test composition reduces the risk of errors and saves a considerable amount of time. Finally, it also promotes the objectivity of the key.