Compose a test digitally

Creating a test digitally: easy, quick and balanced

Keys used to be composed mostly manually. Nowadays, digital test composition may be more obvious. In doing so, the (smart) software creates a balanced exam in no time and at the same time any human errors are eliminated. Are you already composing your test digitally? Learn more about the benefits of digital test composition in this blog!

Manually composing a key

When constructing a test manually, the test developer or test constructor(s) determines, using the test matrix, which questions will go into the test. The premise here is that one test is equivalent to the next when they test basically the same thing. In addition, it is logically obvious that important topics recur in every test.

These aspects make composing tests a labor-intensive and error-prone job. Which items (questions) end up in the test remains more or less dependent on the test developer’s values and preferences. Even if the test matrix is followed, some topics may not be covered. That can make a test unintentionally predictable for candidates, and you want to avoid that at all costs.

What is digital composing?

When a test is compiled digitally, it is automatically pulled from the database(item bank) based on various criteria (related topic(s), number of questions, level of questions, etc.) corresponding to the test matrix. You establish these criteria in advance by mutual agreement. Each test is then guaranteed to have the same composition. The advantage is that you can very easily select finely (at the lowest level in the test matrix). After all, the software does the work. The items in the bank must, of course, be established and checked and fit the test matrix.

Example

See the diagram below for a simplified example. On the left is the construction of the database and on the right is the number of questions drawn. The number of questions per topic has a minimum (left number) and a maximum (right number). The structure corresponds to the structure of the test matrix. The number of questions also corresponds to the test matrix and/or is a further refinement of it. In the example below, each test has 16 questions, so minimum 16 and maximum 16. All topics and cases are part of each drawn test. Each subtopic is covered at least once. In addition, some subtopics recur in each test, in this case 1.1.3. The cases each cover a topic A, B or C and contain 3 or 4 questions, depending on the topic.

Composing key – an example

Benefits of composing tests digitally

Compiling a key manually means searching through (loose) files to view items. In doing so, you may accidentally select the wrong item. By choosing to compose a test digitally, you not only save a lot of time, but at the same time you minimize the chance of errors and guarantee objectivity in item selection.

When composing a test digitally, you can not only ensure that certain questions, given their importance, are covered in each test but also that some questions should not be included (excluded) together in one exam. For example, because they overlap or because one question contains the answer to another question.

Conclusion

With digital (automatic) pulling of tests from a database, you can optimally control weighted taking according to the test matrix. This ensures that all tests are comparable and equivalent. In addition, composing tests digitally reduces the risk of errors and saves a considerable amount of time. Finally, it also promotes the objectivity of the test.