At
open
questions, you are looking more for the candidate’s opinion or story rather than the candidate’s train of thought. The answer allows the candidate to include a lot of detailed information.

In establishing a
closed
question, the correct answer is among the answer options. That way you can ask very specific questions. This question form is used when you are looking for a concrete answer. These questions are automatically checked in digital assessment, which saves considerable time. See Table 1 for an overview of all the different closed question types or view examples of closed questions.

For a brief explanation of the different closed question types, see the table at the end of the blog.

What is the correct sequence of steps of method X?

• 1. a, d, c, b
• 2. d, b, c, a
• 3. d, c, b, a
• 4. c, a, b, d

Put the steps of method X in the correct order.

• a
• b
• c
• d

Equivalence of questions

Note, however, that the question types need not be equivalent to each other. One question may be much more elaborate (with more correct answers), than another. The probability scores (see:“What is a probability score?”) are different in that case. Still, you want every candidate to have a similar exam and thus have an equal chance of passing the exam. Tricky if you want to use question types interchangeably in an exam or item bank. You solve this by creating questions with not too many options. This also further ensures that the time required per question does not vary too much and objectivity is maintained. Also set standards for this per question form; what should be the maximum number of alternatives? Is there also a minimum?

To further promote equivalence of questions, you can choose to employ partial scoring. This does not require the candidate to get the entire question right to score points. A portion of the maximum points to be gained can be obtained by giving a partially correct answer.

What is a probability score?

The probability score is the score a candidate can achieve, if he guesses/games the right answer, but does not actually know. As it were, the candidate is given this score “as a gift. For closed questions, the probability score is greater than 0. For multiple-choice questions with four alternatives it is 0.25% and with three alternatives it is 0.33% of the total points for the question in question. For a question that allows you to get 1 point, the probability score is then 0.25 and 0.33 points, respectively.

Multiple choice

Here one answer must be selected from offered answers.

Multiple select question

Here multiple answers can be selected from the options offered.

Choice list question

Here one answer must be selected from offered answers. A text excerpt includes pull-down menus from which the candidate chooses the correct answer.

Hotspot demand single

Here one answer must be selected from offered answers. An answer can be entered by clicking on the appropriate location within the image, an arrow will appear there. Examples application: geography, understanding of photos and illustrations on a particular topic.

Hot spot demand multiple

Multiple answers can be entered here by clicking on the appropriate locations within the image. Examples application: geography, understanding of photos and illustrations on a particular topic.

Video hotspot question

Here one answer must be selected from offered answers. This question type contains a video where the correct moment must be clicked. Examples application: point out moment in a conversation, point out moment when something special happens or something goes wrong.

Ranking question (ordering question)

Here one answer must be selected from offered answers. The answer options (text or pictures) must be put in a correct order. Examples application: methods, techniques, procedures.

Drag-and-drop question

Objects (text or images) must be dragged into appropriate places within an image or table. Examples application: names of flowers to pictures of flowers, what belongs to what.

Matching/matrix question

This question consists of a number of rows and columns, with the student placing crosses in the appropriate row/column. Example application: indicate the presence or absence of a particular characteristic of each term.

Numerical question

Here one answer must be selected from offered answers. An answer can be entered in the form of a number. Example application: calculate mortgage interest, sales tax, profit.

Input question single

Here one answer must be selected from offered answers. An answer can be entered in the input field, in the form of a short text or a single word. Example application: questions where the correct answer would be an open-ended, it would be in a multiple-choice question.

Input question multiple

Here one answer must be selected from offered answers. Multiple answers can be entered in the input fields provided, both textually and numerically. Examples application: questions where the correct answer would be an open-ended, would be in a multiple-choice question, calculations.