Ellipse

cut-off score

Cut-off score – a matter of failing or passing an exam

If you answer 55% of the questions in an exam correctly, do you automatically pass? No… in fact, whether or not you pass a test depends on the caesura applicable to the test in question. The caesura is the line between a pass or fail. But how is the caesura determined and what (test) aspects affect that caesura determination?

How to determine the cut-off score?

We distinguish four pillars for the determination of the cut-off score:

  1. Assessment with closed-ended questions;
  2. Difficulty level of the questions in the assessment.
  3. Weight of the assessment.
  4. Expected pass rate.

The cut-off score is based on an absolute cut-off score.

Absolute cut-off score versus relative cut-off score

The absolute caesura is a predetermined caesura. The absolute cut-off score is a cut-off score that is determined in advance. This cut-off score is at a fixed point, independent of the scores of the group of students. The cut-off score determined afterwards is the relative cut-off score. The relative cut-off score takes into account the scores of the group. The absolute cut-off score is the most commonly used. The relative cut-off score is useful when you do not know how a test ‘will do’, for example, with a new course or test form.

1. Assessment with closed questions

In an assessment with closed questions, there is always a chance that a student will get the question right, even if he or she does not know the answer. This is called the guessing chance. The size of the guessing chance depends on the number of answer options. Suppose a test has a total of 60 questions with 1 point each and 4 answer options. The guessing probability is then 25% (1 in 4). This means that a student can obtain 15 points (¼ of 60), by guessing.

When determining the cut-off score, you usually take the height of the guessing chance into account. In practice, this means that the cut-off score is higher because the guessing chance is taken into account. In this case, the cut-off score is calculated as follows.

Example
  • Guessing chance = 25% = 15 points
  • Total points – number of points for guessing: 60-15 = 45 points
  • Cut-off score of this (smaller) number of points: 55% of 45 = 24.75
  • Cut-off score: points for guessing 15 + 24.75 = 39.75
  • 39.75 is 66.25% of 60 points.
  • Instead of 55%, the cut-off score is 66.25%.

2. Difficulty of the questions in the assessment

You can determine the cut-off score in a number of ways, while taking into account the difficulty level of the questions. A method that is often used is that of Angoff. In this method, different experts check all questions on their degree of difficulty. They assess what percentage of the candidates who would just manage to pass would get the question right. The percentages of the different experts are then added up and the average of these is the cut-off score.

Example

A group of five teachers take the following steps.

  1. Consider a hypothetical group of students who have just mastered the material.
  2. For each of the following questions, answer what percentage of these students will get the question right.
  3. Omit the highest and the lowest percentages for each question. Take the average of the remaining percentages.

Average percentages (extremes excluded):

  • Question 1: 50%
  • Question 2: 40%
  • Question 3: 80%
  • Question 4: 70%
  • Question .

Added up and averaged: 60% cut-off score

3. Weight of the assessment

If an assessment is important for the practice of the profession and/or concerns a final examination, you use a high cut-off score. This also applies if the work involves a high risk of damage. The cut-off score for a medical exam is probably higher than for many other exams.

Of course, the opposite is also true. When a (formative) digital assessment is intended to measure progress that does not count towards the final result, you can lower the cut-off score.

4. Expected pass rate

You can also adjust the caesura based on an expected pass rate. You can also adjust the cut-off score on the basis of an expected pass rate. For example, if you expect that an assessment is very easy for the target group because all candidates are highly educated and the test only contains simple insight questions. In that case the expected pass rate is very high and you can choose to raise the cut-off score. If you expect the opposite, that the assessment will be very difficult for most candidates, you can lower the cut-off score.

Conclusion

Think carefully when determining a cut-off score. A fixed ‘percentage of questions correct’ or ‘number of points obtained’ is not always a good indicator. There are several things that determine whether the cut-off score is higher or lower. Coordinate this matter with colleagues and record the decisions made.

Decor

Want to know more?

Want to know more about this topic?Feel free to contact us at 013 – 528 63 63