Phased introduction of digital testing

How do you ensure a seamless transition from written to digital testing? You can think of it as a project, you can change the work processes altogether or you can can Just start ‘small’ and introduce digital testing in phases. But how do you get started with this? Below we cover some ways to start small. That way, you will limit the amount of work and time it takes to introduce digital testing.     

Digital review and the impact on existing processes

Start with a limited question bank

A simple way to keep it ‘small’ is to start with a small question bank. In doing so, we distinguish between at random keys and tests with fixed versions. At a later stage, as the next step, you can then easily expand the question bank.

Question bank at random tests

In randomised testing, the starting point may be that each exam should be able to be drawn three times with different questions. Why three times? With ‘three draws’, a candidate can retake twice with completely new questions each time. Should he then retake a third time, he will still get questions he has already had, but in a completely different order and ‘shuffled’. The advantage of this is that recognition is low in the event of a third resit.

Question bank for fixed-version tests

The starting point for fixed-version tests may be that you start with four exams, a higher number than for at random exams. Why raise the norm of the number of exam questions? Because there may be something wrong with one of the exams, making that exam temporarily unavailable. Moreover, it still gives the candidate a unique exam in any third resit.

Start with a ‘sober’ bank content

At the start of digital testing, do you encounter the use of all kinds of different (closed) question types, Of course, you can easily decide to use them at a later stage. Then start with only the question types you also use in written tests, for instance open questions or a combination of open questions and multiple choice questions.

Tip: also read our blog how do you assess open questions objectively?

Key with fixed versions

For tests with fixed versions, the transition to digital testing is relatively small. This is because you do not need to have the structure of the database yet and you can leave the development process unchanged. Testing with fixed versions is actually similar to working with written tests.

Test at a fixed time

If you want to make the transition from written to digital even smaller, you can opt for tests at a fixed test time. This is particularly convenient for providing results and analysing results. Procedures for determining and providing results can then remain unchanged. If you want to change the results following the test, this can be done in groups, just like with written tests. Flexible testing also allows you to change results, but often only after candidates have already received their results. Don't get confused by the way: Testing at a fixed time is different from testing with fixed versions. You can also test at a fixed time with an at random set of questions.

Take part of the exam also in writing

Now, if you want the exam administration to look even more like the written version, you can take (part of) the exams in writing. This can be done by making a printout of the digital exams. The big advantage is that you can use the same venues as for written tests. After all, no computers or a stable online connection are needed. You can then benefit from the advantages of digital testing, without having to change the processes around taking the exams.

An additional advantage of digital testing is that, even after written tests, digital processing of the answers and analysis of the questions can take place.

 

 

Introduce digital testing in phases through pilots

In the transition to digital testing, it is quite conceivable that new questions will be developed or even a completely new exam. Either way, it may come across as new to candidates in terms of the ‘look and feel’. So how do you ensure a smooth transition? For this, we distinguish the following ways:

1. Pilot through fixed testing times
2. Pilot with trial period (flexible review)
3. Pilot prior to opening.

1. Pilot through fixed testing times

What does such a pilot look like? It can be done in several ways. The first, simple way, is to start with digital testing at set times. For example, you organise 2 or 3 fixed test moments. After each moment, you do a question analysis and adjust the results if necessary. This way, you immediately test the quality of the questions and limit any unrest among candidates and other stakeholders.

2. Pilot with trial period

Another form of piloting, to be applied in flexible testing, is to set a trial period. For example, you can start with three months, starting with a lower caesura. You also communicate this to candidates. After that, you evaluate the success rates and possibly move to a slightly higher caesura. You can increase this caesura gradually, in steps. This does require tact and clarity, to avoid unrest.

3. Pilot prior to opening

Suppose prior to opening up the bank you want to be sure how the questions score, then you can invite candidates to take exams. Clear communication is a requirement, though. What is the status if they pass? Will exam fees be refunded if they fail? Etcetera.

How do you implement digital testing?

With 30 years of experience in testing & examining, we have the knowledge to properly advise and guide you. Optimum Assessment n is your partner in digital testing. Take contact with us!