How do you ensure a seamless transition from written to digital testing? You can think of it as a project, you can completely change the work processes or you can can just start “small” and introduce digital testing in stages. But how do you get started with that? We cover some ways to start small below. That way you limit the amount of work and time to go digital with testing.
An easy way to keep it “small” is to start with a small question bank. Here we distinguish between at random tests and tests with fixed versions. At a later stage, as the next step, you can then easily expand the question bank.
In randomized testing, the premise may be that each exam should be able to be drawn three times with different questions. Why three times? With “three draws,” a candidate can retake twice with completely new questions each time. Should he then retake a third time, he will be given questions he has already had, but in a completely different order and “shuffled. The advantage of this is low recognition in the event of a third retake.
Starting point for fixed-version tests can be that you start with four exams, a higher number than for at random exams. Why raise the standard of the number of exam questions? Because there may be something wrong with one of the exams, which temporarily prevents that exam from being used. Moreover, in the event of a third retake, it still gives the candidate a unique exam.
If you are reluctant to use all kinds of different (closed) question types at the start of digital testing, you can of course decide to use them at a later stage. Then start with only the question formats that you also use in written assessment, for example, open-ended questions or a combination of open-ended and multiple-choice questions.
Tip: also read our blog how do you grade open-ended questions objectively?
For tests with fixed versions, the transition to digital testing is relatively small. This is because you don’t have to have the structure of the database yet and you can leave the development process unchanged. Testing with fixed versions is actually similar to working with written tests.
If you want to make the transition from written to digital even smaller, you can opt for tests at a fixed test time. It is especially convenient for providing results and analyzing results. Procedures around outcome determination and delivery can then remain unchanged. As with written testing, if you want to change the results as a result of the taking, you can do so in groups. Flexible sampling also allows you to adjust results, but this often happens after candidates have already received their results. By the way, don’t get confused: Keys at a fixed time is different from keys with fixed versions. You can also test at a fixed time with an at random question bank.
Now, if you want the exam administration to be even more like the written version, you can administer (part of) the exams in writing. You can do this by making a printout of the digital exams. The big advantage is that you can use the same locations as for written testing. After all, it does not require computers or a stable online connection. You can then take advantage of the benefits of digital testing without having to change the processes around taking.
An additional advantage of digital testing is that, even after written test taking, digital processing of the answers and analysis of the questions can take place.
In the transition to digital testing, it is quite conceivable that new questions or even a completely new exam will be developed. In any case, in terms of “look and feel,” it may appear as new to candidates. So how do you ensure a smooth transition? For this we distinguish the following ways:
What does such a pilot look like? This can be done in several ways. The first, simple way, is to start with digital testing at set times. For example, you organize 2 or 3 fixed test moments. After each moment, you do a question analysis and adjust results as needed. This way you immediately test the quality of the questions and limit any anxiety among candidates and other stakeholders.
Another form of pilot running, to be applied in flexible testing, is to establish a trial period. For example, you can start with three months, starting with a lower caesura. You also communicate that to candidates. Then you evaluate how pass rates are doing and possibly move toward a slightly higher caesura. You can build up this caesura increase gradually, in steps. This does require tact and clarity to avoid turmoil.
Suppose prior to opening up the bank you want to be sure how the questions score, then you can invite candidates to take exams. Clear communication is a requirement, though. What is the status if they succeed? Will exam fees be refunded if they fail? Etcetera.
With 30 years of experience in testing & examination, we have the knowledge to properly advise and guide you. Optimum Assessment n is your partner in digital testing. Get in touch with us!
Go for a gradual transition to digital testing and use Optimum Assessment Platform.