Ranking questions in (digital) testing: what are they and how do you use them? There are numerous types of test questions that you can use to create your ideal test. One example is the ranking question (ordering question). What are the advantages and disadvantages of this question type, and what tips can you apply when using it in (digital) testing? What are ranking questions? Ranking questions are questions in which the candidate must rank a number of options in order of importance, relevance or correctness. These could be, for example, steps in a process, events in time, or a list of items in order of importance. This allows you to test whether a candidate is able to organise and categorise concepts in a logical manner. This tests the candidate's acquired knowledge and level of understanding at a different level than, for example, traditional multiple choice questions. Example An example of a ranking question is as follows: Question: Put the steps you take when buying a house in the correct order: Selecting a purchasing agent Viewing a house Make an offer on a house Arrange financing Signing the purchase agreement Answer options In the example above, the answer options are already in the correct order. The attentive reader will notice that this ranking question causes confusion. Steps 1 and 2 can also be reversed and are therefore subjective. Therefore, make sure you choose the correct technical knowledge in your home! Scoring For each correctly ranked item, you can award one point, for example. For a completely correct order, you could award a bonus point, for example. It is important to adapt the scoring to the specific test and the emphasis you want to place on certain steps. It is also possible to accept multiple correct orders, but with different scores. It is always important to establish clear and transparent criteria and to record these in the test guidelines. Advantages There are several advantages to a ranking question: Flexibility: Ranking questions can be used for different types of content and levels of proficiency. This makes it a flexible way to recognise and assess candidates' knowledge. Exploration of knowledge: Ranking questions force candidates to organise and categorise their knowledge and understanding. This is particularly true when learning via formative assessment This can provide additional insight and understanding of a particular subject. Practical applications: Ranking questions can be used for various subjects and levels. This makes them a practical way to assess candidates' performance. Improvement of memory: Ranking questions force candidates to organise information in a certain way, enabling them to remember and understand it better. This makes it an excellent tool for formative assessment. Disadvantages There are a number of disadvantages to using a ranking question in digital assessment: Complexity: Formulating a good ranking question requires careful thought in terms of test construction. It is difficult to formulate answer options that are sufficiently specific, yet still allow for realistic ranking. Subjectivity: Ranking questions are often more subjective than other question types. This is because the answers may depend on personal opinions and interpretations. Limited applicability: Ranking questions are not suitable for every type of subject or situation. Therefore, use different question types. Time: Creating and assessing ranking questions can be time-consuming. This is because there are more considerations and analyses involved in evaluating the answers. So make sure you tailor this carefully to what you want to test! Tips for drafting a ranking question Keep the number of options limited: Try to limit the number of options to a maximum of six, as this helps the examiner to form a clear and manageable picture of the various elements. Use logical sorting optionsEnsure that the options are clear and logical for the candidate and that they can be arranged in a clear and unambiguous manner. Add supporting images and/or descriptions toImages and/or descriptions can help to better visualise and clarify the ranking options. Be careful not to give away any unintended hints about the answer! Conclusion – Ranking questions (ordering questions) in (digital) testing The ranking question is a unique closed question type that can take your (digital) test to the next level. The big advantage is that they test the candidate's ability to make logical connections between answer options. This allows you to better measure what you want to measure. There are also disadvantages to this type of test question, especially when it comes to test construction, which requires a high level of expertise. Would you like more information about a test platform that allows you to use this question easily? Read more about Optimum Assessment Platform.
