A multiple-choice exam is suitable for asking closed-ended questions to students, where the student selects the correct answer from a number of alternatives. The correct answer is called the key. The alternatives are also referred to as distractors. A multiple-choice exam assesses lower cognitive skills, such as factual knowledge and comprehension. Application can be tested to some extent, for example through case-based questions. Multiple-choice tests are highly suitable for testing large groups due to their efficient grading. With ANS, this process can be further automated.
- Purpose of assessment
- Application | Knowledge reproduction | Understanding
- Mode of assessment
- Digital | Paper-based
- Assessment environment
- On campus | Secure setting
- Group size
- Small | Medium | Large
- Assessment duration
- Medium| Short
Step-by-step plan
Step 1: From learning objectives to test matrix
Determine whether this test format aligns with the knowledge and/or skills you intend to measure, as described in your learning objectives.
Step 2: Create a test matrix
Create a test matrix and determine how the questions should be distributed across the different learning objectives. Ensure this aligns with the weighting defined in your test plan. Indicate in the test matrix how many points can be earned per question. Note: the level at which you formulate questions should be consistent with the level of your learning objectives. This means you should never have questions that exceed the level of the learning objective. Questions at a lower level of Bloom's taxonomy are acceptable, but ensure you are measuring what you intend to measure.
A template for the test matrix can be found on the page Basic principles.
Step 3: Construct questions
Construct questions that are aligned with the level of the learning objectives.
When constructing questions, avoid using negatively formulated questions unless necessary. So-called 'trick questions' are discouraged as they can negatively impact validity. Also ensure that the questions are truly questions and that students can answer them without first reading the various answer options.
Make sure questions are unambiguous. Also ensure that the alternative answers are approximately equal in length.
To enhance the learning effect, you can provide a brief explanation for each incorrect answer, stating why it is wrong. For the correct answer, indicate why it is correct.
Several types of multiple-choice questions are possible: see variations for more information.
Step 4: Review your test
Have a colleague review the exam for content and language. Then process the feedback and place the final version of the test in ANS.
Step 5: Test administration by students
Let students take the test.
Step 6: Test analysis
Analyze the test in ANS. Make corrections if necessary.
Step 7: Communication to students
Communicate the results to students and provide feedback during the review session. Ideally, feedback should be provided as soon as possible after the test. An alternative could therefore be to allow students to see which answers were incorrect immediately after the test, along with explanations. If students also provide feedback on the test (or questions), evaluate this critically.
This step-by-step plan assumes that the digital platform ANS is used to administer tests. If you wish to administer a paper-based multiple-choice test, most steps can be followed in the same way. Any exceptions are noted accordingly.
Consider the tools and materials mentioned here as suggestions. In many cases it’s possible to use alternative tools. Please turn to the Learning & Innovation team of your faculty first to see which online and offline tools are available and how to apply them.
Reliability
- Ensure there are a sufficient number of questions on the exam. For questions with four answer options, include at least 40 multiple-choice questions. If you use questions with three answer options, include at least 60 multiple-choice questions.
Transparency
- Communicate in advance which learning objectives will be tested on the exam, the weighting of the exam within the course, and the passing grade threshold.
Inclusivity
- Use simple, clear language that is understandable to every student.
- Use a variety of examples and ensure they are appropriate for the diverse students in your student group.
- Inform students about the features ANS offers, such as increasing the font size or using dark mode.
In addition to multiple-choice questions where students must select one or more of the answer alternatives, other forms of multiple-choice questions are also possible, such as hotspot or match questions.
Downloads
Download the following infographic for more inspiration.
- To properly prepare your students for a multiple-choice exam, it is recommended to familiarize them with this test format during teaching and learning moments, for example with a quiz at the end of a lecture.
- Furthermore, we recommend posting a sample exam on Canvas so that students know what to expect on the test.
