What steps would you take to ensure exam content validity and reliability for a strategic training practice test?

• A. Rely on instructor intuition for item quality.
• B. Create a blueprint mapping items to objectives, use item-writing guidelines, run pilot testing, check for reliability (Cronbach's alpha), calibrate.
• C. Use items from unrelated domains to diversify.
• D. Skip pilot testing and reliability.

Answer: (B)

To ensure exam content validity and reliability, you start by building a blueprint that maps every item to specific objectives and to the required coverage. This alignment demonstrates that the test content is appropriate for what you intend to measure and that all important areas are represented. Next, apply rigorous item-writing guidelines to craft clear, unbiased, and well-constructed questions that reflect those objectives, reducing ambiguity and measurement error. Then run a pilot test with a representative group to gather empirical data on item performance and overall test functioning, which lets you see how items discriminate between different levels of ability and how the test behaves as a whole. Analyzing the pilot data lets you calibrate item difficulty and ensure the scoring is stable, contributing to reliable measurement. Finally, check reliability with a statistic like Cronbach's alpha to quantify internal consistency, confirming that the items coherently measure the same construct. The other approaches don’t provide this evidence: relying on intuition lacks empirical support, using items from unrelated domains harms validity, and skipping pilot testing and reliability leaves you without essential information about how well the test actually measures and whether scores are stable.