Recently, Ainslie Nibert, Associate Dean and Associate Professor for Texas Woman's University College of Nursing, discussed how to create better assessments by writing better questions with ExamSoft's blueprinting and item analysis capabilities.
The key takeaways from the presentation include:
Critical thinking test items contain rationales, are written at the application level or above, require multi-logical thinking to answer, and ask for high levels of discrimination.
Using a test blueprint as your create an assessment is essential to ensure that items reflect your intended objectives.
An effective 3-step method for item analysis includes review of difficulty level, discrimination data (Item Discrimination Ratio and Point Biserial Correlation Coefficient), and effectiveness of alternatives (response frequencies).
This webinar assists with creating critical-thinking test items for all of your exams. You’ll obtain valuable student response data from these new questions that can guide future editing, and help you obtain the greatest benefit from your authoring efforts. By performing a systematic item analysis after each exam, you can pinpoint students’ knowledge gaps, which will help you focus your item writing on those course objectives that are globally misunderstood or ignored. In addition to reviewing item writing techniques, we’ll also cover the advantages of using electronic test blueprints to establish test validity and tie your assessments to your overall program objectives.
“As long as you've got sound knowledge about item writing, good blueprinting capability, and testing software to preform item statistics for you, you are going to be very successful as an item writer."