Right-Mark Scoring
Most students choose right-mark scoring as it is the only scoring method they know for multiple-choice. They find taking responsibility for reporting what they know, by marking right answers and not marking wrong answers, readily acceptable after an intial experience or two with KJS.
Break Out source code, Break Out Plus, and Power Up Plus run in Microsoft and Macintosh Excel with the following six toolbar buttons:
KJS software imports a standard text (.txt) file from a scanner, Word, text editor or by manual entry of student marks onto Sheet 1:
Click Parse to create Sheet 2 where you can also enter student marks manually and edit the data before scoring and rescoring.
Click AnswerFileSave if you have any edits to save and then click Score.
Check for a very low score do to a scanner or other data entry error on Sheet 4:
Check for very difficult questions towards the lower right side of Sheet 3 that may contain errors. Resolve these by accepting them or giving all students the point or dropping the question on Sheet 2. Save the corrections and click Score for corrected results.
Verify that the scores are from independently marked answer sheets on Sheet 6. Only critical wrong, missing, and omit marks are examined. These test results passed the check for independent marking.
Sheet 7 (6a) only prints if the results fail the check for independent marking. If they do, the cause needs to be found. The results from small classes are subject to large sampling errors. This makes Sheet 6 a management tool to compare behavior on more than one test. A classroom policy of (1) a zero on any test that clearly is cheating and (2) that you will assist the student in any challenge of this policy before a disciplinary committee keeps the management of cheating within the classroom. And (3) announce that the test passed the check for independent marking or that one or more failures were detected when reviewing or announcing test results.
The nine digit Student ID can be coded in 3-digit parts for Test Number, Seat Number, and Student Number.
Sheet 5 presents the mark analysis and estimates of the value for judgment needed for Knowledge and Judgment Scoring. It
prints two estimates for the value of student self-judgment based on fitness. Fitness is the average number of options students actually use on the test. This is rarely the design value of four or five options or 25% or 20% for judgment.
As
a rule of thumb, an honest value for judgment is 33% when students are given the choice of traditional, right-mark scoring, and Knowledge and Judgment Scoring on the
same test. If additional reward is desired, it can be set as high as 50%
(knowledge and judgment have equal value).
Click Omit_Value to set the reward for students electing Knowledge and Judgment Scoring rather than right-mark scoring. On this test of high scoring students the estimated value for judgment is between 39% and 52%, on-average.
This value must be consistent with the test instructions, “Mark all items for right-mark scoring or omit (good judgment to not mark wrong answers) for Knowledge and Judgment Scoring with a fixed value of (33%-50%) for good judgment (omits)”, for example.
Power Up Plus contains the above features and benefits as well as an item analysis terminating in a Test Performance Profile (master/easy, unfinished, and discriminating items). Click PUP Item Analysis to continue.
These test results are real. Student names have been changed.
Validity Check: Copy and paste the data in Sheet 1 into your KJS software, sheet 1, cell A1, to check that it delivers the same results or load the answer (.ANS) file in the ZIP file.
28 October 2008