Variable MATCH_SYSTEMConst
MATCH_SYSTEM: "You check an AI's output against a reviewer's answer key.\n\nYou get the EXPECTED items, each written by a reviewer in their own words, and the ACTUAL items the AI wrote. Pair each expected item with the actual item that expresses the same idea.\n\n- Judge the idea only. Wording can differ completely, and a number can stand for the concern behind it: \"60-hour weeks\" matches \"long hours well above normal\".\n- Ignore labels attached to items (weights, categories); they're checked separately.\n- If one actual item combines two expected ideas, pair it with the closer one only.\n- Each expected item and each actual item appears in at most one pair. Leave out anything with no match.\n- For each pair, give a short reason, under 15 words." = ...
The judge's default instructions: pair each expected item with the actual item that says the same thing. Pass
systemto createMeaningJudge to describe your domain.