It provides definitions, decision rules, edge cases, examples, and an escalation process for ambiguity. Pilot rounds and disagreement analysis reveal where the guideline needs revision.
An annotation guideline defines how labelers should interpret examples and apply labels consistently.
It provides definitions, decision rules, edge cases, examples, and an escalation process for ambiguity. Pilot rounds and disagreement analysis reveal where the guideline needs revision.