Examples may be written by people, derived from existing tasks, or generated and filtered with models. Diversity and correctness matter because repeated templates can teach superficial response patterns.
An instruction dataset contains requests paired with desired responses or task outcomes for instruction tuning.
Examples may be written by people, derived from existing tasks, or generated and filtered with models. Diversity and correctness matter because repeated templates can teach superficial response patterns.