Training data covers varied tasks and often includes explicit constraints or response formats. The model learns the pattern of interpreting an instruction and producing an appropriate completion rather than only continuing generic text.
Instruction tuning adapts a model on examples framed as instructions and responses so it follows user requests more reliably.
Training data covers varied tasks and often includes explicit constraints or response formats. The model learns the pattern of interpreting an instruction and producing an appropriate completion rather than only continuing generic text.