A system may remove redundancy, select relevant passages, summarize history, or encode content more compactly. Compression should be evaluated for lost constraints and facts, especially when the omitted material cannot be recovered.
Prompt compression reduces the tokens used by context while trying to preserve information needed for the task.
A system may remove redundancy, select relevant passages, summarize history, or encode content more compactly. Compression should be evaluated for lost constraints and facts, especially when the omitted material cannot be recovered.