Lab ยท LLM caching
Type a paraphrase of a stored prompt. Above the similarity threshold you would reuse a cached answer instead of calling the model.