A retrieval-augmented architecture integrates a retrieval component directly into the model (not just at prompting time), letting the model attend over retrieved passages during generation. Examples include RETRO and REALM, where a differentiable retriever is trained jointly with the language model, allowing the architecture to offload factual knowledge to an external corpus.