Retrieval-Augmented Generation (RAG) / Retrieval Quality/Latency

Kind: tension

Record: tension:retrieval-augmented-generation-rag-retrieval-quality-latency

Canonical: Schema

"retrieval-augmented-generation" (correctness-core layer) is traded against "Retrieval Quality/Latency" (performance-core layer) — a principle cannot be scope-separated from a quality, metric, or cost it competes with; resolve by measuring "Retrieval Quality/Latency" and choosing an explicit operating point.

Listed in Tensions, after Model Inference / Latency/Cost and before Vector Search / Explainability/Recall.

In tension with

• Retrieval-Augmented Generation (RAG)
• Retrieval Quality/Latency

Mechanism

• irreducible-tradeoff

Linked from

• Model Architecture
• Resolution mechanisms