Your AI Writes From Twenty Sources. It Cannot Tell Which One Is Wrong.

Nate B Jones argues that hallucination control starts with source organization, not sharper prompts.

Nate B Jones argues for a workflow shift: hallucinations are not solved mainly by telling the model to be careful, but by giving the agent a cleaner working environment. He opens with Sullivan & Cromwell having to apologize after a legal filing included fabricated or mis-cited authorities. The document looked professional, yet the underlying source structure failed.

The core idea

Before asking an AI to write, code, or synthesize, ask it to build a bounded project room. The agent should find relevant materials, preserve originals, inventory the source set, and explain which files appear authoritative, stale, duplicated, limited, or missing.

Useful artifacts

Why it matters

Once the project room is reviewed, the final prompt can be shorter and safer. It can tell the agent which source controls the numbers, which transcript explains context, and which older deck is background only. The result is not guaranteed perfection, but it makes the work inspectable and moves the AI from “gopher” to collaborator.

Takeaway

This workflow is overkill for casual chatbot use. It is aimed at serious knowledge work: legal, strategic, analytical, coding, and long-form project work. Nate’s claim is that newer agents such as ChatGPT 5.5 and Claude Opus 4.7 are now strong enough at file-system work, metadata inspection, and long-running organization tasks to make this practical.

Source