Every week someone posts about AI hallucination like it's a mystery. It's not. A 2025 Frontiers in AI study measured it: vague, multi-objective prompts hallucinate 38.3% of the time. Structured, single-focus prompts? 18.1%. That's a 20-point accuracy gap from how you write the prompt — not which model you pick.
Everyone's debating GPT vs. Claude vs. Gemini. Nobody's talking about the fact that prompt structure matters more than model selection for most use cases.
The $0 Fix Nobody Uses
Research from SQ Magazine breaks it down further: zero-shot prompts (no examples, no structure) hallucinate at 34.5%. Add a few examples and that drops to 27.2%. Add explicit instructions: 24.6%. Simply adding "If you're not sure, say so" cuts hallucination by another 15%.
That last one is worth repeating. One sentence — "If you're not confident, say you don't know" — is worth more than upgrading your model tier. And it costs nothing.
Why Multi-Task Prompts Are the Worst Offender
"Summarize this doc, extract the key risks, and draft a response email" feels like one task. It's three. And each additional objective gives the model more room to fabricate connections between things that don't connect.
Language models are next-token predictors. Single task = narrow probability distribution = the model knows where it's headed. Three tasks stacked together = triple the surface area for error. A small fabrication in the summary becomes a stated fact in the risk analysis becomes a confident assertion in the draft email.
Longer, multi-part prompts increase error rates by roughly 10%. In legal contexts, hallucination rates run between 58% and 88%. That's not an AI problem. That's a prompting problem.
What Actually Works (With Numbers)
One prompt, one job. Summarize the doc. Stop. Review it. Then extract risks from the verified summary. Then draft the email from verified risks. Three prompts, each building on confirmed output.
Constrain the output. JSON, numbered lists, specific templates. Structured prompts cut medical AI hallucinations by 33%. The less room to improvise, the less it fabricates.
Give examples. Zero-shot to few-shot: 34.5% → 27.2%. Two examples costs you 30 seconds and buys a 7-point accuracy gain.
Set refusal conditions. "If confidence is below 70% or no evidence supports the claim, say 'insufficient data.'" You're not weakening the model. You're giving it a pressure valve so it doesn't fill gaps with fiction.
The Model Isn't the Bottleneck
The best models went from 21.8% hallucination in 2021 to 0.7% in 2025 on benchmarks. But benchmarks test clean, single-objective tasks. Real-world, multi-step workflows — the kind actual professionals run — depend more on how you ask than what you ask.
You wouldn't hand a contractor one work order that says "remodel the kitchen, fix the plumbing, and repaint the exterior." You'd scope each job, inspect the work, then move on.
The people getting the best results from AI already know this. Everyone else is blaming the model.
![Defluffer - reduce token usage 📉 by 45% using this one simple trick! [Earthday challenge]](https://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fiekbgepcutl4jse0sfs0.png)
