Periagoge
Concept
3 min readself knowledge

Hallucination Detection and Fact-Checking in Client Proposals

AI sometimes confidently states facts that don't exist—a problem that's especially dangerous in client proposals where inaccuracy damages credibility. Always verify specific claims, statistics, and citations before sending anything out; treat AI output as a draft that needs human fact-checking.

Hypatia
Why It Matters

Hallucination in AI occurs when a language model generates false information with confidence—not admitting uncertainty, but stating invented facts as fact. An AI might cite a statistic that doesn't exist, invent a case study that never happened, or attribute research to a publication that didn't publish it. For freelancers, hallucinations are catastrophic because they destroy client trust and damage your professional reputation.

The core cause is structural: language models are trained to predict the next word based on patterns, not to verify truth. They're excellent at mimicking the structure of a statistic or research finding, but they don't fact-check themselves. A confident-sounding false claim is indistinguishable from a true one to the model.

Where Hallucinations Appear in Proposal Work

Industry statistics: "80% of B2B SaaS companies report challenges with customer retention." This sounds plausible but may be invented.

Case studies or examples: "Companies using this approach see average ROI improvements of 340%." The number might be real, but the generalization is unsupported.

Research citations: "According to McKinsey's 2023 Digital Transformation Report..." The report might not exist or might not contain that claim.

Client-specific claims: "Your competitor, [Competitor Name], recently pivoted to [business model]." This is easily verifiable—and often false.

Detection Strategies

The confidence test: Any statistic, quote, or specific claim should trigger verification. If the AI provides a source, check it. If no source is cited for a specific fact, flag it as suspicious.

Industry knowledge check: Do you personally know if the claim is true? If a statistic falls outside your knowledge, verify it. Use Google, industry reports, or specialized databases (like statista.com for verified statistics).

Competitor research verification: If the proposal mentions a prospect's competitors or market context, manually verify. A 30-second LinkedIn check catches most competitor hallucinations.

Timeline verification: "Recently" can be vague. If the AI claims something happened in 2023, verify the actual year.

The specificity heuristic: Highly specific numbers ("347% improvement," "$2.3M in cost savings") are more likely to be hallucinated than general claims. Question specificity if it's unsourced.

Prevention Best Practices

Instruction clarity: Add explicit instruction to your prompt: "If you use any statistics, cite the source. If you're uncertain about a fact, say 'This requires verification' rather than guessing." Some AIs will explicitly flag uncertain claims if asked.

Fewer invented examples: Instead of asking the AI to generate examples, retrieve real ones from your case study library (using RAG or manual pasting). Real examples eliminate hallucination entirely.

Temperature management: Lower temperatures reduce hallucinations because the AI sticks to more predictable patterns. For proposal work, aim for 0.2–0.4 to minimize invention.

Human review checkpoints: Never send a proposal without human review of any factual claims. This is non-negotiable. It takes 10 minutes and prevents reputational damage.

The Truth About Hallucinations and Vendor Claims

Some AI vendors claim to have "solved" hallucinations. This is overstated. Hallucinations are reduced but not eliminated through various techniques (training methods, retrieval augmentation, constraint-based prompting). The honest truth: language models will always occasionally hallucinate. Your job is detection and prevention, not avoidance.

RAG systems reduce hallucinations by grounding output in your actual documents. But they only reduce the rate; they don't eliminate it. Always verify.

Building a Fact-Check Routine

Create a simple checklist for proposal review:

  • Are any statistics sourced? If not, verify or remove.
  • Are any case studies generic or invented? Replace with real examples.
  • Are competitor or prospect claims verifiable? Spot-check 3 claims.
  • Are projections or ROI estimates supported by reasoning or examples? If unsourced, flag or remove.

This takes 5–10 minutes per proposal and is the difference between client trust and credibility damage.

Try this: Take a proposal the AI generated for you. Highlight every claim that sounds like a statistic, benchmark, or specific example. For each, ask: "Do I know this is true, or did I just assume it sounds right?" Fact-check each flagged claim. Count how many are actually false or unsourced. This exercise builds your hallucination detection muscle and shows why review is critical.

Helpful guides
Hypatia
Daily Life & Decisions
Related Concepts
Peri
Questions about Hallucination Detection and Fact-Checking in Client Proposals?

Peri can explain this concept, give practical examples, help you decide whether it applies to your situation, or recommend a journey if appropriate.

Ready to work on Hallucination Detection and Fact-Checking in Client Proposals?

Explore related journeys or tell Peri what you're working through.