top of page

How to catch made-up facts in AI answers before they cost you

Writer: Adrian Bueno
Adrian Bueno
Nov 4
3 min read

Updated: Nov 13

Photo by Shubham Dhage


You ask an AI tool to help with a proposal. It gives you a neat paragraph with a market figure, the name of a regulation and a line about what competitors are doing. It reads well and it sounds sure of itself, so you paste it in. Most of the time that is fine. Occasionally one of those details was never real, and you only find out when a client asks where it came from.


You don't need technical knowledge to guard against this. You need a few quick checks and the habit of running them on the right parts of the answer.


Why a confident answer can still be wrong

Tools like ChatGPT or Copilot are built to produce text that sounds like a good answer. They are not looking facts up in a reliable database and checking them. When the tool doesn't have the detail, it can fill the gap with something that fits the pattern, such as a plausible percentage, a believable report title or a law with a sensible-sounding name.


Some tools can now search the web and show links, which helps. But they can still misread a page or attach a claim to the wrong source. Fluent writing tells you nothing about whether the content has been checked.


Check the claims that can hurt you, not every word

You don't need to fact-check the whole answer. Wording, structure and tone are low risk, because if a sentence is clumsy you can see it.


The risk sits in specifics: numbers, dates, names of people and companies, legal or tax statements, quotes, and anything described as a study or a report. Read through the answer once and mark each of those. That is your checking list, and it is usually short.


Three checks that take a few minutes

First, ask the tool for its source, then open the source yourself. Don't accept the tool's description of what the page says. If the link doesn't work, or the page says something different, treat the claim as unproven.

Second, search for the claim in your own words, outside the AI tool. If a figure is real, you should be able to find it on a reputable site. If you can only find it repeated in AI-generated content, that proves little.


Third, ask the same question again in a fresh chat, worded differently. If the figure or the name changes from one answer to the next, the tool is guessing. Real facts tend to stay put, though a consistent answer is still not proof, so this check does not replace the first two.


Be stricter with anything Irish

Much of what these tools have learned comes from larger markets, mainly the US and the UK. Ask about VAT, employment rules, supports for small businesses or data protection, and you can get an answer that is true elsewhere but not here, or one that blends several countries together.


Rules and rates also change, and a tool may be repeating something that was true some time ago. For anything Irish and official, go to the source: gov.ie, Revenue's own site, or the relevant agency or professional body. If money or compliance depends on the answer, ask your accountant or solicitor. The AI answer is just a way to know what to ask them.

Treat sources and quotes as suspect until you find them

A particular weakness is the invented reference: a study with a believable title, a quote attributed to a named expert, a link that looks right and goes nowhere. These look like evidence, which is why they slip through.


A simple rule works well here. If you can't find the original in a couple of minutes, don't use it. Either remove the claim or rewrite it in general terms, such as saying that many businesses find something to be the case, rather than quoting a statistic you can't back up.


A habit that holds up across a team

Decide where AI is welcome and where it needs a second look. First drafts, tidying your own notes, summarising a document you've supplied and suggesting a structure are all reasonable uses. Facts going to a client or a customer need a person to confirm them.


If several people use these tools, make one person responsible for checking anything factual before it goes out. Keep a short note of where each key figure came from. That way, when a client asks, you can answer in ten seconds, and it also shows quickly which claims were never sourced at all.


If you want help turning AI tools into research and reporting you can rely on, Fast Mercury Marketing in County Kildare is happy to talk it through.

Comments


bottom of page