• Fake citations

The fabricated citation: AI's most detectable and most expensive error

Ask a language model for a source and it will give you one. It will have a plausible author, a plausible journal, a plausible year, a plausible DOI. And it will not exist. This is the most reliably detectable AI error there is — because unlike a wrong fact, a fake citation can be checked in ten seconds by anyone — and it is the one that has ended real careers, not just real essays.

5 min readAI and learning

Why a citation is the easiest thing to fabricate

A reference is an extremely learnable *pattern*: author surname, initial, year, title-shaped noun phrase, journal-shaped noun phrase, volume, pages. A model that has seen millions of them can generate a flawless one without any of the components corresponding to anything real. It is not lying — it is completing a pattern, and a citation is nearly pure pattern.

Which is why the fabrication is so *convincing* and so *fragile* at the same time. It looks perfect and it dissolves the instant someone searches for it.

The consequences are not hypothetical

Practising lawyers have been sanctioned for filing briefs citing cases that did not exist. Students are failed for it routinely — and it is the *easiest* form of misconduct to prove, because there is no ambiguity and no argument to have. The citation exists or it does not.

In law especially this is not a subject where you can be relaxed about it. A fabricated authority is the single most serious and most detectable error available to you.

How to not do this

  1. Never cite a source you have not personally opened. Not the abstract. The source.
  2. Check every DOI resolves. Ten seconds each, and it catches the entire category.
  3. Be suspicious of the perfect source. A reference that supports your argument exactly, that you had never heard of, is precisely what a model produces when it is inventing.
  4. Use a tool that can only cite what you gave it. Thaxas can only point at documents in your space — if the paper isn't in your reading list, there is nothing for it to cite and it says so.

Common questions

Why does AI make up references?

A citation is an almost pure pattern — author, year, title-shaped phrase, journal-shaped phrase — and models complete patterns. It can generate a flawless-looking reference where none of the parts correspond to anything real.

How do I check if an AI citation is real?

Search for it, and check the DOI resolves. Never cite anything you haven't personally opened. A perfect source you'd never heard of that exactly supports your argument is the classic signature.

What happens if I submit a fake citation?

It's the easiest form of misconduct to prove — the source exists or it doesn't. Students are failed for it and practising lawyers have been sanctioned for it.

Try it on your own material

Upload your notes, slides or lecture recordings and get a tutor that answers only from them — and says so when they don't cover it.

$12/month, or $8/month billed yearly · cancel in two clicks