Why AI Assistants Never Recommend Your Site — and the 20-Minute llms.txt Fix

A growing share of discovery now happens inside AI assistants. Someone asks for 'a tool that turns podcasts into clips' or 'a good print shop near Columbia' — and an AI answers with specific recommendations. If your site isn't legible to those systems, you're not losing a ranking; you're absent from the conversation entirely.

The uncomfortable part: most websites are built for human eyes and Google's crawler, in that order, and for AI readers not at all. Navigation lives in JavaScript, the value proposition lives in a hero image, and the pricing is a screenshot. An AI system reading that page learns almost nothing it can confidently repeat.

What llms.txt actually is

llms.txt is a plain-text file at your site's root — the same idea as robots.txt, but instead of telling crawlers what they may read, it tells AI systems what your site is. A heading with your name. A paragraph, in plain language, saying what you offer and for whom. A short list of your most important pages with one-line descriptions. That's the whole format.

It works because it removes inference. Instead of an AI guessing your purpose from a marketing headline, you state it in the exact shape language models consume best: clear, factual, structured text.

The 20-minute version

Write it like you'd brief a new employee. First line: your site's name as a heading. Then one paragraph: what you do, who it's for, what makes it different — no slogans, no adjectives doing heavy lifting. Then a bulleted list: your five to ten most important pages, each with a one-sentence description of what a visitor finds there. Save it as llms.txt, upload it to your site root, done.

Two rules keep it useful. Be factual — an AI repeating your hype to a user erodes trust in both of you. And keep it current — a stale llms.txt describing products you no longer sell is worse than none.

While you're at it: the supporting cast

llms.txt works best alongside the structure AI readers already use. Structured data (JSON-LD) tells machines what type of thing each page is. Clear heading hierarchies make your pages skimmable to a parser. Real meta descriptions give summarizers something accurate to summarize. None of this is exotic — it's the same hygiene good SEO wanted, now with a second audience reading it.

How to check where you stand

We built a free scanner that grades exactly this: whether your site has llms.txt, structured data, readable headings, and the content depth AI systems cite — alongside the classic discovery basics. It reads up to eight pages and names every factor it scores: virafold.ai/tools/website-score. Twenty seconds, no signup.

Search engines took a decade to become the front door of the internet. AI assistants are doing it faster, and almost nobody has furnished their site for the new visitor. A text file and twenty minutes puts you ahead of most of the web — that ratio of effort to advantage doesn't appear often.