What Is llms.txt?
llms.txt is a proposed standard file — like robots.txt but for AI crawlers — that tells AI systems who you are, what you offer, and where your key pages live.
Definition
llms.txt is a proposed convention: a Markdown file placed at /llms.txt on your domain that gives AI crawlers and language models a clean, structured briefing about your site — who you are, what you offer, and which pages matter. Think of it as robots.txt's friendlier cousin: robots.txt says where crawlers may go; llms.txt tells them what they are looking at.
Why it matters
AI engines increasingly fetch live web content when forming answers. A clear, machine-readable briefing removes ambiguity about your brand and services — and it costs fifteen minutes. Honest framing: llms.txt is a proposed standard, its direct impact on AI answers is still being studied, and it is a low-cost signal rather than a ranking guarantee. Ours is at llmvisibilitycheck.com/llms.txt because we hold ourselves to the same checklist we recommend.
What to do about it
- Create /llms.txt: a short Markdown brief — company, offering, key pages, contact.
- Optionally add /llms-full.txt with the detailed version (products, pricing, differentiators).
- Keep it updated quarterly as your pages and offers evolve.
- Pair it with AI-crawler-friendly robots.txt rules (explicit Allow for GPTBot, ClaudeBot, PerplexityBot).
Frequently asked questions
Is llms.txt an official standard?
It is a proposed community convention, not an official standard like robots.txt. Several AI companies have acknowledged or adopted it, and adoption is growing — cheap insurance either way.
Does llms.txt replace a sitemap?
No. sitemap.xml lists URLs for crawlers; llms.txt explains meaning for language models. Use both.
Measure it, don't guess it.
Run a free LLM visibility check — see how AI answer engines treat your brand today, in about a minute.
Run Free Check →Related terms: GEO · AI Overviews · AEO · LLM Visibility · All terms