Why it matters
It is a proposal, not a standard that all AI services follow. A short, accurate file costs little and gives assistants a clear summary of your best pages.
Example
# Example Site
> One-line description
- [Guide](https://example.com/guide/): what it coversWhere you will see it
The free llms.txt checker and generator looks at this on a live page and explains what it finds in plain English: validate an existing llms.txt, or generate a draft from the home page.
Related terms
- AI crawler: A crawler operated by an AI company, such as GPTBot (OpenAI) or ClaudeBot (Anthropic), that fetches pages for model training or AI search.
- robots.txt: A plain-text file at the root of a site that tells crawlers which paths they may crawl.
- XML sitemap: A file that lists the URLs you want search engines to know about, optionally with last-modified dates.
Go deeper
- llms.txt explained: What the llms.txt file is, what it looks like, who reads it, how it differs from robots.txt and sitemaps, and how to create and check one.