1. Home
  2. Glossary
  3. llms.txt
SEO

llms.txt

A proposed plain-text Markdown file at /llms.txt that gives AI assistants a short, curated guide to a site's most useful pages. It is a proposal, not an established standard, and publishers decide for themselves whether it is worth adding.

Why it matters

It is a proposal, not a standard that all AI services follow. A short, accurate file costs little and gives assistants a clear summary of your best pages.

Example

# Example Site
> One-line description

- [Guide](https://example.com/guide/): what it covers

Where you will see it

The free llms.txt checker and generator looks at this on a live page and explains what it finds in plain English: validate an existing llms.txt, or generate a draft from the home page.

Related terms

  • AI crawler: A crawler operated by an AI company, such as GPTBot (OpenAI) or ClaudeBot (Anthropic), that fetches pages for model training or AI search.
  • robots.txt: A plain-text file at the root of a site that tells crawlers which paths they may crawl.
  • XML sitemap: A file that lists the URLs you want search engines to know about, optionally with last-modified dates.

Go deeper

  • llms.txt explained: What the llms.txt file is, what it looks like, who reads it, how it differs from robots.txt and sitemaps, and how to create and check one.

← All 66 glossary terms

↑ ↓ to moveEnter to openEsc to closeAll results