Technical
What is llms.txt, and do you need one?
By the CiteCheck team · Updated
Short answer
llms.txt is a proposed standard: a Markdown file at /llms.txt that gives AI agents a short, curated guide to a website with links to the most useful pages. It's most used for software documentation. Google says it isn't needed to appear in AI Overviews or AI Mode, so treat it as a cheap extra for agents, not a ranking factor.
The format in one minute
According to the proposal at llmstxt.org, an llms.txt file is Markdown at the root of your site (or at any sub-path, covering the pages under it). In order, it contains:
- An H1 with the site or project name. This is the only required part.
- A blockquote with a short summary.
- Optional paragraphs or lists with more detail. No headings.
- Optional H2 sections containing "file lists":
- [Title](url): notes. - A section called "Optional", by convention, for links an agent can skip.
Example for a local business:
# Northside Plumbing
> Licensed plumbing company serving Toronto and the GTA since 2009. 24/7 emergency service, upfront flat-rate pricing.
- Service area: Toronto, North York, Scarborough, Etobicoke
- Phone: (416) 555-0100 (24/7)
## Services
- [Emergency plumbing](https://example.com/emergency): 24/7, typical arrival 60–90 minutes
- [Water heater replacement](https://example.com/water-heaters): tank and tankless, prices from $1,600 installed
## Optional
- [About us](https://example.com/about)
Version 2 of the proposal also suggests serving a Markdown version of each page at the same URL plus .md, and linking it with rel="alternate" type="text/markdown".
Who actually uses it
The v2 proposal says thousands of sites publish an llms.txt file, that documentation platforms generate one automatically, and that Chrome's Lighthouse checks for one in its agentic browsing audits. It also says OpenAI, Anthropic and Google publish llms.txt files for their own developer docs. Its main use is software documentation, where coding agents follow it to find API references.
What Google says
Google's AI features documentation is direct: "You don't need to create new machine readable files, AI text files, or markup to appear in these features" (Google Search Central). An llms.txt file won't get you into AI Overviews or AI Mode.
Should a business website add one?
| Situation | Worth it? |
|---|---|
| Developer docs, APIs, SaaS with docs | Yes. This is the main use case. |
| Business with clear services, prices and policies | Low cost, low risk. Can help agents that look for it. |
| Hoping to rank higher in ChatGPT or Google | No. No engine has documented it as a ranking factor. |
If you add one, keep it accurate and short, and update it when your prices or services change. An outdated llms.txt is worse than none.
Generate yours
Use the free llms.txt generator. Fill in your name, summary and key pages, and it outputs a spec-compliant file you can upload to your site root. This site publishes its own at /llms.txt, with the full text of its guides in /llms-full.txt.
See what AI says about your business
Free check: are you mentioned, who's named instead, which sources are cited, and what to fix.
Run a free AI visibility checkFrequently asked questions
- Who created llms.txt?
- Jeremy Howard proposed it in September 2024. Version 2 of the proposal was published on llmstxt.org in August 2026.
- Does Google use llms.txt?
- Google's AI features documentation says you don't need to create new machine-readable files or AI text files to appear in AI Overviews or AI Mode.
- What's the difference between llms.txt and robots.txt?
- robots.txt tells crawlers what they may access. llms.txt tells an agent what is on your site and where the most useful information is. One controls access, the other gives guidance.
- What is llms-full.txt?
- A common convention, not part of the core spec: a single file containing the full text of your key pages, so an agent can load everything at once.
Sources
More guides
Technical
AI crawlers list: GPTBot, OAI-SearchBot, PerplexityBot and more
Every major AI crawler and user agent, what each one is used for, which ones affect AI search visibility, and copy-paste robots.txt rules.
Optimize
Google AI Overviews vs SEO: what changes and what doesn't
What Google says about ranking in AI Overviews and AI Mode, what Pew's click data shows, and how to adjust an SEO plan without chasing myths.
Compare
AI visibility tools compared: Otterly, Peec, Profound, Semrush
Honest comparison of AI visibility trackers OtterlyAI, Peec AI, Profound and Semrush: published prices, prompt limits and engines, checked Nov 2026.