Is llms.txt Actually Needed? What the Evidence Says

llms.txt is an informal file proposed to introduce your site to AI systems; it is not a ratified standard, and according to reported Google statements it is not needed for Google Search’s AI features. Our conclusion: it can be cheap and harmless to add, but we do not present it as a lever for visibility.

What is llms.txt?

llms.txt is a plain-text (Markdown) file placed at the root of your site. The idea: when a large language model tries to understand a site, instead of pages full of menus, ads and scripts it can look at a single file that summarizes what the site contains and which pages matter.

The typical structure is a title, a short summary and lists of links. The file we publish on our own site is built on that logic and can be read at /llms.txt. A sample skeleton:

# Company Name

> One-paragraph summary of what the company does.

## Services

- [Service A](https://yourdomain.com/service-a/)
- [Service B](https://yourdomain.com/service-b/)

## Resources

- [Frequently asked questions](https://yourdomain.com/faq/)

Who proposed it, and what is its status?

The proposal was first published by Jeremy Howard on 3 September 2024. The proposal at llmstxt.org is informal: not a specification approved by a standards body but a community proposal, and mostly adopted in the context of software documentation.

What did Google say?

As reported by Search Engine Roundtable, Google’s John Mueller said that no AI system uses llms.txt and that Google Search does not need it for AI Overviews or AI Mode. This statement rests on press reporting, and we pass it on as a reported view.

It is consistent with Google’s own documentation: Google writes that appearing in AI features has no additional technical requirement and needs no special "AI text file" or schema.

A distinction

What Google said concerns Google products. We found no provider-published documentation on whether other engines read llms.txt, so we do not say "none read it" or "all read it". The only clearly reported statement is the Google one above.

Source: llmstxt.org ↗; Search Engine Roundtable: Google and llms.txt ↗; Google Search Central: AI features ↗

What do we do?

We publish an llms.txt on our own site; the cost is close to zero and it is easy to maintain. But we do not claim it brings us visibility, and we do not offer it to clients as a promise. We suggest the same approach to you: add it if you can, and do not let it delay anything if you cannot.

What matters more

An hour spent on llms.txt makes a much more concrete difference when spent on one of the following:

Letting bots reach the site. robots.txt, CDN and firewall decisions (see the guide on AI crawlers and robots.txt).
Being indexed and snippet-eligible. This is the only documented requirement for Google’s AI features.
Clear, sourced content that answers the question directly. Microsoft Advertising likewise recommends a question followed by a short direct answer, lists and tables, not hiding key answers in tabs or accordions, and not leaving information only in PDFs or images.
Structured data that matches visible text. Google requires markup to match page content.
Being mentioned on third-party sources. Engines also lean on sources outside your site; see which sites AI answers cite.

Decision guide

If you run developer documentation or product manuals: adding it makes sense, since that is where the proposal has been adopted most.
If you are a service, ecommerce or content site: it is optional; finish the five items above first.
If an agency promises "AI rankings through llms.txt": there is no engine documentation behind that promise; ask for the evidence.

The last point is our own assessment; it appears in no provider’s documentation.