llms.txt: does my website need one?

llms.txt is a small Markdown file that gives AI assistants a summary of your website and a list of its most important pages. This guide shows what goes into the file, how to create one and what Google says about it.

Start Your Project
llms.txt file connected to AI assistants and a search engine

In short

An llms.txt sits at the root of a website and points AI tools to the pages that explain the business most clearly. Google Search ignores the file, so it neither helps nor harms rankings.1 For most company websites it is a small, optional addition that some AI tools and agents can read.

A reading guide for AI tools

The idea comes from Jeremy Howard of Answer.AI, who published the proposal on llmstxt.org in September 2024.2 A website is built for people: menus, banners, scripts and cookie notices sit around the actual content. An AI assistant that answers a question works better with a short, clean summary. llms.txt offers exactly that: one plain text file at yourdomain.ch/llms.txt that names the company, says in a few lines what it does and links to the pages worth reading.

The file uses plain Markdown

The format is deliberately simple. Only the first line is required: an H1 with the name of the company or website. Next comes a short summary as a quote block, then optional paragraphs with more detail. Below that, H2 sections hold lists of links, each with a short note on what the page covers. A section called «Optional» collects pages an AI tool can skip when it needs a shorter version.3

# Muster AG
> Muster AG develops WordPress websites and online shops for companies in Switzerland, in German and English.

## Services
- [Website development](https://muster.ch/en/websites/): templates, languages, launch
- [Maintenance](https://muster.ch/en/maintenance/): updates with checked backups

## Optional
- [Company history](https://muster.ch/en/about/)

How to create llms.txt in four steps

1

Choose the pages

Pick what a new customer should read first: services, prices or quotes, references and contact.

2

Write the summary

Two or three sentences about what the company offers and for whom.

3

Create and upload

Put both into a text file in the format above and upload it to the root folder of the website.

4

Check and update

Open yourdomain.ch/llms.txt in the browser, and update the file whenever an important page moves or a new service starts.

On WordPress, Yoast SEO can generate the file automatically and refreshes it every week; if you prefer to choose the pages yourself, write the file by hand and switch the automatic version off.4

llms.txt vs robots.txt: two different jobs

Both files sit side by side in the same root folder, and each has its own job.

robots.txt

  • Sets the rules for crawlers
  • Says which bots may visit which parts of the site
  • Controls AI crawlers such as OpenAI’s GPTBot5
  • Read by search engines and AI crawlers

llms.txt

  • A reading guide for AI tools
  • Gives no instructions; every page stays as accessible as before
  • Points to the pages that explain the business
  • Read by some AI tools and agents; Google Search ignores it

An llms.txt only repeats content that is already public on the website, so it raises no new questions under the FADP; customer data and internal documents stay out of it.6

What Google says about it

Google is clear on this point. Its guide to generative AI features in Search, last updated in July 2026, says that Google Search ignores llms.txt and that a file will neither harm nor help visibility or rankings.7 AI Overviews and AI Mode draw on the same index as classic search, so the work that counts there is familiar: clear pages that answer questions directly, structured data and consistent company facts.8 Our SEO services cover exactly that for Google and AI assistants.

When the file is worth the effort

llms.txt takes little time to set up and is easy to maintain. It is most useful for websites with a lot of structured content: product catalogues, documentation, several languages or many service pages. For Wooden Tec, a relaunched catalogue in four languages, we rewrote the llms.txt for launch day so that it matched the new page structure; the Wooden Tec case study shows the full project. At RankExperts we treat the file as part of a site’s housekeeping: whenever pages change, the llms.txt is updated in the same step. ScaleAble, our brand for WordPress development, places the file on the server and keeps it in line with the site’s plugins.


Sources

  1. Google (2026): Optimizing your website for generative AI features on Google Search. Google Search Central guide, last updated 10 July 2026. https://developers.google.com/search/docs/fundamentals/ai-optimization-guide. Accessed 18 November 2026. ↩︎
  2. Jeremy Howard (2024): The /llms.txt file, v2. Proposal on llmstxt.org, published 3 September 2024, last modified 10 August 2026. https://llmstxt.org/. Accessed 18 November 2026. Answer.AI (2024): /llms.txt—a proposal to provide information to help LLMs use websites. Blog post by Jeremy Howard, 3 September 2024. https://www.answer.ai/posts/2024-09-03-llmstxt.html. Accessed 18 November 2026. ↩︎
  3. Jeremy Howard (2024): The /llms.txt file, v2. Proposal on llmstxt.org, published 3 September 2024, last modified 10 August 2026. Section «Format». https://llmstxt.org/. Accessed 18 November 2026. ↩︎
  4. Yoast (n.d.): Yoast SEO: llms.txt – functional specification. Developer documentation, no publication date. https://developer.yoast.com/features/llms-txt/functional-specification. Accessed 18 November 2026. ↩︎
  5. OpenAI (n.d.): Overview of OpenAI Crawlers. Developer documentation, no publication date. https://developers.openai.com/api/docs/bots. Accessed 18 November 2026. ↩︎
  6. Swiss Confederation (2020): Federal Act on Data Protection (Data Protection Act, FADP), SR 235.1, Art. 5 let. a and Art. 6 para. 3. Statute, unofficial English translation, status as of 1 September 2023. https://www.fedlex.admin.ch/eli/cc/2022/491/en. Accessed 18 November 2026. ↩︎
  7. Google (2026): Optimizing your website for generative AI features on Google Search. Google Search Central guide, last updated 10 July 2026. https://developers.google.com/search/docs/fundamentals/ai-optimization-guide. Accessed 18 November 2026. ↩︎
  8. Google (2026): Optimizing your website for generative AI features on Google Search. Google Search Central guide, last updated 10 July 2026. https://developers.google.com/search/docs/fundamentals/ai-optimization-guide. Accessed 18 November 2026. ↩︎

Next step

Ready for AI search

We look at how search engines and AI assistants read your website today and set up llms.txt, structured data and clear page structures where they help. That makes your content easier for AI assistants to read.

Frequently asked questions about llms.txt

How do I make an llms.txt file?

Open a plain text editor and start with a line beginning with # followed by your company name. Add a one- or two-sentence summary as a line starting with >, then H2 headings with lists of links to your key pages, each with a short note. Save the file as llms.txt, upload it to the root folder of your website and check that it opens in the browser.

Does Google use llms.txt?

Google Search ignores llms.txt. Google’s own guide to generative AI features says the file neither harms nor helps visibility or rankings, and that it is fine to keep one for other services. For AI Overviews and AI Mode, Google relies on its normal search index, so clear pages, structured data and good technical SEO matter more.

What is llms-full.txt?

llms-full.txt is a convention some documentation sites use alongside the original proposal: one long file that contains the full text of all important pages instead of a list of links. It suits software documentation that developers load into AI coding tools. For a typical company website, a short llms.txt with well-chosen links is enough.

Can WordPress create llms.txt automatically?

Yes. Yoast SEO has an llms.txt feature that creates the file in the root folder and refreshes it every week, using recently updated content and the main categories. You can also select the pages manually. If a hand-written llms.txt already exists, Yoast leaves it in place and shows a notice, so you decide which version the site uses.

Can llms.txt block AI crawlers?

No, llms.txt only points AI tools to content; it contains no rules. To keep AI crawlers away from a website or parts of it, add rules for their user agents to robots.txt, for example GPTBot for OpenAI or Google-Extended for Google’s AI models. Both files can sit side by side in the same root folder.

Volodymyr Mykhniuk

Volodymyr Mykhniuk

Articles: 15

Start a project

Tell us about your project

Tell us about your project. We will get back to you personally and look forward to your ideas.

  • A personal reply within one working day
  • One contact person who speaks your language
  • A conversation about goal and scope, then a proposal that fits your project
  • Your details are used only to answer your request
Project Request (EN)

How we use your details is explained in the privacy policy.