What is llms.txt, and does your business website need one?
llms.txt is a plain Markdown file at yoursite.com/llms.txt that gives AI tools a short summary of a website and links to its most useful pages. It was proposed by Jeremy Howard in September 2024, it is optional, and Google says Google Search ignores it. For a service business it is a small extra, not a strategy; Bujify’s AI visibility work, from $297/month, concentrates on crawler access, listings, reviews and pages assistants can quote.
Updated November 20, 2026 · 4 min read
- Proposed
- September 2024, by Jeremy Howard
- Lives at
- yoursite.com/llms.txt
- Format
- Markdown
- Used by Google Search
- No, Google says it ignores it
What llms.txt is
An llms.txt file is a short, curated table of contents for AI tools, written in Markdown and published at a fixed address on your website.
Jeremy Howard of Answer.AI proposed it on llmstxt.org in September 2024. His argument was that AI agents struggle with cluttered web pages and cannot fit a whole site into the text they read at once, so a site should offer one concise, expert-written entry point instead. He expected the file to be used mainly when an assistant consults a site while helping someone, rather than for training models. A second version of the proposal, published in August 2026, kept the same idea and refined the details.
The name joins LLM, short for large language model, the technology behind ChatGPT, Claude and Gemini, with .txt, the extension for a plain text file that any editor can open.
It sits at the root of your domain, the same place as robots.txt, and anyone can read it. Treat it like any other public page: nothing in it should be private, and nothing in it should contradict your website.
What goes in an llms.txt file
The llms.txt format is deliberately small: one required heading, an optional summary and a few lists of links. Here is how the parts of the llmstxt.org specification map to a local business:
| Part of the file | Example for a business | Required? |
|---|---|---|
| H1 heading with the site’s name | # Your Company | Yes, the only required part |
| Blockquote summary, a line starting with > | > Licensed electrician serving Naples, Bonita Springs and Estero | No |
| Paragraphs explaining how to read the file | Service area, emergency hours, how quotes work | No |
| H2 sections, each a list of [name](url) links with optional notes | ## Services, then one link per service page | No |
| A section titled Optional | Links an agent can skip when space is short, such as the blog | No |
The proposal also suggests offering clean Markdown copies of useful pages at the same address with .md added. Version 2 allows llms.txt files in subfolders, such as /docs/llms.txt, as well as at the root.
What llms.txt is used for, and what it is not
llms.txt is used to point AI agents and tools at the pages that explain a site most clearly, and its clearest support so far comes from tools rather than from search engines.
Yoast SEO, the WordPress plugin, has generated the file automatically since June 2025, including in its free version. Search Engine Journal reports that Google’s Lighthouse auditing tool now has an experimental Agentic Browsing category that checks for an llms.txt file, which Lighthouse treats as an emerging convention for browser-based agents rather than a ranking signal. In July 2025, Search Engine Roundtable reported server logs showing OpenAI fetching llms.txt files on a few sites, though OpenAI made no statement about why.
It helps to be clear about what the file does not do:
- It is not robots.txt. It does not allow or block any crawler; robots.txt still does that job.
- It is not a sitemap. Search engines still discover pages through links and your XML sitemap.
- It is not a ranking factor in Google Search.
- It is not a way to dictate what an assistant says about you. Assistants weigh what other sites say, too.
llms.txt for SEO: what Google says
Google’s position is the clearest of any search company: an llms.txt file neither helps nor hurts your visibility in Google Search.
In its Search Central guide to optimizing for generative AI features, Google says you do not need new machine-readable files, AI text files, markup or Markdown to appear in AI Overviews or AI Mode, and lists llms.txt among the myths. The same guide says it is completely fine to create one for other services, because Google Search simply ignores it. Earlier, Gary Illyes of Google said at a 2025 Search Central Live event that Google does not support llms.txt and has no plans to, and he later compared it to the keywords meta tag of the 1990s.
OpenAI publishes an llms.txt for its own developer documentation, but its crawler documentation tells site owners to use robots.txt, not llms.txt, to control how ChatGPT search treats their pages.
The practical reading for a business owner: an hour spent on llms.txt is an hour not spent on indexable pages, a complete Business Profile and genuine reviews, which are what Google’s guide actually points to.
Do I need llms.txt?
Most local service businesses do not need llms.txt, and adding one does no harm.
Whether it is worth your time depends on what else is unfinished:
- Worth adding if your site is large, with many services, locations or help articles, and you want AI agents to find the key pages quickly.
- Worth switching on if your platform does it for you, as Yoast SEO does on WordPress. Then read what it produced.
- Not a priority if OAI-SearchBot is blocked, your Business Profile is incomplete or your reviews are thin. Those cost you real customers; llms.txt is a maybe.
- Not a fix for a site that hides its services, prices and areas inside images or vague copy. Rewrite the pages first.
If you add one, keep it honest and current: your business name, a one-line summary with services and service area, links to each service page, pricing, contact details and a few key answers. An out-of-date llms.txt is worse than none.
llms.txt generators and llms-full.txt
An llms.txt generator is a tool that crawls your site and writes the file for you. It saves typing, but check the output: generators often list every page, while the whole point of the format is a short list chosen by someone who knows the business.
llms-full.txt is a related convention, not part of the core llmstxt.org proposal, in which a site puts the full text of its key pages into a single file. It suits large documentation sites far more than a ten-page business website, and Google’s guidance applies to it in the same way: Google Search does not use it.
If you write the file by hand, a business site’s version can be 20 to 40 lines. Save it as plain text, upload it to the root of your site, open yoursite.com/llms.txt in a browser to check it loads, and update it whenever you add or drop a service.
Common questions
Straight answers. If yours is not here, ask us on a call.
Is llms.txt worth it?
For most small business websites it is a nice-to-have. It takes under an hour, does no harm, and may help some AI tools, but Google Search ignores it and it will not fix weak pages, missing listings or a blocked crawler.
What is llms.txt used for?
It gives AI agents and assistants a short summary of a website and a curated list of its most useful pages, so they can understand the site without wading through menus, scripts and pop-ups.
What is llms.txt in SEO?
In SEO it is an optional file some sites add for AI tools. Google says it is not used in Google Search and will not help or hurt rankings or AI Overviews, so it sits outside the core SEO work.
What is a txt file?
A .txt file is plain text with no formatting, readable in any editor or browser. llms.txt uses that extension but follows Markdown conventions, such as # for headings and [name](url) for links.
What is llms-full.txt?
It is a companion convention where a site publishes the full text of its important pages in one file. It is not part of the core llms.txt proposal and is rarely needed by a small business site.
What does help with AI visibility cost?
An llms.txt file is a small job any web developer can do. Bujify’s AI visibility programs, which cover crawler access, listings, reviews and pages built to be quoted, start at $297/month, month to month.
Related
Find out what Google and AI say about you.
A 30-minute call. We show you where you rank on Google, what ChatGPT and Gemini say when customers ask about your trade, and what we would fix first. No pitch deck, no contract.
- Your map rankings across your service area
- What 5 AI assistants say about you and your competitors
- A written list of the first fixes, yours to keep
