News generation on subscription · newsrooms, blogs and companies

llms.txt generator

Enter your site's address and we'll read its sitemap and up to 30 pages, then draft an llms.txt file in the llmstxt.org format: your site's name, a one-line summary and links grouped by section. Edit it here, then copy or download it. It's free and needs no sign-up.

We fetch your home page, robots.txt, sitemap and up to 30 public pages, once, and don't store the results.

Is an llms.txt file worth it?

  • It's optional

    llms.txt is a proposal from 2024 for giving AI tools a curated summary of a site. No major AI company has said its crawlers rely on it, and having one doesn't make ChatGPT, Claude or Google cite you.

  • It's cheap to have

    It's a single text file. Some AI coding tools and agents do read it when someone points them at a site, and writing it makes you decide which pages best explain what you do.

  • Other things come first

    Whether AI search can cite you depends on crawlers being allowed in robots.txt, your firewall not blocking them, your text being in the HTML and your pages having structured data.

Open the AI crawler checker

What an llms.txt file looks like

The format proposed at llmstxt.org is plain Markdown: a heading with the site's name, a short summary in a quote block, then sections of links, each with an optional note on what the page covers.

# Example News

> Local news and analysis for the Example Valley, updated daily.

## Guides

- [How we cover elections](https://example.com/guides/elections): our sources, corrections policy and timeline.

## Pages

- [About us](https://example.com/about): who runs the site and how to reach the newsroom.

How the generator builds the draft

  • Name and summary from your home page

    The site name comes from your og:site_name tag or the home page title, and the summary from its meta description. If there's no description, the draft leaves a placeholder for you to fill in.

  • Pages from your sitemap

    We find your sitemap through robots.txt or at /sitemap.xml and pick up to 30 pages, one section at a time so the draft covers the whole site and not just the latest posts. Without a sitemap, we use the links on your home page.

  • Titles and descriptions from each page

    Each link uses the page's title, without the site name, and its meta description. Pages marked noindex, tag and author archives, files and other language versions are left out.

  • Sections from your URLs

    Pages are grouped by the first part of their address, so /blog/ pages land under “Blog” and /docs/ under “Docs”. Pages that don't share a section go under “Pages”.

Frequently asked questions

Common questions

How do I create an llms.txt file?

Enter your site above to get a draft built from your sitemap, edit it, then save it as a plain text file named llms.txt at the root of your site, so it opens at yoursite.com/llms.txt.

Do I need an llms.txt file?

It's optional. llms.txt is an emerging convention for giving AI tools a summary of your site, but no major AI company has said its crawlers rely on it. robots.txt, readable HTML and structured data matter more.

Where do I put llms.txt?

At the root of your domain, next to robots.txt: https://yoursite.com/llms.txt. On WordPress, upload it to the folder where wp-config.php is, or use a plugin that serves the file.

What's the difference between llms.txt and robots.txt?

robots.txt tells crawlers what they're allowed to fetch, and the major crawlers follow it. llms.txt is a reading list: it suggests which pages explain your site, and it doesn't allow or block anything.

What is llms-full.txt?

A companion file some sites publish with the full text of their documentation in one Markdown file. This generator creates only llms.txt, the index of links.

Is this generator free?

Yes, with no sign-up. We read your home page, robots.txt, sitemap and up to 30 pages once per draft and don't store the results.