What is llms.txt and does your website need one?
llms.txt explained: what it is, how it differs from robots.txt and sitemaps, and whether it’s worth adding to your site.
What it is
A file at yourdomain.com.au/llms.txt, written in Markdown, that tells AI tools what your site is about and where the key information lives. Think of it as a curated table of contents for machines.
How it differs from other files
- robots.txt tells crawlers what they may access
- sitemap.xml lists every page for search engines
- llms.txt gives a short, human-readable summary of what matters most
What to put in it
- Business name and a one-line description
- Key facts: locations, contact details, services
- Links to main service, location and resource pages
- Short descriptions for each link
Does it work?
It was proposed in 2024 and adoption by major AI companies is limited and evolving. Treat it as a tidy, low-effort signal rather than a strategy.
What matters more
Clear content, structured data, consistent business facts and a good reputation across the web. Our own site publishes an llms.txt as part of a broader approach.
Frequently asked questions
Do Google or OpenAI use llms.txt?
Support is limited and changing. It isn’t an official ranking or citation requirement.
Where does llms.txt go?
In the root of your domain, alongside robots.txt.
Should I block AI crawlers in robots.txt?
If you want to appear in AI answers, generally no. Blocking them reduces your chances of being cited.
