What Is an llms.txt File?
An llms.txt file is a plain text file you place at the root of your website at yourdomain.com/llms.txt. It gives AI language model crawlers a short, structured summary of your site. It tells them what your site is about, which pages are worth reading first, which pages should not be used, and how to contact the site owner.
How Is It Different from robots.txt?
A robots.txt file is about access. It tells crawlers which pages they are allowed to visit. An llms.txt file is about context. It tells AI tools what your site covers and which content is most useful. Both files serve different purposes and can exist at your root at the same time.
The File Format
An llms.txt file uses Markdown-style formatting. The site name goes first as a heading. A short description follows. Then sections like Key Pages, Documentation and Blog list your most important URLs as bullet points. Optional sections cover contact details, licence terms, and pages AI tools should not use.