What is llms.txt?
The **llms.txt** file is a proposal for a Markdown-based handshake between website owners and Large Language Models (LLMs). While traditional search engines rely on XML sitemaps and complex HTML parsing, AI agents prefer high-density, structured text that fits within their context window.
The Difference: robots.txt vs. sitemap.xml vs. llms.txt
| Feature | robots.txt | sitemap.xml | llms.txt |
|---|---|---|---|
| **Audience** | Search Bots | Search Indexers | LLMs & Assistants |
| **Goal** | Restriction | Inventory | Context & Meaning |
| **Format** | Plain Text | XML | Markdown |
Example Implementation
/llms.txt
# Project Name > A one-sentence description of the site's purpose. A more detailed summary of the business identity and core mission goes here. ## Core Documentation - [Product Overview](/product): Detailed feature descriptions. - [API Reference](/docs/api): Technical integration details.