The llms.txt standard, proposed by Jeremy Howard of Answer.AI, is a plain-text Markdown file hosted at your website's root directory that provides a concise, machine-readable map of your site's most important content.
What Is llms.txt?
Think of llms.txt as a "table of contents for AI agents." While robots.txt tells crawlers what they can and cannot access, llms.txt tells AI agents what your site is about and where to find the most important information.
How to Create Your llms.txt
Create a file called llms.txt in your website's public/root directory. Format it as Markdown with these sections:
# Your Company Name> One-line description of what your company does
A 2-3 sentence overview of your business, products, and target audience.
Key Pages
- [Homepage](https://yoursite.com/): Brief description
- [Product](https://yoursite.com/product): Brief description
- [Pricing](https://yoursite.com/pricing): Brief description
- [Blog](https://yoursite.com/blog): Brief description
Products/Services
List your main products or services with brief descriptions.
Contact
- Website: https://yoursite.com
- Email: contact@yoursite.com
Best Practices
- Keep it concise: AI agents have context windows. Aim for under 2,000 words.
- Use Markdown formatting: Headers, lists, and links are machine-parseable.
- Include your most important URLs: Focus on pages you want AI to cite.
- Update regularly: Keep it current with your latest content and offerings.
- Validate it: Use ConduitScore's LLMs.txt checker to ensure proper formatting.
Current Adoption Status
While no major AI company has officially confirmed they use llms.txt at inference time, the standard is gaining adoption across AI-first companies. Having a well-structured llms.txt file positions your website favorably as the standard matures.
Check Your AI Visibility Score
See how your website performs across all 7 categories in 30 seconds.
Scan Your Website Free