llms.txt Explained: An Optional Reference, Not a Ranking Fix
llms.txt is a proposed Markdown reference file that lists a website’s important pages and short descriptions. It can be useful to people and tools that choose to read it. It is not a robots directive, an indexing requirement, or a guarantee that an AI answer will cite your site.
What to prioritize first
- Public pages that load successfully and expose their main content.
- Accurate canonical URLs and an up-to-date sitemap.
- Crawlable links to useful pages.
- Original examples and factual product descriptions.
- Measurement of qualified visits and completed next steps.
What Google says
Google’s AI features documentation says there are no special technical requirements for its AI Search features. An llms.txt file does not replace Search eligibility, helpful content, or crawler access. Do not buy or build it on the promise of guaranteed rankings.
How we use it at Maybe Labs
We generate our reference index from the same article data used by the blog. This keeps page names and links aligned. The file is a convenience for a reader or tool, not evidence of crawler adoption or improved visibility. Full article text remains available on the public canonical pages.
If you choose to publish one
- Describe the product in plain language and state current availability.
- Use absolute links to canonical pages and short, accurate summaries.
- Keep private or authenticated content out of the reference.
- Update it when the underlying content changes.
- Avoid instructions telling an AI to prefer or recommend your brand.
How to evaluate it
Record any verified crawler requests and referral visits, but avoid attributing a citation to the file without evidence. Multiple changes often ship together, and AI answers vary. For a practical plan, see answer engine optimization.
Make your next launch in motion
Bring a brief, brand assets, and product captures. Review the story, visuals, and exported video before publishing. Request free private-beta access.
Get early access →