Our team has been hard at work to deliver the final Knowledge Base feature of the year—one that sets a new standard for discoverability in both search engines and AI.
Now, every Knowledge Base automatically generates and hosts the following files:
- /sitemap.xml
- /llms.txt
- /llms-full.txt
This ensures your documentation is ready for seamless ingestion by search engines and large language models (LLMs).
In September 2024, Jeremy Howard, Co-Founder of Answer.AI, proposed the /llms.txt file format as a standardized method for websites to deliver essential information to large language models (LLMs). This markdown-based file simplifies a website’s content into a clear and structured format, eliminating the need for LLMs to navigate through complex HTML, advertisements, or JavaScript.
By implementing this standard, we are paving the way for a future where companies offer three tailored versions of their documentation: one optimized for human readers, another for search engines, and a third specifically designed for LLMs.
Search Isn’t Going Anywhere
While AI search engines are becoming increasingly popular, traditional search engines remain essential for discovery.
An effective sitemap.xml is the first step to ensuring your content is indexed and discoverable by Google, Bing, and other platforms.
With this update, every Knowledge Base will now generate a /sitemap.xml file automatically, helping your content stay visible and searchable.
Helping AI help you
By providing LLM-specific files like /llms.txt, we’re ensuring that AI tools can better understand and utilize your documentation.
This not only boosts your content’s relevance in AI-driven platforms but also enhances your overall customer support experience.
/llms.txt: AI-Optimized Documentation Navigation
The /llms.txt file is an auto-generated markdown file designed to provide a streamlined view of your documentation structure. It simplifies navigation for large language models (LLMs) like ChatGPT and Perplexity, making it easier for these tools to understand and index your content.
/llms-full.txt: Comprehensive Documentation in One File
The /llms-full.txt file consolidates all your documentation into a single, easy-to-read markdown file.
This feature is especially useful for AI tools that allow you to input a link to load content directly into their context.
For instance, AI coding assistants like Codeium can use this file to provide contextually relevant suggestions. By referencing your product’s detailed documentation—such as authentication workflows or API guidelines—these tools can deliver highly accurate and tailored assistance.
Instead of sharing multiple links to cover various aspects of your documentation, /llms-full.txt offers a one-stop solution. This file ensures AI tools have access to the entirety of your documentation in a single, centralized resource, saving time and improving efficiency.
Get Started Today
These features are available to all ThriveDesk users starting today. It’s never been easier to make your documentation accessible to both search engines and cutting-edge AI tools.
If you’re interested in getting your docs set up in ThriveDesk, get in touch for a preview.
