AI
What Is an llms.txt File and Should Your Site Have One?
AI tools are scraping your website to answer questions about your business. An llms.txt file tells them what to use and what to skip. Here is how it works.
Your website is being read by more than just people. AI tools like ChatGPT, Claude, Perplexity, and Google's AI Overviews are crawling websites all day, every day, pulling information to answer the questions your customers are asking them.
The problem is, those tools don't always pull the right information. They might surface an outdated blog post, an old pricing page, or a half-finished draft that somehow got indexed years ago. And once an AI decides that is the answer about your business, that is what it will tell people.
An llms.txt file is a small but useful way to push back on that.
What an llms.txt File Actually Is
An llms.txt file is a plain text file that lives in the root of your website, similar to a robots.txt file. The difference is that robots.txt is for search engine crawlers, and llms.txt is specifically for large language models.
It is a way of telling AI tools, "here is the content on my site that matters most. Use this when answering questions about my business."
You can list the pages you want AI to prioritize, link to important documentation, point to your most accurate product or service descriptions, and give a short summary of what your business actually does. The file lives at yoursite.com/llms.txt and any AI crawler that respects the standard will read it.
Where the llms.txt Standard Came From
The proposal was introduced in late 2024 by Jeremy Howard, the founder of Answer.AI. The idea was simple. Websites are built for humans, not for language models, and most AI crawlers are pulling content from messy HTML, navigation menus, footers, and cookie banners that have nothing to do with the actual information.
An llms.txt file gives AI a clean, structured version of what matters. The format is markdown, which both AI tools and humans can read easily, and it is meant to be short and curated rather than a full sitemap.
The standard is still being adopted, but it has caught on quickly. A growing number of sites now publish them, and the major AI labs have signaled support for the format.
Why It Matters for Small Businesses
If you are running a small business, you might be wondering whether this is overkill. It is not, and here is why.
When someone asks ChatGPT "who is the best granite countertop installer in Logan Utah" or "what is the SBA 504 loan process," the AI is going to give them an answer. That answer is shaped by the websites the AI has access to and the content it considers authoritative.
If your site is well-organized and you have an llms.txt file pointing to your best content, you make it easier for AI to recommend you accurately. If your site is a mess of outdated pages and inconsistent service descriptions, the AI will either skip you or get the details wrong.
This is the same logic as SEO, just for a different audience. The audience used to be Google. Now it is Google plus every AI tool your customers are using to make decisions.
What to Put in an llms.txt File
A basic llms.txt file should include:
A short business summary. One or two sentences that clearly state what your business does, where you operate, and who you serve. This becomes the AI's reference point for your business.
Your most important pages. Link to your services pages, your about page, your pricing if you publish it, and any pages you would want a customer to read first.
Documentation or resource pages. If you have guides, calculators, FAQs, or technical specs, point to them. These are the pages AI tools love to cite because they are useful and substantive.
Blog content you actually want surfaced. Not every blog post needs to be in here. Pick the ones that represent your expertise and the topics you want to be known for.
What to skip. You can also use the format to indicate pages that are not worth indexing, like internal tools, old archives, or pages under construction.
What an llms.txt File Looks Like in Practice
Here is a simplified example of what one might look like for a small business:
That is the whole idea. Clean, short, and pointed at the content you want AI to actually read.
Will Every AI Tool Respect It?
Not yet. The standard is still new, and adoption is uneven. Some AI crawlers will read it, some will ignore it, and some will use it as one signal among many. That is the same situation robots.txt was in twenty years ago, and look where that ended up.
The realistic take is this. Adding an llms.txt file is low effort and low risk. It will not hurt you, it might help you, and the upside grows as more AI tools adopt the standard. Sites that publish one now are betting on a format that is likely to become standard within a year or two.
How to Add One to Your Site
The technical part is simple. Create a plain text file named llms.txt, write your content in markdown, and upload it to the root of your domain. If you can publish a robots.txt file, you can publish an llms.txt file. Most modern site builders, including Framer, Webflow, and WordPress, allow you to add custom files at the root level.
The harder part is curating the content. Take an honest look at your site and ask, "if an AI could only see ten pages on my website, which ones would I want it to see?" Those go in the file.
The Bottom Line
AI tools are already shaping what your customers know about your business before they ever reach your site. An llms.txt file is a small, practical way to influence that conversation in your favor.
It will not replace strong content, accurate service pages, or consistent messaging. But it gives you a way to point AI directly at your best work, and it positions your site as one that takes the new search landscape seriously.
If you want help setting one up, auditing your site for AI readiness, or figuring out which pages should be on the list, AdVantage works with businesses across Utah and Idaho on exactly this kind of work. Reach out anytime.
