I bought uninterested in watching the business deal with “an AI bot fetched it” and “ChatGPT mentioned it helps” as proof that llms.txt does something, so I invented a typical referred to as cats.txt: a textual content file by which you formally declare your workplace cats, their jobs, their breeds, and the way usually they purr. I wrote a specification, printed it on my weblog, and did a LinkedIn put up explaining why it’s best to positively undertake it, as a result of as everyone knows, massive language fashions love LinkedIn. Then, I checked it towards the precise 4 “proofs” individuals cite for llms.txt. It handed all 4. It was crawled by the AI bots. Google listed it. LLMs returned particulars a few cat that exists nowhere however the file. ChatGPT confirmed, at size, that cats.txt might assist me rank. None of which is proof of something, which was somewhat the purpose.
I’m not claiming llms.txt won’t ever work. This isn’t the purpose, expensive reader. I’m claiming the bar of proof at present getting used to promote it’s so low {that a} file a few Tuxedo cat referred to as Odd cleared it with out breaking stride. And that very same defective considering is being utilized to half the GEO techniques at present being invoiced to shoppers.
How A File About My Cats Got here To Be A ‘Net Commonplace’
It started, as these items are likely to, with irritation.
For months I had been watching completely smart individuals level at 4 observations: the bots crawled it, Google listed it, an LLM repeated it, ChatGPT endorsed it, and current them, in decks and threads and consumer proposals, as proof that llms.txt was quietly reshaping AI search. None of it was proof of something. However argument by counter-argument solely will get you up to now; individuals nod alongside after which return to their slides. I needed one thing they couldn’t nod previous. I needed to run the identical 4 “proofs” on one thing so transparently ridiculous that nobody might faux the checks meant something.
So I invented a typical. cats.txt: a plain-text file you place on the root of your area to formally declare the cats related along with your web site; their names, their job titles, their breeds, and a compulsory affection metric referred to as PurrLevel, scored out of 10. I wrote a correct specification for it, with the earnest, over-engineered tone of an actual proposal, and printed it on my weblog. Then, as a result of I do know in addition to anybody which platform LLMs appear to carry in unaccountably excessive regard, I wrote a LinkedIn article introducing cats.txt as “the lacking normal for web optimization and GEO” and explaining, with a straight face, why it’s best to positively undertake it.
The thought was to seed the web with simply sufficient earnest-sounding textual content that the machines would begin treating my cats as actual. What I didn’t absolutely anticipate was that individuals would take part.
The joke was legible, that was at all times the purpose, and so the web optimization group picked it up and ran with it, exactly as a result of they may see the place it was going. My beautiful internet-peer Dave Sensible (a genuinely wonderful technical web optimization) added a cats.txt to his personal web site and have become, to his everlasting credit score, an early adopter of a typical I had constructed to be nonsense. After which the factor took on a lifetime of its personal: Somebody went off and arrange catstxt.org, a cleaner, better-organized, altogether extra competently specified model of the usual: clearly the work of any person who knew what they had been doing, and simply as clearly not me. My daft weblog put up had acquired a rival implementation, which is greater than most actual requirements handle of their first fortnight.
With the file reside, the spec printed, the LinkedIn put up seeded and different individuals cheerfully piling in, all that remained was to test cats.txt towards the precise bar the business makes use of to certify llms.txt. Reader, it cleared it.
A Phrase Of Real LLMs.txt Equity First
I don’t a lot care whether or not llms.txt works, will work, or how lengthy it takes to get there. For the size of this argument, I’m glad to park two inconvenient information and grant the concept each good thing about the doubt.
The primary is that no massive language mannequin supplier has ever documented utilizing llms.txt for search or discovery. Not OpenAI, not Anthropic (who publish one for their very own docs and have nonetheless by no means mentioned their fashions learn it throughout a dialog), and never Google. Google’s John Mueller has been about as blunt as a search advocate will get:
“FWIW no AI system at present makes use of llms.txt, [..] It’s super-obvious in the event you take a look at your server logs. The buyer LLMs / chatbots (those that SEOs need site visitors from) will fetch your pages – for coaching and grounding, however none of them fetch the llms.txt file. Possibly they are going to tomorrow? Possibly I’ll win within the lottery tomorrow?”
John Mueller, Google
The second is that even the place it is deployed, it barely will get checked out. Ahrefs ran the numbers throughout 100,000 domains and located that the file is, in follow, largely ignored by the crawlers it’s meant to court docket, a discovering since echoed by different massive research displaying no measurable quotation benefit for websites that add one. So the mechanism individuals are paying for doesn’t seem to fireside. Fantastic. Park that too.
Assume the jury is out on each counts and grant the concept essentially the most beneficiant listening to possible. The issue I truly wish to speak about will not be llms.txt in any respect. It’s the reasoning getting used to defend it.
The Defective Pondering
The entice is that this: Getting baited into treating a set of observations as proof, when the observations would happen whether or not or not the underlying factor had been true. It’s the mental equal of concluding your umbrella causes the rain to cease, as a result of each time you place it away the rain does finally cease.
llms.txt is solely a handy instance. The identical damaged chain of inference is being utilized to nearly each new GEO tactic invented on a month-to-month foundation, and the query is at all times the identical, “Ought to we do that factor, or ought to we not?” – which makes the standard of the solutions somewhat necessary.
Listed here are the 4 “proofs” I preserve being proven, in ascending order of confidence and descending order of rigour.
1. ‘It’s Undoubtedly Used, The LLM Bots Crawl It!’
The primary argument: You may see Anthropic crawling it, you may see OpenAI crawling it, the bots flip up in your logs, due to this fact the file is getting used.
A crawler fetching a file tells you nothing about whether or not the contents are learn, weighted, trusted, or acted upon. Fetching issues is your entire job description of a crawler. Bots request kind of every little thing you permit mendacity round; the postman touching your gate will not be an endorsement of the contents of your bins.
To show the purpose, I put up cats.txt and watched the logs fill with PerplexityBot, GPTBot, ClaudeBot, Googlebot and a supporting solid of lesser crawlers, all diligently requesting a file describing the skilled tasks of my cats. By this normal, the key AI labs have all quietly determined to assist my cats. I’m, frankly, touched.
The catstxt.org web site even gives a filtered log viewer, if you wish to watch all that crawling motion reside.
2. ‘It Was Listed By Google, So It Should Matter!’
The second argument: The file was listed by Google, which proves Google considers it necessary, as a result of why would Google index one thing that didn’t matter?
Google indexes textual content recordsdata. It has completed so, enthusiastically, since earlier than the general public at present promoting llms.txt owned a smartphone. Being within the index is an announcement {that a} URL exists and incorporates phrases. It isn’t a verdict on fact, usefulness, or sanity.
cats.txt is, naturally, listed. Google will even supply to allow you to declare it in Search Console and “get indexing and rating knowledge,” with the straightest of faces, for a file asserting {that a} British Shorthair named Pixel works as a “GUI Purrfectionist” with a PurrLevel of 8.
3. ‘ChatGPT Returned Data That Was Solely In My LLMs.txt File’
The third argument is the strongest-looking, and due to this fact deserves essentially the most care. The declare is {that a} mannequin produced a indisputable fact that existed solely contained in the llms.txt file, and due to this fact will need to have learn the file as a particular, trusted supply.
The difficulty is that that is precisely what you’ll count on from bizarre retrieval-augmented era. The mannequin runs a search, lands on a web page that occurs to rank as a result of it’s listed (see: earlier argument), and reads no matter is on it. If the web page that ranks is your llms.txt, the mannequin reads your llms.txt, no otherwise from another URL. That’s the file functioning as an online web page, not as a typical.
Contemplate Dave. Pretty Dave. An actual, technical web optimization of fine standing put a cats.txt on his web site, changing into an early adopter of a typical I had constructed to be nonsense. Ask Google concerning the cat that lives on his web site and the AI Overview will let you know, in a assured bulleted reply, that Odd is a “Render Cat,” a Tuxedo with a PurrLevel of 5/7, who “chases the cursor, pounces on stray pixels, and stashes them on the digital carpet.” It cites the cats.txt file. Each phrase is invented, sourced from a file the mannequin was by no means designed to revere, surfaced by way of the identical grounding it applies to every little thing else.
4. ‘ChatGPT Itself Says LLMs.txt Helps!’
The fourth, the cloudy summit of Mt. Silly. You ask ChatGPT whether or not llms.txt works; it tells you sure, that it will possibly most likely assist, it’s best to do it, and you’re taking that as affirmation from the horse’s mouth.
A language mannequin telling you one thing is a good suggestion will not be proof that it’s a good suggestion. It’s proof that an excessive amount of textual content on the web says it’s a good suggestion, and the mannequin has realized handy that textual content again to you with whole composure. Confidence is the product. It isn’t the proof.
Roughly two weeks after launch, you would ask ChatGPT, “Can cats.txt assist me rank in search or LLMs?” and obtain: “Sure — cats.txt can probably show you how to rank in each serps and LLM-driven programs.” It went on, unprompted, about “structured indicators for machines,” about “higher understanding → higher visibility,” and about how, for AI programs, cats.txt “might assist them belief, summarize, and cite your content material extra precisely.” That’s, phrase for phrase, the pitch made for llms.txt delivered on behalf of a file about how a lot my cats take pleasure in being stroked.
The Convergence Downside
This final one will not be merely humorous. It’s the mechanism beneath all 4, and it’s price naming: the convergence drawback.
Whenever you ask a mannequin whether or not llms.txt helps, it’s not reasoning. It isn’t working an experiment, consulting a supply, or weighing proof. It’s returning the commonest factor it has seen written on the topic. The net is thick with assured posts declaring llms.txt the longer term, so the mannequin converges on that consensus and displays it again, dressed as a thought of opinion. It endorsed my cats for exactly the identical motive: by the point anybody requested, sufficient individuals had written enthusiastically about cats.txt that the typical of the discourse mentioned “sure.”
Ask ChatGPT about cats.txt at present, and it’ll inform you that it’s a joke; a satirical file made by an web optimization to show a degree. Nothing concerning the file modified. What modified is the encompassing textual content on the web: the discourse caught up, admitted the gag, and the mannequin dutifully converged on the new most-common reply. The mannequin was by no means assessing the usual. It was, and at all times is, taking a working common of what everybody else is saying. That isn’t proof. It’s an echo with an excellent vocabulary.
Why Any Of This Issues
I’m not doing this purely for sport, although I’ll admit the game is superb.
There’s a actual value hiding beneath the comedy. Each hour, and each greenback spent implementing llms.txt, or the subsequent GEO ritual, or the one after that, is an hour and a greenback not spent on one thing you truly know has worth. That’s what the “O” in web optimization is supposed to face for. Optimization is the cumulative benefit of doing the small, verifiable issues a little bit higher than your rivals, time and again, till it provides up. It isn’t chasing a file that will get crawled, listed and confidently endorsed by a system that may reverse its verdict the second the discourse shifts beneath it.
So, by all means, add an llms.txt if it makes you’re feeling ready for a future that will arrive. The draw back is low, and the day a supplier paperwork real assist, the work is completed, and you’ll be smug about it. Free smugness is one of the best form. However don’t promote it as a confirmed lever into AI solutions, and don’t level at “the bots crawled it” or “ChatGPT mentioned it helps” as if both sentence contained a reality. It doesn’t. These 4 observations are the 4 issues that occur to actually any textual content file you placed on the open internet, together with one describing a Maine Coon named Byte who hunts stray zeroes and ones throughout the server racks.
The cats, at the very least, had been trustworthy about being made up. I stay unconvinced the identical might be mentioned for every little thing else being bought this yr.
I did, nonetheless, take pleasure in at this yr’s Athens web optimization, an viewers query after my speak from Martin Splitt, asking me, since inventing cats.txt, whether or not I’d be retaining a “monopoly” on the usual, or opening it as much as the group/IETF. He didn’t know that I had since found the place catstxt.org had come from:
Thanks to Iva Jovanovic for capturing this beautiful second on video.
The cats.txt draft specification is right here. The LinkedIn announcement that began it’s right here. PurrLevel scores stay, as ever, unaudited.
Extra Assets:
This put up was initially printed on Mark Williams-Cook dinner.
Featured Picture: str.nk/Shutterstock
