Social Signals
How Cats.txt Showed LLMs.txt Evidence Is GEO Astrology
Aug
I obtained uninterested in watching the business deal with “an AI bot fetched it” and “ChatGPT stated it helps” as proof that llms.txt does something, so I invented a regular known as cats.txt: a textual content file through which you formally declare your workplace cats, their jobs, their breeds, and the way typically they purr. I wrote a specification, revealed it on my weblog, and did a LinkedIn submit explaining why you must positively undertake it, as a result of as everyone knows, massive language fashions love LinkedIn. Then, I checked it in opposition to the precise 4 “proofs” individuals cite for llms.txt. It handed all 4. It was crawled by the AI bots. Google listed it. LLMs returned particulars a few cat that exists nowhere however the file. ChatGPT confirmed, at size, that cats.txt might assist me rank. None of which is proof of something, which was moderately the purpose.
I’m not claiming llms.txt won’t ever work. This isn’t the purpose, pricey reader. I’m claiming the bar of evidence currently being used to sell it is so low {that a} file a few Tuxedo cat known as Odd cleared it with out breaking stride. And that very same defective considering is being utilized to half the GEO tactics at present being invoiced to purchasers.
How A File About My Cats Got here To Be A ‘Net Commonplace’
It started, as this stuff are likely to, with irritation.
For months I had been watching completely smart individuals level at 4 observations: the bots crawled it, Google listed it, an LLM repeated it, ChatGPT endorsed it, and current them, in decks and threads and consumer proposals, as proof that llms.txt was quietly reshaping AI search. None of it was proof of something. However argument by counter-argument solely will get you to this point; individuals nod alongside after which return to their slides. I needed one thing they couldn’t nod previous. I needed to run the identical 4 “proofs” on one thing so transparently ridiculous that nobody might fake the assessments meant something.
So I invented a regular. cats.txt: a plain-text file you place on the root of your area to formally declare the cats related together with your web site; their names, their job titles, their breeds, and a compulsory affection metric known as PurrLevel, scored out of 10. I wrote a correct specification for it, with the earnest, over-engineered tone of an actual proposal, and published it on my blog. Then, as a result of I do know in addition to anybody which platform LLMs appear to carry in unaccountably excessive regard, I wrote a LinkedIn article introducing cats.txt as “the lacking commonplace for web optimization and GEO” and explaining, with a straight face, why you must positively undertake it.
The thought was to seed the web with simply sufficient earnest-sounding textual content that the machines would begin treating my cats as actual. What I didn’t absolutely anticipate was that individuals would take part.
The joke was legible, that was all the time the purpose, and so the web optimization group picked it up and ran with it, exactly as a result of they might see the place it was going. My beautiful internet-peer Dave Good (a genuinely wonderful technical web optimization) added a cats.txt to his own site and have become, to his everlasting credit score, an early adopter of a regular I had constructed to be nonsense. After which the factor took on a lifetime of its personal: Somebody went off and arrange catstxt.org, a cleaner, better-organized, altogether extra competently specified model of the usual: clearly the work of any individual who knew what they had been doing, and simply as clearly not me. My daft weblog submit had acquired a rival implementation, which is greater than most actual requirements handle of their first fortnight.
With the file dwell, the spec revealed, the LinkedIn submit seeded and different individuals cheerfully piling in, all that remained was to examine cats.txt in opposition to the precise bar the business makes use of to certify llms.txt. Reader, it cleared it.
A Phrase Of Real LLMs.txt Equity First
I don’t a lot care whether or not llms.txt works, will work, or how lengthy it takes to get there. For the size of this argument, I’m comfortable to park two inconvenient details and grant the concept each good thing about the doubt.
The primary is that no massive language mannequin supplier has ever documented utilizing llms.txt for search or discovery. Not OpenAI, not Anthropic (who publish one for their very own docs and have nonetheless by no means stated their fashions learn it throughout a dialog), and never Google. Google’s John Mueller has been about as blunt as a search advocate gets:
“FWIW no AI system at present makes use of llms.txt, [..] It’s super-obvious in the event you have a look at your server logs. The patron LLMs / chatbots (those that SEOs need site visitors from) will fetch your pages – for coaching and grounding, however none of them fetch the llms.txt file. Perhaps they may tomorrow? Perhaps I’ll win within the lottery tomorrow?”
John Mueller, Google
The second is that even the place it is deployed, it barely will get checked out. Ahrefs ran the numbers across 100,000 domains and located that the file is, in apply, largely ignored by the crawlers it’s meant to courtroom, a discovering since echoed by different massive research exhibiting no measurable citation advantage for websites that add one. So the mechanism individuals are paying for doesn’t seem to fireside. Nice. Park that too.
Assume the jury is out on each counts and grant the concept probably the most beneficiant listening to possible. The issue I truly need to discuss isn’t llms.txt in any respect. It’s the reasoning getting used to defend it.
The Defective Considering
The lure is that this: Getting baited into treating a set of observations as proof, when the observations would happen whether or not or not the underlying factor had been true. It’s the mental equal of concluding your umbrella causes the rain to cease, as a result of each time you place it away the rain does finally cease.
llms.txt is solely a handy instance. The same broken chain of inference is being applied to almost every new GEO tactic invented on a monthly basis, and the query is all the time the identical, “Ought to we do that factor, or ought to we not?” – which makes the standard of the solutions moderately necessary.
Listed here are the 4 “proofs” I maintain being proven, in ascending order of confidence and descending order of rigour.
1. ‘It’s Undoubtedly Used, The LLM Bots Crawl It!’
The primary argument: You may see Anthropic crawling it, you may see OpenAI crawling it, the bots flip up in your logs, due to this fact the file is getting used.
A crawler fetching a file tells you nothing about whether or not the contents are learn, weighted, trusted, or acted upon. Fetching issues is the complete job description of a crawler. Bots request kind of every thing you allow mendacity round; the postman touching your gate isn’t an endorsement of the contents of your bins.
To show the purpose, I put up cats.txt and watched the logs fill with PerplexityBot, GPTBot, ClaudeBot, Googlebot and a supporting forged of lesser crawlers, all diligently requesting a file describing the skilled tasks of my cats. By this commonplace, the main AI labs have all quietly determined to help my cats. I’m, frankly, touched.
The catstxt.org web site even gives a filtered log viewer, if you wish to watch all that crawling motion dwell.
2. ‘It Was Listed By Google, So It Should Matter!’
The second argument: The file was listed by Google, which proves Google considers it necessary, as a result of why would Google index one thing that didn’t matter?
Google indexes textual content information. It has performed so, enthusiastically, since earlier than the general public at present promoting llms.txt owned a smartphone. Being within the index is a press release {that a} URL exists and accommodates phrases. It’s not a verdict on reality, usefulness, or sanity.
cats.txt is, naturally, listed. Google will even supply to allow you to declare it in Search Console and “get indexing and rating information,” with the straightest of faces, for a file asserting {that a} British Shorthair named Pixel works as a “GUI Purrfectionist” with a PurrLevel of 8.
3. ‘ChatGPT Returned Info That Was Solely In My LLMs.txt File’
The third argument is the strongest-looking, and due to this fact deserves probably the most care. The declare is {that a} mannequin produced a proven fact that existed solely contained in the llms.txt file, and due to this fact should have learn the file as a particular, trusted supply.
The difficulty is that that is precisely what you’d anticipate from unusual retrieval-augmented generation. The mannequin runs a search, lands on a web page that occurs to rank as a result of it’s listed (see: earlier argument), and reads no matter is on it. If the web page that ranks is your llms.txt, the mannequin reads your llms.txt, no in another way from another URL. That’s the file functioning as an online web page, not as a regular.
Take into account Dave. Pretty Dave. An actual, technical web optimization of excellent standing put a cats.txt on his website, turning into an early adopter of a regular I had constructed to be nonsense. Ask Google concerning the cat that lives on his website and the AI Overview will let you know, in a assured bulleted reply, that Odd is a “Render Cat,” a Tuxedo with a PurrLevel of 5/7, who “chases the cursor, pounces on stray pixels, and stashes them on the digital carpet.” It cites the cats.txt file. Each phrase is invented, sourced from a file the mannequin was by no means designed to revere, surfaced by the identical grounding it applies to every thing else.
4. ‘ChatGPT Itself Says LLMs.txt Helps!’
The fourth, the cloudy summit of Mt. Silly. You ask ChatGPT whether or not llms.txt works; it tells you sure, that it might in all probability assist, you must do it, and you are taking that as affirmation from the horse’s mouth.
A language mannequin telling you one thing is a good suggestion isn’t proof that it’s a good suggestion. It’s proof that an excessive amount of textual content on the web says it’s a good suggestion, and the mannequin has discovered at hand that textual content again to you with whole composure. Confidence is the product. It’s not the proof.
Roughly two weeks after launch, you can ask ChatGPT, “Can cats.txt assist me rank in search or LLMs?” and obtain: “Sure — cats.txt can doubtlessly make it easier to rank in each search engines like google and LLM-driven methods.” It went on, unprompted, about “structured alerts for machines,” about “higher understanding → higher visibility,” and about how, for AI methods, cats.txt “might assist them belief, summarize, and cite your content material extra precisely.” That’s, phrase for phrase, the pitch made for llms.txt delivered on behalf of a file about how a lot my cats take pleasure in being stroked.
The Convergence Downside
This final one isn’t merely humorous. It’s the mechanism beneath all 4, and it’s price naming: the convergence problem.
While you ask a mannequin whether or not llms.txt helps, it’s not reasoning. It’s not working an experiment, consulting a supply, or weighing proof. It’s returning the commonest factor it has seen written on the topic. The net is thick with assured posts declaring llms.txt the long run, so the mannequin converges on that consensus and displays it again, dressed as a thought of opinion. It endorsed my cats for exactly the identical cause: by the point anybody requested, sufficient individuals had written enthusiastically about cats.txt that the typical of the discourse stated “sure.”
Ask ChatGPT about cats.txt as we speak, and it’ll inform you that it’s a joke; a satirical file made by an web optimization to show some extent. Nothing concerning the file modified. What modified is the encircling textual content on the web: the discourse caught up, admitted the gag, and the mannequin dutifully converged on the new most-common reply. The mannequin was by no means assessing the usual. It was, and all the time is, taking a working common of what everybody else is saying. That isn’t proof. It’s an echo with an excellent vocabulary.
Why Any Of This Issues
I’m not doing this purely for sport, although I’ll admit the game is great.
There’s a actual price hiding beneath the comedy. Each hour, and each greenback spent implementing llms.txt, or the subsequent GEO ritual, or the one after that, is an hour and a greenback not spent on one thing you truly know has worth. That’s what the “O” in web optimization is supposed to face for. Optimization is the cumulative benefit of doing the small, verifiable issues a little bit higher than your opponents, time and again, till it provides up. It’s not chasing a file that will get crawled, listed and confidently endorsed by a system that may reverse its verdict the second the discourse shifts beneath it.
So, by all means, add an llms.txt if it makes you are feeling ready for a future which will arrive. The draw back is low, and the day a supplier paperwork real help, the work is finished, and you’ll be smug about it. Free smugness is the most effective sort. However don’t promote it as a confirmed lever into AI solutions, and don’t level at “the bots crawled it” or “ChatGPT stated it helps” as if both sentence contained a reality. It doesn’t. These 4 observations are the 4 issues that occur to actually any textual content file you placed on the open internet, together with one describing a Maine Coon named Byte who hunts stray zeroes and ones throughout the server racks.
The cats, no less than, had been sincere about being made up. I stay unconvinced the identical will be stated for every thing else being bought this 12 months.
I did, nevertheless, take pleasure in at this 12 months’s Athens SEO, an viewers query after my speak from Martin Splitt, asking me, since inventing cats.txt, whether or not I might be conserving a “monopoly” on the usual, or opening it as much as the group/IETF. He didn’t know that I had since found the place catstxt.org had come from:
Thanks to Iva Jovanovic for capturing this beautiful second on video.
The cats.txt draft specification is here. The LinkedIn announcement that began it’s here. PurrLevel rankings stay, as ever, unaudited.
Extra Assets:
This submit was initially revealed on Mark Williams-Cook.
Featured Picture: str.nk/Shutterstock
#Cats.txt #Confirmed #LLMs.txt #Proof #GEO #Astrology
