Mueller Explains Why Google Uses Markdown On Dev Docs

Google’s John Mueller says markdown pages serve a particular function for developer documentation websites however gained’t assist most web sites, whilst search turns into extra agentic.

Mueller laid out his reasoning in a Bluesky thread. He was responding to a query from Lily Ray about why Google publishes LLMs.txt information and markdown pages, although they aren’t wanted for search efficiency.

His response targeted primarily on markdown variations of developer documentation, not llms.txt as a standalone file.

Mueller wrote:

“The brief reply is that it’s not performed for search. There’s extra to web sites than simply website positioning :-).”

Mueller’s Discovery Vs. Performance Framework

His reasoning focuses on two completely different web site targets.

He known as the primary “discovery,” or being discovered through a search engine, and the second “performance,” which helps customers full duties on the web page.

Mueller acknowledged the time period wasn’t exact. “There’s in all probability a extra correct time period for this,” he wrote within the thread.

He in contrast the excellence to calls to motion on conventional pages, stating:

“You don’t ‘do them’ for website positioning (to be discovered), however if you happen to’re accountable for the web site general, guaranteeing a excessive ‘discovery charge’ (website positioning) along with a excessive conversion charge is beneficial to justify your work.”

Why Developer Docs Are Completely different

On builders.google.com, he famous, markdown variations make sense.

Mueller stated;

“AI coding has gotten very talked-about, and these coding programs may be (I feel) environment friendly and correct with the code they produce if they will simply learn / parse reference materials, reminiscent of developer documentation.”

He added that markdown may also help AI programs “perceive the context of the documentation they’re taking a look at, in addition to a simplified model of the reference web page.”

Mueller known as this a workaround reasonably than a long-term want, including:

“OF COURSE they will learn HTML simply fantastic, so that is imo extra of a short lived crutch, maybe to avoid wasting tokens.”

Non-Developer Websites Ought to Skip It

For everybody else, Mueller was direct, stating:

“For non-developer websites, I don’t assume this makes a lot sense, even with extra agentic visitors sooner or later. Making a markdown model of a shoe’s specs isn’t going to get you extra gross sales (rivals recognize it tho).”

He went additional in a follow-up put up, pushing again on the concept websites ought to put together for a future the place brokers drive extra visitors.

Mueller added:

“And (I do know, no one reads this far), if you happen to assume that is necessary to organize for when brokers are in every single place: your website (all websites) have far more necessary issues to do for website positioning than to organize for a possible future state of affairs that will or might not come. Prioritize wants earlier than desires.”

Why This Issues

Mueller’s feedback present a extra detailed place than his earlier statements on the subject.

In February, Mueller called the idea of serving markdown pages to bots “a silly thought.” His Bluesky feedback carve out an exception for developer documentation whereas holding the road for each different sort of website.

The thread additionally arrived on the identical day we reported that Google’s guidance on llms.txt now depends on which product you ask. Google’s generative AI optimization information says to skip llms.txt, whereas Lighthouse 13.3 added an experimental audit that checks for the file as a part of agentic looking readiness.

Trying Forward

Mueller’s distinction between discovery and on-page performance may also help you consider whether or not agentic optimization is price their time. The check is whether or not constructing for brokers proper now produces measurable outcomes for a particular website.

The “prioritize wants earlier than desires” line captures a broader rigidity within the trade proper now. Distributors have been promoting llms.txt and markdown optimization as rising practices, however neither Google’s search documentation nor impartial knowledge assist investing in these for non-developer websites.

Featured Picture: kirill_makarov/Shutterstock