Exploit reveals how and why Google ranks content

An exploit discovered by Mark Williams-Cook has revealed more than 2,000 properties Google uses to classify queries and websites, as well as specific classifications such as consensus scoring and query types.

Why we care. The findings of this exploit give us even more insights into how Google search works. Earlier this year, we learned a lot from the huge search leak. Now we’ve gained additional insights into scoring, classification and site quality scores and more.

Consensus scoring. Google counts the number of passages in content that agree with, contradict, or remain neutral to the “general consensus.” Google will generate a consensus score, which likely impacts whether you rank on a specific query – especially debunking queries (e.g., “Is the earth flat?”).

Query classifications. Google categorized nearly all of the queries into eight “refined query semantic classes”:

• Short fact
• Bool (short for Boolean – yes/no questions)
• Other
• Instruction
• Definition
• Reason
• Comparison
• Consequence

Google categorizes nearly all queries into eight semantic classes, including:

• Short Fact/Boolean (yes/no questions)
• News-related queries
• Medical/YMYL (Your Money or Your Life) queries

These classifications determine how Google adjusts its algorithm for specific query types.

Site quality scores. Google’s results are influenced by site quality scores. These are calculated based on:

• Brand visibility (e.g., branded searches, or searches that include the brand’s name).
• User interactions (e.g., clicks, including when the site doesn’t rank in Position 1.
• Anchor text relevance around the web.

Sites that don’t reach a certain threshold (e.g., 0.4 on a 0-1 scale) are ineligible for search features, (e.g., featured snippets, People Also Ask).

Click probability. Google doesn’t use click-through rate directly in ranking. However, it appeared Google used a “click probability” for every organic result.

• “And so it appears that Google does factor in how likely it thinks someone is going to be to click on your result. This would change if we modify the page title. They have a tool that can give you hints about this in the Google Ads Planner, because it will tell you an estimated click-through rate there.”

About the data. Williams-Cook and his team analyze 2 terabytes of data and more than 90 million queries. Google paid his team $13,337 for discovering the exploit.

The video. Improving your SEO with conceptual models – Mark Williams-Cook on YouTube.