Which Data Sources Should You Care About For AI Search?

TierTypical useSupplyProof standingWhat the proof saysReference1Internet & search discoveryGoogle SearchConfirmed + presentGrounding with Google Search connects Gemini to real-time net content material, returning inline citations to supply URLs.Google — Gemini API docs, Grounding with Google Search1Bing SearchConfirmed + presentMicrosoft paperwork Bing outcomes getting used to boost Copilot responses. Not re-verified on this move.Microsoft Bing3Frequent CrawlConfirmed historicGPT-3 used filtered Frequent Crawl as roughly 60% of its sampling combination; LLaMA 1 reported 67%.Common Crawl3Historic net corpora (C4 and so forth.)Confirmed historicC4 is a cleaned by-product of Frequent Crawl; LLaMA reported C4 at 15% of its pretraining combination.TensorFlow Datasets — C44Internet grounding companiesSturdy proof / probablyClass inference overlaying third-party grounding/retrieval intermediaries. No single canonical supply.—1Merchandise & buyingGoogle Service provider MiddleConfirmed + presentService provider feed information underpins Google’s buying surfaces. Retained on consumer instruction; Google Purchasing eliminated as it’s a floor, not a supply.Google Merchant Center Help2Service provider / retail feeds (OpenAI)Confirmed + presentRetailers share a safe, frequently refreshed CSV/JSON feed of identifiers, descriptions, pricing, stock, media and fulfilment so ChatGPT can floor merchandise precisely. Refreshes accepted as typically as each quarter-hour.OpenAI Developers — Agentic Commerce, product feeds4Microsoft Service provider MiddleSturdy proof / probablyEqual business feed infrastructure; inferred parallel to Google Service provider Middle moderately than individually evidenced.—4Market feedsSturdy proof / probablyClass inference. Shopify catalog information is already built-in into ChatGPT, which helps the sample.OpenAI Help — Shopping with ChatGPT Search1Native & locationsGoogle MapsConfirmed + presentGrounding with Google Maps is a documented device alongside Search grounding, giving fashions geospatial context.Google Cloud — Grounding API1Google Enterprise ProfileConfirmed + presentEnterprise profile information feeds Google’s native surfaces. Carried from the supply desk; not individually re-verified.—1YelpConfirmed + presentYelp licenses evaluations, images and enterprise data to OpenAI for real-time native suggestions. Past grounding it additionally drives actions: ChatGPT customers can e book a desk or be a part of a waitlist, and Request a Quote lets customers contact suppliers in-chat. Yelp’s 10-Q confirms it’s stay.Axios; Yelp blog; Yelp 10-Q FY20264OpenStreetMapSturdy proof / probablyExtensively used open geospatial corpus; inferred moderately than confirmed for any named mannequin.—4FoursquareSturdy proof / probablyLeft in Tier 4 intentionally: the OpenAI deal is Yelp’s, and no equal proof exists for Foursquare.—4TripadvisorSturdy proof / probablyClass inference for evaluation/journey information. No confirmed deal recognized on this move.—1Information & referenceWikipediaConfirmed + presentExplicitly current in GPT-3’s disclosed combination and LLaMA (June-Aug 2022 dumps, 20 languages); additionally broadly used as a stay reference/RAG corpus.Wikimedia dumps1WikimediaConfirmed + presentIdentical corpus household as Wikipedia. Licensing is unusually clear: principally CC BY-SA with attribution/share-alike obligations.Wikimedia dumps4WikidataSturdy proof / probablyStructured entity layer; strongly implied by knowledge-graph use however not individually confirmed.—1Neighborhood / Q&A / socialRedditConfirmed + presentThe Google deal gave entry to the Reddit Information API for ‘real-time, structured, distinctive content material’, and permits Reddit content material to be displayed throughout Google merchandise — i.e. stay grounding, not solely coaching.Tom’s Guide (Google/Reddit deal)2RedditConfirmed + presentIdentical deal, coaching aspect: Google could use Reddit posts to coach its AI fashions and enhance companies equivalent to Search; reported at roughly $60m/yr. NOTE: Reddit is reportedly weighing whether or not to resume — deal with as unstable.Fortune; Neowin/WSJ on renewal doubt4Social platformsSturdy proof / probablyClass inference overlaying platform-wide social corpora.—4Boards / communitiesSturdy proof / probablyClass inference. Overlaps Reddit however generalised to non-Reddit boards.—1Information & writer content materialStay writer pagesConfirmed + presentReached at inference time through search grounding moderately than pretraining; retrieval choice and crawlability govern inclusion.Google — Grounding with Google Search2Licensed writer content materialConfirmed + presentOpenAI has a number of express licensing partnerships (FT, Axel Springer, AP, Information Corp). Phrases differ per accomplice on coaching vs grounding vs attribution.OpenAI — FT content partnership2Writer partnershipsConfirmed + presentAxel Springer’s deal consists of in any other case paywalled materials in solutions; AP licensed a part of its textual content archive.OpenAI — Axel Springer partnership3Historic information corporaConfirmed historicArchive materials absorbed in pretraining; distinct from stay licensed entry.—2Developer / technicalGitHubConfirmed + presentLLaMA used GitHub’s public BigQuery dataset, restricted to Apache/BSD/MIT initiatives; The Pile individually consists of GitHub. Public visibility is just not an open licence.GitHub2Stack OverflowConfirmed + presentNamed in licensing-deal mapping alongside Reddit and Shutterstock as a knowledge platform powering a number of consumers.LLM Pulse — AI content licensing deals mapped2Technical docsConfirmed + presentVendor documentation corpora; broadly used however not tied to a single disclosed settlement.—4npm / PyPI registriesSturdy proof / probablyWEAKEST ENTRY IN THE TABLE. Relabelled from ‘package deal registries’ to call examples. No disclosed settlement or documented retrieval use discovered — contemplate slicing.—1Journey & commerce actionsGoogle Resort Middle feedsConfirmed + presentWhen Gemini or AI Mode present lodge choices with real-time costs, that information comes from the Google Inns feed. In Aug 2026 Google added lodge reserving inside AI Mode accomplished with Google Pay, so that is grounding plus actions.TechCrunch — AI Mode travel update4Reserving / accomplice feedsSturdy proof / probablyReserving Holdings and IHG are reported as contributors in Google’s agentic reserving pilot, which helps the path however stops in need of a documented feed spec.InfosTourisme (IHG/Booking pilot)4OTA / commerce sourcesSturdy proof / probablyClass inference. OTAs run their very own price feeds into these surfaces.—4Reservation / stock APIsSturdy proof / probablyClass inference overlaying reserving/stock endpoints uncovered to brokers.—