Optimixed Search News

Google Publishes Documentation on Allowing Google-Agent Access to Websites

By the Optimixed Newsroom
45
News

TLDR

Google has released a new Search help document explaining how website owners can allow Google-Agent to access their sites.

Optimixed Overview

Optimixed's original report on this story.

Google has published a new Search help document on how to allow Google-Agent access to your website. In the document, Google describes Google-Agent as the name used by agents hosted on Google infrastructure to navigate the web and perform actions upon user request, as SERoundtable reported.

How we got here: earlier coverage

  1. Oct 22
    Google CEO Says AI Agents Will Access Websites Through Pages and APIs

    Google's CEO indicated AI agents will access websites both through traditional page browsing and via APIs, with protocols offering better scalability but longer development cycles.

  2. Oct 21
    Google clarifies data-sharing controls in updated Search help documentation

    Google updated its help docs to explicitly list existing data-sharing controls including robots meta tags, data-nosnippet, X-Robots-Tag, and Search generative AI controls.

  3. Oct 6
    Google Search Crawl Rate Doc Adds Retry-After HTTP & More

    Google Search Crawl Rate Doc Adds Retry-After HTTP & More

  4. Oct 5
    Google Is Fighting SERP Tracking. AI Agents May Make It Worse via @sejournal, @martinibuster

    Google Is Fighting SERP Tracking. AI Agents May Make It Worse via @sejournal, @martinibuster

Was this useful?
Share

More SEO News & Algorithm Updates stories

52
News

Google's John Mueller reiterated that the Crawled/Discovered - Currently Not Indexed status in Search Console's page indexing report can indicate Google doesn't consider a site or its pages high-quality enough to index.

Technical SEOSEO News & Algorithm UpdatesAnalytics & Measurement
65
News

Google has clarified how server-side redirects influence ranking signals and canonicalization.

Technical SEOSEO News & Algorithm Updates
62
News

Google's Gary Illyes said Google Search can temporarily keep important URLs that return a 4xx status code in the index rather than removing them immediately.

Technical SEOSEO News & Algorithm Updates
45
News

Google's Gary Illyes says impersonating Googlebot takes about 30 seconds, and Google signs only some Google-Agent requests, leaving site owners who rely on user-agent headers unable to spot impostors.

Technical SEOSEO News & Algorithm Updates