Match the latest Chromium release version used by Googlebot. Of the Chrome browser used by that user agent: for example. Strings in the table, W.X.Y.Z is actually a placeholder that represents the version Wherever you see the string Chrome/ W.X.Y.Z in the user agent Mozilla/5.0 (Linux Android 8.0 Pixel 2 Build/OPD3.170816.012 Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/.138 Mobile Safari/537.36Ī note about Chrome/ W.X.Y.Z in user agents: Mozilla/5.0 (Linux Android 4.2.1 en-us Nexus 5 Build/JOP40D) AppleWebKit/535.19 (KHTML, like Gecko googleweblight) Chrome/.166 Mobile Safari/535.19 Mozilla/5.0 (X11 Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/.75 Safari/537.36 Google FaviconĬaution: Web Light doesn't respect robots.txt rules. Mozilla/5.0 (Linux Android 11 Pixel 2 DuplexWeb-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/.193 Mobile Safari/537.36Ĭaution: For user-initiated requests, Google Favicon ignores Mobile agent: Mozilla/5.0 (Linux Android 7.0 SM-G930V Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/.125 Mobile Safari/537.36 (compatible Google-Read-Aloud +)Ĭaution: Duplex on the web may ignore the * wildcard. User agent tokenĭesktop agent: Mozilla/5.0 (X11 Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/.118 Safari/537.36 (compatible Google-Read-Aloud +) Read Aloud doesn't respect robots.txt rules. User agent tokenĭoesn't respect robots.txt rules. (Various mobile device types) (compatible Mediapartners-Google/2.1 +) Mozilla/5.0 (Linux Android 6.0.1 Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/ W.X.Y.Z Mobile Safari/537.36 (compatible Googlebot/2.1 +) Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko compatible Googlebot/2.1 +) Chrome/ W.X.Y.Z Safari/537.36.Mozilla/5.0 (compatible Googlebot/2.1 +).
Mozilla/5.0 (iPhone CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible AdsBot-Google-Mobile +) Mozilla/5.0 (Linux Android 5.0 SM-G920A) AppleWebKit (KHTML, like Gecko) Chrome Mobile Safari (compatible AdsBot-Google-Mobile +)
Learn how to verify if a visitor is a Google crawler.Ĭhecks Android web page ad quality.
The full user agent string is a full description of the crawler, and appears inĬaution: The user agent string can be spoofed. This list is not complete, but covers most of the crawlers you might see on your One token, as shown in the table you need to match only one crawler token for a rule toĪpply. To match a crawler type when writing crawl rules for your site. The user agent token is used in the User-agent: line in robots.txt The following table shows the crawlers used by various products and services at Google: Is used to automatically discover and scan websites by following links from one webpage toĪbout the common Google crawlers you may see in your referrer logs, and how to specify them in "Crawler" (sometimes also called a "robot" or "spider") is a generic term for any program that Overview of Google crawlers (user agents)