SeeTheStack
Technologies
Trending
Directory
Technologies
Trending
Directory
Loading…
Go
Go
Root & Well-known Files
robots.txt blocks Google-Extended
Visit robots.txt blocks Google-Extended ↗
Adoption
153
sites
4% of the 3,661 websites we track
Pricing: free
Websites using robots.txt blocks Google-Extended
aisdr.com
getfuzzy.ai
imessage.store
moonmath.ai
100r.co
60fps.design
abcnews.com
aeon.co
agentphone.ai
aidirectori.es
aigrow.gg
alexandracarnold.com
alexisoules.com
alexiswalsh.com
allmcps.com
america.gov
americanbanker.com
app.com
aramb.ai
arcinfo.ch
arstechnica.com
artforum.com
artnews.com
attio.com
backengine.ai
backengine.com
bd.nl
billboard.com
billionverify.com
blokbuster.fun
bloxcms.com
bostonglobe.com
bowora.com
brittanybravo.com
btpn.in
busplaner.de
buysub.com
chinatradingdesk.com
chrisburnell.com
chroniclejournal.com
cincinnati.com
cmein.com
cnbc.com
codexmarketplaces.com
contrive.app
courier-journal.com
crowdvolt.com
crucialtracks.org
css-tricks.com
curbed.com
dbushell.com
deadline.com
decider.com
delawareonline.com
detroitnews.com
dispatch.com
doverpost.com
easyveo.com
eater.com
espn.com
Who added or dropped it
No switches yet. We rescan every site monthly, and any site that adds or drops robots.txt blocks Google-Extended shows up here.
Often used with
Google Analytics
59%
Google Tag Manager
59%
Cloudflare
55%
Google Workspace (Gmail)
48%
Amazon SES
42%
Cloudflare Bot Management
40%
core-js
40%
AWS
32%
Microsoft 365 (Exchange Online)
31%
IAB TCF v2 CMP (unidentified)
31%
PHP
30%
Node.js
29%