llms.txt
Compare with other sites' llms.txt files →# Three Impact
> Measured data on how AI crawlers and assistants treat real small-business websites, plus a free AI access checker, a crawler registry and evidence-based guides.
Ownership: Three Impact is published by the team behind cite-met and Space & Story. cite-met appears in our comparisons; we say so wherever it does.
## Guides
- [Do AI crawlers cost you bandwidth? Measured on 12 small-business sites](https://threeimpact.com/ai-crawler-bandwidth): The median small-business site got about 513 AI crawler fetches a month: roughly 11-18 MB of HTML. When crawlers do cost money, how to spot them in logs and slow them.
- [Cloudflare blocking AI crawlers? How to let AI search back in](https://threeimpact.com/cloudflare-blocking-ai-crawlers): Six Cloudflare settings can block ChatGPT, Claude and Perplexity search bots, and one can block Googlebot. Where each lives, which to change, and how to check the fix.
- [GPTBot vs OAI-SearchBot vs ChatGPT-User: OpenAI's three bots compared](https://threeimpact.com/gptbot-vs-oai-searchbot-vs-chatgpt-user): GPTBot trains models, OAI-SearchBot builds ChatGPT search, ChatGPT-User fetches pages live. What each does, which to block, and how often each visited 12 real sites.
- [robots.txt for AI crawlers: what blocking each one costs you](https://threeimpact.com/robots-txt-ai-crawlers): Which AI bots to block and which to keep: the cost of blocking training, search and live-fetch crawlers, with copy-paste robots.txt recipes for small business.
- [AI Overviews vs AI Mode: what changes for a small business](https://threeimpact.com/ai-overviews-vs-ai-mode): How Google's AI Overviews and AI Mode differ, what the click and local-results studies show, and what a small business should do about each (mostly the same).
- [How to track AI visibility: do it yourself, or pay for a tool?](https://threeimpact.com/ai-visibility-tracking-tools): A free monthly method using Search Console, Bing, GA4 and a prompt sheet, where it breaks down, and when a paid AI visibility tracker earns its cost.
- [Does llms.txt matter? What the evidence says in 2026](https://threeimpact.com/does-llms-txt-matter): Google says it doesn't use llms.txt and no major assistant documents reading it. Who supports it, who reads it, and whether a small business should bother.
- [How to track ChatGPT traffic in GA4, step by step](https://threeimpact.com/track-chatgpt-traffic-ga4): Find ChatGPT, Gemini, Claude and Perplexity visits in GA4: the AI Assistant channel, a reusable exploration, a regex, and why the numbers undercount.
- [How AI assistants pick which businesses to recommend](https://threeimpact.com/how-ai-assistants-recommend-businesses): What the evidence says about how ChatGPT, Google AI Overviews, Copilot and Perplexity pick businesses: Ahrefs studies, Google's guidance, BrightLocal, our data.
## Reference
- [AI crawler registry: every AI bot, its user agent and what blocking it costs](https://threeimpact.com/ai-crawler-registry): GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and 27 more: user agents, robots.txt tokens, verification links and observed share.
## Observatory · Q4 2026 edition
- [The AI Search Observatory: what AI crawlers did on 12 small-business sites](https://threeimpact.com/ai-search-observatory): Measured, not modelled: AI crawlers fetched small-business sites 4.4x as often as Googlebot, yet sent 1 visit per 120 fetches. Q4 2026 data and method.
## Compare
- [Profound vs Peec AI vs Otterly.AI: which AI visibility tool fits you?](https://threeimpact.com/compare/profound-vs-peec-ai-vs-otterly): Otterly from $29/month, Peec AI from $95, Profound by quote only. Engines, prompts, data method and crawler analytics compared, and who each one suits. Checked Nov 2026.
- [Otterly.AI vs Peec AI: which AI visibility tracker for a small business or agency?](https://threeimpact.com/compare/otterly-vs-peec-ai): Otterly.AI ($29, 15 prompts, 4 engines) vs Peec AI ($95, 50 prompts, 3 engines you choose): costs at 15 to 350 prompts, engines, method and which to pick.
- [Profound vs Peec AI: enterprise platform or self-serve tracker?](https://threeimpact.com/compare/profound-vs-peec-ai): Profound vs Peec AI: prices, engines, data method, agent analytics and who each suits. Peec from $95/month; Profound by quote only. Checked Nov 2026.
- [Profound vs Scrunch: the two AI visibility platforms that also watch your site](https://threeimpact.com/compare/profound-vs-scrunch): Profound vs Scrunch: both track AI answers and AI agent traffic. Scrunch publishes $300 and $500 plans with 7 engines; Profound is quote-only with 9.
- [Semrush AI Visibility Toolkit vs Ahrefs Brand Radar: which SEO suite's AI tool?](https://threeimpact.com/compare/semrush-vs-ahrefs-brand-radar): Semrush's AI Visibility Toolkit ($99/user, 25 prompts) vs Ahrefs Brand Radar ($199 per AI index, $699 all): how each gets its data, cost, which to pick.
- [Compare AI search tools and platforms, head to head](https://threeimpact.com/compare): Head-to-head comparisons of AI visibility tools (Profound, Peec AI, Otterly, Scrunch, Semrush, Ahrefs), each with a verdict up front and sourced prices.
- [How ChatGPT, Perplexity, Google AI, Copilot and Claude choose their sources](https://threeimpact.com/how-ai-search-engines-choose-sources): Where each AI assistant gets web results, which crawler to allow, how citations work and how often they match Google, from official docs and large studies.
- [Website platforms ranked by AI-readiness: Wix, Squarespace, Webflow, Framer, WordPress, Shopify and more](https://threeimpact.com/website-platforms-ai-readiness): Which website platforms serve real HTML to AI crawlers and let you control robots.txt, llms.txt and schema: Wix, Squarespace, Webflow, WordPress, Shopify.
## About
- [Updates: what changed on Three Impact, and when](https://threeimpact.com/updates): Every content change on Three Impact: new pages, price rechecks, corrections and data updates, newest first. Also available as an RSS feed.
- [About Three Impact: who runs it, how we measure, how we make money](https://threeimpact.com/about): Three Impact is published by the team behind cite-met and Space & Story: who we are, where the Observatory data comes from, how we protect it, how we're funded.
- [Mahmoud Halat](https://threeimpact.com/authors/mahmoud-halat): Mahmoud Halat writes and edits Three Impact. He founded Space & Story, a Toronto web studio, and runs cite-met, the platform behind our Observatory data.
- [How we review and compare: rubric, sources, updates and corrections](https://threeimpact.com/methodology): The six-part rubric behind every Three Impact review, where our prices and data come from, how often we recheck, how we treat our own products, and corrections.
## Tools
- [llms.txt generator and validator](https://threeimpact.com/llms-txt-generator): Build a correct llms.txt in two minutes or check the one you have, against the llmstxt.org format. Runs in your browser; nothing is sent or stored.
- [AI access checker: can ChatGPT, Claude and Perplexity read your site?](https://threeimpact.com/ai-access-checker): Free check of your robots.txt against 23 AI crawlers and tokens, plus noindex, nosnippet, text-without-JavaScript, schema and llms.txt, with a fix for each.
## Reviews
- [Ahrefs Brand Radar review: a giant prompt index for research, slow for tracking](https://threeimpact.com/reviews/ahrefs-brand-radar): Ahrefs Brand Radar: $199/month per AI platform or $699 for all, built on a huge search-backed prompt index. Rubric score, data method, refresh, who it fits.
- [cite-met review: hosting with AI crawler analytics, reviewed by the people who build it](https://threeimpact.com/reviews/cite-met): cite-met hosts small-business sites and shows which AI crawlers read each page, from $60/month. We own it, so no score: facts, weaknesses and better-fit rivals.
- [Otterly.AI review: the cheapest serious AI visibility tracker, and where 15 prompts runs out](https://threeimpact.com/reviews/otterly-ai): Otterly.AI from $29/month: 15 daily prompts on ChatGPT, AI Overviews, Perplexity and Copilot. Rubric score, real costs, data method and when to skip it.
- [Peec AI review: clear, well-documented prompt tracking for teams and agencies](https://threeimpact.com/reviews/peec-ai): Peec AI from $95/month: 50 daily prompts on any 3 of 6 engines, unlimited seats. Rubric score, sourced pricing, how it collects answers and who should skip it.
- [Profound review: the enterprise AI visibility platform, and why small businesses can skip it](https://threeimpact.com/reviews/profound): Profound tracks up to 9 AI engines, adds agent analytics and an AI marketer, and publishes no paid price. Rubric score, the free trial, and who should buy it.
- [Scrunch review: broad engine coverage and agent analytics, at a mid-market price](https://threeimpact.com/reviews/scrunch): Scrunch from $300/month: 350 custom prompts on 7 AI engines with agent traffic monitoring. Rubric score, sourced pricing, Agent Pages and who should skip it.
- [Semrush AI Visibility Toolkit review: convenient for Semrush users, thin for the price](https://threeimpact.com/reviews/semrush-ai-visibility-toolkit): Semrush's AI Visibility Toolkit: $99/month per user for 25 daily prompts. Rubric score, which engines it covers, and when a dedicated tracker is better.
- [AI visibility tool reviews: eight tools, one rubric, every price sourced](https://threeimpact.com/reviews): Eight AI visibility tools scored on one published rubric, with sourced prices (Nov 2026), a sortable table, what 20 prompts really cost and the pick by need.