robots.txt
See which AI crawlers other sites block →# As a condition of accessing this website, you agree to abide by the following
# content signals:
# (a) If a Content-Signal = yes, you may collect content for the corresponding
# use.
# (b) If a Content-Signal = no, you may not collect content for the
# corresponding use.
# (c) If the website operator does not include a Content-Signal for a
# corresponding use, the website operator neither grants nor restricts
# permission via Content-Signal with respect to the corresponding use.
# The content signals and their meanings are:
# search: building a search index and providing search results (e.g., returning
# hyperlinks and short excerpts from your website's contents). Search does not
# include providing AI-generated search summaries.
# ai-input: inputting content into one or more AI models (e.g., retrieval
# augmented generation, grounding, or other real-time taking of content for
# generative AI search answers).
# ai-train: training or fine-tuning AI models.
# use: how AI systems may consume the content (immediate, reference, or full).
# ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
# RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
# AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
# BEGIN Cloudflare Managed content
User-agent: *
Content-Signal: search=yes,ai-train=no,use=reference
Allow: /
# Training crawlers
User-agent: Amazonbot
Disallow: /
User-agent: Applebot-Extended
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: Diffbot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: omgili
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: cohere-ai
Disallow: /
User-agent: MistralAI-Training
Disallow: /
User-agent: meta-externalagent
Disallow: /
User-agent: GoogleOther
Disallow: /
User-agent: Baiduspider
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: AwarioSmartBot
User-agent: AwarioRssBot
Disallow: /
User-agent: Google-CloudVertexBot
Disallow: /
User-agent: QualifiedBot
Disallow: /
User-agent: Cotoyogi
Disallow: /
User-agent: ICC-Crawler
Disallow: /
User-agent: atlassian-bot
Disallow: /
User-agent: FishBot
Disallow: /
User-agent: BorderxBot
Disallow: /
User-agent: NavuBot
Disallow: /
User-agent: SemrushBot-SWA
Disallow: /
User-agent: WARDBot
Disallow: /
User-agent: magpie-crawler
Disallow: /
User-agent: KimiBot
Disallow: /
User-agent: CitibotSiteCrawler
Disallow: /
# END Cloudflare Managed Content
# =============================================================================
# postsnag.com robots.txt
#
# Policy:
# - Allow traditional search engines.
# - Allow AI search, citations, grounding, and user-requested retrieval.
# - Block dedicated model-training and bulk dataset crawlers.
# - Keep API endpoints and unpublished previews out of crawler access.
#
# Deployment prerequisite:
# Disable Cloudflare's managed robots.txt setting before deploying this file:
# Cloudflare > Security Settings > Bot traffic
# Turn off "Set your preference to block training in robots.txt".
#
# After deployment, confirm the live file contains no
# "BEGIN Cloudflare Managed content" block.
# =============================================================================
# Public search and AI retrieval
#
# This wildcard group allows Googlebot, Bingbot, OAI-SearchBot,
# ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot,
# Google-Extended, meta-externalagent, Amazonbot, and other compliant
# crawlers that are not specifically blocked below.
User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=no, use=reference
Disallow: /api/
Disallow: /blog/preview/
Disallow: /creators/preview/
Allow: /
# Dedicated model-training and bulk dataset crawlers
#
# Blocking these does not block OAI-SearchBot, ChatGPT-User,
# Claude-SearchBot, Claude-User, Googlebot, or PerplexityBot.
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Applebot-Extended
User-agent: CCBot
User-agent: Bytespider
Disallow: /
# Google special-case crawlers
#
# Google documents these crawlers as ignoring the global wildcard group,
# so the private-path restrictions are repeated explicitly.
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: Mediapartners-Google
Disallow: /api/
Disallow: /blog/preview/
Disallow: /creators/preview/
Allow: /
# Sitemap
Sitemap: https://postsnag.com/sitemap.xml
llms.txt
Compare with other sites' llms.txt files →# PostSnag
> PostSnag is a Chrome extension and web dashboard for Facebook content research. It helps marketers, agencies, and creators capture posts visible in their own browser session, compare engagement, identify outliers, organize swipe files, and export structured data for analysis in tools such as ChatGPT, Claude, and Gemini.
PostSnag works client-side inside the user's logged-in Facebook session. As the user scrolls a profile, Page, creator account, or Group they can access, PostSnag captures loaded post information such as captions, post types, publication dates, reactions, comments, shares, and available video-play counts. It does not use Facebook login credentials, proxies, burner accounts, or the Facebook API. PostSnag is not affiliated with or endorsed by Meta Platforms or Facebook.
The product consists of a Manifest V3 Chrome extension and a web dashboard at https://app.postsnag.com. Free access is available. Current paid options and guarantees should always be confirmed on the pricing page.
## Start Here
- [PostSnag homepage](https://postsnag.com/): Product overview, primary use cases, and how PostSnag helps users find successful Facebook content.
- [Chrome Extension](https://postsnag.com/chrome-extension): How the PostSnag browser extension captures and organizes Facebook research.
- [Install PostSnag from the Chrome Web Store](https://chromewebstore.google.com/detail/postsnag/mgaicfnchelmoancalnebajninjeiphl): Official Chrome extension listing and installation page.
- [PostSnag dashboard](https://app.postsnag.com/): Sign in, create an account, and access saved research and analytics.
- [Pricing](https://postsnag.com/pricing): Current Free, Pro, and Lifetime plans, feature comparison, billing terms, and refund coverage.
- [FAQ](https://postsnag.com/faq): Answers about supported Facebook surfaces, capturing, analytics, exports, plans, and account safety.
## Facebook Research
- [Facebook Profile Analyzer](https://postsnag.com/facebook-profile-analyzer): Find and compare the strongest posts from a Facebook profile.
- [Facebook Page Analytics](https://postsnag.com/facebook-page-analytics): Analyze the top posts and engagement patterns of Facebook Pages, including competitor Pages.
- [Facebook Creator Analytics](https://postsnag.com/facebook-creator-analytics): Study a creator's posts, reels, formats, posting patterns, and outliers.
- [Facebook Group Analytics](https://postsnag.com/facebook-group-analytics): Analyze posts visible in Facebook Groups the user can access; Group administrator access is not required.
## Product Features
- [Swipe File](https://postsnag.com/features/swipe-file): Save useful Facebook content into a reusable research library.
- [Folders](https://postsnag.com/features/folders): Organize captured posts and profiles into structured collections.
- [Bookmarks](https://postsnag.com/features/bookmarks): Save individual posts and profiles for later review.
- [Download Facebook Videos](https://postsnag.com/features/download-facebook-videos): Save supported Facebook video content available through PostSnag.
- [Download Facebook Photos](https://postsnag.com/features/download-facebook-photos): Save supported Facebook photo content available through PostSnag.
- [Export Facebook Data](https://postsnag.com/features/export-facebook-data): Export field-level post data, including captions, URLs, dates, reactions, comments, shares, and available views, as CSV, JSON, or Markdown.
- [Bulk Export Facebook Profiles and Groups](https://postsnag.com/features/export): Package captured posts together with associated photos and videos into one downloadable bulk archive, with the data portion in CSV, JSON, or Markdown.
- [Profile Analytics](https://postsnag.com/features/profile-analytics): Review totals, averages, post-type performance, publishing patterns, and engagement.
- [Sort and Rank](https://postsnag.com/features/sort-and-rank): Rank captured posts by reactions, comments, shares, video plays, date, and other available fields.
- [Outlier Detection](https://postsnag.com/features/outliers): Surface posts performing significantly above a profile's typical results.
- [Compare Profiles](https://postsnag.com/features/compare-profiles): Compare content and performance patterns across Facebook profiles.
- [Facebook Groups](https://postsnag.com/features/facebook-groups): Capture and study posts from Groups the user can access.
- [Group Members](https://postsnag.com/features/group-members): Research available Group-member and participation information.
- [Top Creators](https://postsnag.com/features/top-creators): Explore high-performing creators and content patterns.
## Original Research
Each breakdown is built from the creator's own captured posts — every post read and ranked, not commentary.
- [Creator Breakdowns](https://postsnag.com/creators): Index of every published analysis.
- [Alex Hormozi Facebook Analysis](https://postsnag.com/creators/alex-hormozi): Posting frequency, formats, engagement distribution, and content patterns.
- [Amy Jackson Facebook Analysis](https://postsnag.com/creators/amy-jackson): Facebook publishing cadence and performance patterns.
- [Dan Martell Facebook Analysis](https://postsnag.com/creators/dan-martell): 235 videos posted in 30 days across 262 captured posts, and why framing rather than production quality predicted performance.
- [Gary Vaynerchuk Facebook Analysis](https://postsnag.com/creators/garyvaynerchuck): Top 30 hooks, best posts, and reusable post templates drawn from 205 analyzed posts.
- [Her First $100K Facebook Analysis](https://postsnag.com/creators/her-first-100k): Personal-finance content formats and relative performance.
- [Kait the Canadian Facebook Analysis](https://postsnag.com/creators/kait-the-canadian): All 88 Claude reels — how the same repost hit 20x on one copy and five likes on another the same day.
- [Kekoa Macauley Facebook Analysis](https://postsnag.com/creators/kekoa-macauley): Content themes, publishing patterns, and engagement outliers.
- [Lead Gen Man Facebook Analysis](https://postsnag.com/creators/lead-gen-man): Lead-generation content formats and what drove response.
- [Leila Hormozi Facebook Analysis](https://postsnag.com/creators/leila-hormozi): Leadership and mindset content, video output, and relative post performance.
- [MaverickGPT Facebook Analysis](https://postsnag.com/creators/maverickgpt): AI-focused video formats, recurring hooks, and the posts that outperformed.
- [Mel Robbins Facebook Analysis](https://postsnag.com/creators/mel-robbins): Publishing frequency, content formats, and engagement patterns.
- [Neil Patel Facebook Analysis](https://postsnag.com/creators/neil-patel): All 95 Facebook posts read and ranked — digital-marketing formats, engagement patterns, and calls to action.
- [Raycfu Facebook Analysis](https://postsnag.com/creators/raycfu): All 27 Claude reels from an ex-Meta engineer, three of which carry half the account.
- [Sabrina Ramonov Facebook Analysis](https://postsnag.com/creators/sabrina-ramonov): AI and productivity content, offers, calls to action, and performance.
- [Shawn Dillon Facebook Analysis](https://postsnag.com/creators/shawn-dillon): All 65 reels — the same "make money with AI" reel posted 65 times, and the exact difference in the two that blew up.
- [Thomas Coleman Facebook Analysis](https://postsnag.com/creators/thomas-coleman): All 63 reels from January to July 2026, and why the same video landed at both extremes.
- [Travis Woo Facebook Analysis](https://postsnag.com/creators/travis-woo): All 68 trading reels from a verified trader — and why his biggest reel showed none of the profit screenshots.
## Blog
- [PostSnag Blog](https://postsnag.com/blog): Product education, Facebook content research, and strategy articles.
- [PostSnag Review and Facebook Research Workflow](https://postsnag.com/blog/postsnag-review-2026-how-a-creator-finds-viral-facebook-posts-in-2026): Practical example of using PostSnag to find and study high-performing Facebook posts.
## AI Agent Access (MCP)
PostSnag exposes a Model Context Protocol server so AI agents (Claude, ChatGPT, and other MCP clients) can query a user's captured Facebook data with that user's authorization.
- [MCP server](https://api.postsnag.com/mcp): Streamable-HTTP MCP endpoint — list/search captured posts, profile top posts, boards, groups, engagement stats, community discovery search, and media/JSON exports.
- [Agent authentication walkthrough](https://postsnag.com/auth.md): OAuth 2.1 with PKCE and open Dynamic Client Registration; scope `mcp:access`; paid plan required.
- [MCP server card](https://postsnag.com/.well-known/mcp/server-card.json): Machine-readable server description and tool list.
- [OAuth discovery](https://postsnag.com/.well-known/oauth-authorization-server): Authorization-server metadata (mirrored from api.postsnag.com).
## Company and Support
- [About PostSnag](https://postsnag.com/about): Company background and PostSnag's relationship to TokScript.
- [Contact](https://postsnag.com/contact): Contact the PostSnag team.
- [Support](https://postsnag.com/support): Help and support resources.
- [Affiliate Program](https://postsnag.com/affiliate): Information about earning commission by referring PostSnag.
## Optional
- [Terms of Service](https://postsnag.com/terms): Rules and conditions governing use of PostSnag.
- [Privacy Policy](https://postsnag.com/privacy): How PostSnag handles user and product data.
- [Refund Policy](https://postsnag.com/refunds): Current refund eligibility and request process.