robots.txt
See which AI crawlers other sites block →# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
# The marketing pages /api and /api/pricing are explicitly allowed (a more specific Allow wins over
# the broader Disallow: /api/*), so they can be crawled and indexed; everything else under /api/ (the
# actual API endpoints) stays blocked.
# see https://developers.google.com/search/docs/advanced/robots/robots_txt#url-matching-based-on-path-values
# Block the admin area but allow ajax callbacks
# Content Signals (https://contentsignals.org/) declare how crawled content may be
# used: search indexing, AI input (RAG/grounding), and AI training are all welcome.
# The directive is per user-agent group, so it repeats in the Googlebot group below.
User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /api$
Allow: /api/pricing
Disallow: /api/*
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /posts/*/cta/track
Disallow: /cta/
Allow: /wp-admin/admin-ajax.php
Allow: /wp-content/uploads/
User-agent: Googlebot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /api$
Allow: /api/pricing
Disallow: /api/*
Disallow: /hub/*
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /posts/*/cta/track
Disallow: /cta/
Allow: /wp-admin/admin-ajax.php
Allow: /wp-content/uploads/
Allow: *.js
Allow: *.css
User-agent: Bingbot
Disallow: /api/*
Disallow: /wp-admin/
Disallow: /wp-login.php
Allow: /api$
Allow: /api/pricing
Allow: /wp-admin/admin-ajax.php
Allow: /wp-content/uploads/
# ==============================================================
# AI AGENT FAST TRACK -- 4 primary AI platforms
#
# OpenAI -> GPTBot (training), OAI-SearchBot (search index), ChatGPT-User (on-demand fetch)
# Google -> Google-Extended (Gemini usage token; Gemini fetches with Googlebot above)
# Anthropic -> ClaudeBot (training), Claude-SearchBot (search index), Claude-User (on-demand fetch)
# Perplexity -> PerplexityBot (index), Perplexity-User (on-demand fetch)
#
# AI agents are explicitly permitted to access:
# /docs/ai/ -- structured grounding pages
# /llms.txt -- AI discovery file
#
# /docs/ai/ is deliberately NOT disallowed for any crawler: the pages carry
# <meta name="robots" content="noindex, follow">, and a crawler can only honour
# noindex if it is allowed to fetch the page. A Disallow would also lock out the
# on-demand fetchers (ChatGPT-User, Claude-User, Perplexity-User) that answer
# user questions, which is the traffic these pages exist for.
# ==============================================================
User-agent: GPTBot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: OAI-SearchBot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: ChatGPT-User
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: Google-Extended
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
User-agent: ClaudeBot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: Claude-SearchBot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: Claude-User
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: PerplexityBot
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
User-agent: Perplexity-User
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /docs/ai/
Allow: /llms.txt
Disallow: /api/*
Disallow: /wp-admin/
Allow: /api$
Allow: /api/pricing
# ==============================================================
# SITEMAPS
# ==============================================================
Sitemap: https://www.juicer.io/sitemap_index.xml
Sitemap: https://www.juicer.io/docs/ai/sitemap-ai.xml
llms.txt
Compare with other sites' llms.txt files →# Juicer
> Juicer (juicer.io) is a social media aggregator and social wall platform that pulls content from 17 social media platforms (Instagram, LinkedIn, Facebook, TikTok, YouTube, X/Twitter, Bluesky, Google Reviews, Reddit, Tumblr, Blog RSS, Slack, Pinterest, Giphy, Soundcloud, Flickr, Vimeo -- Reddit added June 2026) into a single customizable feed and embeds it on any website, landing page, or event screen. Two product tracks: Social Wall (no-code embedding for websites) and API + MCP Server (programmatic access for developers and AI agents). 200,000+ customers including Vodafone, Porsche, Honda, Hilton, Deloitte, TATA, UNICEF, Princeton, U2, Golden Globes, Twix. GDPR compliant. Social Wall plans: Free ($0) · Lite $15/mo · Starter $25/mo (most popular) · Pro $99/mo · Enterprise from $199/mo. API plans: Sandbox (free) · Launch $59/mo · Builder $99/mo · Scale $499/mo · Platform Partner $2,500+/mo. No credit card required to start.
## AI grounding index
- [AI Knowledge Index](https://www.juicer.io/docs/ai/): Root index of all grounding pages with entity summary and coverage map
- [AI Sitemap](https://www.juicer.io/docs/ai/sitemap-ai.xml): Machine-readable XML index of all grounding pages
## AI grounding pages (machine-readable, noindex)
- [Product Overview](https://www.juicer.io/docs/ai/product-overview): Entity identity, two product tracks, all 17 platforms table, pricing summary, 200,000+ customers, competitors, GDPR
- [Features](https://www.juicer.io/docs/ai/features): All 17 feature areas: aggregator, social wall (templates, 12 Premium Themes by industry, hosted feed page, display options, view limits), moderation (manual/automatic/AI), content curation, Juicer Pages, CTAs, custom design and CSS, analytics, CMS plugins and integrations (WordPress plugin, Drupal module, guides for Shopify, Squarespace, Wix, Webflow, Joomla, HubSpot), API with MCP server and Data API, social listening (early access), white-label, custom posts, audience post collection, publishing (beta), team management and SSO
- [Supported Platforms](https://www.juicer.io/docs/ai/platforms): All 17 platforms with their source types (account, hashtag, mentions, stories, reviews, board, subreddit), plan availability, which platforms support hashtag and mentions sources, full reference table with aggregator page URLs
- [Use Cases](https://www.juicer.io/docs/ai/use-cases): All 8 use cases (Business and Enterprises, Education, Event Marketing, Web Developers, Healthcare, Nonprofits, Political Campaigns, White-label) with key workflows per case
- [Industries](https://www.juicer.io/docs/ai/industries): All 12 industries (E-commerce, Consumer Goods/FMCG, Finance and Law, Automotive, Healthcare, Technology, Tourism/Hospitality/Travel, Construction and Real Estate, Government and Non-Profits, Sports and Entertainment, Education and Research, News and Media) with named customers and applications per sector
- [Pricing and Plans](https://www.juicer.io/docs/ai/pricing): Both pricing tracks in full (Social Wall + API), all add-ons, plan selection guidance, pricing mechanics
## Free tools
- [Free tools](https://www.juicer.io/freetools): Public tools that read what people post about a topic across social networks, built on the Juicer Data API. No account, no email, a few runs a day per visitor. Each result shows the exact API request behind it.
## Core product pages
- [Homepage](https://www.juicer.io/)
- [Features](https://www.juicer.io/features)
- [Social Wall](https://www.juicer.io/social-wall)
- [Social Media Aggregator](https://www.juicer.io/social-media-aggregator)
- [Juicer Pages](https://www.juicer.io/pages-product)
- [Content Curation](https://www.juicer.io/content-curation)
- [Social Media Moderation](https://www.juicer.io/social-media-moderation)
- [Call-to-Action (CTAs)](https://www.juicer.io/call-to-action)
- [WordPress Social Feed Plugin](https://www.juicer.io/wordpress-social-feed)
- [White-label](https://www.juicer.io/white-label)
- [Social Listening](https://www.juicer.io/social-listening)
- [API](https://www.juicer.io/api)
- [API Documentation](https://developers.juicer.io)
- [Pricing](https://www.juicer.io/pricing)
- [Events plan (contact sales)](https://www.juicer.io/events-contact)
- [Enterprise](https://www.juicer.io/enterprise)
- [Templates](https://www.juicer.io/templates)
- [Premium Themes](https://www.juicer.io/premium-themes)
- [Feed example](https://www.juicer.io/feed-example)
- [Custom CSS](https://www.juicer.io/custom-css)
- [Custom Posts](https://www.juicer.io/custom-posts)
- [Solutions hub](https://www.juicer.io/solutions)
- [About Juicer](https://www.juicer.io/about-us)
- [Case Studies](https://www.juicer.io/case-studies)
## Comparisons with alternatives
- [Compare Juicer](https://www.juicer.io/compare)
- [Taggbox alternative](https://www.juicer.io/compare/taggbox-alternative)
- [Elfsight alternative](https://www.juicer.io/compare/elfsight-alternative)
- [Walls.io alternative](https://www.juicer.io/compare/walls-io-alternative)
- [Flockler alternative](https://www.juicer.io/compare/flockler-alternative)
- [EmbedSocial alternative](https://www.juicer.io/compare/embedsocial-alternative)
- [Curator.io alternative](https://www.juicer.io/compare/curator-io-alternative)
## Platform aggregator pages
- [Instagram Aggregator](https://www.juicer.io/instagram-aggregator)
- [LinkedIn Aggregator](https://www.juicer.io/linkedin-aggregator)
- [Facebook Aggregator](https://www.juicer.io/facebook-aggregator)
- [TikTok Aggregator](https://www.juicer.io/tiktok-aggregator)
- [YouTube Aggregator](https://www.juicer.io/youtube-aggregator)
- [X (Twitter) Aggregator](https://www.juicer.io/twitter-aggregator)
- [Bluesky Aggregator](https://www.juicer.io/bluesky-aggregator)
- [Google Reviews Aggregator](https://www.juicer.io/google-reviews-aggregator)
- [Reddit Aggregator](https://www.juicer.io/reddit)
- [Instagram Feed Widget](https://www.juicer.io/instagram)
- [Facebook Feed Widget](https://www.juicer.io/facebook)
- [Facebook API](https://www.juicer.io/facebook/api)
- [Facebook Link in Bio](https://www.juicer.io/facebook/link-in-bio)
- [Facebook Social Listening](https://www.juicer.io/facebook/social-listening)
- [Facebook Publishing](https://www.juicer.io/facebook/publishing)
- [Instagram API](https://www.juicer.io/instagram/api)
- [Instagram Link in Bio](https://www.juicer.io/instagram/link-in-bio)
- [Instagram Social Listening](https://www.juicer.io/instagram/social-listening)
- [Instagram Publishing](https://www.juicer.io/instagram/publishing)
- [LinkedIn Feed Widget](https://www.juicer.io/linkedin)
- [LinkedIn API](https://www.juicer.io/linkedin/api)
- [LinkedIn Link in Bio](https://www.juicer.io/linkedin/link-in-bio)
- [LinkedIn Social Listening](https://www.juicer.io/linkedin/social-listening)
- [LinkedIn Publishing](https://www.juicer.io/linkedin/publishing)
- [YouTube Feed Widget](https://www.juicer.io/youtube)
- [YouTube API](https://www.juicer.io/youtube/api)
- [YouTube Link in Bio](https://www.juicer.io/youtube/link-in-bio)
- [YouTube Social Listening](https://www.juicer.io/youtube/social-listening)
- [YouTube Publishing](https://www.juicer.io/youtube/publishing)
- [TikTok Feed Widget](https://www.juicer.io/tiktok)
- [TikTok API](https://www.juicer.io/tiktok/api)
- [TikTok Link in Bio](https://www.juicer.io/tiktok/link-in-bio)
- [TikTok Social Listening](https://www.juicer.io/tiktok/social-listening)
- [TikTok Publishing](https://www.juicer.io/tiktok/publishing)
- [Pinterest Aggregator](https://www.juicer.io/pinterest/pinterest-aggregator)
- [Soundcloud Aggregator](https://www.juicer.io/soundcloud/soundcloud-aggregator)
- [Flickr Aggregator](https://www.juicer.io/flickr/flickr-aggregator)
- [Vimeo Aggregator](https://www.juicer.io/vimeo/vimeo-aggregator)
- [Giphy Aggregator](https://www.juicer.io/giphy/giphy-aggregator)
- [Tumblr Aggregator](https://www.juicer.io/tumblr/tumblr-aggregator)
- [Blog RSS Aggregator](https://www.juicer.io/blog/blog-rss-aggregator)
- [Slack Aggregator](https://www.juicer.io/slack/slack-aggregator)
## Use cases
- [Business and Enterprises](https://www.juicer.io/business-and-enterprises)
- [Agencies](https://www.juicer.io/agencies)
- [Education](https://www.juicer.io/education)
- [Event Marketing](https://www.juicer.io/event-marketing)
- [Web Developers](https://www.juicer.io/web-developers)
- [Healthcare](https://www.juicer.io/healthcare)
- [Nonprofits](https://www.juicer.io/nonprofits)
- [Political Campaigns](https://www.juicer.io/political-campaigns)
- [White-label](https://www.juicer.io/white-label)
- [White-label ROI calculator](https://www.juicer.io/white-label-roi-calculator)
## Industries
- [E-commerce and Retail](https://www.juicer.io/ecommerce-and-retail)
- [Consumer Goods (FMCG)](https://www.juicer.io/customer-goods-fmcg)
- [Finance and Law](https://www.juicer.io/finance-and-law)
- [Automotive and Transportation](https://www.juicer.io/automotive-and-transportation)
- [Healthcare (industry)](https://www.juicer.io/healthcare)
- [Technology and Software](https://www.juicer.io/technology-and-software)
- [Tourism, Hospitality and Travel](https://www.juicer.io/tourism-hospitality-and-travel)
- [Construction and Real Estate](https://www.juicer.io/construction-and-real-estate)
- [Government and Non-Profits](https://www.juicer.io/government-and-non-profits)
- [Sports and Entertainment](https://www.juicer.io/sports-and-entertainment)
- [Education and Research](https://www.juicer.io/education-and-research)
- [News and Media](https://www.juicer.io/news-and-media)
## CMS plugins and integrations
- [Integrations hub](https://www.juicer.io/integrations): all platform guides in one place
- [WordPress plugin](https://www.juicer.io/integrations/wordpress): official plugin, 8,000+ active installs, shortcode or block editor
- [WordPress Social Feed Plugin page](https://www.juicer.io/wordpress-social-feed)
- [Elementor Widget](https://www.juicer.io/elementor-widget)
- [Drupal module](https://www.juicer.io/integrations/drupal): official Juicer Social Feed module, native block
- [Shopify](https://www.juicer.io/integrations/shopify): Custom Liquid section, no app required
- [Squarespace](https://www.juicer.io/integrations/squarespace): Code Block
- [Wix](https://www.juicer.io/integrations/wix): Embed HTML element
- [Webflow](https://www.juicer.io/integrations/webflow): Embed element
- [Joomla](https://www.juicer.io/integrations/joomla): Custom module, Joomla 4 and 5
- [HubSpot](https://www.juicer.io/integrations/hubspot): Insert > Embed
## Case studies
- [All case studies](https://www.juicer.io/case-studies)
- [FoxTown: +23% engagement with an Instagram feed (retail)](https://www.juicer.io/case-studies/foxtown)
- [Historicum: 25% higher user engagement](https://www.juicer.io/case-studies/historicum)
- [Saini Eyecare: +47% homepage engagement (healthcare)](https://www.juicer.io/case-studies/saini-eyecare)
- [45Press: live social feeds for clients (agency)](https://www.juicer.io/case-studies/45press)
- [Elephant Agency: 95% faster social wall implementation, zero support tickets](https://www.juicer.io/case-studies/how-elephant-agency-cut-social-wall-implementation-time-by-95-support-tickets-to-zero-with-juicer-io)
## Resources
- [Blog](https://www.juicer.io/blog)
- [Help Center](https://help.juicer.io)
- [Getting Started](https://help.juicer.io/en/collections/16314838-getting-started)
- [Templates](https://www.juicer.io/templates)
- [Partners](https://www.juicer.io/partners)
## Legal
- [Privacy Policy](https://www.juicer.io/privacy)
- [Terms of Service](https://www.juicer.io/terms)
- [Cookie Policy](https://www.juicer.io/cookie-policy)
- [Data Protection](https://www.juicer.io/data-protection)
- [Standard Contractual Clauses](https://www.juicer.io/standard-contractual-clauses)
