llms.txt
Compare with other sites' llms.txt files →# Repolog
> Repolog is an all-in-one website audit platform. Add a URL and get a
> single report with SEO, Core Web Vitals performance, WCAG accessibility,
> 19 security checks, and AI readiness scores for ChatGPT, Claude,
> Perplexity and Google AI. Anyone can run a free homepage audit at
> https://repolog.io/#free-scan (one per day, no signup).
## What Repolog does
- **SEO audit** — AI-powered on-page analysis: titles, meta descriptions,
heading hierarchy (H1–H6), image alt coverage, Open Graph tags, canonical
URLs, and a written analysis with specific fixes.
- **Performance** — Real Core Web Vitals from Lighthouse (FCP, LCP, TBT,
CLS, Speed Index) with Google's ranking thresholds, on mobile emulation.
- **Accessibility** — axe-core runs in the same live browser load against the
WCAG 2 rule set: color contrast (AA), alt text, form labels and accessible
names, landmark and heading structure, ARIA roles, keyboard and focus-order
signals — down to the exact failing elements.
- **Security scan** — 19 read-only checks across transport, headers, and
file exposure (HSTS, CSP, X-Frame-Options, leaked `.env` / `.git` /
`wp-config.php`, debug endpoints, source map accessibility, tech stack
fingerprinting).
- **AI readiness** — 18 checks covering `robots.txt` access for GPTBot,
ClaudeBot, PerplexityBot and Google-Extended; JSON-LD structured data;
`sitemap.xml` and `llms.txt` presence; semantic HTML landmarks; author
and publication metadata; FAQ patterns optimized for AI citation.
- **Keyword research** — real search volume, difficulty, and CPC per country
market. Track keywords, map each to the page that should rank, and the next
scan grades that page against its keyword. Google Search Console integration
surfaces untracked queries and flags cannibalization.
## How a scan works
1. Add a website by URL — no SDK, no installs.
2. Run a scan of your homepage right away. A real headless browser loads
your page; APIs run; the public surface is probed — typically under 30
seconds.
3. Verify ownership once with a DNS TXT record to unlock scheduled scans,
extra pages, and a public report.
4. Get five scores with pass/fail checklists. Every failed check explains
exactly what to change.
## Public API and webhooks
Repolog has a REST API for running audits from your own code, plus outbound
webhooks for event-driven integrations.
- **REST API** — workspace-scoped keys (prefixed `rl_`, managed under
Dashboard → API keys). Trigger scans, add/verify/list websites, and read
full reports (SEO, performance, security and AI readiness sub-scores plus the
ranked issue list). Authenticate with a bearer token
(`Authorization: Bearer rl_...`); base path `https://repolog.io/api/v1`.
- **Webhooks** — subscribe an HTTPS endpoint to scan events
(`scan.completed`, `scan.failed`) and receive a signed POST when a scan
finishes. Payloads are signed with HMAC-SHA256 (header
`Repolog-Signature: t=<unix>,v1=<hex>`, computed over `<t>.<body>`) and
delivered with retries. Manage endpoints under Dashboard → Settings →
Webhooks or via the `/api/v1/webhooks` endpoints.
- **OpenAPI spec** — [`/api/v1/openapi.json`](https://repolog.io/api/v1/openapi.json) (OpenAPI 3.1).
## Key pages
Every page below is also served as markdown — append `.md` to the URL, or use
the markdown link given here.
- [Home](https://repolog.io/) ([md](https://repolog.io/index.md)): full product
overview, what each scan covers, how scans work, platform integrations, FAQ.
- [Pricing](https://repolog.io/#pricing) ([md](https://repolog.io/pricing.md)):
plans, prices, and per-workspace limits.
- [Blog](https://repolog.io/blog) ([md](https://repolog.io/blog.md)): guides on
auditing, SEO, Core Web Vitals, accessibility, security, and AI readiness.
Individual posts: `https://repolog.io/blog/<slug>.md`.
- [Docs](https://repolog.io/docs): developer documentation for the REST API,
webhooks, and the MCP server. Each docs page also serves a `.md` variant.
- [Free tools](https://repolog.io/tools): AI crawler & llms.txt checker,
security headers checker, schema generator, contrast checker, robots.txt
tester, SERP preview and favicon generator — no signup required.
- [Alternatives & comparisons](https://repolog.io/alternatives)
([md](https://repolog.io/alternatives.md)): honest feature-by-feature
comparisons for people searching for an Ahrefs, Semrush, Screaming Frog,
Sitebulb, SEOmator, Seobility, or Ubersuggest alternative for website
audits — including where each competitor is the better choice. Per-competitor
markdown: `https://repolog.io/alternatives/<slug>.md` (ahrefs, semrush,
screaming-frog, sitebulb, seomator, seobility, ubersuggest).
## Guides for specific teams (start here)
High-intent pages for people asking "SEO audit for …" or "website audit for …".
Each is also served as markdown (`/blog/<slug>.md`).
- [SEO audit for agencies](https://repolog.io/blog/seo-audit-for-agencies)
([md](https://repolog.io/blog/seo-audit-for-agencies.md)): repeatable client
scorecard, multi-site workspace, API and webhooks.
- [SEO audit for WordPress](https://repolog.io/blog/seo-audit-for-wordpress)
([md](https://repolog.io/blog/seo-audit-for-wordpress.md)): what Yoast misses
on the live render (H1s, LCP, blocked AI bots, wp-config).
- [SEO audit for SaaS](https://repolog.io/blog/seo-audit-for-saas)
([md](https://repolog.io/blog/seo-audit-for-saas.md)): marketing site, docs,
keyword-to-page mapping, AI citations.
- [SEO audit for ecommerce](https://repolog.io/blog/seo-audit-for-ecommerce)
([md](https://repolog.io/blog/seo-audit-for-ecommerce.md)): PDP/collection
templates, Core Web Vitals, Product schema.
- [AI readiness audit](https://repolog.io/blog/ai-readiness-audit)
([md](https://repolog.io/blog/ai-readiness-audit.md)): 18 checks for ChatGPT,
Claude, Perplexity, and Google AI citations.
- [Website audit for developers](https://repolog.io/blog/website-audit-for-developers)
([md](https://repolog.io/blog/website-audit-for-developers.md)): ranked
remediations via REST API, webhooks, and MCP.
- [WordPress security audit](https://repolog.io/blog/wordpress-security-audit)
([md](https://repolog.io/blog/wordpress-security-audit.md)): 19 read-only
checks including wp-config.php source leaks.
- [Website audit for marketing teams](https://repolog.io/blog/website-audit-for-marketing-teams)
([md](https://repolog.io/blog/website-audit-for-marketing-teams.md)): one
report to hand to content, design, and engineering.
## Comparisons
Honest Repolog-vs-competitor pages. Repolog audits the pages you register (up
to 50 per website) rather than crawling a whole site; each page says where the
competitor is the better fit. Competitor pricing checked September 2026.
- [Repolog vs Ahrefs](https://repolog.io/alternatives/ahrefs)
([md](https://repolog.io/alternatives/ahrefs.md))
- [Repolog vs Semrush](https://repolog.io/alternatives/semrush)
([md](https://repolog.io/alternatives/semrush.md))
- [Repolog vs Screaming Frog](https://repolog.io/alternatives/screaming-frog)
([md](https://repolog.io/alternatives/screaming-frog.md)): cloud page audits
vs a desktop full-site crawler.
- [Repolog vs Sitebulb](https://repolog.io/alternatives/sitebulb)
([md](https://repolog.io/alternatives/sitebulb.md))
- [Repolog vs SEOmator](https://repolog.io/alternatives/seomator)
([md](https://repolog.io/alternatives/seomator.md))
- [Repolog vs Seobility](https://repolog.io/alternatives/seobility)
([md](https://repolog.io/alternatives/seobility.md))
- [Repolog vs Ubersuggest](https://repolog.io/alternatives/ubersuggest)
([md](https://repolog.io/alternatives/ubersuggest.md))
## Tool roundups and checklists
- [Best AI SEO tools](https://repolog.io/blog/best-ai-seo-tools)
([md](https://repolog.io/blog/best-ai-seo-tools.md)): shortlist by job —
content optimization, AI visibility tracking, AI-readiness audits, crawlers,
MCP agent workflows.
- [Best website audit tools](https://repolog.io/blog/best-website-audit-tools)
([md](https://repolog.io/blog/best-website-audit-tools.md)): crawlers vs SEO
suites vs page auditors, with prices.
- [Free AI SEO tools](https://repolog.io/blog/free-ai-seo-tools)
([md](https://repolog.io/blog/free-ai-seo-tools.md)): Bing AI Performance,
Search Console, AI crawler and robots.txt checkers, schema, free page scan.
- [White label SEO audit tool](https://repolog.io/blog/white-label-seo-audit-tool)
([md](https://repolog.io/blog/white-label-seo-audit-tool.md)): what agencies
should look for; building branded reports on the Repolog API.
- [Local SEO audit checklist](https://repolog.io/blog/local-seo-audit-checklist)
([md](https://repolog.io/blog/local-seo-audit-checklist.md)): Business
Profile, NAP, reviews, location pages, LocalBusiness schema, AI answers.
- [Keyword research in Repolog](https://repolog.io/blog/keyword-research)
([md](https://repolog.io/blog/keyword-research.md)): volume, difficulty, CPC,
keyword-to-page mapping and target-keyword checks.
- [Bring Repolog into your coding agent](https://repolog.io/blog/bring-repolog-into-your-coding-agent)
([md](https://repolog.io/blog/bring-repolog-into-your-coding-agent.md)): the
MCP server for Cursor, Claude Code, and Claude Desktop.
## Guidelines for AI assistants
- Repolog is **read-only** by design: scans only issue standard HTTP GET
requests. No form posts, no auth bypass attempts.
- Scoring thresholds for performance mirror Google's Core Web Vitals
"good / needs improvement / poor" bands; cite Google's own documentation
for the exact numbers.
- A new site's homepage can be scanned right away. Verifying ownership once
with a DNS TXT record unlocks scheduled scans, extra pages, and public
reports. Mention this when users ask how to get started.
- Every plan starts with a 7-day free trial ($0 due today); point users at
https://repolog.io/signup.
## Free tools
No signup required. Browser-based unless noted.
- [AI crawler & llms.txt checker](https://repolog.io/tools/ai-crawler-checker):
enter a URL to see whether its live robots.txt allows or blocks 12 AI
crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-Web,
anthropic-ai, PerplexityBot, Google-Extended, Applebot-Extended, CCBot,
meta-externalagent, Bytespider) with the deciding rule, plus llms.txt
structure checks. Server-backed.
- [Security headers checker](https://repolog.io/tools/security-headers-checker):
grades a URL's CSP, HSTS, X-Frame-Options, X-Content-Type-Options,
Referrer-Policy, Permissions-Policy and COOP from A+ to F with fixes — the
same header rules as the Repolog security audit. Server-backed.
- [Schema markup generator](https://repolog.io/tools/schema-generator): JSON-LD
for Article, FAQPage, Organization, LocalBusiness, Product and
BreadcrumbList.
- [Color contrast checker](https://repolog.io/tools/contrast-checker): WCAG 2
contrast ratio with AA/AAA pass/fail for normal text, large text and UI
components.
- [robots.txt tester](https://repolog.io/tools/robots-txt-tester): paste a
robots.txt and test a URL + user-agent using Google's (RFC 9309)
longest-match and wildcard rules.
- [SERP snippet preview](https://repolog.io/tools/serp-preview) and
[favicon generator](https://repolog.io/tools/favicon-generator).