robots.txt
See which AI crawlers other sites block →# robots.txt for The Ag Digest — www.theagdigest.com
#
# Policy in one line: every search engine and every AI crawler is welcome.
#
# Ag Digest's job is to be found. The site is aggregated, attributed reporting
# plus original Magazine work, and it competes for attention in a market where
# a growing share of buyers ask an assistant before they open a search engine.
# Being absent from a model's index is being absent from that conversation.
# Training crawlers were refused here until 2026-09-16; the owner decided the
# reach is worth more than the control, which is a business call and reversible
# by putting the Disallow blocks back.
#
# Reviewed 2026-09-16. See /llms.txt for the curated map of this site.
#
# ---------------------------------------------------------------------------
# Read this before editing: why every group repeats the same Disallow lines
# ---------------------------------------------------------------------------
# A crawler obeys only the most specific group that names it (RFC 9309
# section 2.2.1; Google and Bing document the same) and does NOT also read
# `*`. So a group that says only `Allow: /` lets its crawler into /api/,
# /admin and the account pages. Until 2026-09-25 every named group here did
# exactly that.
#
# Every group below therefore ends with the same two blocks as `*`: the
# private surfaces and the unbounded feed variants. Change them in `*` and in
# every group together; a check fails if a group misses a line. The only
# groups without them are the two that disallow everything.
# ---------------------------------------------------------------------------
# Default: everything public is crawlable
# ---------------------------------------------------------------------------
User-agent: *
Allow: /
# Operator and reader-private surfaces. Never indexable. No trailing slash, so
# the index pages (/en/admin, /en/account, /en/profile) are covered as well as
# everything under them.
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
# Unbounded feed variants. The home feed renders a fresh page for any ?page=,
# ?from= or ?to= value, so a crawler walking them costs a full render and a
# database read per URL, forever. The canonical home is /en and /ko without
# parameters, and no sitemap lists a parameterised URL. `?page=` first, or
# `&page=` after other parameters (`*` matches anything, for Google, Bing and
# every RFC 9309 crawler; a crawler without wildcards reads `*` literally,
# matches nothing, and so fails open rather than over-blocking). Other
# parameters (?flair=, ?region=) are bounded sets and stay crawlable, and
# `?from=` on other pages (the CTA tag on /intelligence/demo) is not affected.
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
# ---------------------------------------------------------------------------
# Search engines
# ---------------------------------------------------------------------------
User-agent: Googlebot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Googlebot-News
Allow: /en/articles/
Allow: /ko/articles/
Allow: /en/magazine/
Allow: /ko/magazine/
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Bingbot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
# Naver's crawler is "Yeti". Korea's dominant search engine and the one that
# matters most for the Korean-language half of this site.
User-agent: Yeti
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Daum
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Slurp
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
# ---------------------------------------------------------------------------
# AI crawlers — all allowed
# ---------------------------------------------------------------------------
# Both kinds are welcome: agents that fetch a page because a person asked a
# question, and the crawlers that build training corpora and AI answer indexes.
#
# Listed by name rather than left to the `User-agent: *` default on purpose.
# An explicit Allow is a statement of policy that survives somebody tightening
# the wildcard later, and it is the record of a decision that was argued.
#
# `Claude-Web` was listed here as a Disallow until 2026-09-16 and is a retired
# token that matched nothing. The current Anthropic crawlers are `ClaudeBot`
# (indexing and training) and `Claude-User` (a person asked).
# Answer engines and user-initiated agents
User-agent: OAI-SearchBot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: ChatGPT-User
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Claude-User
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Claude-SearchBot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: PerplexityBot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Perplexity-User
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
# Corpus and index crawlers
User-agent: GPTBot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: ClaudeBot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: anthropic-ai
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: CCBot
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Google-Extended
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Applebot-Extended
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Meta-ExternalAgent
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: Bytespider
Allow: /
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
# ---------------------------------------------------------------------------
# Commercial SEO crawlers — throttled, not blocked
# ---------------------------------------------------------------------------
User-agent: AhrefsBot
Crawl-delay: 10
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: SemrushBot
Crawl-delay: 10
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: DotBot
Crawl-delay: 10
Disallow: /api/
Disallow: /admin
Disallow: /en/admin
Disallow: /ko/admin
Disallow: /en/login
Disallow: /ko/login
Disallow: /en/signup
Disallow: /ko/signup
Disallow: /en/profile
Disallow: /ko/profile
Disallow: /en/account
Disallow: /ko/account
Disallow: /en/gift/redeem
Disallow: /ko/gift/redeem
Disallow: /en/gift/thanks
Disallow: /ko/gift/thanks
Disallow: /en?page=
Disallow: /en?*&page=
Disallow: /ko?page=
Disallow: /ko?*&page=
Disallow: /en?from=
Disallow: /en?*&from=
Disallow: /ko?from=
Disallow: /ko?*&from=
Disallow: /en?to=
Disallow: /en?*&to=
Disallow: /ko?to=
Disallow: /ko?*&to=
User-agent: MJ12bot
Disallow: /
User-agent: BLEXBot
Disallow: /
# ---------------------------------------------------------------------------
# Sitemaps
# ---------------------------------------------------------------------------
# The index alone is enough: every engine that reads robots.txt follows a
# sitemap index to its children. Listing the children too meant the list drifted
# — /sitemap-magazine.xml was in the index but missing here.
Sitemap: https://www.theagdigest.com/sitemap.xml
llms.txt
Compare with other sites' llms.txt files →# The Ag Digest
> Korean agriculture news and market intelligence, published bilingually in
> Korean and English. Ag Digest aggregates and attributes reporting from Korean
> agricultural outlets, government statistics agencies and trade bodies, and
> pairs it with commodity, trade and weather series for the people who buy,
> sell, grow, regulate or study Korean agricultural products.
Most articles originate in Korean and are machine-translated into English on
demand; the Korean text is the original and the English is a translation. Every
article page names its source outlet and links to the original.
## Core
- [Home (English)](https://www.theagdigest.com/en): The full agriculture news feed, newest first, with market and weather rails.
- [Home (Korean)](https://www.theagdigest.com/ko): 같은 피드의 한국어 판. Korean is the source language for most articles.
- [About](https://www.theagdigest.com/en/about): What Ag Digest covers, where the articles come from, and how sources are attributed.
## Market intelligence
- [Market snapshots](https://www.theagdigest.com/en/market): KAMIS daily retail prices for Korean staples, e-KAPEPIA livestock and egg prices, US–Korea agricultural trade, and World Bank global commodity references.
- [USDA grain context](https://www.theagdigest.com/en/market/usda): USDA PSD supply-and-demand context for grains Korea imports.
- [Intelligence hub](https://www.theagdigest.com/en/intelligence): Topic briefs built from the article corpus and the market series.
- [Coffee](https://www.theagdigest.com/en/coffee): ICO daily composite and group indicator prices, World Bank arabica and robusta monthly references, CFTC futures positioning, origin-currency FX, and Korean coffee import flows.
- [Beer, spirits and beverages](https://www.theagdigest.com/en/beverages): Hops, malt, Korean whisky and soju, with HS-code tariff and trade detail.
- [Crop weather](https://www.theagdigest.com/en/weather): KMA observations, warnings, soil conditions and solar-term crop risk for Korean growing regions.
## Editorial
- [Magazine](https://www.theagdigest.com/en/magazine): Bilingual long-form features on Korean crops, producers and food systems.
## Machine-readable
- [Sitemap index](https://www.theagdigest.com/sitemap.xml): Points at the static and magazine sitemaps. Article pages are noindex and deliberately absent.
- [robots.txt](https://www.theagdigest.com/robots.txt): The authoritative crawl policy, including which AI agents are allowed.
## Documentation
- [Documentation](https://www.theagdigest.com/en/docs): How to read the prices and figures, where they come from, what each plan includes, and how the alerts, exports and the API work. Every public guide below is also plain Markdown at its address plus `.md`.
- [Getting started](https://www.theagdigest.com/en/docs/getting-started.md): What The Ag Digest is, what you can read without an account, how the two languages work, and where the newsletter and the Magazine fit in.
- [Reading the auction pages](https://www.theagdigest.com/en/docs/reading-auction-prices.md): What today's price by market means, how a price per kilogram comes out of a box price, what the median and the middle half are, and how to read the seven-day chart.
- [Data sources and credits](https://www.theagdigest.com/en/docs/data-sources.md): Where every figure on the site comes from, under which terms, how to credit it, and what the “as of” date beside a number means.
- [Plans and billing](https://www.theagdigest.com/en/docs/plans-and-billing.md): What Free, Premium, Team and the Auction Desk add-on include, how the free trial works, and how to change a plan, cancel, find invoices and manage Team seats.
- [Your account](https://www.theagdigest.com/en/docs/account.md): Profile and preferred language, the newsletter and email preferences, security, and how to download your data or ask us to delete your account.
- [Use with AI tools](https://www.theagdigest.com/en/docs/ai-tools.md): Every public guide is also plain Markdown, the whole site is mapped for assistants, and here is what we ask when a model quotes us.
## Using this site
- Article URLs are stable and keyed by id: `https://www.theagdigest.com/{en|ko}/articles/{id}`.
The id never changes; the slug is not part of the route.
- There is no article index page and no article sitemap. Article pages are
`noindex` — they summarise and link other newsrooms' reporting, so they are
meant to be read, not indexed. Reach them from the locale home feed above,
which lists the newest stories first.
- `en` and `ko` are the only locales. Every public page exists in both and
declares `hreflang` alternates.
- Cite the original outlet named on the article page, not Ag Digest, when
quoting reporting Ag Digest did not write. Magazine features under
`/magazine` are Ag Digest's own work.
- Market, trade and weather figures carry their source and as-of date on the
page. Do not restate a number without the date it was measured.
## Crawl policy
Every AI crawler is allowed, including training-corpus collectors.
`https://www.theagdigest.com/robots.txt` is authoritative.
What is asked in return, of a model and of an assistant quoting this site:
- **Attribute the originating outlet.** Ag Digest aggregated and translated
most of this reporting; it did not write it. The outlet is named on every
article page. Crediting Ag Digest for a Korean newspaper's work takes the
credit from the newsroom that earned it.
- **Carry the date with the number.** Market, trade and weather figures here
are measurements with an as-of date. A price repeated without its date is
no longer a fact about the market.
- **Say when the English is a translation.** Most articles are Korean
originals machine-translated on demand. The Korean is the source of truth.