consciousnesslibrary.org is built with Turbo, hosted on DigitalOcean. It measures traffic with Plausible Analytics. It sends email through Brevo (Sendinblue) and Amazon SES.
| Technology | Version | First seen |
|---|---|---|
| JavaScript Frameworks & Libraries1 | ||
| – | 8 Nov 2026 | |
| Frontend Build Tools & CSS1 | ||
| – | 8 Nov 2026 | |
| Web Servers, Languages & Backend Frameworks2 | ||
| – | 8 Nov 2026 | |
| CDN & Hosting1 | ||
| – | 8 Nov 2026 | |
| Analytics & Tag Management1 | ||
| – | 8 Nov 2026 | |
| Email Marketing & Lead Capture2 | ||
| – | 8 Nov 2026 | |
| Transactional Email12 | ||
| – | 8 Nov 2026 | |
| Accessibility1 | ||
| – | 8 Nov 2026 | |
| Donations & Fundraising2 | ||
Registration from the registry's RDAP record, the certificate the site serves, and its rank in public traffic lists.
The crew hasn’t read this site’s colors yet. We read a palette when we capture a site’s screenshot, busiest sites first. Meanwhile, browse palettes from other sites.
Counted from every stack change we've recorded: of the sites we watched running one of this site's tools, how many went on to add another. A pattern across sites, not a forecast for this one.
mail.protonmail.chmailsec.protonmail.chns3.digitalocean.comns2.digitalocean.comns1.digitalocean.comv=spf1 include:_spf.protonmail.ch ~allprotonmail-verification=51980e964804ef438ace2d2eb4d8bca89aa2e4d9google-site-verification=vRQfc3s3XzKhuac1_7FVMpAFOpnxIM96nKneTL7yHNEv=DMARC1; p=quarantine# Default (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, etc.): # everything is crawlable except admin and faceted/paginated listing URLs. # Article pages, blogs, and discussions are all fair game. User-agent: * Disallow: /admin Disallow: /research/admin # Auth chrome is noindexed already; disallowing it too stops crawlers from # spending budget fetching a sign-in form per article (?article_id= variants). Disallow: /session Disallow: /registration Disallow: /passwords Disallow: /research?*page= Disallow: /research?*filter= Disallow: /research?*query= # ?q= is the controller's alias for ?query=: the same search, a second URL. # Rules can't name a parameter, so the two spellings of "a param called q" # are listed rather than *q=, which would also catch any param ending in q. Disallow: /research?q= Disallow: /research?*&q= # The synthesis "reviewed studies" list, linked from every topic, pair and # recap page: a filtered copy of the index, canonical to /research. Disallow: /research?*meta_analysis_id= # Article pages used to carry back-to-search params (?search_page= etc.) that # multiplied one article into dozens of crawlable URLs; result rows link clean # now, but the rule stays for the crawlers still holding those URLs. The clean # canonical URL stays open. # ?topic= is the exception and must stay crawlable: it is the only link a topic # page gives an article, so blocking it would cost every article the internal # link from its topic. The set is bounded (one value per topic the article is # in) and every variant declares the clean URL canonical. Allow precedes the # Disallow because the more specific rule wins. Allow: /research/*?topic= Disallow: /research/*?* # Legacy pre-rename paths (301 to /research); same param rules apply. Disallow: /articles/admin Disallow: /articles?*page= Disallow: /articles?*filter= Disallow: /articles?*query= Disallow: /articles?q= Disallow: /articles?*&q= Disallow: /articles/*?* # Topic and pair pagination stays open on purpose: it is the crawl path into # the corpus. Long topics run to hundreds of pages (the biggest past a # thousand), so each page past the first is built to be crawled: it declares # itself canonical (?page=N), carries its own title, renders the article list # alone rather than repeating the overview's synthesis, and 404s past the last # page. Round-number "jump to page" links keep deep pages a few hops from the # first. Closing it left the 95k-row author roster as the only pagination a # crawler could walk, which is exactly backwards. # Authors: page 1 of the roster stays open, the rest does not. It is ~1,900 # pages of near-identical rows whose destinations are thin profiles (already # noindexed under Author.thin_profile?), and it was absorbing about half of # Googlebot's crawl. ?sort= is the same roster reshuffled, so it is worse. Disallow: /authors?*page= Disallow: /authors?*sort= # A profile or journal page re-sorted is the same papers in another order. # Their ?page= stays open (each page is its own canonical document). Disallow: /authors/*?*sort= Disallow: /journals/*?*sort= # Faceted/paginated trial listings. Disallow: /trials?*page= Disallow: /trials?*query= Disallow: /trials?*status= Disallow: /trials?*phase= # The corpus map's data feeds: a binary coordinate payload and a # megabytes-long title list, no reading for anyone but the canvas. Disallow: /map/points Disallow: /map/labels # On-demand AI fetchers acting for a live user are readers, not crawls: an # assistant answering one person's question may use search and facets. Bulk # training/index crawlers (GPTBot, ClaudeBot, PerplexityBot, Googlebot) stay # under the default rules above - a UA group here overrides * entirely, so # only admin stays closed. Rack::Attack rate limits apply regardless. User-agent: Claude-User User-agent: ChatGPT-User User-agent: Perplexity-User User-agent: DuckAssistBot Disallow: /admin Disallow: /research/admin Disallow: /articles/admin # Aggressive scrapers and SEO crawlers that bring traffic but no readers User-agent: Bytespider User-agent: PetalBot User-agent: SemrushBot User-agent: AhrefsBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: ZoominfoBot User-agent: SERankingBacklinksBot Disallow: / Sitemap: https://consciousnesslibrary.org/sitemap.xml
| – |
| 8 Nov 2026 |
| – |
| 8 Nov 2026 |
| – |
| 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – | 8 Nov 2026 |
| – |
| 8 Nov 2026 |
| – | 8 Nov 2026 |