robots.txt
See which AI crawlers other sites block →#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used: http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
User-agent: *
Crawl-delay: 10
# CSS, JS, Images
Allow: /misc/*.css$
Allow: /misc/*.css?
Allow: /misc/*.js$
Allow: /misc/*.js?
Allow: /misc/*.gif
Allow: /misc/*.jpg
Allow: /misc/*.jpeg
Allow: /misc/*.png
Allow: /modules/*.css$
Allow: /modules/*.css?
Allow: /modules/*.js$
Allow: /modules/*.js?
Allow: /modules/*.gif
Allow: /modules/*.jpg
Allow: /modules/*.jpeg
Allow: /modules/*.png
Allow: /profiles/*.css$
Allow: /profiles/*.css?
Allow: /profiles/*.js$
Allow: /profiles/*.js?
Allow: /profiles/*.gif
Allow: /profiles/*.jpg
Allow: /profiles/*.jpeg
Allow: /profiles/*.png
Allow: /themes/*.css$
Allow: /themes/*.css?
Allow: /themes/*.js$
Allow: /themes/*.js?
Allow: /themes/*.gif
Allow: /themes/*.jpg
Allow: /themes/*.jpeg
Allow: /themes/*.png
# Directories
Disallow: /includes/
Disallow: /misc/
Disallow: /modules/
Disallow: /profiles/
Disallow: /scripts/
Disallow: /themes/
# Files
Disallow: /CHANGELOG.txt
Disallow: /cron.php
Disallow: /INSTALL.mysql.txt
Disallow: /INSTALL.pgsql.txt
Disallow: /INSTALL.sqlite.txt
Disallow: /install.php
Disallow: /INSTALL.txt
Disallow: /LICENSE.txt
Disallow: /MAINTAINERS.txt
Disallow: /update.php
Disallow: /UPGRADE.txt
Disallow: /xmlrpc.php
# Paths (clean URLs)
Disallow: /admin/
Disallow: /comment/reply/
Disallow: /filter/tips/
Disallow: /node/add/
Disallow: /search/
Disallow: /search/*
Disallow: /user/register/
Disallow: /user/password/
Disallow: /user/login/
Disallow: /user/logout/
# Paths (no clean URLs)
Disallow: /?q=admin/
Disallow: /?q=comment/reply/
Disallow: /?q=filter/tips/
Disallow: /?q=node/add/
Disallow: /?q=search/
Disallow: /?q=user/password/
Disallow: /?q=user/register/
Disallow: /?q=user/login/
Disallow: /?q=user/logout/
# Wellcome custom rules
# /search is deliberately NOT disallowed here. It serves noindex (X-Robots-Tag
# in next.config.js plus the page meta tag), and a crawler has to be able to
# fetch the page to see that - a Disallow would leave the spam URLs already in
# the index sitting there. Compliant crawlers drop them once they read the
# noindex; non-compliant spam bots ignore robots.txt either way and are
# handled by the query guard in src/utils/validate-search-query.ts.
# (The /search/ rules above are the Drupal core paths, not this route.)
# Sitemap
Sitemap: https://wellcome.org/sitemap.xml
llms.txt
Compare with other sites' llms.txt files →# Wellcome
> Wellcome is an independent global charitable foundation based in the UK, investing more than £16 billion between 2022 and 2032 to advance knowledge about life and health, apply it to urgent health challenges, and ensure its benefits are more widely shared.
Wellcome funds researchers at every career stage across life sciences, medicine, social science, and the humanities, with focused programmes in infectious disease, mental health, and the health effects of climate change. It works with partners in the UK and across low- and middle-income countries in Africa, South Asia, and Southeast Asia, where locally led research is essential to solving health challenges.
## Research Funding
- [Research funding](https://wellcome.org/research-funding): How to apply for Wellcome funding, eligibility principles, and scheme types.
- [Find a funding opportunity](https://wellcome.org/research-funding/schemes): Browse all open and upcoming funding schemes by career stage and research type.
- [What we do and don't fund in discovery research](https://wellcome.org/research-funding/guidance/prepare-to-apply/discovery-research-schemes-remit): Guidance on the scope of Wellcome's discovery research funding and what falls outside our remit.
- [How to write a grant application](https://wellcome.org/research-funding/guidance/prepare-to-apply/how-to-write-wellcome-grant-application): Practical guidance on writing a strong Wellcome funding application.
- [How to prepare for an interview](https://wellcome.org/research-funding/guidance/prepare-to-apply/how-to-prepare-funding-interview): What to expect from a Wellcome funding interview and how to prepare.
- [Funded grants](https://wellcome.org/research-funding/funding-portfolio/funded-grants): Explore Wellcome's active and past funded grants.
- [Grant funding data](https://wellcome.org/research-funding/funding-portfolio/funding-data-2024): Annual summary of how Wellcome allocates its grant funding, including spend by region, scheme type, and research area.
- [Prepare to apply](https://wellcome.org/research-funding/guidance/prepare-to-apply): Overview of everything researchers need to know before submitting a funding application to Wellcome.
## Strategic Priorities
- [Our priorities](https://wellcome.org/our-priorities): An overview of Wellcome's three strategic priorities and its approach to discovery research.
- [Mental Health](https://wellcome.org/our-priorities/mental-health): Wellcome's approach to improving treatments, prevention, and understanding of mental health conditions globally.
- [Infectious Disease](https://wellcome.org/our-priorities/infectious-disease): Wellcome's approach to tackling infectious disease through partnerships, advocacy, and championing evidence, to drive progress in neglected or stalled areas and ensure life-saving innovations reach the communities who need them.
- [Discovery Research](https://wellcome.org/our-priorities/discovery-research): How Wellcome funds open-ended research that advances fundamental knowledge about life and health.
- [Climate and Health](https://wellcome.org/our-priorities/climate-and-health): How Wellcome funds research into the health impacts of climate change and works with policy communities to protect people's health.
## About Wellcome
- [About us](https://wellcome.org/about-us): Who we are, our mission, independence, and approach to funding science for better health.
- [How we are funded](https://wellcome.org/about-us/investments): How Wellcome generates income through its investment portfolio to fund charitable activities.
- [Annual report](https://wellcome.org/insights/reports/wellcome-annual-report): Wellcome's latest financial and impact reporting, including charitable expenditure and strategic progress.
- [History](https://wellcome.org/about-us/history-wellcome): The history of Wellcome, from Henry Wellcome's pharmaceutical business to today's independent global foundation.
## Policy and Advocacy
- [Advocacy and partnerships](https://wellcome.org/engagement-and-advocacy/advocacy-and-partnerships): How Wellcome works with governments, international organisations, and partners to shape science policy and improve global health outcomes.
- [Reports](https://wellcome.org/insights/reports): Key publications and research reports from Wellcome, including the Wellcome Global Monitor and thematic policy papers.
## News and articles
- [News and articles](https://wellcome.org/insights/articles): The latest announcements, research findings, and perspectives from Wellcome and the researchers we fund.
## Optional
- [Sustainability](https://wellcome.org/our-priorities/strategy/sustainability-addressing-our-environmental-impacts): Wellcome's approach to responsible investment, operational sustainability, and environmental commitments.
- [Better health for all](https://wellcome.org/our-priorities/strategy/equity): Wellcome's vision for equitable health outcomes and what drives our long-term investment strategy.