llms.txt
Compare with other sites' llms.txt files →# Apart Research
> Apart Research is a nonprofit AI safety organization. We research and evaluate harmful manipulation and other risks in frontier AI systems, and we run Sprints (weekend research hackathons) and Fellowships (mentored research towards publication) that bring new researchers into AI safety.
Website: https://apartresearch.com. Contact: contact@apartresearch.com (general and media), sprints@apartresearch.com (Sprint prizes and submission terms). Last updated: November 7, 2026.
Key facts:
- Nonprofit, remote-first and globally distributed. CEO: Jaime Raldúa Veuthey.
- Research focus: harmful manipulation by advanced AI, one of the systemic risks under the EU AI Act. Our work supports the EU AI Office, including a harmful-manipulation evaluation tender, the Code of Practice, the AI Act Advisory Forum and the Expert Forum on Frontier AI.
- Track record: 60+ publications in AI safety (NeurIPS, ICLR, ICML, AAAI, ACL, Science), 150+ researchers in the Apart Fellowship, 10900+ Sprint participants, 2,200+ Sprint projects, 60+ Sprints since 2022, participants from 130 nationalities.
- We work with frontier AI labs (targeted model-behavior evaluations, independent testing of safeguards), policymakers and public institutions (empirical studies and technical evidence for policy and enforcement), and AI safety researchers (methods, benchmarks, collaborations).
How our programs connect:
- Apart Fellowship (anyone can start): Sprint → top 5–20% of teams invited to Apart Studio (about 6–8 weeks) → about 40% of Studio teams selected for the Apart Fellowship (6–16 weeks) → published research. No application form.
- Partnered Fellowships (apply directly, no Sprint needed): application → selected by the partner's mentors → about 16 weeks on the partner's research agenda → published research.
- Both are remote and part-time (minimum 10 hours per week), with compute, travel and publication support. No stipend by default.
## Work with Apart
- [Contact](https://apartresearch.com/contact): Evaluations or testing for an AI provider, policy and public-sector research, research collaborations, Sprints and Fellowships, careers, sponsoring a Sprint or Fellowship, and general inquiries. Please do not send confidential model information, credentials or restricted material through the form; we set up a suitable channel for sensitive discussions.
- Funding and donations: Apart is funded by grants and donations. To donate, fund research or sponsor a Sprint or Fellowship, use the contact page (choose "Sponsoring a Sprint or Fellowship" or "General inquiry") or email contact@apartresearch.com.
- [Careers](https://apartresearch.com/careers): Open roles and open applications. Currently hiring: [Chief Operating Officer](https://apartresearch.com/careers/chief-operating-officer) (full time, remote (4+ hours overlap with CET working hours preferred)); [Director of Research Programs](https://apartresearch.com/careers/director-of-research-programs) (full-time, remote (4+ hours overlap with CET working hours preferred)); [Special Projects Manager](https://apartresearch.com/careers/special-projects-manager) (full-time or Part-time, remote (4+ hours overlap with CET working hours preferred)); [Fellowships Lead](https://apartresearch.com/careers/fellowships-lead) (full-time, remote (significant working-hour overlap with UTC-6/7 and UTC+1/2)); [AI Cyber Threat Researcher (OSINT)](https://apartresearch.com/careers/ai-cyber-threat-researcher-osint) (full-time or Part-time, remote (4+ hours overlap with CET working hours preferred)); [Research Scientist, Manipulation Evals](https://apartresearch.com/careers/research-scientist-manipulation-evals) (full time, remote, Europe or San Francisco preferred).
- Mentors and partners: Mentor Fellowship teams, or run or sponsor a Partnered Fellowship on your research agenda. Apart handles recruiting, project management and compute. [Apply as a mentor](https://apartresearch.notion.site/2b8fcfd1de9d80979154c372abd51522) or [apply as a partner](https://apartresearch.notion.site/240fcfd1de9d80839b5beb781fe4482d).
- [Propose a partner hackathon](https://apartresearch.com/sprints/collaborations/submit): Apart can host your AI safety hackathon's page, sign-ups and project submissions.
## Research
- [Research](https://apartresearch.com/research): Apart's publications and benchmarks, with filters by research area (manipulation, deception, model evaluation, AI governance, dangerous capabilities, AI agents).
- [All publications on Google Scholar](https://scholar.google.com/citations?hl=en&user=f2-xhQkAAAAJ): Apart Research's full publication list.
- [The science and practice of proportionality in AI risk evaluations](https://doi.org/10.1126/science.aea3835): Science 2026, Policy Forum. AI evaluations should provide meaningful risk information without imposing excessive burden.
- [Noise Injection Reveals Hidden Capabilities of Sandbagging Language Models](https://proceedings.neurips.cc/paper_files/paper/2025/hash/aa95d031f5e151bf8fb402f44bd97054-Abstract-Conference.html): NeurIPS 2025. Detects hidden capabilities by testing how models respond to noise in their weights.
- [DarkBench: Benchmarking Dark Patterns in Large Language Models](https://arxiv.org/abs/2503.10728): ICLR 2025, Oral. A benchmark of 660 prompts for manipulation, sycophancy and other dark patterns in leading language models. Benchmark site: https://darkbench.ai/
- [Multi-Agent Risks from Advanced AI](https://arxiv.org/abs/2502.14143): Cooperative AI Foundation 2025, technical report. Maps the failure modes that emerge when many AI agents interact.
- [Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systems](https://openreview.net/forum?id=ljBR8i3jmX): AAAI 2025.
- [Rethinking CyberSecEval: An LLM-Aided Approach to Evaluation Critique](https://arxiv.org/abs/2411.08813): NeurIPS 2024 workshop.
- [CryptoFormalEval: Integrating LLMs and Formal Verification for Automated Cryptographic Protocol Vulnerability Detection](https://openreview.net/forum?id=hqvJT2pOxu): NeurIPS 2024 workshop.
- [Sandbag Detection through Model Impairment](https://openreview.net/forum?id=zpcx5a8w2a): NeurIPS 2024 workshop.
- [Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities](https://arxiv.org/abs/2410.09114): arXiv preprint 2024.
- [Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts](https://arxiv.org/abs/2410.09247): ICML 2024 workshop.
- [Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training](https://arxiv.org/abs/2401.05566): arXiv preprint 2024. An Anthropic-led paper; Apart contributed as a collaborator.
- [Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark](https://aclanthology.org/2023.findings-acl.733/): Findings of ACL 2023.
- [Responsible Disclosure Policy](https://apartresearch.com/info/responsible-disclosure-policy): How Apart reviews and limits publication of dual-use research, including Sprint projects.
## Programs
- [Programs](https://apartresearch.com/programs): Overview of Sprints and Fellowships and how they connect.
- [Sprints](https://apartresearch.com/sprints): Weekend research hackathons on one AI safety question, about once a month, online and at local sites. Teams build an experiment, evaluation, dataset or tool. No AI safety background needed; teams form in Discord at the start.
- [All Sprints](https://apartresearch.com/sprints/all): Every Apart Sprint since 2022, with dates, format and submitted projects.
- [Sprint projects](https://apartresearch.com/sprints/projects): Search the 2,000+ projects teams have submitted.
- [Local Sprint sites](https://apartresearch.com/sprints/locations): Community groups that host in-person sites for Sprints.
- [Partner hackathons](https://apartresearch.com/sprints/collaborations): Hackathons run by universities and partner organizations with Apart's support.
- [Sprint submission and prize terms](https://apartresearch.com/sprints/prize-terms): Teams keep the copyright in their projects and give Apart a license to publish them, review them and develop its tools with them; prizes are paid by bank transfer through Apart's fiscal sponsor, the registered 501(c)(3) Ashgro Inc.; team prizes are split equally.
- [Fellowships](https://apartresearch.com/fellowships): The Apart Fellowship (by invitation after a Sprint) and Partnered Fellowships (apply directly), with FAQs on time commitment, support, pay and authorship.
- [Apart Fellowship](https://apartresearch.com/fellowships/apart-fellowship): Stand out at a Sprint, develop the idea in Apart Studio, then 6–16 weeks of research with a research project manager, compute and publication support.
- [Partnered Fellowships](https://apartresearch.com/fellowships/partnered-fellowships): Apply to research projects set by partner organizations, who set the agenda and mentor; Apart runs the program.
Former program names: "Apart Lab" and "Apart Lab Fellowship" are now the Apart Fellowship; "Apart Lab Studio" is now Apart Studio; "Alignment Jams" and "hackathons" are now Sprints; "Jam sites" are now local Sprint sites.
## Sprints
Upcoming and past Apart Sprints, newest first. Each page lists the brief, tracks, format and submitted projects.
- [Agent Attribution Hackathon](https://apartresearch.com/sprints/agent-attribution-2026): Upcoming, Dec 11–13, 2026. Telling rogue AI agents apart from human-steered ones. One weekend to build attribution classifiers, simulate agents that evade them, and find rogue agents in the wild.
- [Threat Intelligence & Threat Modelling Hackathon](https://apartresearch.com/sprints/threat-intelligence-threat-modelling-2026): Upcoming, Dec 4–6, 2026. Can LLMs scale up threat intelligence and threat modelling for AI data centres facing nation-state attackers? With Security Level 5 (SL5).
- [AI x Epistemics Research Sprint](https://apartresearch.com/sprints/ai-x-epistemics-research-sprint-2026-11-13-to-2026-11-15): Upcoming, Nov 13–15, 2026. AI for epistemics: whether models know how solid their claims are, trust and provenance infrastructure, and products that improve decisions. Online.
- [Swarm Alignment Hackathon](https://apartresearch.com/sprints/swarm-alignment-2026): Past, Nov 6–8, 2026. Alignment can't stop at single models when AI agents start to negotiate, trade and share tools. Spend a weekend uncovering and preventing failures that emerge between multiple agents.
- [AI Collusion Research Sprint](https://apartresearch.com/sprints/ai-collusion-research-sprint-2026-10-23-to-2026-10-25): Past, Oct 23–25, 2026. Collusion between AI agents in markets and workflows: detecting, auditing and breaking it. Co-organized with Poseidon Research and AE Studio, supported by Modal and the AI Alignment Foundation; online with hubs at Collider (New York City) and AI Safety Hong Kong.
- [AI Incident Response Sprint](https://apartresearch.com/sprints/ai-incident-response-sprint-2026-09-11-to-2026-09-13): Past, Sep 11–13, 2026. Incident response for autonomous AI agents, using the public record of the July 2026 OpenAI–Hugging Face agent intrusion.
- [Digital Minds Research Sprint](https://apartresearch.com/sprints/digital-minds-research-sprint-2026-08-14-to-2026-08-16): Past, Aug 14–16, 2026. Preferences, welfare signals, introspection and identity in frontier AI models.
- [Secret Loyalties Hackathon](https://apartresearch.com/sprints/secret-loyalties-hackathon-2026-07-24-to-2026-07-26): Past, Jul 24–26, 2026. Secretly loyal AI: models that covertly advance a hidden principal's interests while appearing normal.
- [Global South AI Safety Hackathon](https://apartresearch.com/sprints/global-south-ais-hackathon-2026-06-19-to-2026-06-21): Past, Jun 19–21, 2026. First AI safety hackathon designed for and with the Global South, across 7 regional hubs in Latin America, Africa and Asia.
- [The Secure Program Synthesis Hackathon](https://apartresearch.com/sprints/secure-program-synthesis-hackathon-2026-05-22-to-2026-05-24): Past, May 22–24, 2026. AI, formal methods and security: tools that catch what AI code generation gets wrong. Co-organized with Atlas Computing.
- [AIxBio Hackathon](https://apartresearch.com/sprints/aixbio-hackathon-2026-04-24-to-2026-04-26): Past, Apr 24–26, 2026. Biosecurity tools at the intersection of AI and biology, such as DNA synthesis screening and pandemic early warning.
- [AI Control Hackathon 2026](https://apartresearch.com/sprints/ai-control-hackathon-2026-03-20-to-2026-03-22): Past, Mar 20–22, 2026. AI control: techniques that keep untrusted AI systems safe to deploy, including monitoring and sabotage detection.
- [The Technical AI Governance Challenge](https://apartresearch.com/sprints/the-technical-ai-governance-challenge-2026-01-30-to-2026-02-01): Past, Jan 30–Feb 1, 2026. Verification systems and technical infrastructure for international AI governance.
- [AI Manipulation Hackathon](https://apartresearch.com/sprints/ai-manipulation-hackathon-2026-01-09-to-2026-01-11): Past, Jan 9–11, 2026. Measurement and defense tools against AI manipulation.
- [Defensive Acceleration Hackathon](https://apartresearch.com/sprints/def-acc-hackathon-2025-11-21-to-2025-11-23): Past, Nov 21–23, 2025. Societal defenses against AI-enabled threats.
- [The AI Forecasting Hackathon](https://apartresearch.com/sprints/the-ai-forecasting-hackathon-2025-10-31-to-2025-11-02): Past, Oct 31–Nov 2, 2025. Forecasting AI progress and its impacts.
- [ARENA 6.0 Mechanistic Interpretability Hackathon](https://apartresearch.com/sprints/arena-6-mechanistic-interpretability-hackathon-2025-09-13-to-2025-09-14): Past, Sep 13–14, 2025. Mechanistic interpretability projects with the ARENA 6.0 cohort.
- [CBRN AI Risks Research Sprint](https://apartresearch.com/sprints/cbrn-ai-risks-sprint-2025-09-12-to-2025-09-14): Past, Sep 12–14, 2025. Chemical, biological, radiological and nuclear risks from AI.
- [AI Safety x Physics Grand Challenge](https://apartresearch.com/sprints/ai-safety-x-physics-grand-challenge-2025-07-25-to-2025-07-27): Past, Jul 25–27, 2025. Applying physics methods to AI safety problems.
- [Red Teaming A Narrow Path: ControlAI Policy Sprint](https://apartresearch.com/sprints/red-teaming-a-narrow-path-control-ai-policy-sprint-2025-06-13-to-2025-06-13): Past, Jun 13, 2025. Stress-testing ControlAI's "A Narrow Path" policy proposals.
- [Apart x Martian Mechanistic Router Interpretability Hackathon](https://apartresearch.com/sprints/apart-x-martian-mechanistic-router-interpretability-hackathon-2025-05-30-to-2025-06-01): Past, May 30–Jun 1, 2025. Interpretable judge models and routing for expert orchestration, with Martian.
- [Economics of Transformative AI](https://apartresearch.com/sprints/economics-of-transformative-ai-research-sprint-2025-04-25-to-2025-04-27): Past, Apr 25–27, 2025. Economic effects of transformative AI.
- [Dark Patterns in AGI Hackathon at ZAIA](https://apartresearch.com/sprints/dark-patterns-in-agi-hackathon-at-zaia-2025-04-04-to-2025-04-05): Past, Apr 4–6, 2025. Dark patterns and manipulation in AI systems, with the ZAIA community.
- [AI Control Hackathon 2025](https://apartresearch.com/sprints/ai-control-hackathon-2025-03-29-to-2025-03-30): Past, Mar 29–30, 2025. AI control protocols and settings.
- [Women in AI Safety Hackathon](https://apartresearch.com/sprints/women-in-ai-safety-hackathon-2025-03-07-to-2025-03-14): Past, Mar 7–10, 2025. AI safety hackathon highlighting women in the field; Apart's biggest event at the time.
- [AI Safety Entrepreneurship Hackathon](https://apartresearch.com/sprints/ai-safety-entrepreneurship-hackathon-2025-01-17-to-2025-01-20): Past, Jan 17–20, 2025. Building AI safety startups.
- [Reprogramming AI Models Hackathon](https://apartresearch.com/sprints/reprogramming-ai-models-hackathon-2024-11-22-to-2024-11-25): Past, Nov 22–25, 2024. Interpretability and feature steering, with Goodfire's API.
- [AI Policy Hackathon at Johns Hopkins University](https://apartresearch.com/sprints/ai-policy-hackathon-at-johns-hopkins-university-2024-10-26-to-2024-10-28): Past, Oct 26–28, 2024. AI policy proposals, hosted at Johns Hopkins University.
- [Agent Security Hackathon](https://apartresearch.com/sprints/agent-security-hackathon-2024-10-04-to-2024-10-07): Past, Oct 4–7, 2024. Security of LLM agents.
- [ARENA 4.0 Interpretability Hackathon](https://apartresearch.com/sprints/arena-4-interp-hackathon-2024-09-15-to-2024-09-15): Past, Sep 15, 2024. Interpretability projects with the ARENA 4.0 cohort.
- [The Concordia Contest](https://apartresearch.com/sprints/the-concordia-contest-2024-09-06-to-2024-09-09): Past, Sep 6–9, 2024. Cooperative intelligence of language model agents.
- [Hackathon for Technical AI Safety Startups](https://apartresearch.com/sprints/hackathon-for-technical-ai-safety-startups-2024-09-22-to-2024-09-25): Past, Aug 30–Sep 2, 2024. Technical AI safety startup ideas.
- [AI capabilities and risks demo-jam](https://apartresearch.com/sprints/ai-capabilities-and-risks-demo-jam-2024-08-23-to-2024-08-26): Past, Aug 23–26, 2024. Interactive demonstrations of AI capabilities and risks.
- [Research Augmentation Hackathon](https://apartresearch.com/sprints/research-augmentation-hackathon-2024-07-26-to-2024-07-29): Past, Jul 26–29, 2024. Tools that speed up AI alignment research.
- [Deception Detection Hackathon: Preventing AI deception](https://apartresearch.com/sprints/deception-detection-hackathon-preventing-ai-deception-2024-06-28-to-2024-07-01): Past, Jun 28–Jul 1, 2024. Detecting deception in AI systems, with Apollo Research.
- [Computational Mechanics Hackathon](https://apartresearch.com/sprints/computational-mechanics-hackathon-2024-06-01-to-2024-06-03): Past, Jun 1–3, 2024. Interpretability through computational mechanics.
- [AI Security Evaluation Hackathon: Measuring AI Capability](https://apartresearch.com/sprints/ai-security-evaluation-hackathon-2024-05-24-to-2024-05-27): Past, May 24–27, 2024. Benchmarks that measure dangerous AI capabilities.
- [AI and Democracy Hackathon: Demonstrating the Risks](https://apartresearch.com/sprints/ai-and-democracy-hackathon-2024-05-03-to-2024-05-06): Past, May 3–6, 2024. Demonstrating and mitigating AI risks to democracy.
- [InterpVis](https://apartresearch.com/sprints/interpvis-2024-03-12-to-2024-03-14): Past, Apr 13–14, 2024. Visualizations for mechanistic interpretability, at the LISA offices in London.
- [LLM Psychology Hackathon](https://apartresearch.com/sprints/llm-psychology-hackathon-2024-04-05-to-2024-04-07): Past, Apr 5–7, 2024. Studying LLM behavior with methods from psychology.
- [Code Red Hackathon: Can LLMs Replicate and do R&D by Themselves?](https://apartresearch.com/sprints/code-red-hackathon-2024-03-22-to-2024-03-25): Past, Mar 22–25, 2024. Evaluation tasks for autonomous replication and AI R&D, with METR.
- [Multi-Agent Security Research Sprint](https://apartresearch.com/sprints/multi-agent-security-research-sprint-2024-02-09-to-2024-02-11): Past, Feb 9–11, 2024. Securing multi-agent systems in deployment.
- [The AI Governance Research Sprint](https://apartresearch.com/sprints/the-ai-governance-research-sprint-2024-01-05-to-2024-05-07): Past, Jan 5–7, 2024. AI governance research.
- [AI Model Evaluations Hackathon](https://apartresearch.com/sprints/ai-model-evaluations-hackathon-2023-11-24-to-2023-11-26): Past, Nov 24–26, 2023. Evaluations of AI model behavior.
- [Multi-Agent Safety Hackathon](https://apartresearch.com/sprints/multi-agent-safety-hackathon-2024-09-29-to-2023-11-01): Past, Sep 29–Oct 1, 2023. Multi-agent safety, with the Cooperative AI Foundation.
- [The Agency Foundations Challenge](https://apartresearch.com/sprints/the-agency-foundations-challenge-2023-09-08-to-2023-09-24): Past, Sep 8–24, 2023. Safeguarding human agency against advanced AI.
- [Distillation Write-a-thon 2.0](https://apartresearch.com/sprints/distillation-write-a-thon-2023-08-24-to-2023-08-26): Past, Aug 24–26, 202