llms.txt
Compare with other sites' llms.txt files →# Onyx AI
> Onyx is the open-source AI platform for enterprise search, chat, and agents. It connects to all your company's data sources and lets teams find information, build custom AI agents, and deploy any LLM: self-hosted or cloud. SOC 2 Type II certified, GDPR compliant.
Onyx is built for teams that need AI-powered search and chat across internal knowledge. It supports multiple LLMs (OpenAI, Claude, Gemini, Llama, DeepSeek, Qwen, Mistral), permission-aware retrieval, custom agents with actions, and a developer API. Onyx is open source on GitHub and available as both a cloud service and self-hosted deployment.
Founded by Chris Weaver and Yuhong Sun. Backed by Khosla Ventures, First Round Capital, and Y Combinator. Used by hundreds of thousands of users at companies including Ramp, Brex, Thales, Roku, Sportradar, and UC Berkeley.
## Architecture
Onyx is a set of Docker containers deployable on any infrastructure at any scale.
Application layer: Next.js frontend, Python FastAPI API server, Python background workers for async jobs (document fetching, indexing, syncing).
Data layer: PostgreSQL for application data, user sessions, system state, query history, credentials (encrypted in Enterprise Edition), document access control, and knowledge graph entities/relationships. OpenSearch as the keyword and vector search engine for context retrieval. Redis for in-memory caching. MinIO for blob storage of user-uploaded files and connector documents (replaceable with S3 or any S3-compatible object storage).
Infrastructure layer: Nginx reverse proxy for load balancing and routing. All components are replaceable: MinIO with S3, Redis with managed Redis (e.g. ElastiCache), PostgreSQL with managed Postgres (e.g. RDS), Nginx with any routing proxy. OpenSearch is tightly integrated and supports multi-node deployment.
- [System Architecture](https://docs.onyx.app/security/architecture/system_description)
- [Data Flows](https://docs.onyx.app/security/architecture/data_flows)
- [Data Storage](https://docs.onyx.app/security/architecture/data_storage)
## Product
### Chat
- [Chat](https://onyx.app/chat): Generative AI chat connected to your docs, apps, and people
- Model agnostic: connect OpenAI, Claude (Anthropic), Gemini (Google), Llama (Meta), DeepSeek, Qwen, Mistral, or locally hosted models via Ollama/vLLM. Out-of-the-box multimodality, function calling, and reasoning mode.
- Web search and Deep Research for up-to-date internet information. Deep Research performs multiple cycles of thinking, research, and actions for complex questions (may take several minutes, >10x token cost of normal inference).
- Code interpreter for Python execution, data analysis, and visualization
- Image generation via OpenAI DALL-E or Azure OpenAI
- File uploads supporting PDF, Markdown, PowerPoint, CSV, Word, Excel, and more
- Share chats with team members, provide feedback (thumbs up/down viewable by admins), regenerate responses, copy outputs
- Projects: collections of instructions (prompts) and files grouped with chats, reusable without going through Agent creation
- Configurable creativity/reasoning levels for select models
- [Chat Documentation](https://docs.onyx.app/overview/core_features/chat)
### Enterprise Search
- [Enterprise Search](https://onyx.app/search): Permission-aware search across all company data: engineering docs, sales calls, and everything in between
- State-of-the-art search with in-house deep learning models, advanced RAG, multi-pass indexing, contextual retrieval, hybrid search, and LLM-based knowledge graphs
- Automatic permission syncing from external sources: answers reflect only what each user has access to (Enterprise Edition)
- Configurable embedding models (cloud: Cohere, Google; self-hosted: local GPU), refresh frequency, folder/channel/workspace selection
- Reranking: optional post-processing layer for improved accuracy with large document collections
- Advanced options: multilingual query expansion (rephrases queries into additional languages), multipass indexing (variable-sized chunks for better hybrid search), contextual RAG (appends document-level metadata to every chunk), configurable embedding precision (bfloat16 or float), reduced dimensions (OpenAI embeddings only)
- Filters: time ranges, authors, tags, source type; auto-switches to search mode when query is classified as document search
- [Search Documentation](https://docs.onyx.app/overview/core_features/internal_search)
- [Search Configuration](https://docs.onyx.app/admins/advanced_configs/search_configs)
### Agents & Actions
- [Agents & Actions](https://onyx.app/agents-actions): Build custom AI agents with unique instructions, knowledge sources, and actions
- Create custom prompts, integrate knowledge from uploads or connected sources, and enable actions to external tools
- Agents execute complex tasks by running actions, reasoning between steps, and proactively engaging users when needed
- Share agents with specific users or groups and monitor usage analytics
- Built-in agents: Search Agent (id: 0), General Agent (id: -1, basic LLM no tools), Paraphrase Agent (id: -2, search with exact source quotes), Art Agent (id: -3, image generation)
- 4 built-in actions: Internal Search (searches indexed org documents), Web Search (real-time internet via Google PSE, Serper, or Exa), Code Interpreter (Python execution), Image Generation (OpenAI/Azure OpenAI)
- Custom actions via Model Context Protocol (MCP), where Onyx acts as MCP client with dynamic tool discovery, or via OpenAPI specifications
- Authentication options for custom actions: single shared authentication or per-user OAuth flow
- Use cases: Sales (deal research, objection handling), Engineering (codebase Q&A, incident response), Customer Support (ticket resolution, product knowledge), Operations (policy lookup, onboarding), Legal (document review), RFP filling
- [Agents Documentation](https://docs.onyx.app/admins/agents/overview)
- [Actions Documentation](https://docs.onyx.app/admins/actions/overview)
- [MCP Documentation](https://docs.onyx.app/admins/actions/mcp)
### Integrations & Connectors
- [Integrations](https://onyx.app/integrations): 40+ app connectors that sync updates in real time and respect fine-grained access controls
- Slack integration: Create channel-specific AI bots with customized instructions, knowledge, and triggerable actions. Summarize channels and threads. Interaction via @mention (thread reply), /onyx slash command (ephemeral), channel messages, or direct message.
- Microsoft Teams and Zendesk integrations coming soon
Connector categories and supported sources:
- Knowledge Base & Wikis: Confluence, SharePoint, Notion, BookStack, Document360, Discourse, GitBook, Slab, Outline, Google Sites, Guru
- Cloud Storage: Google Drive, Dropbox, AWS S3, Google Cloud Storage, Egnyte, Oracle Storage, Cloudflare R2
- Ticketing & Task Management: Jira, Zendesk, Airtable, Linear, Freshdesk, Asana, ClickUp, ProductBoard
- Messaging: Slack (Indexed + Federated), Microsoft Teams, Gmail, Discord, XenForo, Zulip
- Sales: Salesforce, HubSpot, Gong, Fireflies, Highspot
- Code Repository: GitHub, GitLab, Bitbucket
- Other: Web Scraper, File Upload
Permission-syncing connectors (Enterprise Edition): Confluence, Jira, Google Drive, Gmail, Slack (Federated), Salesforce, GitHub, SharePoint
Connector configuration: prune frequency (default 30 days), refresh frequency (default 30 minutes), configurable indexing start date. Statuses: Indexed, Scheduled, Indexing, Paused, Error.
- [Connectors Overview](https://docs.onyx.app/admins/connectors/overview)
- [Slack Bot Setup](https://docs.onyx.app/admins/getting_started/slack_bot_setup)
### Developer Platform
- [Developer Platform](https://onyx.app/developer-platform): APIs and tools to extend Onyx for your team's needs
- REST API with JSON request/response. Base URLs: https://cloud.onyx.app/api or https://your-self-hosted-onyx.com/api. OpenAPI explorer at /api/docs. SemVer 2.0.0 versioning.
- Three API key types: Admin (full system access), Basic (standard user-level access to Search, Chat, Agents, Actions), Limited (read-only agent access, can post to chat but cannot read history). Personal Access Tokens also available.
- API categories: Chat, Search, Agents, Actions, Connectors & Credentials, Projects & Files, Ingestion API, User Management, Token Limits
- Streaming architecture: packet-based streaming with types for MessageStart/Delta, SearchTool, ImageGenerationTool, CustomTool, Reasoning, Citation
- Ingestion API: lightweight way to index documents programmatically for unsupported data sources or supplemental data
- Onyx MCP Server: access all your team's unstructured knowledge from other AI tools (e.g. use with Cursor for better code generation context)
- Open source developer community with thousands of members
- [API Documentation](https://docs.onyx.app/developers/overview)
- [Ingestion API Guide](https://docs.onyx.app/developers/guides/index_files_ingestion_api)
### Onyx Craft (Beta)
- AI-powered web application builder operating in an isolated sandbox environment
- Output types: Web Applications (Next.js + React + shadcn/ui + Recharts), Documents (reports, markdown), Slides & Images, Knowledge Integration (reads from indexed connectors)
- Sandbox: Python with numpy, pandas, matplotlib; read-only access to indexed documents; session-specific isolated workspaces
- File constraints: 50MB/file, 20 files/session, 200MB total session
- Enable with ENABLE_CRAFT=true environment variable
- [Craft Documentation](https://docs.onyx.app/overview/core_features/craft)
### Desktop App
- [Desktop App](https://onyx.app/desktop-app): Native desktop application for Windows, macOS, and Linux
- Quick launch from system tray or dock without opening a browser
- Global keyboard shortcuts to open Onyx from anywhere
- Native desktop notifications for updates and messages
- Connects to your existing Onyx deployment: configure your server URL on first launch
- Downloads: [Windows (.exe)](https://github.com/onyx-dot-app/onyx/releases/latest/download/Onyx_x64.exe), [macOS (.dmg)](https://github.com/onyx-dot-app/onyx/releases/latest/download/Onyx_universal.dmg), [Linux (.deb)](https://github.com/onyx-dot-app/onyx/releases/latest/download/Onyx_amd64.deb)
## Deployment
### Deployment Options
- Onyx Cloud: Fully managed SaaS with all Enterprise Edition features, 14-day free trial (no credit card required), SOC2 Type II and GDPR compliant
- Self-Host Open Source: Chat, Agents, Actions, Connectors, Deep Research, and more. Free. Data stays within your deployment.
- Self-Host Enterprise Edition: RBAC, automatic permission syncing, advanced knowledge curation. Best for large teams with strict data requirements.
### Quick Start
Single-command install: `curl -fsSL https://raw.githubusercontent.com/onyx-dot-app/onyx/main/deployment/docker_compose/install.sh > install.sh && chmod +x install.sh && ./install.sh`
With Onyx Craft: `./install.sh --include-craft`
Docker Compose: `git clone --depth 1 https://github.com/onyx-dot-app/onyx.git && cd onyx/deployment/docker_compose && docker compose up -d`, then access at localhost:3000.
Kubernetes (Helm): `helm repo add onyx https://onyx-dot-app.github.io/onyx/ && helm install onyx onyx/onyx -n onyx`
### Resource Requirements
Minimum: 4 vCPU, 10 GB RAM, 32 GB disk + ~2.5x indexed data. Preferred: 8+ vCPU, 16+ GB RAM, 500 GB disk for orgs <5000 users. The search index does not allow writes once disk usage hits 75%.
Recommended cloud instances: AWS m7g.xlarge, GCP e2-standard-4, Azure D4s_v3.
Kubernetes resource allocation: api_server (1 CPU, 2Gi), background (2 CPU, 8Gi), indexing_model_server (2 CPU, 4Gi), inference_model_server (2 CPU, 4Gi), postgres (2 CPU, 2Gi), search index (≥4 CPU, ≥8Gi). The search index scales ~3GB memory per 1GB indexed documents.
### Cloud Deployments
- AWS: EC2 (recommended for 90% of orgs), EKS, RDS
- GCP: Compute Engine VM
- Azure: Virtual Machine
- Digital Ocean
All cloud deployments follow same pattern: provision VM, install Docker + Docker Compose, clone Onyx repo, configure environment variables, launch with HTTPS via Let's Encrypt (init-letsencrypt.sh).
- [Deployment Overview](https://docs.onyx.app/deployment/overview)
- [Quickstart](https://docs.onyx.app/deployment/getting_started/quickstart)
- [Docker Compose](https://docs.onyx.app/deployment/local/docker)
- [Kubernetes](https://docs.onyx.app/deployment/local/kubernetes)
- [AWS EC2](https://docs.onyx.app/deployment/cloud/aws/ec2)
- [GCP](https://docs.onyx.app/deployment/cloud/gcp)
- [Azure](https://docs.onyx.app/deployment/cloud/azure)
- [Configuration Reference](https://docs.onyx.app/deployment/configuration/configuration)
## LLM Configuration
### Cloud Providers
- OpenAI: GPT-4o, GPT-4.1, o3, GPT-5
- Anthropic: Claude 4 Sonnet, Claude 4 Opus
- Azure OpenAI
- AWS Bedrock
- Google Vertex AI / Google AI
- OpenRouter
- Custom inference provider (any OpenAI-compatible endpoint)
### Self-Hosted Models
- gpt-oss-20b (OpenAI open-weight, chain-of-thought)
- Llama 4 and 3.3 family (Meta)
- Qwen-3 family
- DeepSeek-R1
- Any Ollama-hosted model or vLLM-served model
Configure in Admin Panel → Configuration → LLM. Supports setting a Default Model and a Fast Model (for quick operations like query expansion, session naming).
- [AI Models Configuration](https://docs.onyx.app/admins/ai_models/overview)
## Security & Enterprise
### Security
- SOC 2 Type II certified, GDPR compliant
- AES-256-GCM encryption at rest, TLS 1.3 in transit (Onyx Cloud); self-hosted deployments: admin-managed encryption
- Yearly penetration tests (results available under NDA), regular container scans
- No training or fine-tuning of any models on user data
- Self-hosted: Onyx team receives none of your data; anonymous telemetry enabled by default (can be disabled)
- All data processing occurs within your infrastructure for self-hosted deployments
### Authentication
- Basic Auth (email/password): all editions
- Google OAuth: all editions
- OIDC (OpenID Connect): Enterprise Edition (supports Okta, Microsoft Entra ID/Azure AD)
- SAML 2.0: Enterprise Edition (requires building from source)
### Enterprise Edition Features
- SSO with OpenID Connect and SAML 2.0
- User Groups and RBAC (fine-grained permissions on Agents, Actions, Documents, Rate Limits)
- Curator role (between Admin and User; can publish Connectors, Document Sets, Agents)
- Automatic permission inheritance from external systems (permission-syncing connectors)
- Enterprise-grade encryption for credentials and API keys (ENCRYPTION_KEY_SECRET)
- Whitelabeling (custom branding, logos, styling)
- Usage analytics (query history, usage statistics, exportable to CSV)
- Priority support with guaranteed response times and white-glove deployment assistance
- Custom analytics integration (e.g. PostHog)
### User Roles
- Admin: Full system access, audit, and configuration (first user is automatically Admin)
- Curator: Document management, content curation, connector publishing (Enterprise only)
- User: Standard access to chat and search
### Deployment Flexibility
- Onyx Cloud (managed SaaS), self-hosted on any infrastructure (AWS, Azure, GCP), on-premise, or fully air-gapped with no external third parties
- Choose any organization-approved LLM provider with bring-your-own-keys, or plug in a self-hosted LLM for air-gapped deployment
- Region-specific deployments, white-labelling, custom integrations, data exports
- [Security Architecture](https://docs.onyx.app/security/architecture/system_description)
- [Access Controls](https://docs.onyx.app/security/architecture/access_controls)
- [Security FAQ](https://docs.onyx.app/security/architecture/faq)
- [Self-Hosted Data Processing](https://docs.onyx.app/security/self_hosted/data_processing)
- [Enterprise Edition](https://docs.onyx.app/deployment/miscellaneous/enterprise_edition)
## Pricing
- [Pricing](https://onyx.app/pricing): Plans for teams of all sizes
- **Business** ($20/user/month annual, $25/user/month monthly): Chat and Search UI, all major LLMs, custom AI agents, actions (MCP/OpenAPI), 40+ app connectors, web search, deep research, code interpreter, image generation, Slack integration, developer APIs, query history, usage dashboards, RBAC, permission inheritance, encryption of secrets, Google OAuth
- **Enterprise** (contact sales): Everything in Business plus OIDC/SAML SSO, on-premise deployments, region-specific deployments, early access to features, white-labelling, custom integrations, data exports, invoice billing, volume discounts, higher education pricing, dedicated support, enterprise SLA
## LLM Leaderboards
### LLM Leaderboard
- [LLM Leaderboard](https://onyx.app/llm-leaderboard): The definitive ranking of all major LLMs, open and closed source, across coding, reasoning, math, agentic, and chat benchmarks with pricing comparison, tier lists, and head-to-head comparisons
- Benchmark categories: Overall, Coding, Math, Chat, Reasoning, Agentic
- Benchmarks tracked: MMLU, MMLU-Pro, MMMLU, HumanEval, SWE-bench Verified, LiveCodeBench, Terminal-Bench 2.0, AIME 2025, MATH-500, GPQA Diamond, Chatbot Arena (LMArena), IFEval, ARC-AGI-2, MMMU-Pro, Humanity's Last Exam (HLE), τ2-bench, OSWorld-Verified, BrowseComp
- Models compared include Claude, GPT, Gemini, DeepSeek, Llama, Qwen, Mistral, Grok, and more
- Includes input/output pricing per 1M tokens for all models
### Open Source LLM Leaderboard
- [Open Source LLM Leaderboard](https://onyx.app/open-llm-leaderboard): Rankings of the best open source models across coding, reasoning, math, and software engineering benchmarks
- Benchmark categories: Overall, Coding, Math, Chat, Reasoning
- Models: DeepSeek R1, DeepSeek V3, Llama 4 Maverick, Qwen 3, Mistral Large 3, Gemma 3, and more
### Self-Hosted LLM Leaderboard
- [Self-Hosted LLM Leaderboard](https://onyx.app/self-hosted-llm-leaderboard): Rankings of self-hostable open-weight models for enterprise with VRAM requirements, hardware specs, and quality-per-cost efficiency comparisons
- Benchmark categories: Overall, Coding, Math, Reasoning, Efficiency
- Includes VRAM requirements (FP16, INT8, INT4), hardware tier recommendations, licensing information, and min GPU specs
- ~30 models across frontier (DeepSeek R1, Llama 4 Maverick, Qwen 3.5), mid-size (Llama 3.3 70B, Qwen 2.5-72B), and lightweight (Gemma 3 27B, Phi-4, Mistral Small 3.1) tiers
## Alternatives & Comparisons
- [Onyx vs Glean](https://onyx.app/alternatives/glean): Open-source, self-hostable alternative to Glean at roughly a third of the per-seat cost
- [Onyx vs Microsoft 365 Copilot](https://onyx.app/alternatives/microsoft-copilot): Cross-platform connectors and better answer quality, validated head-to-head at Thales
- [Onyx vs ChatGPT Enterprise](https://onyx.app/alternatives/chatgpt-enterprise): Self-hosting and model freedom vs cloud-only, OpenAI-only deployment
- [Onyx vs Open WebUI](https://onyx.app/alternatives/open-webui): MIT license, enterprise connectors, and permission syncing vs a self-host-only chat UI with a restrictive custom license
- [Onyx vs LibreChat](https://onyx.app/alternatives/librechat): Automated enterprise connectors, permission syncing, and an admin dashboard vs manual file-upload RAG and YAML configuration
- [Onyx vs Dust](https://onyx.app/alternatives/dust): Permission-aware search and true self-hosting vs workspace-level access and a cloud-only product
## Tools & Benchmarks
- [Enterprise LLM Infrastructure Calculator](https://onyx.app/enterprise-llm-infrastructure): Plan self-hosted LLM deployments for teams, with GPU sizing, cost estimates, and infrastructure recommendations
- [EnterpriseRAG-Bench](https://onyx.app/enterpriserag-bench): A public 500,000+ document synthetic enterprise corpus and multi-category question set for benchmarking RAG systems, MIT licensed with an open leaderboard
- [LLM Hardware Requirements Checker](https://onyx.app/llm-hardware-requirements): Auto-de