Self-Hosting
Self-Hosting Overview
Run your own Orbyt gateway.
This section is for teams who want to run the Orbyt gateway on their own infrastructure. Orbyt is designed to be lightweight, scalable, and easy to deploy using modern containerized or bare-metal setups.
Architecture
The gateway consists of several core services:
- API Gateway: The entry point for all LLM requests.
- Primary Backend: Manages the dashboard, API keys, and configuration.
- DevTools: A debugging interface for real-time trace inspection.
- Redis: Handles the concurrent key pool and rate limiting.
- PostgreSQL: Stores persistent telemetry and configuration data.