| What it does | Smart AI routing gateway for LLM traffic management
| Open-source agent harness engineering platform built on OpenTelemetry
|
|---|
| Stage | Not given
| Startup
|
|---|
| Founded | Not given
| 2024
|
|---|
| Based in | Not given
| IN
|
|---|
| Pricing model | Freemium
| Open source
|
|---|
| Pricing | Self-hosted: Free. Free Hosted: $0/month (10,000 routed requests/month, 2 concurrent requests). Personal: $9/month ($9 billed monthly; 300,000 routed requests/month, 10 concurrent requests). Team: $49/month ($49 billed monthly; 3,000,000 routed requests/month, 100 concurrent requests; 10 people incl
| Open source (Apache 2.0): Free self-hosted with unlimited usage. Enterprise Edition: Contact sales for pricing. Cloud: Coming soon.
|
|---|
| Key features | - Request characterization and intent detection
- Smart Groups and model assignment
- Queue-first routing with fallbacks
- Per-user and per-API-key limits
- Pre and post-dispatch guardrails
- Real-time request tracing and analytics
- 100,000+ model compatibility
- OpenAI-compatible API
- Request queuing, pacing and cooldowns
- Provider cost tracking per request
| - OpenTelemetry-native LLM tracing for every call, tool, and retrieval
- Agent evals with LLM-as-a-judge and heuristics
- Prompt Hub for versioning and deployment without code changes
- Guardrails for prompt injection, jailbreak, and sensitive topic detection
- Vault for encrypted API key management
- OpenGround for side-by-side LLM model comparison
- GPU monitoring for utilization, memory, temperature, and power
- Coding agent observability for Claude Code, Codex, and Cursor
- Cost tracking and latency monitoring
- 56+ integrations with LLMs, frameworks, and vector databases
|
|---|
| What makes it different | - Route requests based on intent to optimize cost and latency without sending all work to expensive models
- Real-time visibility into every LLM request, decision, guardrail, and cost in one trace
- Enforce per-user, per-agent and organization-wide limits with attribution and audit trails
- Available as fully self-hosted open-source or managed cloud platform
- Fast built-in routing at 1-5ms latency or optional System One classifier for richer decisions
| - Self-host free forever under Apache 2.0 with unlimited usage and no per-trace fees
- OpenTelemetry-native traces exportable to Grafana, Datadog, or any OTLP backend
- Zero-code instrumentation with eBPF controller, native SDKs, or GPU collector
- Unified platform for traces, evals, guardrails, and prompts on the same production data
- Full data ownership and no vendor lock-in with exportable OpenTelemetry traces
|
|---|
| Community votes | 0 | 0 |
|---|
| DR (Domain Rating by Ahrefs) | Not checked yet ● no change since last check | 65 ● no change since last check |
|---|
| Trust Flow (Majestic) | 17 | 23 |
|---|
| Citation Flow (Majestic) | 22 | 39 |
|---|
| Referring domains (Majestic) | 48 | 483 |
|---|
AnchorShell Relay
OpenLIT