| What it does | AI agent red-teaming platform for testing, evaluation, monitoring, and governance
| Test LLMs on your own tasks before you switch models
|
|---|
| Stage | Not given
| Not given
|
|---|
| Founded | Not given
| Not given
|
|---|
| Based in | US
| Not given
|
|---|
| Pricing model | Freemium
| Paid
|
|---|
| Pricing | Launch Plan: Pay Per Test Case with free trial available. Scale Plan: Custom pricing based on needs, includes everything in Launch Plan plus cross-browser execution, CI/CD integration, AI debugger, SOC 2 Type II compliance, and dedicated customer success manager.
| Standard: $99 one-time for 2 machines, including 1 year of updates. Pro coming soon.
|
|---|
| Key features | - Adaptive red-teaming with adversarial scenarios
- Agent tracing with execution path inspection
- Automated evaluation with LLM and code-based checks
- Policies and guardrails for agent governance
- Support for multiple agent types
- Framework and model agnostic integration
- 60+ tool integrations for CI/CD
- SOC 2 Type II compliance
- SSO and SAML identity integration
- Fine-grained access control
| - Benchmark any OpenRouter model on your own prompts, CSVs or Hugging Face datasets
- Rubric-based scoring by AI judge, by hand, or both
- Cost per answered task with retries and caching
- Time to first token and output tokens per second per call
- Shareable reports in HTML, CSV and JSON formats
- Compare up to three past benchmarks side by side
- Hard spending cap per run
- Fully self-hosted on your machine
- No SDK or code changes required
|
|---|
| What makes it different | - Discovers failures before production through adaptive red-teaming
- Converts discovered failures into permanent regression checks
- Full visibility into agent behavior with execution tracing
- Works with any agent type and existing tech stack
- Enterprise-grade security built from the start
| - Tests your own tasks with real data instead of generic benchmarks
- Comes before integration with no SDK or code changes needed
- Reports actual cost per answered task including retries and caching
- Entirely self-hosted with data never leaving your machine
- One shareable report with every answer and judge reasoning
|
|---|
| Community votes | 0 | 0 |
|---|
| DR (Domain Rating by Ahrefs) | 30 ▲ +1 (up) since last check | Not checked yet ● no change since last check |
|---|
| Trust Flow (Majestic) | 11 | 0 |
|---|
| Citation Flow (Majestic) | 21 | 16 |
|---|
| Referring domains (Majestic) | 221 | 3 |
|---|
BotGauge
orbench