| What it does | Test LLMs on your own tasks before you switch models
| Bug reporting tool for web apps and coding agents
|
|---|
| Stage | Not given
| Not given
|
|---|
| Founded | Not given
| Not given
|
|---|
| Based in | Not given
| RS
|
|---|
| Pricing model | Paid
| Freemium
|
|---|
| Pricing | Standard: $99 one-time for 2 machines, including 1 year of updates. Pro coming soon.
| Free plan: up to 3 members, 30 recordings per month, kept for 14 days. Team plan: $12 per member per month (billed yearly at $144) or $15 per member per month (monthly billing), with 14-day free trial. Enterprise: custom pricing on annual contract.
|
|---|
| Key features | - Benchmark any OpenRouter model on your own prompts, CSVs or Hugging Face datasets
- Rubric-based scoring by AI judge, by hand, or both
- Cost per answered task with retries and caching
- Time to first token and output tokens per second per call
- Shareable reports in HTML, CSV and JSON formats
- Compare up to three past benchmarks side by side
- Hard spending cap per run
- Fully self-hosted on your machine
- No SDK or code changes required
| - Console error logs with full stack traces
- Network request capture and replay as cURL or HAR
- Instant replay of the last few minutes without reproduction
- Page DOM replay for element inspection
- Automatic sensitive data redaction and masking
- MCP server integration for AI coding agents
- Integrations with Linear, Jira, GitHub, Slack, Sentry and more
- Recording links for non-technical users without extension
|
|---|
| What makes it different | - Tests your own tasks with real data instead of generic benchmarks
- Comes before integration with no SDK or code changes needed
- Reports actual cost per answered task including retries and caching
- Entirely self-hosted with data never leaving your machine
- One shareable report with every answer and judge reasoning
| - Complete bug context in one shareable link instead of back-and-forth messages
- AI coding agents can read the full report and propose fixes automatically
- Automatic sensitive data protection before any upload
- Works with any modern browser through recording links, no extension required
- Integrates with existing dev tools and issue trackers automatically
|
|---|
| Community votes | 0 | 0 |
|---|
| DR (Domain Rating by Ahrefs) | Not checked yet ● no change since last check | 3 ● no change since last check |
|---|
| Trust Flow (Majestic) | 0 | 3 |
|---|
| Citation Flow (Majestic) | 16 | 27 |
|---|
| Referring domains (Majestic) | 3 | 30 |
|---|
orbench
Faylee