| What it does | Build custom benchmarks to compare frontier models on performance, cost, and time efficiency for your specific tasks
| Independent verification for AI agent outcomes
|
|---|
| Stage | Not given
| Startup
|
|---|
| Founded | Not given
| Not given
|
|---|
| Based in | US
| Not given
|
|---|
| Pricing model | Not given
| Freemium
|
|---|
| Pricing | Token usage for creating and running benchmarks at raw model cost. Rubric grading: $0.002 per criterion per model (standard judges) or $0.040 per criterion (premium judges), $0.10 on agentic tasks. Pairwise grading: $0.006 per match (standard, $0.150 premium), $0.015 per match on document tasks (sta
| Hobbyist: free forever with 250 checks/month; Pro: $9/month with 2,500 checks/month, $0.01 per extra check
|
|---|
| Key features | - Custom benchmark builder with example-driven task creation
- Multiple evaluation types: Q&A, document analysis, agentic tasks, interactive conversations
- Run benchmarks across multiple frontier models simultaneously
- Cost and time per task metrics
- Standard and premium judge tiers for grading
- Rubric grading with custom criteria
- Deterministic objective grading
- No markup on model token costs
| - Independent outcome verification with VERIFIED, FAILED, or UNKNOWN status
- First-party adapters for Stripe, GitHub, Linear, Sentry, Resend, and HTTP endpoints
- MCP integration with Claude Code, Cursor, and any MCP host
- GitHub Actions required check that fails on unverified claims
- Audit trail storing claims, evidence, and verdicts separately
- Capability inspection before agents call tools
- Read-only credential access with AES-256-GCM encryption
- Continuous monitoring with watches every 5-10 minutes on Pro plan
- Evidence retention for 7 days on Hobbyist, 1 year on Pro
|
|---|
| What makes it different | - Build benchmarks on your actual tasks and data instead of standardized tests
- Compare models across performance, cost, and time efficiency simultaneously
- Grading expertise from major AI evaluations
| - Refuses to guess: returns UNKNOWN rather than false positives when evidence is unreachable
- Neutral gate between agent execution and success verification
- Runs the same way in production as in development
- Never needs write access, only reads authoritative state
- Structured audit trail for debugging and agent evaluation
|
|---|
| Community votes | 0 | 0 |
|---|
| DR (Domain Rating by Ahrefs) | 85 ▲ +1 (up) since last check | 2 ● no change since last check |
|---|
| Trust Flow (Majestic) | 28 | 1 |
|---|
| Citation Flow (Majestic) | 59 | 23 |
|---|
| Referring domains (Majestic) | 17353 | 14 |
|---|
Optima
DidWork