| What it does | Platform to evaluate, trace, monitor and security test AI agents
| Human evaluation for text-to-speech with blinded listening studies
|
|---|
| Stage | Not given
| Not given
|
|---|
| Founded | Not given
| Not given
|
|---|
| Based in | Not given
| US
|
|---|
| Pricing model | Freemium
| Paid
|
|---|
| Pricing | Free plan at $0 forever with 5,000 spans/month, 25 test runs/month, 100 evaluator executions/month, 2 custom evaluators, 5 datasets, 2 prompts, 5 users, 3 projects, 7-day data retention. Pro plan at $39 per month with 200,000 spans/month plus $5 per 100k additional spans, 100 test runs/month, 5,000
| $18.00 per hour of audio heard by listeners; $0.30 per judgement on a pair of two 30-second clips; $300.00 for 200 pairs × 5 ratings with 30-second clips (1,000 judgements)
|
|---|
| Key features | - Observability and tracing of every LLM call, tool invocation and decision point with latency, cost and token usage metrics
- Evaluation to score agent answers before release against traces that broke
- Simulation to test agents with realistic users before launch
- Red teaming to find injection, tool abuse and data leaks before launch
- Prompt management with versioning and deployment controls
- Online evaluation to score real conversations in production
- Agent Insights to spot patterns and detect drift
- Real-time alerts on cost, latency, errors and quality regressions
- Support for 14+ LLM providers and 12+ frameworks
- MCP server for querying and debugging traces from inside IDE
| - Blinded paired-preference studies with no system names visible
- API for creating studies and retrieving results
- Exact price quote before study starts
- Per-judgement data export as CSV
- Paid US-based listener panel
- Attention signals recorded with every judgement
- Live results streaming as listeners answer
- Detection template for AI vs human narration
- Published methodology and platform transparency
|
|---|
| What makes it different | - Single platform that covers the entire AI agent lifecycle from prompt management through production monitoring, instead of scattered tools
- Built on OpenTelemetry standards for native observability across frameworks you already use
| - Publishes its own listening studies on the same platform with the same methodology as customer studies
- Forced-choice preference testing answers which system people prefer, not rating scales
- Fast turnaround with live result streaming and no minimum study size
- Transparent pricing with no setup fees or minimums, quoted before starting
- Customer audio stored securely and used only for that study
|
|---|
| Community votes | 0 | 0 |
|---|
| DR (Domain Rating by Ahrefs) | 13 ▼ −1 (down) since last check | 8 ● no change since last check |
|---|
| Trust Flow (Majestic) | 10 | 9 |
|---|
| Citation Flow (Majestic) | 26 | 24 |
|---|
| Referring domains (Majestic) | 32 | 69 |
|---|
Netra
Woodstitch