| What it does | AI shopping agent testing for Shopify stores
| Test LLMs on your own tasks before you switch models
|
|---|
| Stage | Startup
| Not given
|
|---|
| Founded | Not given
| Not given
|
|---|
| Based in | Not given
| Not given
|
|---|
| Pricing model | Freemium
| Paid
|
|---|
| Pricing | Free test once per month per store; Priority test $5; Full report $99; Monthly monitoring $19/month per store
| Standard: $99 one-time for 2 machines, including 1 year of updates. Pro coming soon.
|
|---|
| Key features | - Tests three types of AI shopping agents: code-reading, screen-reading, and protocol agents
- Identifies six critical checkout failure points: Arrive, Find, Choose, Cart, Checkout, Total
- Free monthly test with email confirmation
- $5 priority test for immediate results and retesting
- Video recordings and step-by-step logs of agent attempts
- Reports show ChatGPT, Gemini, Perplexity and Claude agent compatibility
| - Benchmark any OpenRouter model on your own prompts, CSVs or Hugging Face datasets
- Rubric-based scoring by AI judge, by hand, or both
- Cost per answered task with retries and caching
- Time to first token and output tokens per second per call
- Shareable reports in HTML, CSV and JSON formats
- Compare up to three past benchmarks side by side
- Hard spending cap per run
- Fully self-hosted on your machine
- No SDK or code changes required
|
|---|
| What makes it different | - Only tool that tests all three ways AI agents actually shop: code-based, vision-based, and through Shopify's protocol
- Detects real agent checkout failures that AI-readiness scores miss
- No store access required: tests only public storefront like any customer
- Completely free monthly test with full results
| - Tests your own tasks with real data instead of generic benchmarks
- Comes before integration with no SDK or code changes needed
- Reports actual cost per answered task including retries and caching
- Entirely self-hosted with data never leaving your machine
- One shareable report with every answer and judge reasoning
|
|---|
| Community votes | 0 | 0 |
|---|
| DR (Domain Rating by Ahrefs) | 3 ▲ +3 (up) since last check | Not checked yet ● no change since last check |
|---|
| Trust Flow (Majestic) | 0 | 0 |
|---|
| Citation Flow (Majestic) | 12 | 16 |
|---|
| Referring domains (Majestic) | 1 | 3 |
|---|
Tire Kicker
orbench