99tests vs Optima

A side-by-side comparison built from both listings. Blank cells mean the company has not given that detail; we never guess.

99tests compared with Optima
Detail	99tests	Optima
What it does	Real testers run your AI-generated test cases on real phones and browsers with a human-verified pass/fail report in 3 days	Build custom benchmarks to compare frontier models on performance, cost, and time efficiency for your specific tasks
Stage	Established	Not given
Founded	2011	Not given
Based in	IN	US
Pricing model	Paid	Not given
Pricing	Starter ₹9,999 + GST (5 sessions × 45 min, 2 devices/browsers, up to ~25 test cases, 3 business days); Standard ₹18,999 + GST (10 sessions × 45 min, 4 devices/browsers, up to ~50 test cases, 3 business days); Deep ₹34,999 + GST (20 sessions × 90 min, 6 devices/browsers, up to ~120 test cases, 5 busi	Token usage for creating and running benchmarks at raw model cost. Rubric grading: $0.002 per criterion per model (standard judges) or $0.040 per criterion (premium judges), $0.10 on agentic tasks. Pairwise grading: $0.006 per match (standard, $0.150 premium), $0.015 per match on document tasks (sta
Key features	Test case execution on real Android and iOS phones Cross-browser testing on Chrome, Safari, Edge and Firefox Human-verified pass/fail results for every test case Screenshot and video recording of every failure Exact reproduction steps for every failure Device, OS and browser version details in report Verified severity grading against published rubric Duplicate finding merging and verification One-click re-run on same plan with new build Coverage table showing pass/fail/blocked status per device	Custom benchmark builder with example-driven task creation Multiple evaluation types: Q&A, document analysis, agentic tasks, interactive conversations Run benchmarks across multiple frontier models simultaneously Cost and time per task metrics Standard and premium judge tiers for grading Rubric grading with custom criteria Deterministic objective grading No markup on model token costs
What makes it different	Real devices only, not emulators or simulators Human verification catches failures emulators and AI agent test runs miss Fixed price with no hourly overage or hidden charges Unfilled device sessions automatically credited to next job	Build benchmarks on your actual tasks and data instead of standardized tests Compare models across performance, cost, and time efficiency simultaneously Grading expertise from major AI evaluations
Community votes	0	0
DR (Domain Rating by Ahrefs)	28 +1 (up) since last check	84 −1 (down) since last check
Trust Flow (Majestic)	9	28
Citation Flow (Majestic)	32	59
Referring domains (Majestic)	109	17353

5 details filled in for both companies.

More alternatives to 99tests More alternatives to Optima