evalship alternatives
evalship alternatives in Automated Testing & QA. A GitHub App that reviews LLM evals and comments on pull requests. It flags evals that pass when they
Summary
evalship alternatives in Automated Testing & QA. A GitHub App that reviews LLM evals and comments on pull requests. It flags evals that pass when they should fail, reports what a PR broke, and can block the merge. Free is $0 for 1 user, 1 private repo, 100 PR analyses a month, and public repos. Team is $19 a month or $190 a year. Pro is $49 a month or $490 a year. Business is $199 a month or $1,990 a year. Yearly billing includes two months free. The site currently shows paid plans at 60% off, and those plans start with a… 12 other catalog listings are linked below.
Alternatives
- UI Verify — Screenshots the screens a pull request changes in Playwright, Storybook, or Vitest, and an AI judge separates an intended change from a
- Confident AI — Tests LLM apps with research-backed metrics, traces production traffic, and red-teams them before they ship. The free plan includes 5 test
- Kerno — Checks backend changes inside a coding-agent loop, and keeps a code graph called KIT. Community is $0 for 30 test runs a month, one repo
- Robusty — Runs a plain-English scenario in a real cloud browser and reports pass or fail. The trial is 20 runs with no card; Starter is $29 a month.
- Tiden — Stores what you asked a coding agent to build as versioned specs, then checks each change against those specs before it ships. Starter is
- Noveum.ai — Records instrumented agent runs and scores chat, voice, and workflow traces against a library of published checks. Free includes 2,500
- LaunchProof — Opens your site or app on iPhone, Android, and major desktop browsers, then returns one report that names each problem and a fix. A smaller
- Zof — Sits between an AI change and production. It explains the change, checks behavior, collects evidence, and can block a risky release
- Galileo AI — AI tool for app testing and debugging.
- Maestro.dev — End-to-end UI tests for iOS, Android, and web, with a local CLI and a cloud runner.
- OrangePro — Looks at behavior changes in AI-written code, finds where tests do not cover them, and returns tests plus a run log. The homepage does not
- Ratl.ai — AI agents for Autonomous Testing & Software Delivery