At a glance
| Capability | TestOrchestrator | Xray |
|---|---|---|
| Hosting model | Standalone web app | Jira Cloud / Data Center app |
| Requires Jira | No | Yes |
| Pricing model | Flat monthly per workspace | Per Jira user, monthly |
| Free plan | Yes — 5 users | Free under 10 Jira users (Atlassian) |
| Manual test cases | First class | First class |
| BDD / Cucumber | Not first-class | First class |
| Exploratory testing | First class | Limited |
| Test case folders | Yes | Yes (folders + repositories) |
| Setup curve | Same day | Days for full BDD wiring |
Pricing and feature claims about Xray change over time. Always confirm current Xray pricing and capabilities on the Atlassian Marketplace before deciding.
Where TestOrchestrator wins
- Lighter footprint. No Jira install required, no BDD ceremony if your team doesn't write Gherkin.
- Predictable cost. Flat monthly pricing instead of per-user — your bill doesn't track Jira headcount.
- Exploratory testing built in. First-class sessions, charters, and logged findings — not a missing surface that has to be bolted on.
- Faster onboarding. A new tester can be productive in an hour because there's only one UI to learn, not two (Jira + Xray).
- No Jira-as-prerequisite. Useful when your test management vendor decision shouldn't depend on what your PM team uses.
Where Xray still wins
- BDD-driven teams. If your engineers write Cucumber scenarios as the source of truth, Xray is built around that workflow with deep CI integration.
- Test automation reporting. Xray's automated test result reporting (Cucumber, JUnit, NUnit, TestNG) into Jira is best-in-class.
- Jira-coupled traceability. Requirements → tests → defects all in Jira issues, with mature dashboards.
- Atlassian procurement. If your company buys everything via Atlassian Marketplace, adding to that contract is easier than introducing a new vendor.
Migrating from Xray
- Sign up for a TestOrchestrator workspace at /signup.
- For your existing cases:
- Small collection: create them directly in the test case repository — see the docs.
- Larger collection: export from Xray (REST API or built-in export) and contact support. We will load your cases into your workspace for you.
- Configure Jira external references in External References so links to existing tickets keep working.
- If you have BDD scenarios you want to keep, evaluate whether they belong as test cases in TestOrchestrator or stay as code in your repo with CI reporting.
A self-serve bulk-import UI is on the roadmap.
When to choose TestOrchestrator
You're a small-to-mid QA team that doesn't write Gherkin as the source of truth, you want flat predictable pricing, and your test management decision shouldn't be locked to Jira.
When to choose Xray
Your team is BDD-first, your CI emits Cucumber/JUnit results that feed Jira dashboards, and your stakeholders read those Jira dashboards. Xray earns its keep in that workflow.