AI Test Case Generation

Draft test cases with AI from a requirement — pasted text, or an issue in Linear, Jira, Azure DevOps or Notion. Pick the folder, template and how many cases you want, then review each draft before any case is created. You can also add the drafts straight to the list. Generation is available on every plan, including Free, which has a limited monthly allowance.

Before you can use it

If you cannot find Generate with AI, the usual reasons are:

  • The workspace has not turned AI on. A Tenant Admin does this once in AI Settings, which includes accepting the AI Data Processing Addendum. Until then no AI control appears for anyone in the workspace.
  • AI is switched off for this project. A Tenant Admin can disable AI on individual projects.
  • You do not have the Create test cases permission. Generating cases writes cases, so it needs the same permission as creating one by hand.
  • You are composing a test run. The AI entries are hidden until you leave the run composer, so a generated batch can never be added to a run by accident.

If the AI terms were updated since your workspace accepted them, the generator still opens and says so. An admin can accept the new terms in AI Settings. Anyone else sees who to ask.

Opening the generator

Open it from anywhere in Test Cases. That includes All cases, because the generator has its own folder picker:

  • A folder’s context menu — Generate cases with AI (the folder is pre-selected).
  • The sparkle button in the Test Cases toolbar.
  • The command palette (⌘/Ctrl+K) — Generate cases with AI.
  • The Generate with AI button on an empty folder or an empty project.

The folder you are in is pre-selected as the destination. At All cases the generator picks the first top-level folder. You can change it before generating.

Choose a source

The source is the requirement the AI reads. It sits in a row of tabs along the top: Pasted text, Linear, Jira, Azure DevOps and Notion. Each tracker tab has a dot. A filled dot means the project has that integration connected. An empty ring means it is not set up yet.

Source How you pick the requirement
Pasted text Paste a requirement, user story or acceptance criteria, up to 20,000 characters. A character counter appears as you get close to the limit.
Linear Search your Linear issues by key or title (type two or more characters), then pick one.
Jira Type the issue key, for example PROJ-123.
Azure DevOps Type the work item ID.
Notion Paste the page ID.

For a tracker, the line under the issue names the integration in use, and the issue’s description is what the model reads. If the project has more than one integration for a tracker, choose the site from that line. If it has only one, it is selected for you. A tracker that is not connected shows a link to Admin › Integrations, where a workspace admin can connect it. See Integrations.

Folder, template and count

Below the source, three pills set how the cases are drafted:

  • Folder — where the cases are created. It opens a searchable list of your folder tree.
  • Template — the test case template the drafts fill in, including steps and priority. The project’s default template is pre-selected.
  • Count — 3, 5, 8, 10, 15 or 20 cases.

Optionally, steer the drafts in the Guide the AI field between the source and the pills (up to 200 characters; a counter appears as you near the limit). While it is empty it offers three suggestions — Edge cases only, Focus on regression and Negative paths — that fill it in one click, and you can edit the text afterwards. The field is unavailable while the selected tracker is not connected. If Generate is disabled, the footer says what it is waiting for, and so does the button’s tooltip. Press ⌘/Ctrl+Enter to generate from the keyboard.

Review first, or add instantly

The arrow next to Generate chooses what happens with the drafts. The generator remembers your choice.

  • Review drafts first (default) — you read, edit, keep or drop each draft before any case is created.
  • Add instantly — the generator closes right away and the drafts are added to the folder as soon as they are ready. You can keep working in the meantime, and edit or delete the new cases from the list.

While it generates

A progress line shows three steps (reading the source, drafting the cases, matching the template’s fields) and how long it has been running. If it takes longer than usual, a note says so. Select Stop to cancel at any time. Nothing is added, and your text, issue and settings are kept so you can adjust them and try again. Stopping does not refund the attempt: it still counts toward your AI usage.

Review the drafts

The review list shows how many drafts came back and which model wrote them. For each draft you can:

  • Keep or skip it with its checkbox, or use Select all / Clear. Only selected drafts are added.
  • Edit the title in place (up to 255 characters).
  • Expand it to read the numbered steps. Each step shows its action and the expected result.

Each row also shows the draft’s priority and its number of steps. If fewer drafts came back than you asked for, a note explains why. For example, “Returned 6 of 15 — your text supports about 6 distinct cases”. The model’s answer is also checked against your template: drafts that repeat each other and values that do not fit a field are removed before you see them, and a short line under the list says how many. If you close the generator with drafts still selected, it asks once before discarding them, because generating them used AI allowance.

Adding the cases, and Undo

Select Add (or press ⌘/Ctrl+Enter). The generator closes and the new cases appear in the list at once, marked Saving… until each one gets its case number. A single notification follows the whole batch, for example “5 cases added to Checkout”, with two actions:

  • View — go to the destination folder.
  • Undo — delete the cases this batch just created. It is shown only if you have permission to delete test cases.

If a case cannot be saved, the error is shown on that row, with Retry and Discard. Retrying cannot create a duplicate. Cases generated from a tracker issue are linked back to that issue.

Plans, limits & errors

  • Every plan includes AI generation. The Free plan comes with a limited monthly allowance, and the generator’s footer says so. Upgrading to Starter or above gives you more.
  • Monthly limit reached. Every generation counts toward the workspace’s monthly AI allowance. Once it runs out, the generator says so, names the date the allowance resets, and offers View plans. An attempt that is refused this way is not counted.
  • Too many requests. Generation is rate-limited per person and per workspace. If you hit the limit, the generator shows how many seconds to wait, and Generate turns back on by itself.
  • The tracker could not be read. The generator says what went wrong, for example that the issue was not found or the tracker did not answer, and offers Try again. If the integration needs reconnecting, it tells you where to do that.
  • Generation failed. The error is shown in the generator with Try again, and your inputs are kept.
  • The project’s AI model is being retired. A note above the requirement names the model and the date. Generation keeps working until then. Ask a workspace admin to pick another model in AI Settings.

Usage is shown as a percentage in AI Settings and on the workspace home, never as a token count. You can compare plans on the pricing page.

Related