Skip to main content
A Smart Smoke Suite is one way for a trigger to choose its flows. Instead of running flows you name in advance, the QA Wolf agent selects the flows affected by the pull request behind each deploy. This gives engineers a faster release signal in the review cycle. Smart Smoke Suites are designed to layer onto your existing coverage strategies. The suite has no fixed size. The agent selects the flows it judges affected by the change, so a wide-ranging PR selects more flows than a narrow one. It can also be empty: when the agent judges a change low-risk, or finds no flow that covers it, no run starts.
Full Service customers: Smart Smoke Suites run as part of PR testing. Talk to your QA Wolf team to turn them on.

How it works

  1. QA Wolf reads the pull request behind the deploy: its title and description, plus its changed files and diff on GitHub. On GitLab it reads the merge request’s title and description only.
  2. The agent compares the change with your existing flows, along with any instructions on the trigger, and picks the flows the change affects.
  3. The selected flows run against the deploy’s URL.
  4. QA Wolf posts the agent’s analysis as a comment on the pull request, and reports the result on the pull request as described in PR testing. When no run starts, GitHub gets a passing QA Wolf Test Results check.

Requirements

  • A connected GitHub or GitLab integration covering the deploying repository, so each deploy links to its pull request. See PR testing.
  • A deploy tied to a pull request. It can go to any environment, not only a preview. GitHub deployments and GitLab deployment jobs are tied automatically. A deployment.reportStatus report is tied when it sends metadata.repository with metadata.pullRequestNumber, or with metadata.commitSha while that pull request is still open. See Deployments.
  • A deployment trigger matching those deploys. On the triggers page, start it from Pull request previews, enter the environment name pattern, such as pr-*, and pick Let QA Wolf choose from the pull request’s changes. The pattern isn’t limited to previews, so dev-* covers several static dev environments. The triggers table shows the trigger as Smart smoke suite.
Once it’s set up, each matching deploy tied to a pull request gets its own selection. To stop, switch the trigger to Always run the same flows, or pause it. The change applies to deploys that arrive afterwards. A Smart Smoke Suite is a deployment trigger whose action kind is generativeSuite; see Trigger fields. It needs PR testing: a deploy with no pull request behind it, such as a merge to main deployed to staging, is skipped.

FAQ

How does QA Wolf decide which flows to run?

The agent reads the pull request (its title and description, and on GitHub its changed files and diff), your existing flows, and any instructions on the trigger. It picks the flows it judges the change affects.

Can we add specific tests to always run on PRs?

Name them in the trigger’s instructions. Instructions guide the agent’s selection; they don’t guarantee a flow runs.

Do we have to write new flows specifically for Smart Smoke Suites?

No. The agent selects from the flows you already have.
Last modified on November 9, 2026