- Completed — all flows in the run have passed or been marked Do Not Investigate
- Needs Investigation — one or more flows failed and have not been marked Do Not Investigate
A flow needing investigation should be reviewed quickly and identified as either a bug (filed in your issue tracker) or a broken test (updated accordingly).
- Canceled — the run was canceled mid-execution by a subsequent run matching the same branch and environment
Where runs can be performed
There are several ways to execute flows in QA Wolf. What you can run, where feedback appears, and whether results are recorded differs by method.| Method | How | Feedback | Appears in Run History |
|---|---|---|---|
| Individual lines | Select lines in editor + Run | Editor only | No |
| A test block | Select test() function + Run | Editor only | No |
| A full flow | Run button in Automate | Editor only | No |
| All flows in environment | Map | Runs tab | No |
| Select flows in environment | Select flows in Map | Runs tab | No |
| Scheduled run | Automatic | Runs tab Run History | Yes |
Run History in the Automate tab only shows results from scheduled runs. See Scheduling flows to set up a schedule.
How to start a manual run
A run can be initiated in three ways:- Manually from the Runs tab
- On a schedule — see Scheduling flows
- When a build is deployed — for example, from GitHub Actions or another CI/CD system
Flow orchestration logic
Runs orchestrate the execution order of flows and their multiple attempts, while the flows themselves report the results of each attempt, including logs and video artifacts.Attempt retry logic
Flows are attempted up to three times to ensure that a failure was not due to an accidental or temporary environment issue. All flows must report a result before any of them are re-attempted. The concurrency of each wave decreases to further reduce the impact of environmental issues.- First attempt — each flow executes concurrently unless run rules specify an alternate order
- Second attempt — failed flows execute in batches of five
- Final attempt — remaining failing flows execute serially