Cost of flakiness
What re-running unreliable tests spent over the last 30 days.
7d14d30d
Total
$113
over 30 days
CI time re-running
13 min
24 retries · $0.11
Interruptions
6
$112.50 of people's time
Avoided by quarantine
$0
0 tests no longer blocking
How this is worked out. The retry wall-clock is measured, and counts only attempts that followed a failed attempt of the same test. Everything in money is that measurement times these rates: $0.01 per CI minute (default), $75.00 per developer hour (default), and 15 min assumed per interruption (default). Quarantine credits back only the interruption: a quarantined test still runs, so its CI minutes are not saved.
Spend per day
Where it went
| Test | Suite | Retries | CI time | Interruptions | Cost |
|---|---|---|---|---|---|
| test_TC_TASK_018_confirmingDeleteRemovesTask | TaskDeletionUITests | 2 | 2 min | 2 | $37.52 |
| test_TC_SEARCH_002_partialTitleMatch | TaskSearchUITests | 1 | 2 min | 1 | $18.77 |
| test_TC_FILTER_003_statusAllShowsAllTasks | TaskFilterUITests | 1 | 2 min | 1 | $18.76 |
| test_TC_TASK_003_newTaskAppearsInList | TaskCreationUITests | 1 | 1 min | 1 | $18.76 |
| TC-NAV-001 — Tapping a task card navigates to Task Details | Navigation | 1 | 0 min | 1 | $18.75 |
| TC-NAV-010 — Task completion state persists after app restart | Persistence | 3 | 1 min | 0 | $0.01 |
| TC-NAV-009 — Tasks persist after app restart | Persistence | 3 | 1 min | 0 | $0.01 |
| "before all" hook for Navigation | No suite | 1 | 0 min | 0 | $0.00 |
| "before all" hook for Tasks — Sort | No suite | 1 | 0 min | 0 | $0.00 |
| "before all" hook for Tasks — Complete / Reopen | No suite | 1 | 0 min | 0 | $0.00 |