Cost of flakiness

What re-running unreliable tests spent over the last 30 days.

7d14d30d
Total
$113
over 30 days
CI time re-running
13 min
24 retries · $0.11
Interruptions
6
$112.50 of people's time
Avoided by quarantine
$0
0 tests no longer blocking
How this is worked out. The retry wall-clock is measured, and counts only attempts that followed a failed attempt of the same test. Everything in money is that measurement times these rates: $0.01 per CI minute (default), $75.00 per developer hour (default), and 15 min assumed per interruption (default). Quarantine credits back only the interruption: a quarantined test still runs, so its CI minutes are not saved.
Spend per day

Where it went

TestSuiteRetriesCI timeInterruptionsCost
test_TC_TASK_018_confirmingDeleteRemovesTaskTaskDeletionUITests22 min2$37.52
test_TC_SEARCH_002_partialTitleMatchTaskSearchUITests12 min1$18.77
test_TC_FILTER_003_statusAllShowsAllTasksTaskFilterUITests12 min1$18.76
test_TC_TASK_003_newTaskAppearsInListTaskCreationUITests11 min1$18.76
TC-NAV-001 — Tapping a task card navigates to Task DetailsNavigation10 min1$18.75
TC-NAV-010 — Task completion state persists after app restartPersistence31 min0$0.01
TC-NAV-009 — Tasks persist after app restartPersistence31 min0$0.01
"before all" hook for NavigationNo suite10 min0$0.00
"before all" hook for Tasks — SortNo suite10 min0$0.00
"before all" hook for Tasks — Complete / ReopenNo suite10 min0$0.00