Test cases

One test case across runners and platforms, matched by the id in its title, with the most trouble first.

Latest 333 runs, which is all of them.

Each number counts runs, not attempts. A run failed when its last attempt failed, and passed on retry when an earlier attempt failed. Failures from runs where most of the suite failed together are left out, as they are in the score.

Test caseappium-androidappium-iosespressoxcuitest
All 64 test cases
64 test cases
3431 passed
64 test cases
9 passed on retry
3932 passed
60 test cases
4 failed
3614 passed
63 test cases
24 passed on retry
3817 passed
TC-TASK-018
68 passed
80 passed
1 failed
74 passed
4 passed on retry
75 passed
TC-FILTER-002
71 passed
80 passed
1 failed
74 passed
3 passed on retry
75 passed
TC-FILTER-004
71 passed
1 passed on retry
79 passed
75 passed
2 passed on retry
76 passed
TC-SEARCH-006
70 passed
1 passed on retry
78 passed
75 passed
2 passed on retry
76 passed
TC-SEARCH-002
71 passed
80 passed
75 passed
2 passed on retry
76 passed
TC-TASK-003
68 passed
80 passed
75 passed
2 passed on retry
77 passed
TC-TASK-022
70 passed
1 passed on retry
79 passed
75 passed
1 passed on retry
78 passed
TC-AUTH-004
68 passed
77 passed
75 passed
1 passed on retry
78 passed
TC-AUTH-012
69 passed
80 passed
1 failed
74 passed
79 passed
TC-FILTER-001
71 passed
80 passed
1 failed
74 passed
78 passed
TC-FILTER-003
71 passed
80 passed
75 passed
1 passed on retry
77 passed
TC-FILTER-005
71 passed
80 passed
75 passed
1 passed on retry
77 passed
TC-FILTER-007
71 passed
80 passed
75 passed
1 passed on retry
77 passed
TC-NAV-001
12 passed
1 passed on retry
12 passed
12 passed
9 passed
TC-SEARCH-003
70 passed
79 passed
75 passed
1 passed on retry
77 passed
TC-TASK-001
68 passed
80 passed
75 passed
1 passed on retry
78 passed
TC-TASK-007
68 passed
80 passed
75 passed
1 passed on retry
78 passed
TC-TASK-014
68 passed
80 passed
75 passed
1 passed on retry
78 passed
TC-TASK-020
70 passed
1 passed on retry
79 passed
75 passed
79 passed
TC-TASK-021
70 passed
1 passed on retry
79 passed
75 passed
79 passed
TC-TASK-023
70 passed
1 passed on retry
79 passed
75 passed
78 passed
TC-TASK-024
70 passed
1 passed on retry
79 passed
75 passed
78 passed
TC-TASK-025
70 passed
1 passed on retry
79 passed
75 passed
78 passed
TC-AUTH-001
68 passed
79 passed
75 passed
79 passed
TC-AUTH-002
68 passed
77 passed
75 passed
79 passed
TC-AUTH-003
68 passed
77 passed
75 passed
79 passed
TC-AUTH-005
68 passed
77 passed
75 passed
79 passed
TC-AUTH-006
68 passed
77 passed
75 passed
79 passed
TC-AUTH-007
68 passed
77 passed
75 passed
79 passed
TC-AUTH-008
69 passed
77 passed
75 passed
79 passed
TC-AUTH-009
68 passed
79 passed
75 passed
79 passed
TC-AUTH-010
68 passed
80 passed
75 passed
79 passed
TC-AUTH-011
68 passed
80 passed
—
79 passed
TC-AUTH-013no runs counted+1 no runs counted——
TC-FILTER-006
71 passed
80 passed
75 passed
78 passed
TC-NAV-002
12 passed
13 passed
12 passed
9 passed
TC-NAV-003
12 passed
13 passed
12 passed
9 passed
TC-NAV-004
12 passed
13 passed
12 passed
9 passed
TC-NAV-005
12 passed
13 passed
12 passed
9 passed
TC-NAV-006
12 passed
13 passed
12 passed
9 passed
TC-NAV-007
12 passed
13 passed
12 passed
9 passed
TC-NAV-008
12 passed
13 passed
12 passed
9 passed
TC-NAV-009
12 passed
13 passed
—
9 passed
TC-NAV-010
12 passed
13 passed
—
9 passed
TC-SEARCH-001
71 passed
80 passed
75 passed
78 passed
TC-SEARCH-004
70 passed
79 passed
75 passed
78 passed
TC-SEARCH-005
70 passed
79 passed
75 passed
78 passed
TC-SORT-001
11 passed
13 passed
12 passed
9 passed
TC-SORT-002
11 passed
13 passed
12 passed
9 passed
TC-SORT-003
11 passed
13 passed
12 passed
9 passed
TC-SORT-004
11 passed
13 passed
12 passed
9 passed
TC-SORT-005
11 passed
13 passed
12 passed
9 passed
TC-SORT-006
11 passed
13 passed
12 passed
9 passed
TC-TASK-002
68 passed
80 passed
75 passed
79 passed
TC-TASK-004
68 passed
80 passed
75 passed
79 passed
TC-TASK-005
68 passed
80 passed
75 passed
79 passed
TC-TASK-006
68 passed
80 passed
75 passed
79 passed
TC-TASK-008
68 passed
80 passed
75 passed
79 passed
TC-TASK-009
68 passed
80 passed
75 passed
79 passed
TC-TASK-013
68 passed
80 passed
75 passed
79 passed
TC-TASK-015
68 passed
80 passed
75 passed
79 passed
TC-TASK-016
68 passed
80 passed
75 passed
79 passed
TC-TASK-017
68 passed
80 passed
75 passed
79 passed
TC-TASK-019
68 passed
80 passed
75 passed
79 passed