Regression: Regression of 30 benchmarks: TOTAL.fails



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew %Δ Now Current Age
32570 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0102 (basepoints/gcc-14-03632-ge7b26744404), 0108 (basepoints/gcc-14-03744-g6b96de22d6b) 432.0328.0 -24.07% 362.0 -21.98% 2023-09-07T09:16:55
32571 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0114 (basepoints/gcc-14-03822-g1ea7130315a), 0115 (basepoints/gcc-14-03823-g50b5199cff6) 432.0386.0 -10.65% 362.0 9.70% 2023-09-10T22:34:26
32572 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0127 (basepoints/gcc-14-04045-g038c0afa893), 0128 (basepoints/gcc-14-04046-g3a0e01f6bb1) 386.0391.0 1.30% 362.0 -5.97% 2023-09-16T21:07:48
32618 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0104 (basepoints/gcc-14-03615-gfcede95472c), 0106 (basepoints/gcc-14-03631-gd3dd69706af) 308.0278.0 -9.74% 288.0 -8.57% 2023-09-01T23:24:58
32619 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0106 (basepoints/gcc-14-03631-gd3dd69706af), 0107 (basepoints/gcc-14-03632-ge7b26744404) 311.0306.0 -1.61% 288.0 3.60% 2023-09-02T00:48:59
32620 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0119 (basepoints/gcc-14-03822-g1ea7130315a), 0120 (basepoints/gcc-14-03823-g50b5199cff6) 344.0364.0 5.81% 288.0 -6.49% 2023-09-11T05:34:08
32759 master-thumb_m7_eabi:789887171421761561 nb_fails TOTAL.fails 0102 (basepoints/gcc-14-03615-gfcede95472c), 0104 (basepoints/gcc-14-03631-gd3dd69706af) 518.0484.0 -6.56% 354.0 -32.18% 2023-09-02T14:25:46
32760 master-thumb_m7_eabi:789887171421761561 nb_fails TOTAL.fails 0104 (basepoints/gcc-14-03631-gd3dd69706af), 0105 (basepoints/gcc-14-03632-ge7b26744404) 518.0512.0 -1.16% 354.0 -26.86% 2023-09-02T19:13:04
32761 master-thumb_m7_eabi:789887171421761561 nb_fails TOTAL.fails 0105 (basepoints/gcc-14-03632-ge7b26744404), 0132 (basepoints/gcc-14-03744-g6b96de22d6b) 484.0376.0 -22.31% 354.0 -30.86% 2023-09-05T22:23:43
32830 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0099 (basepoints/gcc-15-01901-g98914f9eba5f), 0100 (basepoints/gcc-15-01960-gf777ab31e55c) 353.0349.0 -1.13% 163.0 -53.82% 2024-07-10T10:47:43
32832 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0112 (basepoints/gcc-15-02359-g928116e94a5a), 0113 (basepoints/gcc-15-02360-gdab0f35fcb4) 346.0338.0 -2.31% 163.0 -52.89% 2024-07-28T02:21:14
32834 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0129 (3-changed-components), 0131 (5-changed-components) 338.0334.0 -1.18% 163.0 -52.20% 2024-08-13T16:28:33
32835 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0131 (5-changed-components), 0132 (5-changed-components) 334.0325.0 -2.69% 163.0 -51.20% 2024-08-16T14:20:19
32848 master-thumb_m0_eabi:342534359769205202 nb_fails TOTAL.fails 0101 (no-change), 0103 (basepoints/gcc-14-03502-g7997f0d35ef) 321.0312.0 -2.80% 259.0 -19.31% 2023-08-19T03:51:29
32849 master-thumb_m0_eabi:342534359769205202 nb_fails TOTAL.fails 0111 (basepoints/gcc-14-03615-gfcede95472c), 0116 (basepoints/gcc-14-03631-gd3dd69706af) 311.0275.0 -11.58% 259.0 -16.72% 2023-09-06T00:32:29
32850 master-thumb_m0_eabi:342534359769205202 nb_fails TOTAL.fails 0116 (basepoints/gcc-14-03631-gd3dd69706af), 0117 (basepoints/gcc-14-03632-ge7b26744404) 311.0303.0 -2.57% 259.0 -5.82% 2023-09-06T14:08:45
32851 master-thumb_m0_eabi:342534359769205202 nb_fails TOTAL.fails 0134 (basepoints/gcc-14-03822-g1ea7130315a), 0135 (basepoints/gcc-14-03823-g50b5199cff6) 329.0361.0 9.73% 259.0 -15.08% 2023-09-08T22:56:28
33921 master-thumb_m3_softfp_eabi:47382429395399045 nb_fails TOTAL.fails 0103 (basepoints/gcc-15-01901-g98914f9eba5f), 0105 (basepoints/gcc-15-01944-ge08ebd7d77a2) 389.0385.0 -1.03% 149.0 -61.70% 2024-07-13T15:32:03
34104 master-thumb_m33_hard_eabi:625583502139302580 nb_fails TOTAL.fails 0130 (basepoints/gcc-15-02359-g928116e94a5a), 0131 (basepoints/gcc-15-02360-gdab0f35fcb4) 409.0399.0 -2.44% 159.0 -61.12% 2024-08-22T08:59:32
34106 master-thumb_m33_hard_eabi:625583502139302580 nb_fails TOTAL.fails 0134 (basepoints/gcc-15-02384-ga7d6f7327e9), 0136 (basepoints/gcc-15-03082-g9bbad368513) 399.0386.0 -3.26% 159.0 -60.45% 2024-08-22T13:00:27
34143 master-thumb_m0_soft_eabi:718896572867151725 nb_fails TOTAL.fails 0104 (5-changed-components), 0105 (5-changed-components) 266.0257.0 -3.38% 55.0 -79.32% 2024-08-16T13:43:37
34144 master-thumb_m0_soft_eabi:718896572867151725 nb_fails TOTAL.fails 0136 (binutils-2_41-release-04186-g9a3781f1203), 0137 (binutils-2_41-release-04187-g31ed3a9d691) 258.071615.0 27657.75% 55.0 -78.68% 2024-09-10T12:46:20
34177 master-thumb_v8a_hard_eabi:619965277143480357 nb_fails TOTAL.fails 0104 (basepoints/gcc-14-03280-g17d670dbca1), 0105 (basepoints/gcc-14-03281-g99b5921bfc8) 340.0355.0 4.41% 127.0 -62.65% 2023-08-31T10:11:46
34178 master-thumb_v8a_hard_eabi:619965277143480357 nb_fails TOTAL.fails 0108 (basepoints/gcc-14-03441-ga1558e9ad85), 0110 (basepoints/gcc-14-03502-g7997f0d35ef) 333.0328.0 -1.50% 127.0 -64.53% 2023-08-31T23:34:10
34180 master-thumb_v8a_hard_eabi:619965277143480357 nb_fails TOTAL.fails 0114 (basepoints/gcc-14-03615-gfcede95472c), 0116 (basepoints/gcc-14-03631-gd3dd69706af) 328.0294.0 -10.37% 127.0 -61.75% 2023-09-01T13:45:24
34181 master-thumb_v8a_hard_eabi:619965277143480357 nb_fails TOTAL.fails 0116 (basepoints/gcc-14-03631-gd3dd69706af), 0117 (basepoints/gcc-14-03632-ge7b26744404) 328.0322.0 -1.83% 127.0 -56.80% 2023-09-01T16:54:29
34183 master-thumb_v8a_hard_eabi:619965277143480357 nb_fails TOTAL.fails 0124 (basepoints/gcc-14-03745-g4f4fa250118), 0139 (basepoints/gcc-14-03823-g50b5199cff6) 358.0380.0 6.15% 127.0 -60.92% 2023-09-08T08:03:14
34273 master-thumb_m55_hard_eabi:399934044803555727 nb_fails TOTAL.fails 0102 (basepoints/gcc-14-03281-g99b5921bfc8), 0107 (basepoints/gcc-14-03380-gd3b5a1bccc2) 562.0576.0 2.49% 157.0 -72.06% 2023-08-28T18:50:19
34274 master-thumb_m55_hard_eabi:399934044803555727 nb_fails TOTAL.fails 0120 (basepoints/gcc-14-03632-ge7b26744404), 0126 (basepoints/gcc-14-03745-g4f4fa250118) 548.0415.0 -24.27% 157.0 -71.35% 2023-09-05T05:55:22
34275 master-thumb_m55_hard_eabi:399934044803555727 nb_fails TOTAL.fails 0131 (basepoints/gcc-14-03822-g1ea7130315a), 0132 (basepoints/gcc-14-03823-g50b5199cff6) 415.0470.0 13.25% 157.0 -62.08% 2023-09-10T13:12:07
Change State Split Delete