Regression: Regression of 27 benchmarks: TOTAL.fails



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew %Δ Now Current Age
32561 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0077 (basepoints/gcc-14-03164-gf93a612fc45), 0080 (basepoints/gcc-14-03165-gce6c4d3b4d3) 469.0450.0 -4.05% 362.0 -25.05% 2023-08-22T10:42:18
32564 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0080 (basepoints/gcc-14-03165-gce6c4d3b4d3), 0083 (basepoints/gcc-14-03280-g17d670dbca1) 450.0442.0 -1.78% 362.0 -19.56% 2023-08-22T22:41:38
32566 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0084 (basepoints/gcc-14-03281-g99b5921bfc8), 0086 (basepoints/gcc-14-03431-g7e05cd632fa) 452.0458.0 1.33% 362.0 -19.91% 2023-08-23T17:39:58
32567 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0086 (basepoints/gcc-14-03431-g7e05cd632fa), 0087 (basepoints/gcc-14-03432-gddd64a6ec3b) 458.0463.0 1.09% 362.0 -20.96% 2023-08-24T00:16:11
32568 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0090 (basepoints/gcc-14-03441-ga1558e9ad85), 0092 (basepoints/gcc-14-03502-g7997f0d35ef) 442.0437.0 -1.13% 362.0 -22.15% 2023-08-25T15:47:07
32569 master-thumb_m3_eabi:719846687264750394 nb_fails TOTAL.fails 0093 (basepoints/gcc-14-03503-g55f6a7d949a), 0098 (basepoints/gcc-14-03614-g5f2098cce6c) 437.0432.0 -1.14% 362.0 -17.16% 2023-08-31T19:32:52
32614 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0035 (basepoints/gcc-14-03037-g8ae83274d8c), 0077 (basepoints/gcc-14-03038-gda1a888b524) 310.0318.0 2.58% 288.0 -7.10% 2023-08-15T18:10:37
32615 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0090 (basepoints/gcc-14-03164-gf93a612fc45), 0091 (basepoints/gcc-14-03165-gce6c4d3b4d3) 321.0325.0 1.25% 288.0 -10.28% 2023-08-22T17:07:32
32616 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0091 (basepoints/gcc-14-03165-gce6c4d3b4d3), 0093 (basepoints/gcc-14-03431-g7e05cd632fa) 325.0339.0 4.31% 288.0 -11.38% 2023-08-23T11:53:05
32617 master-thumb_m23_eabi:564955760422315397 nb_fails TOTAL.fails 0093 (basepoints/gcc-14-03431-g7e05cd632fa), 0094 (basepoints/gcc-14-03432-gddd64a6ec3b) 339.0344.0 1.47% 288.0 -15.04% 2023-08-23T21:22:45
32757 master-thumb_m7_eabi:789887171421761561 nb_fails TOTAL.fails 0026 (basepoints/gcc-14-03037-g8ae83274d8c), 0029 (basepoints/gcc-14-03038-gda1a888b524) 513.0521.0 1.56% 354.0 -30.99% 2023-08-08T06:06:44
32758 master-thumb_m7_eabi:789887171421761561 nb_fails TOTAL.fails 0089 (basepoints/gcc-14-03281-g99b5921bfc8), 0092 (basepoints/gcc-14-03440-ge80f7c13f64) 530.0542.0 2.26% 354.0 -33.21% 2023-08-24T12:00:33
32827 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0062 (basepoints/gcc-15-00940-ge0ab5ee9bed), 0063 (basepoints/gcc-15-00941-g65dbe0ab7cd) 355.0359.0 1.13% 163.0 -53.82% 2024-06-04T15:15:55
32828 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0071 (basepoints/gcc-15-01393-ge17114f99c9), 0072 (basepoints/gcc-15-01394-gc9b96a68860) 359.0363.0 1.11% 163.0 -54.60% 2024-06-20T07:22:08
32829 master-thumb_m7_hard_eabi:670212090789607987 nb_fails TOTAL.fails 0077 (basepoints/gcc-15-01578-g5185274c76cc), 0078 (basepoints/gcc-15-01579-g792f97b44ffc) 365.0369.0 1.10% 163.0 -55.34% 2024-06-23T15:25:11
32844 master-thumb_m0_eabi:342534359769205202 nb_fails TOTAL.fails 0028 (basepoints/gcc-14-03038-gda1a888b524), 0098 (basepoints/gcc-14-03164-gf93a612fc45) 166.0324.0 95.18% 259.0 56.02% 2023-08-09T20:49:56
32846 master-thumb_m0_eabi:342534359769205202 nb_fails TOTAL.fails 0098 (basepoints/gcc-14-03164-gf93a612fc45), 0099 (basepoints/gcc-14-03165-gce6c4d3b4d3) 324.0329.0 1.54% 259.0 -20.06% 2023-08-10T19:54:01
33916 master-thumb_m3_softfp_eabi:47382429395399045 nb_fails TOTAL.fails 0075 (basepoints/gcc-15-01393-ge17114f99c9e), 0076 (basepoints/gcc-15-01394-gc9b96a68860b) 358.0362.0 1.12% 149.0 -58.38% 2024-06-21T08:56:02
33917 master-thumb_m3_softfp_eabi:47382429395399045 nb_fails TOTAL.fails 0084 (basepoints/gcc-15-01578-g5185274c76cc), 0085 (basepoints/gcc-15-01579-g792f97b44ffc) 364.0384.0 5.49% 149.0 -59.07% 2024-06-25T19:58:47
33918 master-thumb_m3_softfp_eabi:47382429395399045 nb_fails TOTAL.fails 0087 (basepoints/gcc-15-01618-g9f168b412f44), 0088 (basepoints/gcc-15-01619-g3b9b8d6cfdf5) 384.0392.0 2.08% 149.0 -61.20% 2024-06-26T04:18:33
34100 master-thumb_m33_hard_eabi:625583502139302580 nb_fails TOTAL.fails 0071 (basepoints/gcc-15-01393-ge17114f99c9), 0072 (basepoints/gcc-15-01394-gc9b96a68860) 378.0382.0 1.06% 159.0 -57.94% 2024-06-20T07:00:00
34101 master-thumb_m33_hard_eabi:625583502139302580 nb_fails TOTAL.fails 0077 (basepoints/gcc-15-01578-g5185274c76cc), 0078 (basepoints/gcc-15-01579-g792f97b44ffc) 384.0388.0 1.04% 159.0 -58.59% 2024-06-23T15:23:48
34102 master-thumb_m33_hard_eabi:625583502139302580 nb_fails TOTAL.fails 0084 (basepoints/gcc-15-01618-g9f168b412f44), 0085 (basepoints/gcc-15-01619-g3b9b8d6cfdf5) 388.0419.0 7.99% 159.0 -59.02% 2024-06-28T03:15:04
34140 master-thumb_m0_soft_eabi:718896572867151725 nb_fails TOTAL.fails 0083 (basepoints/gcc-15-02359-g928116e94a5a), 0084 (basepoints/gcc-15-02360-gdab0f35fcb4d) 275.0267.0 -2.91% 55.0 -80.00% 2024-07-27T06:17:04
34142 master-thumb_m0_soft_eabi:718896572867151725 nb_fails TOTAL.fails 0086 (basepoints/gcc-15-02361-g3129a2ed6a7), 0087 (basepoints/gcc-15-02362-ga9e9f772c748) 267.0270.0 1.12% 55.0 -79.40% 2024-07-28T02:13:10
34176 master-thumb_v8a_hard_eabi:619965277143480357 nb_fails TOTAL.fails 0098 (basepoints/gcc-14-03164-gf93a612fc45), 0099 (basepoints/gcc-14-03165-gce6c4d3b4d3) 336.0340.0 1.19% 127.0 -62.20% 2023-08-26T23:12:38
34353 master-arm_eabi:1084008951837733723 nb_fails TOTAL.fails 0089 (basepoints/gcc-14-01909-g5a1ef1cfac0), 0091 (no-change) 1110.069796.0 6187.93% 55.0 -95.00% 2023-06-18T06:12:20
Change State Split Delete