Regression: Regression of 54 benchmarks: 500.perlbench_r (max), 500.perlbench_r (max) (percentage), 502.gcc_r (max), 502.gcc_r (max)...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
267 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 30.029.0 -3.33% 17.0 -43.33% 2023-09-05T23:22:20
268 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 46.043.0 -6.52% 18.0 -60.87% 2023-09-05T23:22:20
269 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 80.081.0 1.25% 69.0 -65.67% 2023-09-05T23:22:20
270 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 49.047.0 -4.08% 20.0 -60.00% 2023-09-05T23:22:20
271 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 3.07.0 133.33% 8.0 700.00% 2023-09-05T23:22:20
272 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 1.321.25 -5.30% 0.55 -58.33% 2023-09-05T23:22:20
273 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 4.05.0 25.00% 1.0 -87.50% 2023-09-05T23:22:20
274 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 2.694.53 68.40% 2.43 -70.69% 2023-09-05T23:22:20
275 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 4.664.38 -6.01% 4.81 -6.60% 2023-09-05T23:22:20
276 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.580.53 -8.62% 0.44 -24.14% 2023-09-05T23:22:20
277 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 16.014.0 -12.50% 11.0 -31.25% 2023-09-05T23:22:20
278 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.560.49 -12.50% 0.42 -25.00% 2023-09-05T23:22:20
279 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 14.012.0 -14.29% 12.0 -14.29% 2023-09-05T23:22:20
280 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 12.013.0 8.33% 10.0 -28.57% 2023-09-05T23:22:20
281 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 2.622.66 1.53% 2.38 -62.93% 2023-09-05T23:22:20
282 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.450.42 -6.67% 0.54 20.00% 2023-09-05T23:22:20
283 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 4.06.0 50.00% 2.0 -50.00% 2023-09-05T23:22:20
284 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 2.03.0 50.00% 1.0 0.00% 2023-09-05T23:22:20
285 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.30.29 -3.33% 0.33 10.00% 2023-09-05T23:22:20
286 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 7.06.0 -14.29% 5.0 -28.57% 2023-09-05T23:22:20
287 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 14.013.0 -7.14% 16.0 14.29% 2023-09-05T23:22:20
288 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 4.020.0 400.00% 12.0 1100.00% 2023-09-05T23:22:20
289 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 3.019.0 533.33% 11.0 1000.00% 2023-09-05T23:22:20
290 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 12.013.0 8.33% 10.0 -28.57% 2023-09-05T23:22:20
291 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.310.23 -25.81% 0.08 0.00% 2023-09-05T23:22:20
292 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.660.63 -4.55% 0.98 48.48% 2023-09-05T23:22:20
293 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 12.010.0 -16.67% 11.0 -8.33% 2023-09-05T23:22:20
294 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 82.0138.0 68.29% 70.0 -72.97% 2023-09-05T23:22:20
295 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 12.010.0 -16.67% 11.0 -8.33% 2023-09-05T23:22:20
296 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 3.07.0 133.33% 8.0 700.00% 2023-09-05T23:22:20
297 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.450.42 -6.67% 0.59 31.11% 2023-09-05T23:22:20
298 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 6.08.0 33.33% 17.0 183.33% 2023-09-05T23:22:20
299 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 9.08.0 -11.11% 11.0 22.22% 2023-09-05T23:22:20
300 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.580.49 -15.52% 0.55 -5.17% 2023-09-05T23:22:20
301 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 2.162.12 -1.85% 0.95 -57.96% 2023-09-05T23:22:20
302 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 30.029.0 -3.33% 17.0 -43.33% 2023-09-05T23:22:20
303 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 19.018.0 -5.26% 9.0 -52.63% 2023-09-05T23:22:20
304 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.110.2 81.82% 0.23 475.00% 2023-09-05T23:22:20
305 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.510.48 -5.88% 0.39 -23.53% 2023-09-05T23:22:20
306 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.120.15 25.00% 0.03 -87.50% 2023-09-05T23:22:20
307 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.160.18 12.50% 0.36 125.00% 2023-09-05T23:22:20
308 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.180.28 55.56% 0.09 -50.00% 2023-09-05T23:22:20
309 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 155.0133.0 -14.19% 139.0 -13.66% 2023-09-05T23:22:20
310 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.110.56 409.09% 0.34 1033.33% 2023-09-05T23:22:20
311 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.30.28 -6.67% 0.55 83.33% 2023-09-05T23:22:20
312 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.490.42 -14.29% 0.45 -8.16% 2023-09-05T23:22:20
313 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 22.021.0 -4.55% 32.0 45.45% 2023-09-05T23:22:20
314 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.110.56 409.09% 0.34 750.00% 2023-09-05T23:22:20
315 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.10.09 -10.00% 0.06 -40.00% 2023-09-05T23:22:20
316 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 155.0133.0 -14.19% 139.0 -13.66% 2023-09-05T23:22:20
317 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.190.25 31.58% 0.55 189.47% 2023-09-05T23:22:20
318 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 12.010.0 -16.67% 8.0 -33.33% 2023-09-05T23:22:20
319 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 1.00.94 -6.00% 0.49 -51.00% 2023-09-05T23:22:20
320 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0027 (llvmorg-18-init-04636-g43d05f4cc959), 0028 (llvmorg-18-init-04755-gfd4c80dec929) 0.240.2 -16.67% 0.15 -37.50% 2023-09-05T23:22:20
Change State Split Delete