Regression: Regression of 41 benchmarks: 500.perlbench_r (avg) (percentage), 500.perlbench_r (max), 500.perlbench_r (max) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
4511 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 49.062.0 26.53% 18.0 -30.77% 2024-05-12T12:15:52
4512 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 349.0274.0 -21.49% 69.0 15.00% 2024-05-12T12:15:52
4513 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 1.371.88 37.23% 0.55 89.66% 2024-05-12T12:15:52
4514 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 1.431.85 29.37% 0.55 -27.63% 2024-05-12T12:15:52
4515 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.80.87 8.75% 0.57 -39.36% 2024-05-12T12:15:52
4516 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 10.299.85 -4.28% 2.43 -76.38% 2024-05-12T12:15:52
4517 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 16.017.0 6.25% 12.0 -33.33% 2024-05-12T12:15:52
4518 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 21.020.0 -4.76% 22.0 4.76% 2024-05-12T12:15:52
4519 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 4.03.0 -25.00% 11.0 175.00% 2024-05-12T12:15:52
4520 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.140.13 -7.14% 0.13 -7.14% 2024-05-12T12:15:52
4521 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.420.41 -2.38% 0.42 0.00% 2024-05-12T12:15:52
4522 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 47.064.0 36.17% 19.0 90.00% 2024-05-12T12:15:52
4523 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 11.010.0 -9.09% 10.0 -9.09% 2024-05-12T12:15:52
4524 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 12.158.54 -29.71% 2.38 16.10% 2024-05-12T12:15:52
4525 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.870.88 1.15% 0.51 -39.29% 2024-05-12T12:15:52
4526 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 3.01.0 -66.67% 12.0 100.00% 2024-05-12T12:15:52
4527 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 11.010.0 -9.09% 10.0 -9.09% 2024-05-12T12:15:52
4528 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 8.07.0 -12.50% 2.0 -66.67% 2024-05-12T12:15:52
4529 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.50.49 -2.00% 0.98 84.91% 2024-05-12T12:15:52
4530 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 311.0315.0 1.29% 70.0 -76.74% 2024-05-12T12:15:52
4531 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.280.25 -10.71% 0.07 -66.67% 2024-05-12T12:15:52
4532 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (unexplained diff vs previous) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 4.016.0 300.00% None 0.00% 2024-05-12T12:15:52
4533 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (avg) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 1.281.18 -7.81% 1.4 9.37% 2024-05-12T12:15:52
4534 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 1.551.52 -1.94% 0.95 -39.87% 2024-05-12T12:15:52
4535 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 1.781.82 2.25% 1.21 -35.64% 2024-05-12T12:15:52
4536 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 5.04.0 -20.00% 4.0 -20.00% 2024-05-12T12:15:52
4537 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (unexplained diff vs previous) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.230.94 308.70% None 0.00% 2024-05-12T12:15:52
4538 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.490.48 -2.04% 0.44 -10.20% 2024-05-12T12:15:52
4539 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 168.0163.0 -2.98% 139.0 -4.14% 2024-05-12T12:15:52
4540 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.090.03 -66.67% 0.34 100.00% 2024-05-12T12:15:52
4541 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (avg) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 21.020.0 -4.76% 22.0 4.76% 2024-05-12T12:15:52
4542 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.40.37 -7.50% 0.55 37.50% 2024-05-12T12:15:52
4543 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 16.015.0 -6.25% 32.0 88.24% 2024-05-12T12:15:52
4544 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.990.83 -16.16% 3.23 0.00% 2024-05-12T12:15:52
4545 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.310.29 -6.45% 0.34 9.68% 2024-05-12T12:15:52
4546 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 5.04.0 -20.00% 4.0 -20.00% 2024-05-12T12:15:52
4547 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 19.016.0 -15.79% 56.0 0.00% 2024-05-12T12:15:52
4548 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 168.0163.0 -2.98% 139.0 -4.14% 2024-05-12T12:15:52
4549 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.620.61 -1.61% 0.49 -20.97% 2024-05-12T12:15:52
4550 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 0.260.25 -3.85% 0.07 -66.67% 2024-05-12T12:15:52
4551 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0357 (llvmorg-19-init-11007-g78b3a00418ce), 0358 (llvmorg-19-init-11040-gc6c7afd21edd) 7.06.0 -14.29% 9.0 28.57% 2024-05-12T12:15:52
Change State Split Delete