Regression: Regression of 51 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
4420 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 3.873.66 -5.43% 3.34 -20.10% 2024-05-10T14:10:54
4421 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 39.038.0 -2.56% 20.0 -48.72% 2024-05-10T14:10:54
4422 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 38.026.0 -31.58% 18.0 -52.63% 2024-05-10T14:10:54
4423 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 37.036.0 -2.70% 20.0 -47.37% 2024-05-10T14:10:54
4424 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 277.0349.0 25.99% 69.0 0.00% 2024-05-10T14:10:54
4425 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.230.17 -26.09% 0.55 0.00% 2024-05-10T14:10:54
4426 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 1.130.77 -31.86% 0.55 -51.33% 2024-05-10T14:10:54
4427 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 2.05.0 150.00% 1.0 0.00% 2024-05-10T14:10:54
4428 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 1.01.05 5.00% 0.57 42.50% 2024-05-10T14:10:54
4429 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 1.361.05 -22.79% 0.0 0.00% 2024-05-10T14:10:54
4430 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 9.4610.83 14.48% 2.43 -56.53% 2024-05-10T14:10:54
4431 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.991.04 5.05% 0.09 -77.50% 2024-05-10T14:10:54
4432 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 20.021.0 5.00% 12.0 50.00% 2024-05-10T14:10:54
4433 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 31.021.0 -32.26% 22.0 -31.25% 2024-05-10T14:10:54
4434 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.080.26 225.00% 0.44 -27.87% 2024-05-10T14:10:54
4435 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 2.07.0 250.00% 11.0 -31.25% 2024-05-10T14:10:54
4436 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.440.43 -2.27% 0.42 -4.55% 2024-05-10T14:10:54
4437 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 8.06.0 -25.00% 19.0 0.00% 2024-05-10T14:10:54
4438 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 16.015.0 -6.25% 14.0 -12.50% 2024-05-10T14:10:54
4439 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 8.6412.15 40.62% 2.38 0.00% 2024-05-10T14:10:54
4440 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.20.19 -5.00% 0.54 145.45% 2024-05-10T14:10:54
4441 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.90.87 -3.33% 0.51 -43.33% 2024-05-10T14:10:54
4442 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 7.08.0 14.29% 8.0 -11.11% 2024-05-10T14:10:54
4443 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 11.012.0 9.09% 11.0 -15.38% 2024-05-10T14:10:54
4444 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.520.5 -3.85% 0.98 88.46% 2024-05-10T14:10:54
4445 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 303.0311.0 2.64% 70.0 -61.11% 2024-05-10T14:10:54
4446 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 50.04.0 -92.00% None 0.00% 2024-05-10T14:10:54
4447 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.130.14 7.69% 0.77 492.31% 2024-05-10T14:10:54
4448 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (avg) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 1.91.28 -32.63% 1.4 -26.32% 2024-05-10T14:10:54
4449 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 2.01.0 -50.00% 1.0 -50.00% 2024-05-10T14:10:54
4450 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 11.09.0 -18.18% 8.0 -27.27% 2024-05-10T14:10:54
4451 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 1.631.65 1.23% 0.95 -45.71% 2024-05-10T14:10:54
4452 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 2.051.99 -2.93% 1.21 -40.98% 2024-05-10T14:10:54
4453 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 72.070.0 -2.78% 57.0 -29.63% 2024-05-10T14:10:54
4454 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 39.038.0 -2.56% 20.0 -48.72% 2024-05-10T14:10:54
4455 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 2.850.23 -91.93% None 0.00% 2024-05-10T14:10:54
4456 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.060.15 150.00% 0.03 0.00% 2024-05-10T14:10:54
4457 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.50.49 -2.00% 0.44 -12.00% 2024-05-10T14:10:54
4458 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.640.53 -17.19% 0.45 -29.69% 2024-05-10T14:10:54
4459 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (avg) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 31.021.0 -32.26% 22.0 -31.25% 2024-05-10T14:10:54
4460 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.640.62 -3.13% 0.55 -14.06% 2024-05-10T14:10:54
4461 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.750.69 -8.00% 0.69 -8.00% 2024-05-10T14:10:54
4462 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 27.021.0 -22.22% 0.0 0.00% 2024-05-10T14:10:54
4463 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 1.150.99 -13.91% 3.23 -19.65% 2024-05-10T14:10:54
4464 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.380.37 -2.63% 0.34 -10.53% 2024-05-10T14:10:54
4465 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 22.019.0 -13.64% 56.0 -28.21% 2024-05-10T14:10:54
4466 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 16.015.0 -6.25% 14.0 -12.50% 2024-05-10T14:10:54
4467 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 11.09.0 -18.18% 8.0 -27.27% 2024-05-10T14:10:54
4468 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 20.021.0 5.00% 2.0 -75.00% 2024-05-10T14:10:54
4469 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.090.06 -33.33% 0.07 -22.22% 2024-05-10T14:10:54
4470 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0354 (llvmorg-19-init-11003-gc8864bceeb20), 0355 (no-change) 0.230.21 -8.70% 0.15 -34.78% 2024-05-10T14:10:54
Change State Split Delete