Regression: Regression of 53 benchmarks: 500.perlbench_r (avg) (percentage), 500.perlbench_r (max), 500.perlbench_r (max) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1401 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.310.38 22.58% 0.24 0.00% 2024-01-07T01:25:30
1402 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 5.09.0 80.00% None 0.00% 2024-01-07T01:25:30
1403 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.390.37 -5.13% 0.1 -75.61% 2024-01-07T01:25:30
1404 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 2.062.02 -1.94% 3.34 62.14% 2024-01-07T01:25:30
1405 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 16.018.0 12.50% 17.0 0.00% 2024-01-07T01:25:30
1406 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 7.06.0 -14.29% 18.0 157.14% 2024-01-07T01:25:30
1407 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 6.04.0 -33.33% 69.0 0.00% 2024-01-07T01:25:30
1408 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 3.08.0 166.67% 1.0 0.00% 2024-01-07T01:25:30
1409 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.510.5 -1.96% 0.57 11.76% 2024-01-07T01:25:30
1410 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 9.987.96 -20.24% 2.43 -76.13% 2024-01-07T01:25:30
1411 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.270.22 -18.52% 0.11 0.00% 2024-01-07T01:25:30
1412 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 5.04.0 -20.00% 2.0 0.00% 2024-01-07T01:25:30
1413 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 3.883.78 -2.58% 4.81 12.12% 2024-01-07T01:25:30
1414 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.130.25 92.31% None 0.00% 2024-01-07T01:25:30
1415 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.80.76 -5.00% 0.44 -45.68% 2024-01-07T01:25:30
1416 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.20.19 -5.00% 0.13 -35.00% 2024-01-07T01:25:30
1417 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 3.012.0 300.00% None 0.00% 2024-01-07T01:25:30
1418 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.180.14 -22.22% 2.38 0.00% 2024-01-07T01:25:30
1419 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.430.42 -2.33% 0.54 20.00% 2024-01-07T01:25:30
1420 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 10.012.0 20.00% 8.0 0.00% 2024-01-07T01:25:30
1421 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 8.09.0 12.50% 1.0 0.00% 2024-01-07T01:25:30
1422 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 5.07.0 40.00% 5.0 66.67% 2024-01-07T01:25:30
1423 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 10.09.0 -10.00% 11.0 10.00% 2024-01-07T01:25:30
1424 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.640.73 14.06% 0.08 0.00% 2024-01-07T01:25:30
1425 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 1.00.97 -3.00% 0.98 -2.00% 2024-01-07T01:25:30
1426 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 14.015.0 7.14% 11.0 -21.43% 2024-01-07T01:25:30
1427 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 296.0232.0 -21.62% 70.0 -76.35% 2024-01-07T01:25:30
1428 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.090.34 277.78% 0.09 -89.53% 2024-01-07T01:25:30
1429 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 14.015.0 7.14% 11.0 -21.43% 2024-01-07T01:25:30
1430 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 1.031.0 -2.91% 0.59 -42.72% 2024-01-07T01:25:30
1431 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.740.82 10.81% 0.77 0.00% 2024-01-07T01:25:30
1432 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.340.33 -2.94% 0.28 -17.65% 2024-01-07T01:25:30
1433 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 20.019.0 -5.00% 11.0 -45.00% 2024-01-07T01:25:30
1434 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 14.013.0 -7.14% None 0.00% 2024-01-07T01:25:30
1435 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.840.83 -1.19% 0.95 -3.06% 2024-01-07T01:25:30
1436 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 3.04.0 33.33% 4.0 33.33% 2024-01-07T01:25:30
1437 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 3.04.0 33.33% 4.0 33.33% 2024-01-07T01:25:30
1438 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 43.042.0 -2.33% 9.0 -79.07% 2024-01-07T01:25:30
1439 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 40.039.0 -2.50% 57.0 42.50% 2024-01-07T01:25:30
1440 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.160.15 -6.25% 0.12 -25.00% 2024-01-07T01:25:30
1441 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 7.06.0 -14.29% 4.0 -42.86% 2024-01-07T01:25:30
1442 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 14.013.0 -7.14% None 0.00% 2024-01-07T01:25:30
1443 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.10.26 160.00% 0.03 0.00% 2024-01-07T01:25:30
1444 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.590.61 3.39% 0.44 -32.31% 2024-01-07T01:25:30
1445 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.290.34 17.24% 0.36 24.14% 2024-01-07T01:25:30
1446 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 1.31.27 -2.31% 0.55 -57.69% 2024-01-07T01:25:30
1447 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.650.72 10.77% 0.69 40.82% 2024-01-07T01:25:30
1448 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 31.030.0 -3.23% 32.0 3.23% 2024-01-07T01:25:30
1449 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 7.06.0 -14.29% 4.0 -42.86% 2024-01-07T01:25:30
1450 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.270.26 -3.70% 0.06 -77.78% 2024-01-07T01:25:30
1451 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 2.32.27 -1.30% 0.49 -78.70% 2024-01-07T01:25:30
1452 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.160.15 -6.25% 0.07 -56.25% 2024-01-07T01:25:30
1453 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0181 (llvmorg-18-init-16827-g7bf13fe81218), 0182 (llvmorg-18-init-16828-g75d820dcdd86) 0.150.26 73.33% 0.15 50.00% 2024-01-07T01:25:30
Change State Split Delete