Regression: Regression of 62 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1677 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.380.13 -65.79% 0.24 0.00% 2024-01-29T17:03:23
1678 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 5.01.0 -80.00% None 0.00% 2024-01-29T17:03:23
1679 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.340.28 -17.65% 0.1 -70.59% 2024-01-29T17:03:23
1680 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 1.881.85 -1.60% 3.34 77.66% 2024-01-29T17:03:23
1681 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 26.021.0 -19.23% 20.0 -23.08% 2024-01-29T17:03:23
1682 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 347.0317.0 -8.65% 69.0 109.09% 2024-01-29T17:03:23
1683 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 35.033.0 -5.71% 20.0 -42.86% 2024-01-29T17:03:23
1684 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 8.010.0 25.00% 8.0 0.00% 2024-01-29T17:03:23
1685 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.210.22 4.76% 0.55 139.13% 2024-01-29T17:03:23
1686 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 5.04.0 -20.00% 6.0 20.00% 2024-01-29T17:03:23
1687 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 1.02.0 100.00% 1.0 0.00% 2024-01-29T17:03:23
1688 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 10.6210.88 2.45% 2.43 -62.56% 2024-01-29T17:03:23
1689 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 3.884.01 3.35% 4.81 50.78% 2024-01-29T17:03:23
1690 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.130.03 -76.92% None 0.00% 2024-01-29T17:03:23
1691 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.690.66 -4.35% 0.44 -36.23% 2024-01-29T17:03:23
1692 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.190.18 -5.26% 0.13 -31.58% 2024-01-29T17:03:23
1693 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.550.54 -1.82% 0.42 -23.64% 2024-01-29T17:03:23
1694 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 18.016.0 -11.11% 14.0 -22.22% 2024-01-29T17:03:23
1695 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 11.889.81 -17.42% 2.38 110.62% 2024-01-29T17:03:23
1696 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 12.04.0 -66.67% 8.0 0.00% 2024-01-29T17:03:23
1697 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.330.32 -3.03% 0.33 -2.94% 2024-01-29T17:03:23
1698 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.270.25 -7.41% 0.32 18.52% 2024-01-29T17:03:23
1699 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 5.04.0 -20.00% 5.0 0.00% 2024-01-29T17:03:23
1700 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 22.030.0 36.36% 12.0 -45.45% 2024-01-29T17:03:23
1701 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 21.030.0 42.86% 11.0 -47.62% 2024-01-29T17:03:23
1702 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 2.01.0 -50.00% 2.0 -50.00% 2024-01-29T17:03:23
1703 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.850.53 -37.65% 0.98 15.29% 2024-01-29T17:03:23
1704 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 11.010.0 -9.09% 11.0 0.00% 2024-01-29T17:03:23
1705 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 341.0351.0 2.93% 70.0 -62.96% 2024-01-29T17:03:23
1706 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 1.02.0 100.00% 0.0 0.00% 2024-01-29T17:03:23
1707 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 11.010.0 -9.09% 11.0 0.00% 2024-01-29T17:03:23
1708 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.070.03 -57.14% 0.07 -50.00% 2024-01-29T17:03:23
1709 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 8.010.0 25.00% 8.0 0.00% 2024-01-29T17:03:23
1710 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.840.82 -2.38% 0.59 -29.76% 2024-01-29T17:03:23
1711 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.290.27 -6.90% 0.28 -3.45% 2024-01-29T17:03:23
1712 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.550.5 -9.09% 0.55 0.00% 2024-01-29T17:03:23
1713 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 11.09.0 -18.18% None 0.00% 2024-01-29T17:03:23
1714 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 1.611.53 -4.97% 0.95 -40.99% 2024-01-29T17:03:23
1715 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 1.361.11 -18.38% 1.21 -11.03% 2024-01-29T17:03:23
1716 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.250.3 20.00% 0.23 -8.00% 2024-01-29T17:03:23
1717 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 26.021.0 -19.23% 20.0 -23.08% 2024-01-29T17:03:23
1718 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.190.18 -5.26% 0.3 57.89% 2024-01-29T17:03:23
1719 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 11.09.0 -18.18% None 0.00% 2024-01-29T17:03:23
1720 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.030.06 100.00% 0.03 0.00% 2024-01-29T17:03:23
1721 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 5.04.0 -20.00% 6.0 20.00% 2024-01-29T17:03:23
1722 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.590.53 -10.17% 0.44 -25.42% 2024-01-29T17:03:23
1723 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.380.37 -2.63% 0.36 -5.26% 2024-01-29T17:03:23
1724 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 126.0129.0 2.38% 139.0 51.09% 2024-01-29T17:03:23
1725 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.630.85 34.92% 0.34 -46.03% 2024-01-29T17:03:23
1726 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.250.18 -28.00% 0.55 120.00% 2024-01-29T17:03:23
1727 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 5.04.0 -20.00% 5.0 0.00% 2024-01-29T17:03:23
1728 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.520.53 1.92% 0.69 25.45% 2024-01-29T17:03:23
1729 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 26.016.0 -38.46% 32.0 23.08% 2024-01-29T17:03:23
1730 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 1.020.61 -40.20% 3.23 0.00% 2024-01-29T17:03:23
1731 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.620.85 37.10% 0.34 -45.16% 2024-01-29T17:03:23
1732 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 20.012.0 -40.00% 56.0 0.00% 2024-01-29T17:03:23
1733 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 18.016.0 -11.11% 14.0 -22.22% 2024-01-29T17:03:23
1734 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.120.14 16.67% 0.06 -68.42% 2024-01-29T17:03:23
1735 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 126.0129.0 2.38% 139.0 51.09% 2024-01-29T17:03:23
1736 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.230.22 -4.35% 0.07 -69.57% 2024-01-29T17:03:23
1737 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 0.170.16 -5.88% 0.15 -11.76% 2024-01-29T17:03:23
1738 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0197 (llvmorg-19-init-00873-g6720e3af253e), 0198 (llvmorg-19-init-00874-gd04ae1b15ff3) 4.03.0 -25.00% 9.0 125.00% 2024-01-29T17:03:23
Change State Split Delete