Regression: Regression of 72 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
3654 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 19.018.0 -5.26% 22.0 15.79% 2023-02-17T09:03:40
3655 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 21.022.0 4.76% None 0.00% 2023-02-17T09:03:40
3656 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.050.04 -20.00% 0.08 14.29% 2023-02-17T09:03:40
3657 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 55.054.0 -1.82% 61.0 10.91% 2023-02-17T09:03:40
3658 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 20.022.0 10.00% 20.0 -20.00% 2023-02-17T09:03:40
3659 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.660.69 4.55% 0.46 -30.30% 2023-02-17T09:03:40
3660 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 5.01.0 -80.00% 7.0 40.00% 2023-02-17T09:03:40
3661 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 47.050.0 6.38% 33.0 -29.79% 2023-02-17T09:03:40
3662 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 55.054.0 -1.82% 61.0 10.91% 2023-02-17T09:03:40
3663 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.440.5 13.64% None 0.00% 2023-02-17T09:03:40
3664 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 17.079.0 364.71% 10.0 11.11% 2023-02-17T09:03:40
3665 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 1.61.63 1.87% 1.63 -4.68% 2023-02-17T09:03:40
3666 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 12.011.0 -8.33% 54.0 350.00% 2023-02-17T09:03:40
3667 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 22.021.0 -4.55% 23.0 4.55% 2023-02-17T09:03:40
3668 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.190.18 -5.26% 0.83 336.84% 2023-02-17T09:03:40
3669 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 1.461.48 1.37% 0.63 -62.05% 2023-02-17T09:03:40
3670 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.220.2 -9.09% None 0.00% 2023-02-17T09:03:40
3671 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 13.014.0 7.69% 10.0 100.00% 2023-02-17T09:03:40
3672 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.780.77 -1.28% 0.43 -46.25% 2023-02-17T09:03:40
3673 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 94.093.0 -1.06% 47.0 -47.78% 2023-02-17T09:03:40
3674 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 80.092.0 15.00% None 0.00% 2023-02-17T09:03:40
3675 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 79.078.0 -1.27% 96.0 26.32% 2023-02-17T09:03:40
3676 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 50.049.0 -2.00% 53.0 20.45% 2023-02-17T09:03:40
3677 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.520.51 -1.92% 0.26 -48.00% 2023-02-17T09:03:40
3678 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 1.11.66 50.91% None 0.00% 2023-02-17T09:03:40
3679 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 10.09.0 -10.00% None 0.00% 2023-02-17T09:03:40
3680 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 19.018.0 -5.26% 22.0 15.79% 2023-02-17T09:03:40
3681 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 17.079.0 364.71% None 0.00% 2023-02-17T09:03:40
3682 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 1.21.6 33.33% 1.54 38.74% 2023-02-17T09:03:40
3683 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 23.022.0 -4.35% 12.0 -47.83% 2023-02-17T09:03:40
3684 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 25.020.0 -20.00% 18.0 80.00% 2023-02-17T09:03:40
3685 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 22.021.0 -4.55% 23.0 4.55% 2023-02-17T09:03:40
3686 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.150.13 -13.33% 0.06 -60.00% 2023-02-17T09:03:40
3687 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 16.012.0 -25.00% 25.0 56.25% 2023-02-17T09:03:40
3688 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 210.0157.0 -25.24% 44.0 -52.17% 2023-02-17T09:03:40
3689 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.030.05 66.67% None 0.00% 2023-02-17T09:03:40
3690 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 93.0125.0 34.41% 120.0 41.18% 2023-02-17T09:03:40
3691 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.250.23 -8.00% 0.28 12.00% 2023-02-17T09:03:40
3692 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.10.12 20.00% 0.84 0.00% 2023-02-17T09:03:40
3693 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.520.5 -3.85% 0.27 -48.08% 2023-02-17T09:03:40
3694 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 47.050.0 6.38% 33.0 -29.79% 2023-02-17T09:03:40
3695 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 13.014.0 7.69% 15.0 87.50% 2023-02-17T09:03:40
3696 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 5.06.0 20.00% 4.0 -84.62% 2023-02-17T09:03:40
3697 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (avg) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.090.11 22.22% 0.09 12.50% 2023-02-17T09:03:40
3698 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.420.41 -2.38% 0.48 14.29% 2023-02-17T09:03:40
3699 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.250.27 8.00% 0.25 -16.67% 2023-02-17T09:03:40
3700 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 10.012.0 20.00% 10.0 11.11% 2023-02-17T09:03:40
3701 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 63.098.0 55.56% 66.0 94.12% 2023-02-17T09:03:40
3702 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.030.01 -66.67% 0.05 66.67% 2023-02-17T09:03:40
3703 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 156.0154.0 -1.28% 52.0 -43.48% 2023-02-17T09:03:40
3704 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 1.431.07 -25.17% 0.3 -51.61% 2023-02-17T09:03:40
3705 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 28.026.0 -7.14% 31.0 10.71% 2023-02-17T09:03:40
3706 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.340.33 -2.94% 0.36 5.88% 2023-02-17T09:03:40
3707 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.150.69 360.00% None 0.00% 2023-02-17T09:03:40
3708 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.820.79 -3.66% 0.68 -17.07% 2023-02-17T09:03:40
3709 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 64.097.0 51.56% None 0.00% 2023-02-17T09:03:40
3710 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 7.08.0 14.29% 55.0 0.00% 2023-02-17T09:03:40
3711 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.810.84 3.70% 0.92 17.95% 2023-02-17T09:03:40
3712 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.250.26 4.00% None 0.00% 2023-02-17T09:03:40
3713 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 50.049.0 -2.00% 53.0 20.45% 2023-02-17T09:03:40
3714 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 3.05.0 66.67% None 0.00% 2023-02-17T09:03:40
3715 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 1.091.69 55.05% 1.14 90.00% 2023-02-17T09:03:40
3716 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 5.04.0 -20.00% 9.0 12.50% 2023-02-17T09:03:40
3717 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.150.7 366.67% 0.09 12.50% 2023-02-17T09:03:40
3718 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.440.43 -2.27% 0.53 26.19% 2023-02-17T09:03:40
3719 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 131.0127.0 -3.05% 126.0 -3.82% 2023-02-17T09:03:40
3720 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.160.12 -25.00% 0.25 56.25% 2023-02-17T09:03:40
3721 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 79.078.0 -1.27% 96.0 26.32% 2023-02-17T09:03:40
3722 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 0.160.13 -18.75% 0.11 83.33% 2023-02-17T09:03:40
3723 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 42.040.0 -4.76% 35.0 -16.67% 2023-02-17T09:03:40
3724 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 16.019.0 18.75% 8.0 -63.64% 2023-02-17T09:03:40
3725 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 0024 (llvmorg-17-init-02545-gf3fa1086c7f8), 0025 (llvmorg-17-init-02729-gdf016a9525e5) 10.012.0 20.00% 10.0 11.11% 2023-02-17T09:03:40
Change State Split Delete