Regression: Regression of 70 benchmarks: 401.bzip2 (max), 401.bzip2 (unexplained diff vs previous), 403.gcc, 403.gcc (avg), 403.gcc ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2970 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 22.021.0 -4.55% 22.0 0.00% 2023-01-12T06:28:24
2971 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 18.020.0 11.11% None 0.00% 2023-01-12T06:28:24
2972 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 82.077.0 -6.10% 92.0 12.20% 2023-01-12T06:28:24
2973 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 25.06.0 -76.00% 31.0 -13.89% 2023-01-12T06:28:24
2974 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.130.12 -7.69% 0.13 0.00% 2023-01-12T06:28:24
2975 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.480.5 4.17% 0.46 0.00% 2023-01-12T06:28:24
2976 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 13.018.0 38.46% 7.0 -36.36% 2023-01-12T06:28:24
2977 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 35.036.0 2.86% 33.0 0.00% 2023-01-12T06:28:24
2978 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.560.53 -5.36% 0.63 12.50% 2023-01-12T06:28:24
2979 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.270.25 -7.41% None 0.00% 2023-01-12T06:28:24
2980 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.240.22 -8.33% 0.16 -33.33% 2023-01-12T06:28:24
2981 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 17.015.0 -11.76% 10.0 -23.08% 2023-01-12T06:28:24
2982 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 1.951.99 2.05% 1.63 -7.39% 2023-01-12T06:28:24
2983 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 1.351.38 2.22% 1.1 -18.52% 2023-01-12T06:28:24
2984 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 51.053.0 3.92% 54.0 -6.90% 2023-01-12T06:28:24
2985 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 27.028.0 3.70% 23.0 -14.81% 2023-01-12T06:28:24
2986 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.780.81 3.85% 0.83 -4.60% 2023-01-12T06:28:24
2987 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 4.06.0 50.00% 10.0 150.00% 2023-01-12T06:28:24
2988 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 76.081.0 6.58% 47.0 -61.79% 2023-01-12T06:28:24
2989 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 49.045.0 -8.16% None 0.00% 2023-01-12T06:28:24
2990 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 91.090.0 -1.10% 96.0 2.13% 2023-01-12T06:28:24
2991 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 39.038.0 -2.56% 49.0 25.64% 2023-01-12T06:28:24
2992 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.10.09 -10.00% 0.11 10.00% 2023-01-12T06:28:24
2993 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.420.45 7.14% 0.26 -61.76% 2023-01-12T06:28:24
2994 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.320.33 3.13% 0.04 -87.50% 2023-01-12T06:28:24
2995 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.250.24 -4.00% 0.31 24.00% 2023-01-12T06:28:24
2996 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.160.04 -75.00% 0.2 -13.04% 2023-01-12T06:28:24
2997 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 39.038.0 -2.56% 49.0 25.64% 2023-01-12T06:28:24
2998 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 22.021.0 -4.55% 22.0 0.00% 2023-01-12T06:28:24
2999 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 17.016.0 -5.88% None 0.00% 2023-01-12T06:28:24
3000 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 1.682.03 20.83% 1.54 -8.33% 2023-01-12T06:28:24
3001 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.390.42 7.69% 0.36 -21.74% 2023-01-12T06:28:24
3002 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 29.031.0 6.90% 12.0 -63.64% 2023-01-12T06:28:24
3003 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 9.06.0 -33.33% 18.0 100.00% 2023-01-12T06:28:24
3004 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 27.028.0 3.70% 23.0 -14.81% 2023-01-12T06:28:24
3005 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 80.081.0 1.25% 45.0 150.00% 2023-01-12T06:28:24
3006 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.160.12 -25.00% 0.06 -14.29% 2023-01-12T06:28:24
3007 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 74.067.0 -9.46% 25.0 -51.92% 2023-01-12T06:28:24
3008 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 31.06.0 -80.65% 44.0 41.94% 2023-01-12T06:28:24
3009 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.040.02 -50.00% None 0.00% 2023-01-12T06:28:24
3010 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 10.09.0 -10.00% 6.0 100.00% 2023-01-12T06:28:24
3011 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 130.0154.0 18.46% 120.0 -7.69% 2023-01-12T06:28:24
3012 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.590.77 30.51% 0.84 366.67% 2023-01-12T06:28:24
3013 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.730.7 -4.11% 0.27 -63.01% 2023-01-12T06:28:24
3014 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.320.33 3.13% 0.28 -12.50% 2023-01-12T06:28:24
3015 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 35.036.0 2.86% 33.0 0.00% 2023-01-12T06:28:24
3016 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 19.017.0 -10.53% 19.0 0.00% 2023-01-12T06:28:24
3017 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 82.077.0 -6.10% 92.0 12.20% 2023-01-12T06:28:24
3018 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 22.020.0 -9.09% 15.0 -31.82% 2023-01-12T06:28:24
3019 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 32.033.0 3.12% 4.0 -87.50% 2023-01-12T06:28:24
3020 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 79.080.0 1.27% 46.0 -17.86% 2023-01-12T06:28:24
3021 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 84.079.0 -5.95% 66.0 -21.43% 2023-01-12T06:28:24
3022 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.090.12 33.33% 0.05 -28.57% 2023-01-12T06:28:24
3023 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 57.061.0 7.02% 52.0 -22.39% 2023-01-12T06:28:24
3024 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.210.04 -80.95% 0.3 42.86% 2023-01-12T06:28:24
3025 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.420.43 2.38% 0.36 -12.20% 2023-01-12T06:28:24
3026 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.040.06 50.00% 0.11 175.00% 2023-01-12T06:28:24
3027 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.420.39 -7.14% 0.68 61.90% 2023-01-12T06:28:24
3028 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 39.051.0 30.77% 55.0 358.33% 2023-01-12T06:28:24
3029 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.210.24 14.29% None 0.00% 2023-01-12T06:28:24
3030 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 4.02.0 -50.00% None 0.00% 2023-01-12T06:28:24
3031 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 1.451.36 -6.21% 1.14 -21.38% 2023-01-12T06:28:24
3032 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 148.0150.0 1.35% 126.0 -7.35% 2023-01-12T06:28:24
3033 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.750.69 -8.00% 0.25 -52.83% 2023-01-12T06:28:24
3034 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 91.090.0 -1.10% 96.0 2.13% 2023-01-12T06:28:24
3035 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 9.08.0 -11.11% 10.0 11.11% 2023-01-12T06:28:24
3036 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 19.017.0 -10.53% 19.0 0.00% 2023-01-12T06:28:24
3037 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 0.060.04 -33.33% 0.11 83.33% 2023-01-12T06:28:24
3038 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 21.020.0 -4.76% 35.0 66.67% 2023-01-12T06:28:24
3039 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0009 (no-change), 0012 (llvmorg-16-init-17215-g4c20cc8ca9b6) 23.017.0 -26.09% 8.0 -20.00% 2023-01-12T06:28:24
Change State Split Delete