Regression: Regression of 67 benchmarks: 401.bzip2 (max), 403.gcc, 403.gcc (avg), 403.gcc (avg) (percentage), 403.gcc (max), 403.gcc...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
985 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 18.017.0 -5.56% 20.0 11.11% 2022-11-04T01:42:45
986 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 98.0101.0 3.06% 92.0 -20.69% 2022-11-04T01:42:45
987 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 85.079.0 -7.06% 31.0 -50.79% 2022-11-04T01:42:45
988 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 9.08.0 -11.11% 8.0 -20.00% 2022-11-04T01:42:45
989 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 5.06.0 20.00% 7.0 -50.00% 2022-11-04T01:42:45
990 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.670.69 2.99% 0.63 -20.25% 2022-11-04T01:42:45
991 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.370.3 -18.92% None 0.00% 2022-11-04T01:42:45
992 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.220.21 -4.55% 0.16 -27.27% 2022-11-04T01:42:45
993 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 10.09.0 -10.00% 10.0 -33.33% 2022-11-04T01:42:45
994 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 2.172.32 6.91% 1.63 -42.81% 2022-11-04T01:42:45
995 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 1.391.37 -1.44% 1.1 -26.67% 2022-11-04T01:42:45
996 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 25.021.0 -16.00% 54.0 116.00% 2022-11-04T01:42:45
997 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 13.014.0 7.69% 23.0 35.29% 2022-11-04T01:42:45
998 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.390.32 -17.95% 0.83 112.82% 2022-11-04T01:42:45
999 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.650.63 -3.08% 0.63 -5.97% 2022-11-04T01:42:45
1000 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.610.52 -14.75% None 0.00% 2022-11-04T01:42:45
1001 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 1.220.92 -24.59% 0.43 -64.75% 2022-11-04T01:42:45
1002 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 70.069.0 -1.43% 47.0 -44.71% 2022-11-04T01:42:45
1003 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 42.055.0 30.95% None 0.00% 2022-11-04T01:42:45
1004 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 71.069.0 -2.82% 96.0 35.21% 2022-11-04T01:42:45
1005 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 39.041.0 5.13% 49.0 44.12% 2022-11-04T01:42:45
1006 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 49.050.0 2.04% 53.0 10.42% 2022-11-04T01:42:45
1007 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.280.26 -7.14% 0.04 33.33% 2022-11-04T01:42:45
1008 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.140.13 -7.14% 0.18 80.00% 2022-11-04T01:42:45
1009 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.250.26 4.00% 0.31 40.91% 2022-11-04T01:42:45
1010 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.540.5 -7.41% 0.2 -50.00% 2022-11-04T01:42:45
1011 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 39.041.0 5.13% 49.0 44.12% 2022-11-04T01:42:45
1012 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 20.024.0 20.00% None 0.00% 2022-11-04T01:42:45
1013 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 106.0104.0 -1.89% 85.0 -24.78% 2022-11-04T01:42:45
1014 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.80.79 -1.25% 1.54 0.00% 2022-11-04T01:42:45
1015 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.950.99 4.21% 0.36 -65.05% 2022-11-04T01:42:45
1016 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 86.080.0 -6.98% 18.0 28.57% 2022-11-04T01:42:45
1017 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 13.014.0 7.69% 23.0 35.29% 2022-11-04T01:42:45
1018 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 26.023.0 -11.54% 25.0 -78.99% 2022-11-04T01:42:45
1019 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 37.044.0 18.92% 44.0 -54.64% 2022-11-04T01:42:45
1020 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 61.060.0 -1.64% 120.0 0.00% 2022-11-04T01:42:45
1021 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.330.26 -21.21% 0.28 -15.15% 2022-11-04T01:42:45
1022 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.060.11 83.33% 0.84 0.00% 2022-11-04T01:42:45
1023 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.250.26 4.00% 0.28 154.55% 2022-11-04T01:42:45
1024 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 120.090.0 -25.00% 42.0 -65.00% 2022-11-04T01:42:45
1025 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 98.0101.0 3.06% 92.0 -20.69% 2022-11-04T01:42:45
1026 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 20.019.0 -5.00% 15.0 -25.00% 2022-11-04T01:42:45
1027 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 28.026.0 -7.14% 4.0 33.33% 2022-11-04T01:42:45
1028 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 9.08.0 -11.11% 8.0 -20.00% 2022-11-04T01:42:45
1029 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.220.21 -4.55% 0.25 13.64% 2022-11-04T01:42:45
1030 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 47.045.0 -4.26% 46.0 -4.17% 2022-11-04T01:42:45
1031 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 54.053.0 -1.85% 66.0 22.22% 2022-11-04T01:42:45
1032 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.050.04 -20.00% 0.05 -50.00% 2022-11-04T01:42:45
1033 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 151.0145.0 -3.97% 52.0 -65.56% 2022-11-04T01:42:45
1034 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.250.3 20.00% 0.3 -54.55% 2022-11-04T01:42:45
1035 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 35.028.0 -20.00% 31.0 -11.43% 2022-11-04T01:42:45
1036 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.20.22 10.00% 0.36 38.46% 2022-11-04T01:42:45
1037 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 5.017.0 240.00% None 0.00% 2022-11-04T01:42:45
1038 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 1.041.02 -1.92% 0.68 -35.24% 2022-11-04T01:42:45
1039 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 106.0104.0 -1.89% 85.0 -24.78% 2022-11-04T01:42:45
1040 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 4.07.0 75.00% 55.0 0.00% 2022-11-04T01:42:45
1041 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 49.050.0 2.04% 53.0 10.42% 2022-11-04T01:42:45
1042 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.960.92 -4.17% 1.14 18.75% 2022-11-04T01:42:45
1043 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.390.38 -2.56% 0.53 35.90% 2022-11-04T01:42:45
1044 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 169.0176.0 4.14% 126.0 -41.40% 2022-11-04T01:42:45
1045 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.260.23 -11.54% 0.25 -79.34% 2022-11-04T01:42:45
1046 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 71.069.0 -2.82% 96.0 35.21% 2022-11-04T01:42:45
1047 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.550.54 -1.82% 0.62 5.08% 2022-11-04T01:42:45
1048 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.540.5 -7.41% 0.11 22.22% 2022-11-04T01:42:45
1049 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 0.050.16 220.00% None 0.00% 2022-11-04T01:42:45
1050 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 54.053.0 -1.85% 35.0 -35.19% 2022-11-04T01:42:45
1051 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0387 (llvmorg-16-init-09804-ge83446f43b23), 0388 (llvmorg-16-init-09958-gfdf22598862a) 24.025.0 4.17% 27.0 170.00% 2022-11-04T01:42:45
Change State Split Delete