Regression: Regression of 50 benchmarks: 403.gcc (max), 403.gcc (max) (percentage), 429.mcf (unexplained diff vs previous), 429.mcf ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
883 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.120.13 8.33% 0.08 -42.86% 2022-10-26T15:14:03
884 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 85.071.0 -16.47% 31.0 -63.53% 2022-10-26T15:14:03
885 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.160.18 12.50% 0.13 -13.33% 2022-10-26T15:14:03
886 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 46.045.0 -2.17% 7.0 -84.78% 2022-10-26T15:14:03
887 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.50.51 2.00% None 0.00% 2022-10-26T15:14:03
888 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.250.23 -8.00% 0.16 -36.00% 2022-10-26T15:14:03
889 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 3.323.04 -8.43% 1.63 -50.90% 2022-10-26T15:14:03
890 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 26.025.0 -3.85% 54.0 107.69% 2022-10-26T15:14:03
891 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.40.39 -2.50% 0.83 107.50% 2022-10-26T15:14:03
892 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.770.76 -1.30% 0.63 -37.62% 2022-10-26T15:14:03
893 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.40.14 -65.00% 0.43 -71.33% 2022-10-26T15:14:03
894 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 96.094.0 -2.08% 47.0 -32.86% 2022-10-26T15:14:03
895 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 91.094.0 3.30% None 0.00% 2022-10-26T15:14:03
896 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 74.072.0 -2.70% 96.0 45.45% 2022-10-26T15:14:03
897 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 36.039.0 8.33% 49.0 36.11% 2022-10-26T15:14:03
898 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.520.51 -1.92% 0.26 -31.58% 2022-10-26T15:14:03
899 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.10.12 20.00% 0.04 -60.00% 2022-10-26T15:14:03
900 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.230.25 8.70% 0.31 34.78% 2022-10-26T15:14:03
901 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.540.45 -16.67% 0.2 -62.96% 2022-10-26T15:14:03
902 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 36.039.0 8.33% 49.0 36.11% 2022-10-26T15:14:03
903 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.160.17 6.25% 0.12 -25.00% 2022-10-26T15:14:03
904 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 25.024.0 -4.00% 12.0 -52.00% 2022-10-26T15:14:03
905 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 49.050.0 2.04% 18.0 -79.07% 2022-10-26T15:14:03
906 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 14.010.0 -28.57% 45.0 -38.36% 2022-10-26T15:14:03
907 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 12.09.0 -25.00% 25.0 78.57% 2022-10-26T15:14:03
908 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.080.1 25.00% None 0.00% 2022-10-26T15:14:03
909 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.360.34 -5.56% 0.28 -22.22% 2022-10-26T15:14:03
910 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.520.53 1.92% 0.27 -50.91% 2022-10-26T15:14:03
911 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 14.015.0 7.14% 11.0 -21.43% 2022-10-26T15:14:03
912 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 39.013.0 -66.67% 42.0 -71.23% 2022-10-26T15:14:03
913 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 23.026.0 13.04% 19.0 -13.64% 2022-10-26T15:14:03
914 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 19.021.0 10.53% 15.0 -34.78% 2022-10-26T15:14:03
915 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 14.012.0 -14.29% 4.0 -60.00% 2022-10-26T15:14:03
916 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.240.25 4.17% 0.25 -24.24% 2022-10-26T15:14:03
917 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 61.057.0 -6.56% 66.0 8.20% 2022-10-26T15:14:03
918 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 39.036.0 -7.69% 31.0 -20.51% 2022-10-26T15:14:03
919 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.190.14 -26.32% 0.61 -39.00% 2022-10-26T15:14:03
920 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 14.015.0 7.14% 11.0 -21.43% 2022-10-26T15:14:03
921 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 1.131.09 -3.54% 0.68 -39.82% 2022-10-26T15:14:03
922 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 8.010.0 25.00% None 0.00% 2022-10-26T15:14:03
923 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 1.071.0 -6.54% 1.14 6.54% 2022-10-26T15:14:03
924 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 14.015.0 7.14% 9.0 -43.75% 2022-10-26T15:14:03
925 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.410.39 -4.88% 0.53 47.22% 2022-10-26T15:14:03
926 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 250.0232.0 -7.20% 126.0 -49.60% 2022-10-26T15:14:03
927 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.120.09 -25.00% 0.25 78.57% 2022-10-26T15:14:03
928 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 74.072.0 -2.70% 96.0 45.45% 2022-10-26T15:14:03
929 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.480.47 -2.08% 0.62 12.73% 2022-10-26T15:14:03
930 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 23.026.0 13.04% 19.0 -13.64% 2022-10-26T15:14:03
931 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 0.310.32 3.23% 0.11 -79.63% 2022-10-26T15:14:03
932 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0384 (llvmorg-16-init-08675-g14de3d5c634b), 0386 (llvmorg-16-init-09391-gcfeab503cc93) 54.056.0 3.70% 35.0 -40.68% 2022-10-26T15:14:03
Change State Split Delete