Regression: Regression of 65 benchmarks: 403.gcc (max), 403.gcc (max) (percentage), 429.mcf, 429.mcf (avg), 429.mcf (avg) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.070.05 -28.57% 0.08 14.29% 2022-03-02T08:21:26
6 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 18.013.0 -27.78% 20.0 11.11% 2022-03-02T08:21:26
7 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 7.02.0 -71.43% 92.0 1214.29% 2022-03-02T08:21:26
8 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 50.065.0 30.00% 31.0 -38.00% 2022-03-02T08:21:26
9 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.06.0 500.00% 8.0 700.00% 2022-03-02T08:21:26
10 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.160.99 -14.66% 0.46 -60.34% 2022-03-02T08:21:26
11 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 86.073.0 -15.12% 33.0 -61.63% 2022-03-02T08:21:26
12 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.050.02 -60.00% 0.63 1160.00% 2022-03-02T08:21:26
13 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.490.31 -36.73% None 0.00% 2022-03-02T08:21:26
14 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.040.12 200.00% 0.16 300.00% 2022-03-02T08:21:26
15 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 31.023.0 -25.81% 54.0 74.19% 2022-03-02T08:21:26
16 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.470.35 -25.53% 0.83 76.60% 2022-03-02T08:21:26
17 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.160.91 -21.55% 0.63 -45.69% 2022-03-02T08:21:26
18 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 4.011.0 175.00% 10.0 150.00% 2022-03-02T08:21:26
19 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.010.54 5300.00% 0.43 4200.00% 2022-03-02T08:21:26
20 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 88.067.0 -23.86% 47.0 -46.59% 2022-03-02T08:21:26
21 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 89.056.0 -37.08% None 0.00% 2022-03-02T08:21:26
22 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 88.067.0 -23.86% 96.0 9.09% 2022-03-02T08:21:26
23 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 50.060.0 20.00% 49.0 -2.00% 2022-03-02T08:21:26
24 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 8.07.0 -12.50% 8.0 0.00% 2022-03-02T08:21:26
25 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.020.1 400.00% 0.11 450.00% 2022-03-02T08:21:26
26 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.490.37 -24.49% 0.26 -46.94% 2022-03-02T08:21:26
27 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.010.2 1900.00% 0.04 300.00% 2022-03-02T08:21:26
28 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.010.14 1300.00% 0.18 1700.00% 2022-03-02T08:21:26
29 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.320.38 18.75% 0.31 -3.13% 2022-03-02T08:21:26
30 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.020.07 250.00% 0.09 350.00% 2022-03-02T08:21:26
31 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.320.41 28.12% 0.2 -37.50% 2022-03-02T08:21:26
32 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 50.060.0 20.00% 49.0 -2.00% 2022-03-02T08:21:26
33 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.040.09 125.00% 0.12 200.00% 2022-03-02T08:21:26
34 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.070.06 -14.29% 0.07 0.00% 2022-03-02T08:21:26
35 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.050.04 -20.00% 0.36 620.00% 2022-03-02T08:21:26
36 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 20.015.0 -25.00% 12.0 -40.00% 2022-03-02T08:21:26
37 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 51.065.0 27.45% 18.0 -64.71% 2022-03-02T08:21:26
38 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 88.068.0 -22.73% 45.0 -48.86% 2022-03-02T08:21:26
39 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.390.29 -25.64% 0.06 -84.62% 2022-03-02T08:21:26
40 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.053.0 5200.00% 25.0 2400.00% 2022-03-02T08:21:26
41 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.020.1 400.00% None 0.00% 2022-03-02T08:21:26
42 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 8.06.0 -25.00% 6.0 -25.00% 2022-03-02T08:21:26
43 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.040.03 -25.00% 0.28 600.00% 2022-03-02T08:21:26
44 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.450.34 -24.44% 0.27 -40.00% 2022-03-02T08:21:26
45 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 3.08.0 166.67% 11.0 266.67% 2022-03-02T08:21:26
46 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.010.2 1900.00% 0.28 2700.00% 2022-03-02T08:21:26
47 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 86.073.0 -15.12% 33.0 -61.63% 2022-03-02T08:21:26
48 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 7.02.0 -71.43% 92.0 1214.29% 2022-03-02T08:21:26
49 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.070.05 -28.57% 0.05 -28.57% 2022-03-02T08:21:26
50 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 3.011.0 266.67% 15.0 400.00% 2022-03-02T08:21:26
51 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.020.0 1900.00% 4.0 300.00% 2022-03-02T08:21:26
52 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.06.0 500.00% 8.0 700.00% 2022-03-02T08:21:26
53 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.220.16 -27.27% 0.25 13.64% 2022-03-02T08:21:26
54 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 86.067.0 -22.09% 46.0 -46.51% 2022-03-02T08:21:26
55 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 7.05.0 -28.57% 52.0 642.86% 2022-03-02T08:21:26
56 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 4.03.0 -25.00% 31.0 675.00% 2022-03-02T08:21:26
57 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.180.92 -22.03% 0.61 -48.31% 2022-03-02T08:21:26
58 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 3.08.0 166.67% 11.0 266.67% 2022-03-02T08:21:26
59 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.040.12 200.00% 0.11 175.00% 2022-03-02T08:21:26
60 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 2.010.0 400.00% None 0.00% 2022-03-02T08:21:26
61 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 8.05.0 -37.50% 9.0 12.50% 2022-03-02T08:21:26
62 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 8.07.0 -12.50% 8.0 0.00% 2022-03-02T08:21:26
63 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.490.37 -24.49% 0.53 8.16% 2022-03-02T08:21:26
64 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.010.54 5300.00% 0.25 2400.00% 2022-03-02T08:21:26
65 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 88.067.0 -23.86% 96.0 9.09% 2022-03-02T08:21:26
66 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 1.09.0 800.00% 10.0 900.00% 2022-03-02T08:21:26
67 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.010.36 3500.00% 0.62 6100.00% 2022-03-02T08:21:26
68 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 0.320.41 28.12% 0.11 -65.62% 2022-03-02T08:21:26
69 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0367 (no-change), 0369 (llvmorg-16-init-02065-ge3d64ccf9f55) 57.042.0 -26.32% 8.0 -85.96% 2022-03-02T08:21:26
Change State Split Delete