Regression: Regression of 38 benchmarks: 403.gcc (max), 403.gcc (max) (percentage), 429.mcf, 429.mcf (avg), 429.mcf (unexplained dif...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew %Δ Now Current Age
2328 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.120.14 16.67% 0.08 0.00% 2022-12-15T12:35:21
2329 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 57.058.0 1.75% 31.0 -52.31% 2022-12-15T12:35:21
2330 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 7.08.0 14.29% 8.0 14.29% 2022-12-15T12:35:21
2331 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.160.15 -6.25% 0.13 -18.75% 2022-12-15T12:35:21
2332 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.450.44 -2.22% 0.46 2.22% 2022-12-15T12:35:21
2333 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 1.161.13 -2.59% 1.63 40.52% 2022-12-15T12:35:21
2334 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 33.031.0 -6.06% 54.0 58.82% 2022-12-15T12:35:21
2335 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.450.48 6.67% 0.83 59.62% 2022-12-15T12:35:21
2336 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.320.31 -3.13% 0.63 80.00% 2022-12-15T12:35:21
2337 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.650.66 1.54% 0.43 -57.43% 2022-12-15T12:35:21
2338 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 55.052.0 -5.45% 49.0 -10.91% 2022-12-15T12:35:21
2339 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.350.33 -5.71% 0.31 -11.43% 2022-12-15T12:35:21
2340 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.360.37 2.78% 0.2 -51.22% 2022-12-15T12:35:21
2341 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 55.052.0 -5.45% 49.0 -10.91% 2022-12-15T12:35:21
2342 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 15.014.0 -6.67% 12.0 -20.00% 2022-12-15T12:35:21
2343 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 11.05.0 -54.55% 18.0 -40.00% 2022-12-15T12:35:21
2344 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 22.023.0 4.55% 45.0 73.08% 2022-12-15T12:35:21
2345 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 65.064.0 -1.54% 25.0 -67.53% 2022-12-15T12:35:21
2346 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 14.017.0 21.43% 6.0 500.00% 2022-12-15T12:35:21
2347 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.330.31 -6.06% 0.27 -18.18% 2022-12-15T12:35:21
2348 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.250.26 4.00% 0.28 0.00% 2022-12-15T12:35:21
2349 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 63.064.0 1.59% 42.0 -57.58% 2022-12-15T12:35:21
2350 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 23.022.0 -4.35% 19.0 -17.39% 2022-12-15T12:35:21
2351 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.120.14 16.67% 0.05 400.00% 2022-12-15T12:35:21
2352 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (avg) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 7.08.0 14.29% 8.0 14.29% 2022-12-15T12:35:21
2353 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 23.022.0 -4.35% 46.0 84.00% 2022-12-15T12:35:21
2354 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 105.0101.0 -3.81% 66.0 -37.14% 2022-12-15T12:35:21
2355 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.30.31 3.33% 0.61 69.44% 2022-12-15T12:35:21
2356 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.740.76 2.70% 0.68 -16.05% 2022-12-15T12:35:21
2357 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 13.014.0 7.69% None 0.00% 2022-12-15T12:35:21
2358 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 1.831.77 -3.28% 1.14 -37.70% 2022-12-15T12:35:21
2359 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 14.016.0 14.29% 9.0 0.00% 2022-12-15T12:35:21
2360 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 87.085.0 -2.30% 126.0 44.83% 2022-12-15T12:35:21
2361 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.630.65 3.17% 0.25 -67.95% 2022-12-15T12:35:21
2362 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 23.022.0 -4.35% 19.0 -17.39% 2022-12-15T12:35:21
2363 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 0.070.03 -57.14% 0.11 -42.11% 2022-12-15T12:35:21
2364 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 38.039.0 2.63% 35.0 -16.67% 2022-12-15T12:35:21
2365 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0422 (no-change), 0424 (llvmorg-16-init-15602-g40dd8ff3310b) 24.025.0 4.17% 27.0 0.00% 2022-12-15T12:35:21
Change State Split Delete