Regression: Regression of 73 benchmarks: 401.bzip2 (unexplained diff vs previous), 401.bzip2 (unexplained diff vs previous) (percent...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2367 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 24.023.0 -4.17% 22.0 -8.33% 2022-12-20T10:20:21
2368 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 14.015.0 7.14% None 0.00% 2022-12-20T10:20:21
2369 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 62.063.0 1.61% 61.0 -7.58% 2022-12-20T10:20:21
2370 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 107.0102.0 -4.67% 92.0 -14.81% 2022-12-20T10:20:21
2371 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 53.054.0 1.89% 31.0 -46.55% 2022-12-20T10:20:21
2372 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 6.07.0 16.67% 7.0 -46.15% 2022-12-20T10:20:21
2373 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.740.7 -5.41% 0.63 -14.86% 2022-12-20T10:20:21
2374 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 62.063.0 1.61% 61.0 -7.58% 2022-12-20T10:20:21
2375 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.120.09 -25.00% None 0.00% 2022-12-20T10:20:21
2376 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 1.131.11 -1.77% 1.63 44.25% 2022-12-20T10:20:21
2377 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 1.041.02 -1.92% 1.1 5.77% 2022-12-20T10:20:21
2378 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 34.053.0 55.88% 54.0 74.19% 2022-12-20T10:20:21
2379 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 16.019.0 18.75% 23.0 43.75% 2022-12-20T10:20:21
2380 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.520.81 55.77% 0.83 72.92% 2022-12-20T10:20:21
2381 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 1.060.95 -10.38% 0.63 103.23% 2022-12-20T10:20:21
2383 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.280.17 -39.29% None 0.00% 2022-12-20T10:20:21
2384 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.650.59 -9.23% 0.43 -34.85% 2022-12-20T10:20:21
2385 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 94.052.0 -44.68% 47.0 -50.00% 2022-12-20T10:20:21
2386 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 22.016.0 -27.27% None 0.00% 2022-12-20T10:20:21
2387 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 100.0101.0 1.00% 96.0 -10.28% 2022-12-20T10:20:21
2388 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 15.06.0 -60.00% None 0.00% 2022-12-20T10:20:21
2389 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 52.054.0 3.85% 53.0 3.92% 2022-12-20T10:20:21
2390 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.520.29 -44.23% 0.26 -50.00% 2022-12-20T10:20:21
2391 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 1.271.29 1.57% None 0.00% 2022-12-20T10:20:21
2392 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.330.35 6.06% 0.04 100.00% 2022-12-20T10:20:21
2393 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 13.08.0 -38.46% None 0.00% 2022-12-20T10:20:21
2394 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 24.023.0 -4.17% 22.0 -8.33% 2022-12-20T10:20:21
2395 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 78.076.0 -2.56% 85.0 8.97% 2022-12-20T10:20:21
2396 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.570.64 12.28% 1.54 0.00% 2022-12-20T10:20:21
2397 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 17.013.0 -23.53% None 0.00% 2022-12-20T10:20:21
2398 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 14.013.0 -7.14% 12.0 -14.29% 2022-12-20T10:20:21
2399 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 16.019.0 18.75% 23.0 43.75% 2022-12-20T10:20:21
2400 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 37.070.0 89.19% 45.0 95.65% 2022-12-20T10:20:21
2401 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 40.018.0 -55.00% 25.0 -60.94% 2022-12-20T10:20:21
2402 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 29.028.0 -3.45% 28.0 -9.68% 2022-12-20T10:20:21
2403 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.10.12 20.00% None 0.00% 2022-12-20T10:20:21
2404 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 4.07.0 75.00% 6.0 -64.71% 2022-12-20T10:20:21
2405 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 43.048.0 11.63% 120.0 0.00% 2022-12-20T10:20:21
2406 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.510.82 60.78% 0.84 0.00% 2022-12-20T10:20:21
2407 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.310.29 -6.45% 0.27 -12.90% 2022-12-20T10:20:21
2408 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 29.028.0 -3.45% 28.0 -9.68% 2022-12-20T10:20:21
2409 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 63.057.0 -9.52% 42.0 -34.38% 2022-12-20T10:20:21
2410 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 22.020.0 -9.09% 19.0 -13.64% 2022-12-20T10:20:21
2411 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 107.0102.0 -4.67% 92.0 -14.81% 2022-12-20T10:20:21
2412 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.080.06 -25.00% 0.05 -64.29% 2022-12-20T10:20:21
2413 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 33.035.0 6.06% 4.0 100.00% 2022-12-20T10:20:21
2414 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.530.5 -5.66% 0.48 -9.43% 2022-12-20T10:20:21
2415 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 77.070.0 -9.09% 46.0 109.09% 2022-12-20T10:20:21
2416 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.040.05 25.00% 0.05 -44.44% 2022-12-20T10:20:21
2417 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 34.035.0 2.94% 31.0 -13.89% 2022-12-20T10:20:21
2418 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.250.29 16.00% 0.36 44.00% 2022-12-20T10:20:21
2419 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.510.94 84.31% 0.61 96.77% 2022-12-20T10:20:21
2420 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.080.11 37.50% None 0.00% 2022-12-20T10:20:21
2421 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.740.73 -1.35% 0.68 -10.53% 2022-12-20T10:20:21
2422 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.290.12 -58.62% None 0.00% 2022-12-20T10:20:21
2423 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 78.076.0 -2.56% 85.0 8.97% 2022-12-20T10:20:21
2424 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 74.075.0 1.35% None 0.00% 2022-12-20T10:20:21
2425 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 34.054.0 58.82% 55.0 0.00% 2022-12-20T10:20:21
2426 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.90.93 3.33% 0.92 3.37% 2022-12-20T10:20:21
2427 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 52.054.0 3.85% 53.0 3.92% 2022-12-20T10:20:21
2428 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 13.012.0 -7.69% None 0.00% 2022-12-20T10:20:21
2429 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 1.771.72 -2.82% 1.14 -35.59% 2022-12-20T10:20:21
2430 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.560.55 -1.79% 0.55 -8.33% 2022-12-20T10:20:21
2431 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.550.56 1.82% 0.53 -10.17% 2022-12-20T10:20:21
2432 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 85.083.0 -2.35% 126.0 48.24% 2022-12-20T10:20:21
2433 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.410.18 -56.10% 0.25 -61.54% 2022-12-20T10:20:21
2434 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 100.0101.0 1.00% 96.0 -10.28% 2022-12-20T10:20:21
2435 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 0.630.65 3.17% 0.62 -8.82% 2022-12-20T10:20:21
2436 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 24.025.0 4.17% 24.0 0.00% 2022-12-20T10:20:21
2437 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 22.020.0 -9.09% 19.0 -13.64% 2022-12-20T10:20:21
2438 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 38.037.0 -2.63% 35.0 -10.26% 2022-12-20T10:20:21
2439 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 36.035.0 -2.78% 27.0 8.00% 2022-12-20T10:20:21
2440 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0424 (llvmorg-16-init-15602-g40dd8ff3310b), 0425 (llvmorg-16-init-15603-g2656572d4851) 11.010.0 -9.09% 8.0 -38.46% 2022-12-20T10:20:21
Change State Split Delete