Regression: Regression of 61 benchmarks: 401.bzip2 (unexplained diff vs previous), 403.gcc, 403.gcc (avg), 403.gcc (max), 403.gcc (m...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
3424 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 11.08.0 -27.27% None 0.00% 2023-02-04T06:00:22
3425 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 13.011.0 -15.38% 20.0 53.85% 2023-02-04T06:00:22
3426 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 66.071.0 7.58% 31.0 -60.76% 2023-02-04T06:00:22
3427 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.560.58 3.57% 0.46 -17.86% 2023-02-04T06:00:22
3428 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 24.022.0 -8.33% 7.0 -12.50% 2023-02-04T06:00:22
3429 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 41.042.0 2.44% 33.0 -19.51% 2023-02-04T06:00:22
3430 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 1.331.01 -24.06% 1.63 22.56% 2023-02-04T06:00:22
3431 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 1.381.4 1.45% 1.1 -22.54% 2023-02-04T06:00:22
3432 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 15.014.0 -6.67% 54.0 260.00% 2023-02-04T06:00:22
3433 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 24.023.0 -4.17% 23.0 -4.17% 2023-02-04T06:00:22
3434 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.230.22 -4.35% 0.83 260.87% 2023-02-04T06:00:22
3435 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 1.461.34 -8.22% 0.63 -56.85% 2023-02-04T06:00:22
3436 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 22.021.0 -4.55% 24.0 9.09% 2023-02-04T06:00:22
3437 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 4.01.0 -75.00% 10.0 100.00% 2023-02-04T06:00:22
3438 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.940.98 4.26% 0.43 -61.61% 2023-02-04T06:00:22
3439 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 111.0103.0 -7.21% 47.0 -57.66% 2023-02-04T06:00:22
3440 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.150.17 13.33% 0.11 57.14% 2023-02-04T06:00:22
3441 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.610.57 -6.56% 0.26 -57.38% 2023-02-04T06:00:22
3442 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.130.11 -15.38% 0.04 0.00% 2023-02-04T06:00:22
3443 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.420.45 7.14% 0.2 -60.00% 2023-02-04T06:00:22
3444 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 10.011.0 10.00% None 0.00% 2023-02-04T06:00:22
3445 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.910.98 7.69% 1.54 28.33% 2023-02-04T06:00:22
3446 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.360.33 -8.33% 0.36 -66.04% 2023-02-04T06:00:22
3447 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 30.027.0 -10.00% 12.0 -60.00% 2023-02-04T06:00:22
3448 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 67.069.0 2.99% 18.0 -77.50% 2023-02-04T06:00:22
3449 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 24.023.0 -4.17% 23.0 -4.17% 2023-02-04T06:00:22
3450 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.560.51 -8.93% 0.06 -89.29% 2023-02-04T06:00:22
3451 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 31.024.0 -22.58% 44.0 -32.31% 2023-02-04T06:00:22
3452 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.150.17 13.33% None 0.00% 2023-02-04T06:00:22
3453 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 70.075.0 7.14% 120.0 29.03% 2023-02-04T06:00:22
3454 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.660.6 -9.09% 0.27 -59.09% 2023-02-04T06:00:22
3455 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 10.09.0 -10.00% 11.0 10.00% 2023-02-04T06:00:22
3456 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 41.042.0 2.44% 33.0 -19.51% 2023-02-04T06:00:22
3457 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 91.096.0 5.49% 42.0 -61.47% 2023-02-04T06:00:22
3458 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 10.09.0 -10.00% 15.0 50.00% 2023-02-04T06:00:22
3459 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 13.011.0 -15.38% 4.0 0.00% 2023-02-04T06:00:22
3460 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.160.14 -12.50% 0.25 56.25% 2023-02-04T06:00:22
3461 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 107.097.0 -9.35% 46.0 -57.01% 2023-02-04T06:00:22
3462 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.20.19 -5.00% 0.22 10.00% 2023-02-04T06:00:22
3463 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 37.036.0 -2.70% 66.0 78.38% 2023-02-04T06:00:22
3464 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.160.15 -6.25% 0.05 0.00% 2023-02-04T06:00:22
3465 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 53.048.0 -9.43% 52.0 -66.67% 2023-02-04T06:00:22
3466 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.210.16 -23.81% 0.3 -31.82% 2023-02-04T06:00:22
3467 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 34.033.0 -2.94% 31.0 -11.43% 2023-02-04T06:00:22
3468 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 12.07.0 -41.67% None 0.00% 2023-02-04T06:00:22
3469 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 10.09.0 -10.00% 11.0 10.00% 2023-02-04T06:00:22
3470 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.040.01 -75.00% 0.11 120.00% 2023-02-04T06:00:22
3471 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 1.091.02 -6.42% 0.68 -37.61% 2023-02-04T06:00:22
3472 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.130.1 -23.08% None 0.00% 2023-02-04T06:00:22
3473 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 14.016.0 14.29% None 0.00% 2023-02-04T06:00:22
3474 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.640.62 -3.13% 1.14 78.12% 2023-02-04T06:00:22
3475 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 7.05.0 -28.57% 9.0 28.57% 2023-02-04T06:00:22
3476 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 103.077.0 -25.24% 126.0 22.33% 2023-02-04T06:00:22
3477 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 14.016.0 14.29% 10.0 66.67% 2023-02-04T06:00:22
3478 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.620.61 -1.61% 0.62 0.00% 2023-02-04T06:00:22
3479 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 22.021.0 -4.55% 24.0 9.09% 2023-02-04T06:00:22
3480 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.420.43 2.38% 0.11 -78.43% 2023-02-04T06:00:22
3481 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 0.020.06 200.00% None 0.00% 2023-02-04T06:00:22
3482 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 56.052.0 -7.14% 35.0 -37.50% 2023-02-04T06:00:22
3483 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 11.010.0 -9.09% 27.0 145.45% 2023-02-04T06:00:22
3484 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0020 (llvmorg-17-init-01157-g120ce83660de), 0021 (llvmorg-17-init-01505-gb83caa32dc86) 82.074.0 -9.76% 8.0 -90.24% 2023-02-04T06:00:22
Change State Split Delete