Regression: Regression of 66 benchmarks: 403.gcc (max), 403.gcc (max) (percentage), 429.mcf (max), 429.mcf (max) (percentage), 444.n...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
3587 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 20.019.0 -5.00% 22.0 10.00% 2023-02-14T07:13:36
3588 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 21.025.0 19.05% None 0.00% 2023-02-14T07:13:36
3589 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 57.055.0 -3.51% 61.0 7.02% 2023-02-14T07:13:36
3590 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 20.025.0 25.00% 20.0 53.85% 2023-02-14T07:13:36
3591 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 75.074.0 -1.33% 92.0 27.78% 2023-02-14T07:13:36
3592 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 36.035.0 -2.78% 31.0 -50.00% 2023-02-14T07:13:36
3593 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.630.66 4.76% 0.46 -25.81% 2023-02-14T07:13:36
3594 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 8.05.0 -37.50% 7.0 -76.67% 2023-02-14T07:13:36
3595 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 46.047.0 2.17% 33.0 -26.67% 2023-02-14T07:13:36
3596 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.510.5 -1.96% 0.63 28.57% 2023-02-14T07:13:36
3597 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 57.055.0 -3.51% 61.0 7.02% 2023-02-14T07:13:36
3598 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 1.61.71 6.87% 1.63 -20.49% 2023-02-14T07:13:36
3599 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 13.012.0 -7.69% 54.0 315.38% 2023-02-14T07:13:36
3600 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.20.19 -5.00% 0.83 315.00% 2023-02-14T07:13:36
3601 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 1.761.66 -5.68% 0.63 -52.27% 2023-02-14T07:13:36
3602 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.220.13 -40.91% None 0.00% 2023-02-14T07:13:36
3603 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.780.8 2.56% 0.43 -48.81% 2023-02-14T07:13:36
3604 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 94.090.0 -4.26% 47.0 -50.00% 2023-02-14T07:13:36
3605 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 9.010.0 11.11% None 0.00% 2023-02-14T07:13:36
3606 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 79.076.0 -3.80% 96.0 21.52% 2023-02-14T07:13:36
3607 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.130.12 -7.69% 0.11 -15.38% 2023-02-14T07:13:36
3609 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.520.5 -3.85% 0.26 -50.00% 2023-02-14T07:13:36
3610 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.240.26 8.33% 0.04 -83.33% 2023-02-14T07:13:36
3611 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.230.22 -4.35% 0.2 -48.72% 2023-02-14T07:13:36
3612 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 10.06.0 -40.00% None 0.00% 2023-02-14T07:13:36
3613 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 20.019.0 -5.00% 22.0 10.00% 2023-02-14T07:13:36
3614 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 1.21.11 -7.50% 1.54 -26.32% 2023-02-14T07:13:36
3615 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.420.62 47.62% 0.36 28.57% 2023-02-14T07:13:36
3616 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 24.023.0 -4.17% 12.0 -50.00% 2023-02-14T07:13:36
3617 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 8.010.0 25.00% 18.0 -28.00% 2023-02-14T07:13:36
3618 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 128.0122.0 -4.69% 45.0 40.62% 2023-02-14T07:13:36
3619 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.160.15 -6.25% 0.06 -70.00% 2023-02-14T07:13:36
3620 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 22.016.0 -27.27% 25.0 13.64% 2023-02-14T07:13:36
3621 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 65.092.0 41.54% 44.0 1366.67% 2023-02-14T07:13:36
3622 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 93.085.0 -8.60% 120.0 -24.53% 2023-02-14T07:13:36
3623 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.540.52 -3.70% 0.27 -50.00% 2023-02-14T07:13:36
3624 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.270.26 -3.70% 0.28 16.67% 2023-02-14T07:13:36
3625 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 46.047.0 2.17% 33.0 -26.67% 2023-02-14T07:13:36
3626 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 75.078.0 4.00% 42.0 -48.78% 2023-02-14T07:13:36
3627 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 23.022.0 -4.35% 19.0 -17.39% 2023-02-14T07:13:36
3628 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 75.074.0 -1.33% 92.0 27.78% 2023-02-14T07:13:36
3629 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 24.026.0 8.33% 4.0 -83.33% 2023-02-14T07:13:36
3630 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.440.42 -4.55% 0.48 9.09% 2023-02-14T07:13:36
3631 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.250.3 20.00% 0.25 56.25% 2023-02-14T07:13:36
3632 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 130.0120.0 -7.69% 46.0 -52.58% 2023-02-14T07:13:36
3633 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 35.034.0 -2.86% 66.0 88.57% 2023-02-14T07:13:36
3634 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.050.03 -40.00% 0.05 -75.00% 2023-02-14T07:13:36
3635 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 61.092.0 50.82% 52.0 26.83% 2023-02-14T07:13:36
3636 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.440.62 40.91% 0.3 1400.00% 2023-02-14T07:13:36
3637 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 1.731.68 -2.89% 0.61 41.86% 2023-02-14T07:13:36
3638 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 23.029.0 26.09% None 0.00% 2023-02-14T07:13:36
3639 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.860.82 -4.65% 0.68 -20.93% 2023-02-14T07:13:36
3640 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.250.3 20.00% None 0.00% 2023-02-14T07:13:36
3641 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 45.044.0 -2.22% 53.0 17.78% 2023-02-14T07:13:36
3642 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.610.6 -1.64% 1.14 86.89% 2023-02-14T07:13:36
3643 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.440.42 -4.55% 0.53 20.45% 2023-02-14T07:13:36
3644 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 121.0131.0 8.26% 126.0 -18.71% 2023-02-14T07:13:36
3645 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.220.16 -27.27% 0.25 13.64% 2023-02-14T07:13:36
3646 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 79.076.0 -3.80% 96.0 21.52% 2023-02-14T07:13:36
3647 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 12.011.0 -8.33% 10.0 -16.67% 2023-02-14T07:13:36
3648 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.590.57 -3.39% 0.62 5.08% 2023-02-14T07:13:36
3649 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 23.022.0 -4.35% 19.0 -17.39% 2023-02-14T07:13:36
3650 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 0.20.25 25.00% None 0.00% 2023-02-14T07:13:36
3651 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 44.042.0 -4.55% 35.0 -20.45% 2023-02-14T07:13:36
3652 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 26.025.0 -3.85% 27.0 17.39% 2023-02-14T07:13:36
3653 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0023 (llvmorg-17-init-02114-g8c7cfa357280), 0024 (llvmorg-17-init-02545-gf3fa1086c7f8) 23.022.0 -4.35% 8.0 -72.41% 2023-02-14T07:13:36
Change State Split Delete