Regression: Regression of 66 benchmarks: 401.bzip2 (max), 401.bzip2 (unexplained diff vs previous), 401.bzip2 (unexplained diff vs p...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
3520 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 11.013.0 18.18% None 0.00% 2023-02-11T03:31:12
3521 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 75.072.0 -4.00% 92.0 21.05% 2023-02-11T03:31:12
3522 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 66.062.0 -6.06% 31.0 -53.03% 2023-02-11T03:31:12
3523 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.630.62 -1.59% 0.46 -26.98% 2023-02-11T03:31:12
3524 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 31.030.0 -3.23% 7.0 -22.22% 2023-02-11T03:31:12
3525 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 46.045.0 -2.17% 33.0 -28.26% 2023-02-11T03:31:12
3526 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.510.49 -3.92% 0.63 21.15% 2023-02-11T03:31:12
3527 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.050.08 60.00% None 0.00% 2023-02-11T03:31:12
3528 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 9.07.0 -22.22% 10.0 -9.09% 2023-02-11T03:31:12
3529 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 1.992.05 3.02% 1.63 79.12% 2023-02-11T03:31:12
3530 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 23.022.0 -4.35% 23.0 0.00% 2023-02-11T03:31:12
3531 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 1.341.32 -1.49% 0.63 -64.20% 2023-02-11T03:31:12
3532 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.880.84 -4.55% 0.43 -52.22% 2023-02-11T03:31:12
3533 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 97.094.0 -3.09% 47.0 -51.55% 2023-02-11T03:31:12
3534 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 9.015.0 66.67% None 0.00% 2023-02-11T03:31:12
3535 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 81.079.0 -2.47% 96.0 15.66% 2023-02-11T03:31:12
3536 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 28.031.0 10.71% None 0.00% 2023-02-11T03:31:12
3537 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 47.045.0 -4.26% 53.0 12.77% 2023-02-11T03:31:12
3538 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.540.52 -3.70% 0.26 -51.85% 2023-02-11T03:31:12
3539 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.140.31 121.43% None 0.00% 2023-02-11T03:31:12
3540 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.320.24 -25.00% 0.04 0.00% 2023-02-11T03:31:12
3541 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.420.39 -7.14% 0.2 -52.38% 2023-02-11T03:31:12
3542 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 7.01.0 -85.71% None 0.00% 2023-02-11T03:31:12
3543 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 2.032.09 2.96% 1.54 0.00% 2023-02-11T03:31:12
3544 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 25.024.0 -4.00% 12.0 -52.00% 2023-02-11T03:31:12
3545 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 37.025.0 -32.43% 18.0 50.00% 2023-02-11T03:31:12
3546 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 23.022.0 -4.35% 23.0 0.00% 2023-02-11T03:31:12
3547 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 36.032.0 -11.11% 45.0 -64.84% 2023-02-11T03:31:12
3548 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 3.022.0 633.33% 25.0 -39.02% 2023-02-11T03:31:12
3549 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 26.027.0 3.85% 28.0 7.69% 2023-02-11T03:31:12
3550 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 6.03.0 -50.00% 44.0 0.00% 2023-02-11T03:31:12
3551 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.090.07 -22.22% None 0.00% 2023-02-11T03:31:12
3552 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 154.0159.0 3.25% 120.0 0.00% 2023-02-11T03:31:12
3553 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.250.04 -84.00% 0.28 0.00% 2023-02-11T03:31:12
3554 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.020.05 150.00% 0.84 0.00% 2023-02-11T03:31:12
3555 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.560.54 -3.57% 0.27 -51.79% 2023-02-11T03:31:12
3556 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 26.027.0 3.85% 28.0 7.69% 2023-02-11T03:31:12
3557 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 46.045.0 -2.17% 33.0 -28.26% 2023-02-11T03:31:12
3558 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 85.082.0 -3.53% 42.0 -51.72% 2023-02-11T03:31:12
3559 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 75.072.0 -4.00% 92.0 21.05% 2023-02-11T03:31:12
3560 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 32.024.0 -25.00% 4.0 0.00% 2023-02-11T03:31:12
3561 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 42.041.0 -2.38% 52.0 23.81% 2023-02-11T03:31:12
3562 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.040.02 -50.00% 0.3 0.00% 2023-02-11T03:31:12
3563 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 28.04.0 -85.71% 31.0 -3.12% 2023-02-11T03:31:12
3564 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.360.34 -5.56% 0.36 0.00% 2023-02-11T03:31:12
3565 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.490.43 -12.24% 0.61 -64.74% 2023-02-11T03:31:12
3566 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.060.01 -83.33% None 0.00% 2023-02-11T03:31:12
3567 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 7.05.0 -28.57% None 0.00% 2023-02-11T03:31:12
3568 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.970.86 -11.34% 0.68 -29.90% 2023-02-11T03:31:12
3569 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.540.6 11.11% None 0.00% 2023-02-11T03:31:12
3570 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 8.018.0 125.00% None 0.00% 2023-02-11T03:31:12
3571 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 1.03.0 200.00% 55.0 0.00% 2023-02-11T03:31:12
3572 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.810.78 -3.70% 0.92 13.58% 2023-02-11T03:31:12
3573 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.130.16 23.08% None 0.00% 2023-02-11T03:31:12
3574 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 47.045.0 -4.26% 53.0 12.77% 2023-02-11T03:31:12
3575 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 5.07.0 40.00% None 0.00% 2023-02-11T03:31:12
3576 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.510.52 1.96% 0.55 7.84% 2023-02-11T03:31:12
3577 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.450.44 -2.22% 0.53 15.22% 2023-02-11T03:31:12
3578 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 150.0155.0 3.33% 126.0 80.00% 2023-02-11T03:31:12
3579 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.030.22 633.33% 0.25 -40.48% 2023-02-11T03:31:12
3580 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 81.079.0 -2.47% 96.0 15.66% 2023-02-11T03:31:12
3581 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.230.16 -30.43% 0.11 37.50% 2023-02-11T03:31:12
3582 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 0.060.04 -33.33% None 0.00% 2023-02-11T03:31:12
3583 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 50.044.0 -12.00% 35.0 -30.00% 2023-02-11T03:31:12
3584 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 24.023.0 -4.17% 27.0 200.00% 2023-02-11T03:31:12
3585 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0022 (llvmorg-17-init-01856-g09e0f48c0a40), 0023 (llvmorg-17-init-02114-g8c7cfa357280) 30.029.0 -3.33% 8.0 -50.00% 2023-02-11T03:31:12
Change State Split Delete