Regression: Regression of 52 benchmarks: 401.bzip2 (max), 401.bzip2 (max) (percentage), 403.gcc, 403.gcc (avg), 403.gcc (avg) (perce...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2518 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 62.061.0 -1.61% 61.0 -1.61% 2022-12-27T16:51:10
2519 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 95.092.0 -3.16% 92.0 -3.16% 2022-12-27T16:51:10
2520 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 52.031.0 -40.38% 31.0 -40.38% 2022-12-27T16:51:10
2521 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.140.13 -7.14% 0.13 -7.14% 2022-12-27T16:51:10
2522 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.650.63 -3.08% 0.63 -3.08% 2022-12-27T16:51:10
2523 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 62.061.0 -1.61% 61.0 -1.61% 2022-12-27T16:51:10
2524 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 11.010.0 -9.09% 10.0 -9.09% 2022-12-27T16:51:10
2525 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 1.571.63 3.82% 1.63 -6.32% 2022-12-27T16:51:10
2526 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 1.121.1 -1.79% 1.1 3.77% 2022-12-27T16:51:10
2527 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 53.054.0 1.89% 54.0 10.20% 2022-12-27T16:51:10
2528 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 21.023.0 9.52% 23.0 9.52% 2022-12-27T16:51:10
2529 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.810.83 2.47% 0.83 10.67% 2022-12-27T16:51:10
2530 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.710.63 -11.27% 0.63 -11.27% 2022-12-27T16:51:10
2531 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.470.43 -8.51% 0.43 -21.82% 2022-12-27T16:51:10
2532 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 48.047.0 -2.08% 47.0 -2.08% 2022-12-27T16:51:10
2533 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 50.049.0 -2.00% 49.0 -2.00% 2022-12-27T16:51:10
2534 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.270.26 -3.70% 0.26 -3.70% 2022-12-27T16:51:10
2535 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.020.04 100.00% 0.04 -85.19% 2022-12-27T16:51:10
2536 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.320.31 -3.13% 0.31 -3.13% 2022-12-27T16:51:10
2537 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.330.2 -39.39% 0.2 -39.39% 2022-12-27T16:51:10
2538 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 50.049.0 -2.00% 49.0 -2.00% 2022-12-27T16:51:10
2539 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 1.581.54 -2.53% 1.54 -9.94% 2022-12-27T16:51:10
2540 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.370.36 -2.70% 0.36 -2.70% 2022-12-27T16:51:10
2541 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 11.018.0 63.64% 18.0 -51.35% 2022-12-27T16:51:10
2542 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 21.023.0 9.52% 23.0 9.52% 2022-12-27T16:51:10
2543 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 37.045.0 21.62% 45.0 800.00% 2022-12-27T16:51:10
2544 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 18.025.0 38.89% 25.0 -50.98% 2022-12-27T16:51:10
2545 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 31.044.0 41.94% 44.0 1000.00% 2022-12-27T16:51:10
2546 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 7.06.0 -14.29% 6.0 -50.00% 2022-12-27T16:51:10
2547 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.820.84 2.44% 0.84 13.51% 2022-12-27T16:51:10
2548 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.280.27 -3.57% 0.27 -3.57% 2022-12-27T16:51:10
2549 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 45.042.0 -6.67% 42.0 -22.22% 2022-12-27T16:51:10
2550 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 20.019.0 -5.00% 19.0 -5.00% 2022-12-27T16:51:10
2551 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 95.092.0 -3.16% 92.0 -3.16% 2022-12-27T16:51:10
2552 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 2.04.0 100.00% 4.0 -85.19% 2022-12-27T16:51:10
2553 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.240.25 4.17% 0.25 -3.85% 2022-12-27T16:51:10
2554 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 52.046.0 -11.54% 46.0 -11.54% 2022-12-27T16:51:10
2555 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 69.066.0 -4.35% 66.0 -4.35% 2022-12-27T16:51:10
2556 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 54.052.0 -3.70% 52.0 -3.70% 2022-12-27T16:51:10
2557 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.210.3 42.86% 0.3 900.00% 2022-12-27T16:51:10
2558 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.330.36 9.09% 0.36 9.09% 2022-12-27T16:51:10
2559 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.510.61 19.61% 0.61 771.43% 2022-12-27T16:51:10
2560 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.70.68 -2.86% 0.68 -2.86% 2022-12-27T16:51:10
2561 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 54.055.0 1.85% 55.0 12.24% 2022-12-27T16:51:10
2562 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 1.211.14 -5.79% 1.14 -5.79% 2022-12-27T16:51:10
2563 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.10.09 -10.00% 0.09 -10.00% 2022-12-27T16:51:10
2564 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 119.0126.0 5.88% 126.0 -5.26% 2022-12-27T16:51:10
2565 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.180.25 38.89% 0.25 -51.92% 2022-12-27T16:51:10
2566 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.630.62 -1.59% 0.62 -3.13% 2022-12-27T16:51:10
2567 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 20.019.0 -5.00% 19.0 -5.00% 2022-12-27T16:51:10
2568 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 0.070.11 57.14% 0.11 -52.17% 2022-12-27T16:51:10
2569 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0428 (no-change), 0429 (llvmorg-16-init-15856-g339d810a0fcc) 36.035.0 -2.78% 35.0 -2.78% 2022-12-27T16:51:10
Change State Split Delete