Regression: Regression of 20 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5649 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.430.33 -23.26% 0.54 -8.47% 2023-12-11T14:14:50
5650 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 89.081.0 -8.99% 73.0 -17.98% 2023-12-11T14:14:50
5651 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 44.042.0 -4.55% 31.0 -31.11% 2023-12-11T14:14:50
5652 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.590.57 -3.39% 0.83 76.60% 2023-12-11T14:14:50
5653 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 89.081.0 -8.99% 73.0 -17.98% 2023-12-11T14:14:50
5654 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 37.032.0 -13.51% 52.0 40.54% 2023-12-11T14:14:50
5655 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.30.31 3.33% 0.23 -23.33% 2023-12-11T14:14:50
5656 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.30.29 -3.33% 0.27 -12.90% 2023-12-11T14:14:50
5657 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 66.065.0 -1.52% 94.0 77.36% 2023-12-11T14:14:50
5658 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (avg) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.630.57 -9.52% 0.52 -17.46% 2023-12-11T14:14:50
5659 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 1.151.13 -1.74% 0.65 -16.67% 2023-12-11T14:14:50
5660 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 52.047.0 -9.62% 136.0 161.54% 2023-12-11T14:14:50
5661 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 130.0128.0 -1.54% 74.0 362.50% 2023-12-11T14:14:50
5662 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.370.33 -10.81% 0.97 162.16% 2023-12-11T14:14:50
5663 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.160.15 -6.25% 0.61 144.00% 2023-12-11T14:14:50
5664 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 41.031.0 -24.39% 52.0 -8.77% 2023-12-11T14:14:50
5665 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 131.0129.0 -1.53% 73.0 -17.05% 2023-12-11T14:14:50
5666 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) (percentage) 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 0.380.33 -13.16% 0.54 42.11% 2023-12-11T14:14:50
5667 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 44.042.0 -4.55% 31.0 -31.11% 2023-12-11T14:14:50
5668 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 0105 (llvmorg-18-init-14569-g142e567cf008), 0108 (llvmorg-18-init-14625-gf68435ff92fd) 66.065.0 -1.52% 94.0 77.36% 2023-12-11T14:14:50
Change State Split Delete