Regression: Regression of 41 benchmarks: 500.perlbench_r (max), 500.perlbench_r (max) (percentage), 502.gcc_r (max), 505.mcf_r (avg)...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1635 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 1.91.88 -1.05% 3.34 75.79% 2024-01-27T17:17:24
1636 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 29.035.0 20.69% 17.0 -41.38% 2024-01-27T17:17:24
1637 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 26.033.0 26.92% 69.0 0.00% 2024-01-27T17:17:24
1638 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 28.035.0 25.00% 20.0 -28.57% 2024-01-27T17:17:24
1639 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 19.021.0 10.53% 19.0 0.00% 2024-01-27T17:17:24
1640 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 6.646.49 -2.26% 2.43 -63.40% 2024-01-27T17:17:24
1641 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 3.363.19 -5.06% 4.81 39.02% 2024-01-27T17:17:24
1642 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 19.018.0 -5.26% 11.0 -47.62% 2024-01-27T17:17:24
1643 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.560.55 -1.79% 0.42 -25.00% 2024-01-27T17:17:24
1644 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 19.018.0 -5.26% 12.0 0.00% 2024-01-27T17:17:24
1645 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 10.09.0 -10.00% None 0.00% 2024-01-27T17:17:24
1646 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.91.13 25.56% 2.38 0.00% 2024-01-27T17:17:24
1647 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 17.022.0 29.41% 12.0 33.33% 2024-01-27T17:17:24
1648 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 16.021.0 31.25% 11.0 -21.43% 2024-01-27T17:17:24
1649 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 5.04.0 -20.00% 2.0 -66.67% 2024-01-27T17:17:24
1650 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.870.85 -2.30% 0.98 12.64% 2024-01-27T17:17:24
1651 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 191.0189.0 -1.05% 70.0 -63.35% 2024-01-27T17:17:24
1652 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 4.03.0 -25.00% 0.0 0.00% 2024-01-27T17:17:24
1653 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.170.14 -17.65% 0.07 -66.67% 2024-01-27T17:17:24
1654 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (unexplained diff vs previous) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 2.03.0 50.00% 0.0 0.00% 2024-01-27T17:17:24
1655 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.860.84 -2.33% 0.59 -31.40% 2024-01-27T17:17:24
1656 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 1.331.58 18.80% 0.77 -42.11% 2024-01-27T17:17:24
1657 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 17.016.0 -5.88% 11.0 -35.29% 2024-01-27T17:17:24
1658 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 7.06.0 -14.29% 1.0 -85.71% 2024-01-27T17:17:24
1659 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.90.97 7.78% 0.87 -3.33% 2024-01-27T17:17:24
1660 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 1.311.61 22.90% 0.95 -27.48% 2024-01-27T17:17:24
1661 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 41.039.0 -4.88% 9.0 -78.05% 2024-01-27T17:17:24
1662 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 37.036.0 -2.70% 57.0 54.05% 2024-01-27T17:17:24
1663 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.230.25 8.70% 0.23 9.52% 2024-01-27T17:17:24
1664 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.550.56 1.82% 0.39 -29.09% 2024-01-27T17:17:24
1665 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 99.092.0 -7.07% 139.0 40.40% 2024-01-27T17:17:24
1666 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.480.63 31.25% 0.34 36.00% 2024-01-27T17:17:24
1667 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 19.021.0 10.53% 19.0 0.00% 2024-01-27T17:17:24
1668 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.570.55 -3.51% 0.69 21.05% 2024-01-27T17:17:24
1669 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.680.66 -2.94% 0.45 0.00% 2024-01-27T17:17:24
1670 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 27.026.0 -3.70% 32.0 18.52% 2024-01-27T17:17:24
1671 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.480.62 29.17% 0.34 -17.07% 2024-01-27T17:17:24
1672 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (unexplained diff vs previous) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.120.19 58.33% 0.0 0.00% 2024-01-27T17:17:24
1673 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.260.19 -26.92% 0.06 -40.00% 2024-01-27T17:17:24
1674 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 99.092.0 -7.07% 139.0 40.40% 2024-01-27T17:17:24
1675 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0192 (llvmorg-19-init-00386-g36b4a9ccd9f7), 0197 (llvmorg-19-init-00873-g6720e3af253e) 0.250.23 -8.00% 0.07 -72.00% 2024-01-27T17:17:24
Change State Split Delete