Regression: Regression of 46 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1741 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 1.02.0 100.00% None 0.00% 2024-01-31T20:35:01
1742 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.280.25 -10.71% 0.1 -64.29% 2024-01-31T20:35:01
1743 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 2.143.0 40.19% 3.34 80.54% 2024-01-31T20:35:01
1744 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 33.048.0 45.45% 69.0 -78.23% 2024-01-31T20:35:01
1745 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 33.031.0 -6.06% 20.0 -39.39% 2024-01-31T20:35:01
1746 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 8.09.0 12.50% 8.0 -20.00% 2024-01-31T20:35:01
1747 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 4.02.0 -50.00% 11.0 120.00% 2024-01-31T20:35:01
1748 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 19.020.0 5.26% 19.0 -9.52% 2024-01-31T20:35:01
1749 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.030.06 100.00% None 0.00% 2024-01-31T20:35:01
1750 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.540.18 -66.67% 0.42 -22.22% 2024-01-31T20:35:01
1751 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 16.015.0 -6.25% 14.0 -12.50% 2024-01-31T20:35:01
1752 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 1.131.51 33.63% 2.38 -75.74% 2024-01-31T20:35:01
1753 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 9.08.0 -11.11% 1.0 -75.00% 2024-01-31T20:35:01
1754 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 16.017.0 6.25% 16.0 45.45% 2024-01-31T20:35:01
1755 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 30.026.0 -13.33% 11.0 -63.33% 2024-01-31T20:35:01
1756 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.720.65 -9.72% 0.08 -75.00% 2024-01-31T20:35:01
1757 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.530.51 -3.77% 0.98 84.91% 2024-01-31T20:35:01
1758 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 10.09.0 -10.00% 11.0 10.00% 2024-01-31T20:35:01
1759 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.280.27 -3.57% 0.09 -67.86% 2024-01-31T20:35:01
1760 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 10.09.0 -10.00% 11.0 10.00% 2024-01-31T20:35:01
1761 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 8.09.0 12.50% 8.0 -20.00% 2024-01-31T20:35:01
1762 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.820.8 -2.44% 0.59 -28.05% 2024-01-31T20:35:01
1763 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.50.46 -8.00% 0.55 10.00% 2024-01-31T20:35:01
1764 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 9.08.0 -11.11% None 0.00% 2024-01-31T20:35:01
1765 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 1.531.46 -4.58% 0.95 -37.91% 2024-01-31T20:35:01
1766 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 41.040.0 -2.44% 9.0 -76.92% 2024-01-31T20:35:01
1767 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 1.561.59 1.92% 1.21 9.01% 2024-01-31T20:35:01
1768 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 41.057.0 39.02% 57.0 58.33% 2024-01-31T20:35:01
1769 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.30.28 -6.67% 0.23 -23.33% 2024-01-31T20:35:01
1770 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.510.52 1.96% 0.39 -23.53% 2024-01-31T20:35:01
1771 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 9.08.0 -11.11% None 0.00% 2024-01-31T20:35:01
1772 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.530.49 -7.55% 0.44 -16.98% 2024-01-31T20:35:01
1773 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.380.4 5.26% 0.36 -2.70% 2024-01-31T20:35:01
1774 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 125.0119.0 -4.80% 139.0 7.75% 2024-01-31T20:35:01
1775 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.110.06 -45.45% 0.3 114.29% 2024-01-31T20:35:01
1776 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 19.020.0 5.26% 19.0 -9.52% 2024-01-31T20:35:01
1777 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.180.16 -11.11% 0.55 205.56% 2024-01-31T20:35:01
1778 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.660.64 -3.03% 0.69 30.19% 2024-01-31T20:35:01
1779 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 1.023.09 202.94% 3.23 429.51% 2024-01-31T20:35:01
1780 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.850.76 -10.59% 0.34 -60.00% 2024-01-31T20:35:01
1781 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 20.059.0 195.00% 56.0 366.67% 2024-01-31T20:35:01
1782 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 16.015.0 -6.25% 14.0 -12.50% 2024-01-31T20:35:01
1783 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.120.13 8.33% 0.06 -57.14% 2024-01-31T20:35:01
1785 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 11.03.0 -72.73% 8.0 -27.27% 2024-01-31T20:35:01
1786 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 0.220.21 -4.55% 0.07 -68.18% 2024-01-31T20:35:01
1787 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0198 (llvmorg-19-init-00874-gd04ae1b15ff3), 0201 (llvmorg-19-init-01158-g2d2f962c9b64) 3.02.0 -33.33% 9.0 200.00% 2024-01-31T20:35:01
Change State Split Delete