Regression: Regression of 48 benchmarks: 500.perlbench_r (max), 500.perlbench_r (max) (percentage), 500.perlbench_r (unexplained dif...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2816 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 34.035.0 2.94% 17.0 -55.26% 2024-03-15T04:33:24
2817 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.130.75 476.92% 0.24 0.00% 2024-03-15T04:33:24
2818 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 3.133.09 -1.28% 3.34 6.71% 2024-03-15T04:33:24
2819 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 61.065.0 6.56% 18.0 -75.34% 2024-03-15T04:33:24
2820 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 40.08.0 -80.00% 69.0 0.00% 2024-03-15T04:33:24
2821 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 34.032.0 -5.88% 20.0 -41.18% 2024-03-15T04:33:24
2822 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.450.06 -95.86% 0.55 0.00% 2024-03-15T04:33:24
2823 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.791.91 6.70% 0.55 -74.18% 2024-03-15T04:33:24
2824 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.40.42 5.00% 0.57 29.55% 2024-03-15T04:33:24
2825 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.60.66 10.00% 0.11 -81.67% 2024-03-15T04:33:24
2826 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 11.012.0 9.09% 2.0 -81.82% 2024-03-15T04:33:24
2827 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.240.34 41.67% 0.09 80.00% 2024-03-15T04:33:24
2828 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 5.054.99 -1.19% 4.81 -9.42% 2024-03-15T04:33:24
2829 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.20.26 30.00% 0.44 120.00% 2024-03-15T04:33:24
2830 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 5.07.0 40.00% 11.0 120.00% 2024-03-15T04:33:24
2831 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.081.02 -5.56% 0.42 -61.11% 2024-03-15T04:33:24
2832 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 49.02.0 -95.92% 19.0 0.00% 2024-03-15T04:33:24
2833 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 8.07.0 -12.50% 12.0 300.00% 2024-03-15T04:33:24
2834 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 16.015.0 -6.25% 10.0 -37.50% 2024-03-15T04:33:24
2835 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.260.25 -80.16% 2.38 0.00% 2024-03-15T04:33:24
2836 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.430.41 -4.65% 0.54 25.58% 2024-03-15T04:33:24
2837 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.011.03 1.98% 0.51 -54.05% 2024-03-15T04:33:24
2838 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 4.024.0 500.00% 8.0 0.00% 2024-03-15T04:33:24
2839 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 22.017.0 -22.73% 2.0 0.00% 2024-03-15T04:33:24
2840 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.330.32 -3.03% 0.33 0.00% 2024-03-15T04:33:24
2841 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 13.012.0 -7.69% 16.0 23.08% 2024-03-15T04:33:24
2842 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 16.015.0 -6.25% 10.0 -37.50% 2024-03-15T04:33:24
2843 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.540.74 37.04% 0.98 122.73% 2024-03-15T04:33:24
2844 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 243.0239.0 -1.65% 70.0 -74.17% 2024-03-15T04:33:24
2845 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 11.08.0 -27.27% 17.0 466.67% 2024-03-15T04:33:24
2846 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.230.25 8.70% 0.28 21.74% 2024-03-15T04:33:24
2847 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.670.68 1.49% 0.55 -17.91% 2024-03-15T04:33:24
2848 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 17.014.0 -17.65% 8.0 -52.94% 2024-03-15T04:33:24
2849 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.591.5 -5.66% 0.95 -40.25% 2024-03-15T04:33:24
2850 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 34.035.0 2.94% 17.0 -55.26% 2024-03-15T04:33:24
2851 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 61.060.0 -1.64% 57.0 -6.56% 2024-03-15T04:33:24
2852 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.590.57 -3.39% 0.39 -33.90% 2024-03-15T04:33:24
2853 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 1.020.79 -22.55% 0.09 0.00% 2024-03-15T04:33:24
2854 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.940.76 -19.15% 0.45 -52.13% 2024-03-15T04:33:24
2855 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.60.66 10.00% 0.55 -8.33% 2024-03-15T04:33:24
2856 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.290.26 -10.34% 0.45 309.09% 2024-03-15T04:33:24
2857 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 17.023.0 35.29% 32.0 128.57% 2024-03-15T04:33:24
2858 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.130.11 -15.38% 0.06 -53.85% 2024-03-15T04:33:24
2859 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 0.350.25 -28.57% 0.55 450.00% 2024-03-15T04:33:24
2860 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 23.022.0 -4.35% 8.0 -65.22% 2024-03-15T04:33:24
2861 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 17.014.0 -17.65% 8.0 -52.94% 2024-03-15T04:33:24
2862 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 5.07.0 40.00% 2.0 100.00% 2024-03-15T04:33:24
2863 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0260 (llvmorg-19-init-05412-gcf5cd98e7427), 0263 (no-change) 10.012.0 20.00% 9.0 -10.00% 2024-03-15T04:33:24
Change State Split Delete