Regression: Regression of 48 benchmarks: 500.perlbench_r (avg) (percentage), 500.perlbench_r (max), 500.perlbench_r (max) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
4118 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.030.12 300.00% 0.24 -22.58% 2024-04-28T14:55:59
4119 llvm-aarch64-master-O3:239801545695209356 execution_variation 521.wrf_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 51.050.0 -1.96% 36.0 -26.53% 2024-04-28T14:55:59
4120 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 27.035.0 29.63% 17.0 -62.22% 2024-04-28T14:55:59
4121 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 49.046.0 -6.12% 18.0 -63.27% 2024-04-28T14:55:59
4122 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 45.040.0 -11.11% 20.0 -55.56% 2024-04-28T14:55:59
4123 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.380.26 -31.58% 0.55 -59.85% 2024-04-28T14:55:59
4124 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.431.34 -6.29% 0.55 -61.54% 2024-04-28T14:55:59
4125 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.710.75 5.63% 0.57 -28.75% 2024-04-28T14:55:59
4126 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.30.45 50.00% 0.0 0.00% 2024-04-28T14:55:59
4127 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 8.418.04 -4.40% 2.43 -71.11% 2024-04-28T14:55:59
4128 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.250.2 -20.00% 0.09 -40.00% 2024-04-28T14:55:59
4129 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 14.015.0 7.14% 12.0 -25.00% 2024-04-28T14:55:59
4130 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.071.03 -3.74% 0.44 -64.52% 2024-04-28T14:55:59
4131 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 29.027.0 -6.90% 11.0 -66.67% 2024-04-28T14:55:59
4132 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.840.61 -27.38% 0.42 68.00% 2024-04-28T14:55:59
4133 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 13.09.0 -30.77% 19.0 -59.57% 2024-04-28T14:55:59
4134 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.00.98 -2.00% 0.51 -49.50% 2024-04-28T14:55:59
4135 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.04.0 300.00% 8.0 -20.00% 2024-04-28T14:55:59
4136 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 7.013.0 85.71% 2.0 -33.33% 2024-04-28T14:55:59
4137 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 5.07.0 40.00% 1.0 -75.00% 2024-04-28T14:55:59
4138 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 14.018.0 28.57% 12.0 0.00% 2024-04-28T14:55:59
4139 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 14.017.0 21.43% 11.0 0.00% 2024-04-28T14:55:59
4140 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.410.58 41.46% 0.08 -75.76% 2024-04-28T14:55:59
4141 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 4.05.0 25.00% 2.0 -75.00% 2024-04-28T14:55:59
4142 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.380.42 10.53% 0.98 0.00% 2024-04-28T14:55:59
4143 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 267.0262.0 -1.87% 70.0 -74.17% 2024-04-28T14:55:59
4144 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.140.18 28.57% 0.07 -75.00% 2024-04-28T14:55:59
4145 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.341.21 -9.70% 0.59 -55.97% 2024-04-28T14:55:59
4146 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.231.6 30.08% 0.77 -62.07% 2024-04-28T14:55:59
4147 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 26.024.0 -7.69% 11.0 -57.69% 2024-04-28T14:55:59
4148 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.840.87 3.57% 0.87 3.57% 2024-04-28T14:55:59
4149 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 2.071.86 -10.14% 0.95 -54.11% 2024-04-28T14:55:59
4150 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 1.71.68 -1.18% 1.21 -28.82% 2024-04-28T14:55:59
4151 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 27.028.0 3.70% 57.0 159.09% 2024-04-28T14:55:59
4152 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.190.18 -5.26% 0.3 57.89% 2024-04-28T14:55:59
4153 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.540.53 -1.85% 0.44 -20.00% 2024-04-28T14:55:59
4154 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.330.61 84.85% 0.09 -35.71% 2024-04-28T14:55:59
4155 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 168.0170.0 1.19% 139.0 -17.26% 2024-04-28T14:55:59
4156 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.40.51 27.50% 0.34 0.00% 2024-04-28T14:55:59
4157 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.460.45 -2.17% 0.55 19.57% 2024-04-28T14:55:59
4158 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.620.58 -6.45% 0.69 60.47% 2024-04-28T14:55:59
4159 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 6.09.0 50.00% 0.0 0.00% 2024-04-28T14:55:59
4160 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 12.013.0 8.33% 32.0 3.23% 2024-04-28T14:55:59
4161 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.40.51 27.50% 0.34 0.00% 2024-04-28T14:55:59
4162 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.10.09 -10.00% 0.06 -40.00% 2024-04-28T14:55:59
4164 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 17.012.0 -29.41% 8.0 60.00% 2024-04-28T14:55:59
4165 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 5.04.0 -20.00% 2.0 -33.33% 2024-04-28T14:55:59
4166 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0332 (llvmorg-19-init-09747-ge5c92c51e986), 0333 (llvmorg-19-init-09748-g8e17c84836b0) 0.280.26 -7.14% 0.07 -75.00% 2024-04-28T14:55:59
Change State Split Delete