Regression: Regression of 67 benchmarks: 500.perlbench_r (avg) (percentage), 500.perlbench_r (max), 500.perlbench_r (max) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
3179 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 31.029.0 -6.45% 17.0 -45.16% 2024-03-27T16:25:18
3180 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.340.4 17.65% 0.24 -83.56% 2024-03-27T16:25:18
3181 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 2.03.0 50.00% None 0.00% 2024-03-27T16:25:18
3182 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 32.030.0 -6.25% 20.0 -39.39% 2024-03-27T16:25:18
3183 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 23.021.0 -8.70% 18.0 -21.74% 2024-03-27T16:25:18
3184 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 10.044.0 340.00% 69.0 590.00% 2024-03-27T16:25:18
3185 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 23.024.0 4.35% 20.0 -23.08% 2024-03-27T16:25:18
3186 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.060.09 50.00% 0.55 -17.91% 2024-03-27T16:25:18
3187 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.680.64 -5.88% 0.55 -19.12% 2024-03-27T16:25:18
3188 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 5.07.0 40.00% 11.0 -8.33% 2024-03-27T16:25:18
3189 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 5.04.0 -20.00% 1.0 -80.00% 2024-03-27T16:25:18
3190 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.570.54 -5.26% 0.57 0.00% 2024-03-27T16:25:18
3191 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 1.21.37 14.17% 0.0 0.00% 2024-03-27T16:25:18
3192 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 20.019.0 -5.00% 19.0 -5.00% 2024-03-27T16:25:18
3193 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 8.538.34 -2.23% 2.43 -73.03% 2024-03-27T16:25:18
3194 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.060.11 83.33% 0.11 -75.00% 2024-03-27T16:25:18
3195 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 1.02.0 100.00% 2.0 -75.00% 2024-03-27T16:25:18
3196 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 4.994.87 -2.40% 4.81 -4.94% 2024-03-27T16:25:18
3197 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.060.09 50.00% None 0.00% 2024-03-27T16:25:18
3198 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 8.09.0 12.50% 11.0 -8.33% 2024-03-27T16:25:18
3199 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.50.48 -4.00% 0.44 -12.00% 2024-03-27T16:25:18
3200 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 14.015.0 7.14% 13.0 -7.14% 2024-03-27T16:25:18
3201 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 2.03.0 50.00% 19.0 -17.39% 2024-03-27T16:25:18
3202 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 2.03.0 50.00% None 0.00% 2024-03-27T16:25:18
3203 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 14.013.0 -7.14% 10.0 -28.57% 2024-03-27T16:25:18
3204 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 2.621.5 -42.75% 2.38 580.00% 2024-03-27T16:25:18
3205 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.510.49 -3.92% 0.54 5.88% 2024-03-27T16:25:18
3206 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.920.87 -5.43% 0.51 -44.57% 2024-03-27T16:25:18
3207 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 11.013.0 18.18% 8.0 -82.98% 2024-03-27T16:25:18
3208 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 11.010.0 -9.09% 8.0 -27.27% 2024-03-27T16:25:18
3209 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 12.010.0 -16.67% 1.0 -91.67% 2024-03-27T16:25:18
3210 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 3.04.0 33.33% 5.0 0.00% 2024-03-27T16:25:18
3211 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 14.015.0 7.14% 16.0 0.00% 2024-03-27T16:25:18
3212 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 14.013.0 -7.14% 10.0 -28.57% 2024-03-27T16:25:18
3213 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.980.81 -17.35% 0.08 -91.84% 2024-03-27T16:25:18
3214 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 1.41.32 -5.71% 0.98 -31.94% 2024-03-27T16:25:18
3215 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 248.0244.0 -1.61% 70.0 -72.97% 2024-03-27T16:25:18
3216 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 1.191.39 16.81% 0.59 -30.59% 2024-03-27T16:25:18
3217 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 8.010.0 25.00% 17.0 112.50% 2024-03-27T16:25:18
3218 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 23.028.0 21.74% 11.0 -35.29% 2024-03-27T16:25:18
3219 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.710.73 2.82% 0.55 -22.54% 2024-03-27T16:25:18
3220 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.920.88 -4.35% 0.87 -5.43% 2024-03-27T16:25:18
3221 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 1.061.13 6.60% 0.95 -22.13% 2024-03-27T16:25:18
3222 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 31.029.0 -6.45% 17.0 -45.16% 2024-03-27T16:25:18
3223 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 1.671.56 -6.59% 1.21 -27.54% 2024-03-27T16:25:18
3224 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.250.24 -4.00% 0.23 -8.00% 2024-03-27T16:25:18
3225 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.520.5 -3.85% 0.39 -25.00% 2024-03-27T16:25:18
3226 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 32.030.0 -6.25% 20.0 -39.39% 2024-03-27T16:25:18
3227 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.220.27 22.73% 0.3 -9.09% 2024-03-27T16:25:18
3228 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.160.13 -18.75% 0.03 -81.25% 2024-03-27T16:25:18
3229 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.610.59 -3.28% 0.44 -27.87% 2024-03-27T16:25:18
3230 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.370.39 5.41% 0.36 -2.70% 2024-03-27T16:25:18
3231 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 145.0142.0 -2.07% 139.0 -4.14% 2024-03-27T16:25:18
3232 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.140.19 35.71% 0.3 -9.09% 2024-03-27T16:25:18
3233 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 20.019.0 -5.00% 19.0 -5.00% 2024-03-27T16:25:18
3234 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.970.87 -10.31% 0.69 -28.87% 2024-03-27T16:25:18
3235 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 24.028.0 16.67% 0.0 0.00% 2024-03-27T16:25:18
3236 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 45.042.0 -6.67% 32.0 -30.43% 2024-03-27T16:25:18
3237 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.280.26 -7.14% 0.34 21.43% 2024-03-27T16:25:18
3238 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.150.76 406.67% 3.23 0.00% 2024-03-27T16:25:18
3239 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 3.015.0 400.00% 56.0 0.00% 2024-03-27T16:25:18
3240 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.720.76 5.56% 0.66 -8.33% 2024-03-27T16:25:18
3241 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.080.06 -25.00% 0.06 -25.00% 2024-03-27T16:25:18
3242 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 145.0142.0 -2.07% 139.0 -4.14% 2024-03-27T16:25:18
3243 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.250.32 28.00% 0.55 120.00% 2024-03-27T16:25:18
3244 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 0.160.15 -6.25% 0.15 -6.25% 2024-03-27T16:25:18
3245 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0281 (llvmorg-19-init-06792-ge251f56a4d80), 0282 (llvmorg-19-init-06793-g94b5c118b3da) 14.015.0 7.14% 13.0 -7.14% 2024-03-27T16:25:18
Change State Split Delete