Regression: Regression of 64 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2515 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 30.031.0 3.33% 17.0 -43.33% 2024-02-26T18:46:04
2516 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 3.563.47 -2.53% 3.34 -6.18% 2024-02-26T18:46:04
2517 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 37.036.0 -2.70% 20.0 -45.95% 2024-02-26T18:46:04
2518 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 16.011.0 -31.25% 17.0 6.25% 2024-02-26T18:46:04
2519 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 72.056.0 -22.22% 18.0 -75.00% 2024-02-26T18:46:04
2520 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 265.0259.0 -2.26% 69.0 -73.96% 2024-02-26T18:46:04
2521 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 22.013.0 -40.91% 20.0 -13.04% 2024-02-26T18:46:04
2522 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.841.45 -21.20% 0.55 -70.11% 2024-02-26T18:46:04
2523 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 2.121.68 -20.75% 0.55 -74.06% 2024-02-26T18:46:04
2524 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.951.15 21.05% 0.0 0.00% 2024-02-26T18:46:04
2525 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 8.828.67 -1.70% 2.43 -70.18% 2024-02-26T18:46:04
2526 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 5.095.33 4.72% 4.81 -5.50% 2024-02-26T18:46:04
2527 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.481.43 -3.38% 0.44 -70.27% 2024-02-26T18:46:04
2528 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 12.013.0 8.33% 13.0 8.33% 2024-02-26T18:46:04
2529 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 40.038.0 -5.00% 11.0 -72.50% 2024-02-26T18:46:04
2530 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.791.64 -8.38% 0.42 -76.54% 2024-02-26T18:46:04
2531 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 63.049.0 -22.22% 19.0 -69.84% 2024-02-26T18:46:04
2532 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 28.031.0 10.71% 12.0 300.00% 2024-02-26T18:46:04
2533 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 16.015.0 -6.25% 14.0 -12.50% 2024-02-26T18:46:04
2534 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 8.877.98 -10.03% 2.38 -73.17% 2024-02-26T18:46:04
2535 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.880.93 5.68% 0.51 -42.05% 2024-02-26T18:46:04
2536 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 7.09.0 28.57% 2.0 -94.74% 2024-02-26T18:46:04
2537 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 8.09.0 12.50% 1.0 -83.33% 2024-02-26T18:46:04
2538 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.330.32 -3.03% 0.32 -3.03% 2024-02-26T18:46:04
2539 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 10.09.0 -10.00% 12.0 300.00% 2024-02-26T18:46:04
2540 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.640.73 14.06% 0.08 -83.67% 2024-02-26T18:46:04
2541 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.540.51 -5.56% 0.98 81.48% 2024-02-26T18:46:04
2542 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 11.012.0 9.09% 11.0 -15.38% 2024-02-26T18:46:04
2543 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.03.0 200.00% 0.0 0.00% 2024-02-26T18:46:04
2544 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 11.012.0 9.09% 11.0 -15.38% 2024-02-26T18:46:04
2545 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 2.03.0 50.00% 0.0 0.00% 2024-02-26T18:46:04
2546 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.381.27 -7.97% 0.59 -57.25% 2024-02-26T18:46:04
2547 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 12.011.0 -8.33% 17.0 41.67% 2024-02-26T18:46:04
2548 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.730.5 -31.51% 0.77 4.05% 2024-02-26T18:46:04
2549 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 27.025.0 -7.41% 11.0 -59.26% 2024-02-26T18:46:04
2550 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.610.59 -3.28% 0.55 -9.84% 2024-02-26T18:46:04
2551 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 23.017.0 -26.09% 8.0 -65.22% 2024-02-26T18:46:04
2552 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.051.01 -3.81% 0.87 -17.14% 2024-02-26T18:46:04
2553 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.020.61 -40.20% 0.95 -10.38% 2024-02-26T18:46:04
2554 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 30.031.0 3.33% 17.0 -43.33% 2024-02-26T18:46:04
2555 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 36.026.0 -27.78% 9.0 -75.00% 2024-02-26T18:46:04
2556 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 70.067.0 -4.29% 57.0 -18.57% 2024-02-26T18:46:04
2557 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 37.036.0 -2.70% 20.0 -45.95% 2024-02-26T18:46:04
2558 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.520.48 -7.69% 0.44 -15.38% 2024-02-26T18:46:04
2559 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.330.42 27.27% 0.09 -94.89% 2024-02-26T18:46:04
2560 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 157.0172.0 9.55% 139.0 -7.95% 2024-02-26T18:46:04
2561 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.280.94 -26.56% 0.45 -64.84% 2024-02-26T18:46:04
2562 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.280.26 -7.14% 0.34 277.78% 2024-02-26T18:46:04
2563 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.30.33 10.00% 0.55 129.17% 2024-02-26T18:46:04
2564 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.650.73 12.31% 0.69 38.00% 2024-02-26T18:46:04
2565 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 19.023.0 21.05% 0.0 0.00% 2024-02-26T18:46:04
2566 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.041.14 9.62% 0.45 309.09% 2024-02-26T18:46:04
2567 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 17.016.0 -5.88% 32.0 88.24% 2024-02-26T18:46:04
2568 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 16.015.0 -6.25% 14.0 -12.50% 2024-02-26T18:46:04
2569 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.120.19 58.33% 0.0 0.00% 2024-02-26T18:46:04
2570 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.630.67 6.35% 0.66 4.76% 2024-02-26T18:46:04
2571 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.120.19 58.33% 0.06 -14.29% 2024-02-26T18:46:04
2572 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 157.0172.0 9.55% 139.0 -7.95% 2024-02-26T18:46:04
2573 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 0.380.35 -7.89% 0.55 44.74% 2024-02-26T18:46:04
2574 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 38.035.0 -7.89% 8.0 -78.95% 2024-02-26T18:46:04
2575 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 23.017.0 -26.09% 8.0 -65.22% 2024-02-26T18:46:04
2576 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 1.971.44 -26.90% 0.49 -75.13% 2024-02-26T18:46:04
2577 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 12.013.0 8.33% 13.0 8.33% 2024-02-26T18:46:04
2578 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0242 (llvmorg-19-init-03493-g8a87f763a684), 0245 (no-change) 5.06.0 20.00% 9.0 125.00% 2024-02-26T18:46:04
Change State Split Delete