Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7f1d757fb40f06cc1c6b134d770987b340286996 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O2-build/156/
View Options
Report
Filter

llvm-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0156 (no-change) 2024-01-13T15:51:26 0:00:00
Previous 0158 (llvmorg-18-init-18333-g1a300d6da3f3) 2024-01-20T14:54:56 0:00:00
Baseline 0027 (llvmorg-17-init-08118-g0b911a3dc34a) 2023-04-13T21:53:13 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 105 74
Performance Improvements 23 78
Added Tests 0 14
Unchanged Tests 808 770
Total Tests 936

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r 1.51% 13128.000 13326.000 - -9.63% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) 2233.33% 0.030 0.700 - 400.00% -
519.lbm_r (unexplained diff vs previous) 2040.00% 5.000 107.000 - 345.83% -
511.povray_r (unexplained diff vs previous) (percentage) 981.82% 0.110 1.190 - 120.37% -
511.povray_r (unexplained diff vs previous) 943.48% 23.000 240.000 - 105.13% -
503.bwaves_r (unexplained diff vs previous) (percentage) 750.00% 0.020 0.170 - 142.86% -
541.leela_r (unexplained diff vs previous) 700.00% 6.000 48.000 - 108.70% -
503.bwaves_r (unexplained diff vs previous) 620.00% 5.000 36.000 - 157.14% -
541.leela_r (unexplained diff vs previous) (percentage) 620.00% 0.050 0.360 - 111.76% -
500.perlbench_r (max) 292.86% 56.000 220.000 - 3.29% -
500.perlbench_r (max) (percentage) 286.49% 0.370 1.430 - 7.52% -
554.roms_r (unexplained diff vs previous) (percentage) 205.56% 0.180 0.550 - 1000.00% -
554.roms_r (unexplained diff vs previous) 202.70% 37.000 112.000 - 833.33% -
508.namd_r (max) 180.00% 10.000 28.000 - -74.07% -
525.x264_r (unexplained diff vs previous) (percentage) 177.78% 0.180 0.500 - 233.33% -
508.namd_r (max) (percentage) 172.73% 0.110 0.300 - -73.45% -
525.x264_r (unexplained diff vs previous) 172.73% 11.000 30.000 - 172.73% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 123.91% 0.460 1.030 - 312.00% -
500.perlbench_r (unexplained diff vs previous) 122.22% 27.000 60.000 - -72.35% -
549.fotonik3d_r (unexplained diff vs previous) 122.12% 104.000 231.000 - 192.41% -
500.perlbench_r (unexplained diff vs previous) (percentage) 116.67% 0.180 0.390 - -71.11% -
548.exchange2_r (max) (percentage) 90.00% 0.100 0.190 - -13.64% -
508.namd_r (unexplained diff vs previous) (percentage) 88.89% 0.090 0.170 - -84.55% -
548.exchange2_r (max) 88.24% 17.000 32.000 - -20.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 87.50% 0.160 0.300 - -60.53% -
531.deepsjeng_r (unexplained diff vs previous) 85.71% 14.000 26.000 - -61.19% -
549.fotonik3d_r (max) (percentage) 84.62% 0.780 1.440 - 19.01% -
549.fotonik3d_r (max) 84.57% 175.000 323.000 - -14.78% -
510.parest_r (unexplained diff vs previous) 83.87% 31.000 57.000 - 1325.00% -
510.parest_r (unexplained diff vs previous) (percentage) 78.57% 0.140 0.250 - 1150.00% -
508.namd_r (unexplained diff vs previous) 77.78% 9.000 16.000 - -84.76% -
548.exchange2_r (unexplained diff vs previous) 66.67% 3.000 5.000 - 66.67% -
511.povray_r (max) 26.44% 208.000 263.000 - 122.88% -
511.povray_r (max) (percentage) 26.21% 1.030 1.300 - 136.36% -
557.xz_r (max) (percentage) 16.67% 0.060 0.070 - -63.16% -
557.xz_r (unexplained diff vs previous) (percentage) 16.67% 0.060 0.070 - -63.16% -
525.x264_r (max) (percentage) 16.67% 0.420 0.490 - 226.67% -
557.xz_r (max) 16.67% 6.000 7.000 - -66.67% -
525.x264_r (max) 16.00% 25.000 29.000 - 163.64% -
557.xz_r (unexplained diff vs previous) 14.29% 7.000 8.000 - -63.64% -
510.parest_r (max) 14.00% 50.000 57.000 - 32.56% -
510.parest_r (max) (percentage) 13.64% 0.220 0.250 - 31.58% -
503.bwaves_r (max) (percentage) 13.33% 0.150 0.170 - 88.89% -
520.omnetpp_r (unexplained diff vs previous) 13.04% 23.000 26.000 - -45.83% -
503.bwaves_r (max) 12.90% 31.000 35.000 - 84.21% -
519.lbm_r (max) (percentage) 12.90% 0.620 0.700 - 311.76% -
519.lbm_r (max) 12.63% 95.000 107.000 - 268.97% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 12.50% 0.160 0.180 - -45.45% -
554.roms_r (max) (percentage) 12.24% 0.490 0.550 - 685.71% -
554.roms_r (max) 12.12% 99.000 111.000 - 593.75% -
521.wrf_r 11.88% 160.000 179.000 - 55.65% -
521.wrf_r (avg) 11.88% 160.000 179.000 - 55.65% -
531.deepsjeng_r 10.81% 37.000 41.000 - 13.89% -
531.deepsjeng_r (avg) 10.81% 37.000 41.000 - 13.89% -
521.wrf_r (avg) (percentage) 10.66% 1.220 1.350 - 73.08% -
548.exchange2_r 10.00% 20.000 22.000 - -18.52% -
548.exchange2_r (avg) 10.00% 20.000 22.000 - -18.52% -
531.deepsjeng_r (max) 9.52% 63.000 69.000 - 2.99% -
531.deepsjeng_r (max) (percentage) 9.46% 0.740 0.810 - 5.19% -
525.x264_r 9.09% 11.000 12.000 - 100.00% -
525.x264_r (avg) 9.09% 11.000 12.000 - 100.00% -
531.deepsjeng_r (avg) (percentage) 9.09% 0.440 0.480 - 17.07% -
538.imagick_r (max) (percentage) 8.70% 0.460 0.500 - 19.05% -
548.exchange2_r (avg) (percentage) 8.33% 0.120 0.130 - -13.33% -
538.imagick_r (max) 7.81% 64.000 69.000 - 18.97% -
500.perlbench_r 7.78% 90.000 97.000 - -33.56% -
500.perlbench_r (avg) 7.78% 90.000 97.000 - -33.56% -
526.blender_r (max) 7.28% 481.000 516.000 - 1072.73% -
526.blender_r (max) (percentage) 7.16% 4.050 4.340 - 1105.56% -
541.leela_r 6.98% 43.000 46.000 - -22.03% -
541.leela_r (avg) 6.98% 43.000 46.000 - -22.03% -
500.perlbench_r (avg) (percentage) 6.78% 0.590 0.630 - -30.77% -
520.omnetpp_r (avg) (percentage) 6.60% 1.060 1.130 - 22.83% -
520.omnetpp_r 6.49% 154.000 164.000 - 22.39% -
520.omnetpp_r (avg) 6.49% 154.000 164.000 - 22.39% -
520.omnetpp_r (max) 6.45% 93.000 99.000 - -72.95% -
520.omnetpp_r (max) (percentage) 6.25% 0.640 0.680 - -72.80% -
541.leela_r (avg) (percentage) 6.06% 0.330 0.350 - -20.45% -
523.xalancbmk_r (avg) (percentage) 5.26% 0.190 0.200 - -16.67% -
525.x264_r (avg) (percentage) 5.26% 0.190 0.200 - 122.22% -
519.lbm_r 4.88% 41.000 43.000 - 48.28% -
519.lbm_r (avg) 4.88% 41.000 43.000 - 48.28% -
541.leela_r (max) 4.88% 82.000 86.000 - 16.22% -
541.leela_r (max) (percentage) 4.84% 0.620 0.650 - 18.18% -
510.parest_r (avg) (percentage) 4.76% 0.210 0.220 - 46.67% -
508.namd_r 4.35% 23.000 24.000 - -60.66% -
508.namd_r (avg) 4.35% 23.000 24.000 - -60.66% -
510.parest_r 4.17% 48.000 50.000 - 47.06% -
510.parest_r (avg) 4.17% 48.000 50.000 - 47.06% -
511.povray_r (avg) (percentage) 4.08% 0.490 0.510 - 41.67% -
511.povray_r 4.04% 99.000 103.000 - 33.77% -
511.povray_r (avg) 4.04% 99.000 103.000 - 33.77% -
508.namd_r (avg) (percentage) 4.00% 0.250 0.260 - -59.38% -
521.wrf_r (max) 3.83% 261.000 271.000 - 148.62% -
519.lbm_r (avg) (percentage) 3.70% 0.270 0.280 - 64.71% -
544.nab_r (max) (percentage) 3.33% 0.300 0.310 - 19.23% -
521.wrf_r (max) (percentage) 2.51% 1.990 2.040 - 175.68% -
544.nab_r (max) 2.33% 43.000 44.000 - 18.92% -
549.fotonik3d_r 2.24% 134.000 137.000 - -43.85% -
549.fotonik3d_r (avg) 2.24% 134.000 137.000 - -43.85% -
549.fotonik3d_r (avg) (percentage) 1.67% 0.600 0.610 - -21.79% -
527.cam4_r (max) 1.60% 125.000 127.000 - 0.00% -
527.cam4_r (max) (percentage) 1.09% 0.920 0.930 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r -2.82% 2637844.000 2563540.000 - 0.31% -
554.roms_r -2.39% 3194640.000 3118224.000 - 1.90% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) -97.67% 43.000 1.000 - -50.00% -
526.blender_r (unexplained diff vs previous) (percentage) -96.81% 0.940 0.030 - -91.67% -
544.nab_r (unexplained diff vs previous) (percentage) -96.67% 0.300 0.010 - 0.00% -
526.blender_r (unexplained diff vs previous) -96.43% 112.000 4.000 - -91.11% -
538.imagick_r (unexplained diff vs previous) -84.62% 26.000 4.000 - -93.10% -
538.imagick_r (unexplained diff vs previous) (percentage) -84.21% 0.190 0.030 - -92.86% -
527.cam4_r (unexplained diff vs previous) (percentage) -82.95% 0.880 0.150 - 0.00% -
527.cam4_r (unexplained diff vs previous) -82.50% 120.000 21.000 - 0.00% -
505.mcf_r (max) -81.82% 66.000 12.000 - -87.50% -
505.mcf_r (unexplained diff vs previous) -81.82% 66.000 12.000 - -87.50% -
505.mcf_r (max) (percentage) -80.85% 0.470 0.090 - -86.76% -
505.mcf_r (unexplained diff vs previous) (percentage) -80.85% 0.470 0.090 - -86.76% -
521.wrf_r (unexplained diff vs previous) -54.39% 57.000 26.000 - -74.26% -
521.wrf_r (unexplained diff vs previous) (percentage) -53.49% 0.430 0.200 - -70.59% -
527.cam4_r -17.19% 64.000 53.000 - 0.00% -
527.cam4_r (avg) -17.19% 64.000 53.000 - 0.00% -
527.cam4_r (avg) (percentage) -17.02% 0.470 0.390 - 0.00% -
505.mcf_r (avg) (percentage) -3.03% 0.330 0.320 - -38.46% -
505.mcf_r -2.17% 46.000 45.000 - -38.36% -
505.mcf_r (avg) -2.17% 46.000 45.000 - -38.36% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 4.35% 23.000 24.000 - 4.35% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 2.84% 775742.000 797740.000 - -0.21% -
554.roms_r 1.90% 3060081.000 3118224.000 - -2.39% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 1.74% 11293.000 11489.000 - 0.52% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
510.parest_r (unexplained diff vs previous) 1325.00% 4.000 57.000 - 83.87% -
510.parest_r (unexplained diff vs previous) (percentage) 1150.00% 0.020 0.250 - 78.57% -
526.blender_r (max) (percentage) 1105.56% 0.360 4.340 - 7.16% -
526.blender_r (max) 1072.73% 44.000 516.000 - 7.28% -
554.roms_r (unexplained diff vs previous) (percentage) 1000.00% 0.050 0.550 - 205.56% -
554.roms_r (unexplained diff vs previous) 833.33% 12.000 112.000 - 202.70% -
554.roms_r (max) (percentage) 685.71% 0.070 0.550 - 12.24% -
554.roms_r (max) 593.75% 16.000 111.000 - 12.12% -
519.lbm_r (unexplained diff vs previous) (percentage) 400.00% 0.140 0.700 - 2233.33% -
519.lbm_r (unexplained diff vs previous) 345.83% 24.000 107.000 - 2040.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 312.00% 0.250 1.030 - 123.91% -
519.lbm_r (max) (percentage) 311.76% 0.170 0.700 - 12.90% -
554.roms_r (avg) (percentage) 283.33% 0.060 0.230 - 0.00% -
519.lbm_r (max) 268.97% 29.000 107.000 - 12.63% -
554.roms_r 253.85% 13.000 46.000 - 0.00% -
554.roms_r (avg) 253.85% 13.000 46.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 233.33% 0.150 0.500 - 177.78% -
525.x264_r (max) (percentage) 226.67% 0.150 0.490 - 16.67% -
549.fotonik3d_r (unexplained diff vs previous) 192.41% 79.000 231.000 - 122.12% -
526.blender_r (avg) (percentage) 181.82% 0.330 0.930 - 0.00% -
521.wrf_r (max) (percentage) 175.68% 0.740 2.040 - 2.51% -
525.x264_r (unexplained diff vs previous) 172.73% 11.000 30.000 - 172.73% -
526.blender_r 168.29% 41.000 110.000 - 0.00% -
526.blender_r (avg) 168.29% 41.000 110.000 - 0.00% -
525.x264_r (max) 163.64% 11.000 29.000 - 16.00% -
503.bwaves_r (unexplained diff vs previous) 157.14% 14.000 36.000 - 620.00% -
521.wrf_r (max) 148.62% 109.000 271.000 - 3.83% -
503.bwaves_r (unexplained diff vs previous) (percentage) 142.86% 0.070 0.170 - 750.00% -
511.povray_r (max) (percentage) 136.36% 0.550 1.300 - 26.21% -
511.povray_r (max) 122.88% 118.000 263.000 - 26.44% -
525.x264_r (avg) (percentage) 122.22% 0.090 0.200 - 5.26% -
511.povray_r (unexplained diff vs previous) (percentage) 120.37% 0.540 1.190 - 981.82% -
541.leela_r (unexplained diff vs previous) (percentage) 111.76% 0.170 0.360 - 620.00% -
541.leela_r (unexplained diff vs previous) 108.70% 23.000 48.000 - 700.00% -
511.povray_r (unexplained diff vs previous) 105.13% 117.000 240.000 - 943.48% -
525.x264_r 100.00% 6.000 12.000 - 9.09% -
525.x264_r (avg) 100.00% 6.000 12.000 - 9.09% -
503.bwaves_r (max) (percentage) 88.89% 0.090 0.170 - 13.33% -
503.bwaves_r (max) 84.21% 19.000 35.000 - 12.90% -
521.wrf_r (avg) (percentage) 73.08% 0.780 1.350 - 10.66% -
548.exchange2_r (unexplained diff vs previous) 66.67% 3.000 5.000 - 66.67% -
519.lbm_r (avg) (percentage) 64.71% 0.170 0.280 - 3.70% -
521.wrf_r 55.65% 115.000 179.000 - 11.88% -
521.wrf_r (avg) 55.65% 115.000 179.000 - 11.88% -
519.lbm_r 48.28% 29.000 43.000 - 4.88% -
519.lbm_r (avg) 48.28% 29.000 43.000 - 4.88% -
510.parest_r 47.06% 34.000 50.000 - 4.17% -
510.parest_r (avg) 47.06% 34.000 50.000 - 4.17% -
510.parest_r (avg) (percentage) 46.67% 0.150 0.220 - 4.76% -
511.povray_r (avg) (percentage) 41.67% 0.360 0.510 - 4.08% -
511.povray_r 33.77% 77.000 103.000 - 4.04% -
511.povray_r (avg) 33.77% 77.000 103.000 - 4.04% -
510.parest_r (max) 32.56% 43.000 57.000 - 14.00% -
510.parest_r (max) (percentage) 31.58% 0.190 0.250 - 13.64% -
520.omnetpp_r (avg) (percentage) 22.83% 0.920 1.130 - 6.60% -
520.omnetpp_r 22.39% 134.000 164.000 - 6.49% -
520.omnetpp_r (avg) 22.39% 134.000 164.000 - 6.49% -
544.nab_r (max) (percentage) 19.23% 0.260 0.310 - 3.33% -
538.imagick_r (max) (percentage) 19.05% 0.420 0.500 - 8.70% -
549.fotonik3d_r (max) (percentage) 19.01% 1.210 1.440 - 84.62% -
538.imagick_r (max) 18.97% 58.000 69.000 - 7.81% -
544.nab_r (max) 18.92% 37.000 44.000 - 2.33% -
541.leela_r (max) (percentage) 18.18% 0.550 0.650 - 4.84% -
531.deepsjeng_r (avg) (percentage) 17.07% 0.410 0.480 - 9.09% -
541.leela_r (max) 16.22% 74.000 86.000 - 4.88% -
531.deepsjeng_r 13.89% 36.000 41.000 - 10.81% -
531.deepsjeng_r (avg) 13.89% 36.000 41.000 - 10.81% -
500.perlbench_r (max) (percentage) 7.52% 1.330 1.430 - 286.49% -
531.deepsjeng_r (max) (percentage) 5.19% 0.770 0.810 - 9.46% -
500.perlbench_r (max) 3.29% 213.000 220.000 - 292.86% -
531.deepsjeng_r (max) 2.99% 67.000 69.000 - 9.52% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -6.39% 23893420.000 22366083.000 - -0.34% -
549.fotonik3d_r -2.73% 1256502.000 1222261.000 - -0.14% -
508.namd_r -2.26% 624815.000 610693.000 - 0.01% -
519.lbm_r -1.22% 13451.000 13287.000 - 0.00% -
507.cactuBSSN_r -1.13% 3707734.000 3665927.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -28.32% 31362.000 22480.000 - 0.15% -
525.x264_r -19.15% 7490.000 6056.000 - -0.18% -
519.lbm_r -12.35% 17526.000 15362.000 - -0.15% -
554.roms_r -11.24% 22927.000 20351.000 - 0.00% -
521.wrf_r -9.63% 14746.000 13326.000 - 1.51% -
548.exchange2_r -8.48% 18630.000 17050.000 - -0.23% -
511.povray_r -6.02% 21547.000 20249.000 - 0.01% -
526.blender_r -4.22% 12432.000 11907.000 - 0.24% -
500.perlbench_r -3.75% 16051.000 15449.000 - 0.34% -
531.deepsjeng_r -2.58% 8789.000 8562.000 - -0.07% -
557.xz_r -2.43% 11556.000 11275.000 - 0.20% -
541.leela_r -2.25% 13571.000 13266.000 - -0.18% -
503.bwaves_r -1.59% 21135.000 20800.000 - -0.18% -
502.gcc_r -1.19% 11030.000 10899.000 - 0.55% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r (unexplained diff vs previous) -93.10% 58.000 4.000 - -84.62% -
538.imagick_r (unexplained diff vs previous) (percentage) -92.86% 0.420 0.030 - -84.21% -
526.blender_r (unexplained diff vs previous) (percentage) -91.67% 0.360 0.030 - -96.81% -
526.blender_r (unexplained diff vs previous) -91.11% 45.000 4.000 - -96.43% -
505.mcf_r (max) -87.50% 96.000 12.000 - -81.82% -
505.mcf_r (unexplained diff vs previous) -87.50% 96.000 12.000 - -81.82% -
505.mcf_r (max) (percentage) -86.76% 0.680 0.090 - -80.85% -
505.mcf_r (unexplained diff vs previous) (percentage) -86.76% 0.680 0.090 - -80.85% -
508.namd_r (unexplained diff vs previous) -84.76% 105.000 16.000 - 77.78% -
508.namd_r (unexplained diff vs previous) (percentage) -84.55% 1.100 0.170 - 88.89% -
521.wrf_r (unexplained diff vs previous) -74.26% 101.000 26.000 - -54.39% -
508.namd_r (max) -74.07% 108.000 28.000 - 180.00% -
508.namd_r (max) (percentage) -73.45% 1.130 0.300 - 172.73% -
520.omnetpp_r (max) -72.95% 366.000 99.000 - 6.45% -
520.omnetpp_r (max) (percentage) -72.80% 2.500 0.680 - 6.25% -
500.perlbench_r (unexplained diff vs previous) -72.35% 217.000 60.000 - 122.22% -
500.perlbench_r (unexplained diff vs previous) (percentage) -71.11% 1.350 0.390 - 116.67% -
521.wrf_r (unexplained diff vs previous) (percentage) -70.59% 0.680 0.200 - -53.49% -
557.xz_r (max) -66.67% 21.000 7.000 - 16.67% -
557.xz_r (unexplained diff vs previous) -63.64% 22.000 8.000 - 14.29% -
523.xalancbmk_r (max) (percentage) -63.16% 0.380 0.140 - 0.00% -
557.xz_r (max) (percentage) -63.16% 0.190 0.070 - 16.67% -
557.xz_r (unexplained diff vs previous) (percentage) -63.16% 0.190 0.070 - 16.67% -
531.deepsjeng_r (unexplained diff vs previous) -61.19% 67.000 26.000 - 85.71% -
508.namd_r -60.66% 61.000 24.000 - 4.35% -
508.namd_r (avg) -60.66% 61.000 24.000 - 4.35% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -60.53% 0.760 0.300 - 87.50% -
508.namd_r (avg) (percentage) -59.38% 0.640 0.260 - 4.00% -
544.nab_r (unexplained diff vs previous) -50.00% 2.000 1.000 - -97.67% -
520.omnetpp_r (unexplained diff vs previous) -45.83% 48.000 26.000 - 13.04% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -45.45% 0.330 0.180 - 12.50% -
549.fotonik3d_r -43.85% 244.000 137.000 - 2.24% -
549.fotonik3d_r (avg) -43.85% 244.000 137.000 - 2.24% -
505.mcf_r (avg) (percentage) -38.46% 0.520 0.320 - -3.03% -
505.mcf_r -38.36% 73.000 45.000 - -2.17% -
505.mcf_r (avg) -38.36% 73.000 45.000 - -2.17% -
538.imagick_r (avg) (percentage) -36.67% 0.300 0.190 - 0.00% -
538.imagick_r -36.59% 41.000 26.000 - 0.00% -
538.imagick_r (avg) -36.59% 41.000 26.000 - 0.00% -
500.perlbench_r -33.56% 146.000 97.000 - 7.78% -
500.perlbench_r (avg) -33.56% 146.000 97.000 - 7.78% -
500.perlbench_r (avg) (percentage) -30.77% 0.910 0.630 - 6.78% -
503.bwaves_r -23.81% 21.000 16.000 - 0.00% -
503.bwaves_r (avg) -23.81% 21.000 16.000 - 0.00% -
541.leela_r -22.03% 59.000 46.000 - 6.98% -
541.leela_r (avg) -22.03% 59.000 46.000 - 6.98% -
549.fotonik3d_r (avg) (percentage) -21.79% 0.780 0.610 - 1.67% -
541.leela_r (avg) (percentage) -20.45% 0.440 0.350 - 6.06% -
503.bwaves_r (avg) (percentage) -20.00% 0.100 0.080 - 0.00% -
548.exchange2_r (max) -20.00% 40.000 32.000 - 88.24% -
548.exchange2_r -18.52% 27.000 22.000 - 10.00% -
548.exchange2_r (avg) -18.52% 27.000 22.000 - 10.00% -
523.xalancbmk_r (avg) (percentage) -16.67% 0.240 0.200 - 5.26% -
549.fotonik3d_r (max) -14.78% 379.000 323.000 - 84.57% -
548.exchange2_r (max) (percentage) -13.64% 0.220 0.190 - 90.00% -
548.exchange2_r (avg) (percentage) -13.33% 0.150 0.130 - 8.33% -
544.nab_r -2.44% 41.000 40.000 - 0.00% -
544.nab_r (avg) -2.44% 41.000 40.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 4.35% 23.000 24.000 - 4.35% -

Added Tests - Code Size
527.cam4_r

Added Tests - Execution
527.cam4_r

Added Tests - sample variability
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)

Report Time: 0.37s
Execution (seconds)
Name Current %
500.perlbench_r 15449.000 -
502.gcc_r 10899.000 -
503.bwaves_r 20800.000 -
505.mcf_r 14090.000 -
507.cactuBSSN_r 11489.000 -
508.namd_r 9526.000 -
510.parest_r 22872.000 -
511.povray_r 20249.000 -
519.lbm_r 15362.000 -
520.omnetpp_r 14564.000 -
521.wrf_r 13326.000 1.51%
525.x264_r 6056.000 -
526.blender_r 11907.000 -
527.cam4_r 13688.000 -
531.deepsjeng_r 8562.000 -
538.imagick_r 13987.000 -
541.leela_r 13266.000 -
544.nab_r 14350.000 -
548.exchange2_r 17050.000 -
549.fotonik3d_r 22480.000 -
554.roms_r 20351.000 -
557.xz_r 11275.000 -
Geometric Mean 13933.074 -
Code Size (bytes)
Name Current %
500.perlbench_r 2142761.000 -
502.gcc_r 8920916.000 -
503.bwaves_r 797740.000 -
505.mcf_r 27059.000 -
507.cactuBSSN_r 3665927.000 -
508.namd_r 610693.000 -
510.parest_r 8606180.000 -
511.povray_r 911671.000 -
519.lbm_r 13287.000 -
520.omnetpp_r 2152157.000 -
521.wrf_r 22366083.000 -
525.x264_r 496306.000 -
526.blender_r 13677191.000 -
527.cam4_r 9186171.000 -
531.deepsjeng_r 81426.000 -
538.imagick_r 1693985.000 -
541.leela_r 144127.000 -
544.nab_r 191048.000 -
548.exchange2_r 2563540.000 -2.82%
549.fotonik3d_r 1222261.000 -
554.roms_r 3118224.000 -2.39%
557.xz_r 177120.000 -
Geometric Mean 1029601.630 -
Score
Name Current %
nb_compile_successful 22.000 -4.35%
nb_execution_successful 22.000 -4.35%
nb_total_tests 24.000 4.35%
Geometric Mean 22.647 -1.53%
sample variability
Name Current %
500.perlbench_r 97.000 7.78%
500.perlbench_r (avg) 97.000 7.78%
500.perlbench_r (avg) (percentage) 0.630 6.78%
500.perlbench_r (max) 220.000 292.86%
500.perlbench_r (max) (percentage) 1.430 286.49%
500.perlbench_r (unexplained diff vs previous) 60.000 122.22%
500.perlbench_r (unexplained diff vs previous) (percentage) 0.390 116.67%
503.bwaves_r 16.000 -
503.bwaves_r (avg) 16.000 -
503.bwaves_r (avg) (percentage) 0.080 -
503.bwaves_r (max) 35.000 12.90%
503.bwaves_r (max) (percentage) 0.170 13.33%
503.bwaves_r (unexplained diff vs previous) 36.000 620.00%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.170 750.00%
505.mcf_r 45.000 -2.17%
505.mcf_r (avg) 45.000 -2.17%
505.mcf_r (avg) (percentage) 0.320 -3.03%
505.mcf_r (max) 12.000 -81.82%
505.mcf_r (max) (percentage) 0.090 -80.85%
505.mcf_r (unexplained diff vs previous) 12.000 -81.82%
505.mcf_r (unexplained diff vs previous) (percentage) 0.090 -80.85%
507.cactuBSSN_r 1.000 -
507.cactuBSSN_r (avg) 1.000 -
507.cactuBSSN_r (avg) (percentage) 0.010 -
507.cactuBSSN_r (max) 1.000 -
507.cactuBSSN_r (max) (percentage) 0.010 -
508.namd_r 24.000 4.35%
508.namd_r (avg) 24.000 4.35%
508.namd_r (avg) (percentage) 0.260 4.00%
508.namd_r (max) 28.000 180.00%
508.namd_r (max) (percentage) 0.300 172.73%
508.namd_r (unexplained diff vs previous) 16.000 77.78%
508.namd_r (unexplained diff vs previous) (percentage) 0.170 88.89%
510.parest_r 50.000 4.17%
510.parest_r (avg) 50.000 4.17%
510.parest_r (avg) (percentage) 0.220 4.76%
510.parest_r (max) 57.000 14.00%
510.parest_r (max) (percentage) 0.250 13.64%
510.parest_r (unexplained diff vs previous) 57.000 83.87%
510.parest_r (unexplained diff vs previous) (percentage) 0.250 78.57%
511.povray_r 103.000 4.04%
511.povray_r (avg) 103.000 4.04%
511.povray_r (avg) (percentage) 0.510 4.08%
511.povray_r (max) 263.000 26.44%
511.povray_r (max) (percentage) 1.300 26.21%
511.povray_r (unexplained diff vs previous) 240.000 943.48%
511.povray_r (unexplained diff vs previous) (percentage) 1.190 981.82%
519.lbm_r 43.000 4.88%
519.lbm_r (avg) 43.000 4.88%
519.lbm_r (avg) (percentage) 0.280 3.70%
519.lbm_r (max) 107.000 12.63%
519.lbm_r (max) (percentage) 0.700 12.90%
519.lbm_r (unexplained diff vs previous) 107.000 2040.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.700 2233.33%
520.omnetpp_r 164.000 6.49%
520.omnetpp_r (avg) 164.000 6.49%
520.omnetpp_r (avg) (percentage) 1.130 6.60%
520.omnetpp_r (max) 99.000 6.45%
520.omnetpp_r (max) (percentage) 0.680 6.25%
520.omnetpp_r (unexplained diff vs previous) 26.000 13.04%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.180 12.50%
521.wrf_r 179.000 11.88%
521.wrf_r (avg) 179.000 11.88%
521.wrf_r (avg) (percentage) 1.350 10.66%
521.wrf_r (max) 271.000 3.83%
521.wrf_r (max) (percentage) 2.040 2.51%
521.wrf_r (unexplained diff vs previous) 26.000 -54.39%
521.wrf_r (unexplained diff vs previous) (percentage) 0.200 -53.49%
523.xalancbmk_r (avg) (percentage) 0.200 5.26%
523.xalancbmk_r (max) (percentage) 0.140 -
525.x264_r 12.000 9.09%
525.x264_r (avg) 12.000 9.09%
525.x264_r (avg) (percentage) 0.200 5.26%
525.x264_r (max) 29.000 16.00%
525.x264_r (max) (percentage) 0.490 16.67%
525.x264_r (unexplained diff vs previous) 30.000 172.73%
525.x264_r (unexplained diff vs previous) (percentage) 0.500 177.78%
526.blender_r 110.000 -
526.blender_r (avg) 110.000 -
526.blender_r (avg) (percentage) 0.930 -
526.blender_r (max) 516.000 7.28%
526.blender_r (max) (percentage) 4.340 7.16%
526.blender_r (unexplained diff vs previous) 4.000 -96.43%
526.blender_r (unexplained diff vs previous) (percentage) 0.030 -96.81%
527.cam4_r 53.000 -17.19%
527.cam4_r (avg) 53.000 -17.19%
527.cam4_r (avg) (percentage) 0.390 -17.02%
527.cam4_r (max) 127.000 1.60%
527.cam4_r (max) (percentage) 0.930 1.09%
527.cam4_r (unexplained diff vs previous) 21.000 -82.50%
527.cam4_r (unexplained diff vs previous) (percentage) 0.150 -82.95%
531.deepsjeng_r 41.000 10.81%
531.deepsjeng_r (avg) 41.000 10.81%
531.deepsjeng_r (avg) (percentage) 0.480 9.09%
531.deepsjeng_r (max) 69.000 9.52%
531.deepsjeng_r (max) (percentage) 0.810 9.46%
531.deepsjeng_r (unexplained diff vs previous) 26.000 85.71%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.300 87.50%
538.imagick_r 26.000 -
538.imagick_r (avg) 26.000 -
538.imagick_r (avg) (percentage) 0.190 -
538.imagick_r (max) 69.000 7.81%
538.imagick_r (max) (percentage) 0.500 8.70%
538.imagick_r (unexplained diff vs previous) 4.000 -84.62%
538.imagick_r (unexplained diff vs previous) (percentage) 0.030 -84.21%
541.leela_r 46.000 6.98%
541.leela_r (avg) 46.000 6.98%
541.leela_r (avg) (percentage) 0.350 6.06%
541.leela_r (max) 86.000 4.88%
541.leela_r (max) (percentage) 0.650 4.84%
541.leela_r (unexplained diff vs previous) 48.000 700.00%
541.leela_r (unexplained diff vs previous) (percentage) 0.360 620.00%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 44.000 2.33%
544.nab_r (max) (percentage) 0.310 3.33%
544.nab_r (unexplained diff vs previous) 1.000 -97.67%
544.nab_r (unexplained diff vs previous) (percentage) 0.010 -96.67%
548.exchange2_r 22.000 10.00%
548.exchange2_r (avg) 22.000 10.00%
548.exchange2_r (avg) (percentage) 0.130 8.33%
548.exchange2_r (max) 32.000 88.24%
548.exchange2_r (max) (percentage) 0.190 90.00%
548.exchange2_r (unexplained diff vs previous) 5.000 66.67%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.030 -
549.fotonik3d_r 137.000 2.24%
549.fotonik3d_r (avg) 137.000 2.24%
549.fotonik3d_r (avg) (percentage) 0.610 1.67%
549.fotonik3d_r (max) 323.000 84.57%
549.fotonik3d_r (max) (percentage) 1.440 84.62%
549.fotonik3d_r (unexplained diff vs previous) 231.000 122.12%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 1.030 123.91%
554.roms_r 46.000 -
554.roms_r (avg) 46.000 -
554.roms_r (avg) (percentage) 0.230 -
554.roms_r (max) 111.000 12.12%
554.roms_r (max) (percentage) 0.550 12.24%
554.roms_r (unexplained diff vs previous) 112.000 202.70%
554.roms_r (unexplained diff vs previous) (percentage) 0.550 205.56%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 7.000 16.67%
557.xz_r (max) (percentage) 0.070 16.67%
557.xz_r (unexplained diff vs previous) 8.000 14.29%
557.xz_r (unexplained diff vs previous) (percentage) 0.070 16.67%
Geometric Mean 4.509 10.02%