Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e8e7cf2abe04d5691eb8e31cd18589ec9eb78635 (+ 5 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (f8cd181e2d1d5541681ea7e3e92c8da46b048979) (+ 12 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=58272284b633e5fd17293abdc55d56e546a1b02a (+ 8 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/cc2fbfb820fc476698d05a3b39f083124e82b2a3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/349/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0349 (3-changed-components) 2024-12-30T17:22:04 0:00:00
Previous 0348 (basepoints/gcc-15-06471-gefc0981077a) 2024-12-29T02:44:12 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 126 12
Performance Improvements 3 179
Added Tests 4 0
Unchanged Tests 1103 1045
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 10.61% 1838.000 2033.000 - 42.77% -
401.bzip2 6.77% 2912.000 3109.000 - 5.71% -
437.leslie3d 6.06% 11040.000 11709.000 - 0.59% -
482.sphinx3 4.97% 805.000 845.000 - -10.58% -
450.soplex 4.68% 556.000 582.000 - 2.65% -
473.astar 4.11% 4913.000 5115.000 - -0.25% -
471.omnetpp 3.84% 2631.000 2732.000 - 0.29% -
433.milc 2.74% 1130.000 1161.000 - 0.87% -
465.tonto 2.37% 10838.000 11095.000 - 1.41% -
462.libquantum 2.26% 133.000 136.000 - -2.86% -
459.GemsFDTD 2.10% 5274.000 5385.000 - -12.77% -
453.povray 1.86% 539.000 549.000 - 0.37% -
435.gromacs 1.71% 7035.000 7155.000 - -1.57% -
410.bwaves 1.65% 5834.000 5930.000 - 4.92% -
445.gobmk 1.58% 4818.000 4894.000 - -2.57% -
447.dealII 1.37% 1602.000 1624.000 - -5.80% -
434.zeusmp 1.32% 2271.000 2301.000 - -8.47% -
470.lbm 1.24% 3788.000 3835.000 - 1.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 3840.00% 5.000 197.000 - -98.18% -
401.bzip2 (unexplained diff vs previous) (percentage) 3629.41% 0.170 6.340 - -98.28% -
410.bwaves (unexplained diff vs previous) 1271.43% 7.000 96.000 - -98.77% -
410.bwaves (unexplained diff vs previous) (percentage) 1250.00% 0.120 1.620 - -98.83% -
450.soplex (unexplained diff vs previous) 1200.00% 2.000 26.000 - -99.82% -
450.soplex (unexplained diff vs previous) (percentage) 1141.67% 0.360 4.470 - -99.83% -
435.gromacs (unexplained diff vs previous) 990.91% 11.000 120.000 - -98.29% -
435.gromacs (unexplained diff vs previous) (percentage) 950.00% 0.160 1.680 - -98.26% -
473.astar (unexplained diff vs previous) 910.00% 20.000 202.000 - -98.01% -
473.astar (unexplained diff vs previous) (percentage) 863.41% 0.410 3.950 - -98.00% -
429.mcf (max) 795.83% 24.000 215.000 - -83.74% -
429.mcf (unexplained diff vs previous) 786.36% 22.000 195.000 - -98.95% -
401.bzip2 (max) 775.00% 24.000 210.000 - -90.92% -
401.bzip2 (max) (percentage) 715.66% 0.830 6.770 - -91.39% -
429.mcf (max) (percentage) 709.92% 1.310 10.610 - -88.58% -
429.mcf (unexplained diff vs previous) (percentage) 699.17% 1.200 9.590 - -99.27% -
459.GemsFDTD (unexplained diff vs previous) 692.86% 14.000 111.000 - -99.28% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 662.96% 0.270 2.060 - -99.18% -
434.zeusmp (max) 650.00% 4.000 30.000 - -98.54% -
434.zeusmp (max) (percentage) 633.33% 0.180 1.320 - -98.39% -
445.gobmk (max) 541.67% 12.000 77.000 - -97.09% -
445.gobmk (unexplained diff vs previous) 533.33% 12.000 76.000 - -98.64% -
445.gobmk (max) (percentage) 532.00% 0.250 1.580 - -97.00% -
445.gobmk (unexplained diff vs previous) (percentage) 520.00% 0.250 1.550 - -98.60% -
482.sphinx3 (max) 485.71% 7.000 41.000 - -95.50% -
473.astar (max) 483.33% 36.000 210.000 - -93.83% -
471.omnetpp (max) 477.78% 18.000 104.000 - -95.21% -
471.omnetpp (unexplained diff vs previous) 461.11% 18.000 101.000 - -99.05% -
471.omnetpp (max) (percentage) 456.52% 0.690 3.840 - -95.18% -
473.astar (max) (percentage) 455.41% 0.740 4.110 - -93.81% -
471.omnetpp (unexplained diff vs previous) (percentage) 444.12% 0.680 3.700 - -99.05% -
458.sjeng (unexplained diff vs previous) (percentage) 407.69% 0.130 0.660 - -99.27% -
482.sphinx3 (max) (percentage) 407.14% 0.980 4.970 - -94.85% -
482.sphinx3 (unexplained diff vs previous) 400.00% 8.000 40.000 - -99.85% -
458.sjeng (unexplained diff vs previous) 390.00% 10.000 49.000 - -99.29% -
482.sphinx3 (unexplained diff vs previous) (percentage) 377.78% 0.990 4.730 - -99.83% -
433.milc (max) 287.50% 8.000 31.000 - -97.03% -
433.milc (unexplained diff vs previous) 287.50% 8.000 31.000 - -99.73% -
433.milc (max) (percentage) 280.56% 0.720 2.740 - -96.98% -
433.milc (unexplained diff vs previous) (percentage) 276.06% 0.710 2.670 - -99.73% -
437.leslie3d (unexplained diff vs previous) 255.85% 188.000 669.000 - -71.09% -
458.sjeng (max) 250.00% 14.000 49.000 - -98.64% -
458.sjeng (max) (percentage) 247.37% 0.190 0.660 - -98.61% -
450.soplex (max) 237.50% 8.000 27.000 - -95.05% -
437.leslie3d (unexplained diff vs previous) (percentage) 235.88% 1.700 5.710 - -71.28% -
450.soplex (max) (percentage) 214.09% 1.490 4.680 - -95.14% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - -99.98% -
462.libquantum (unexplained diff vs previous) (percentage) 194.67% 0.750 2.210 - -99.98% -
459.GemsFDTD (max) 169.05% 42.000 113.000 - -97.44% -
459.GemsFDTD (max) (percentage) 162.50% 0.800 2.100 - -97.06% -
410.bwaves (max) 110.87% 46.000 97.000 - -97.04% -
410.bwaves (max) (percentage) 106.25% 0.800 1.650 - -97.15% -
444.namd (unexplained diff vs previous) 100.00% 3.000 6.000 - -99.93% -
444.namd (unexplained diff vs previous) (percentage) 97.56% 0.410 0.810 - -99.93% -
437.leslie3d (max) 90.08% 373.000 709.000 - -63.25% -
437.leslie3d (max) (percentage) 79.29% 3.380 6.060 - -63.45% -
465.tonto (max) 77.03% 148.000 262.000 - -87.59% -
465.tonto (max) (percentage) 72.99% 1.370 2.370 - -87.73% -
470.lbm (max) 51.61% 31.000 47.000 - -98.29% -
435.gromacs (max) 50.62% 81.000 122.000 - -96.59% -
462.libquantum (max) 50.00% 2.000 3.000 - -97.83% -
470.lbm (max) (percentage) 47.62% 0.840 1.240 - -98.29% -
435.gromacs (max) (percentage) 47.41% 1.160 1.710 - -96.52% -
447.dealII (max) 37.50% 16.000 22.000 - -98.41% -
447.dealII (max) (percentage) 33.01% 1.030 1.370 - -98.29% -
462.libquantum (max) (percentage) 24.86% 1.810 2.260 - -97.72% -
429.mcf 12.20% 82.000 92.000 - -15.60% -
429.mcf (avg) 12.20% 82.000 92.000 - -15.60% -
453.povray (unexplained diff vs previous) 11.11% 9.000 10.000 - -99.82% -
401.bzip2 10.53% 38.000 42.000 - -73.91% -
401.bzip2 (avg) 10.53% 38.000 42.000 - -73.91% -
453.povray (unexplained diff vs previous) (percentage) 8.98% 1.670 1.820 - -99.83% -
450.soplex 8.33% 12.000 13.000 - -63.89% -
450.soplex (avg) 8.33% 12.000 13.000 - -63.89% -
482.sphinx3 7.69% 13.000 14.000 - -81.08% -
482.sphinx3 (avg) 7.69% 13.000 14.000 - -81.08% -
437.leslie3d 6.64% 482.000 514.000 - 44.79% -
437.leslie3d (avg) 6.64% 482.000 514.000 - 44.79% -
447.dealII 5.88% 17.000 18.000 - -81.82% -
447.dealII (avg) 5.88% 17.000 18.000 - -81.82% -
473.astar 5.48% 73.000 77.000 - -63.85% -
473.astar (avg) 5.48% 73.000 77.000 - -63.85% -
434.zeusmp 5.26% 19.000 20.000 - -86.39% -
434.zeusmp (avg) 5.26% 19.000 20.000 - -86.39% -
401.bzip2 (avg) (percentage) 4.55% 1.320 1.380 - -74.82% -
471.omnetpp 3.85% 52.000 54.000 - -75.78% -
471.omnetpp (avg) 3.85% 52.000 54.000 - -75.78% -
465.tonto 3.79% 132.000 137.000 - -62.47% -
465.tonto (avg) 3.79% 132.000 137.000 - -62.47% -
470.lbm 3.45% 29.000 30.000 - -87.45% -
470.lbm (avg) 3.45% 29.000 30.000 - -87.45% -
459.GemsFDTD 3.12% 64.000 66.000 - -81.67% -
459.GemsFDTD (avg) 3.12% 64.000 66.000 - -81.67% -
445.gobmk 2.56% 39.000 40.000 - -79.59% -
445.gobmk (avg) 2.56% 39.000 40.000 - -79.59% -
410.bwaves 2.13% 47.000 48.000 - -80.72% -
410.bwaves (avg) 2.13% 47.000 48.000 - -80.72% -
482.sphinx3 (avg) (percentage) 1.83% 1.640 1.670 - -78.94% -
433.milc (avg) (percentage) 1.69% 1.180 1.200 - -80.17% -
435.gromacs 1.67% 120.000 122.000 - -66.76% -
435.gromacs (avg) 1.67% 120.000 122.000 - -66.76% -
465.tonto (avg) (percentage) 1.64% 1.220 1.240 - -62.87% -
429.mcf (avg) (percentage) 1.34% 4.480 4.540 - -40.81% -
473.astar (avg) (percentage) 1.33% 1.500 1.520 - -63.46% -
450.soplex (avg) (percentage) 1.29% 2.330 2.360 - -63.30% -
470.lbm (avg) (percentage) 1.28% 0.780 0.790 - -87.52% -
445.gobmk (avg) (percentage) 1.22% 0.820 0.830 - -78.77% -
434.zeusmp (avg) (percentage) 1.15% 0.870 0.880 - -84.96% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) -14.29% 7.000 6.000 - -99.12% -
444.namd (max) (percentage) -4.12% 0.970 0.930 - -98.99% -
453.povray (max) (percentage) -2.65% 2.640 2.570 - -97.18% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.35% 1946163.000 1972475.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 42.77% 1424.000 2033.000 - 10.61% -
401.bzip2 5.71% 2941.000 3109.000 - 6.77% -
410.bwaves 4.92% 5652.000 5930.000 - 1.65% -
450.soplex 2.65% 567.000 582.000 - 4.68% -
465.tonto 1.41% 10941.000 11095.000 - 2.37% -
470.lbm 1.24% 3788.000 3835.000 - 1.24% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 44.79% 355.000 514.000 - 6.64% -
437.leslie3d (avg) 44.79% 355.000 514.000 - 6.64% -
437.leslie3d (avg) (percentage) 43.93% 3.050 4.390 - 0.46% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.90% 59479.000 54186.000 - 0.00% -
459.GemsFDTD -5.47% 244728.000 231344.000 - 0.00% -
444.namd -3.27% 188385.000 182220.000 - 0.00% -
447.dealII -2.16% 311591.000 304870.000 - 0.00% -
435.gromacs -1.86% 499261.000 489954.000 - 0.00% -
410.bwaves -1.84% 16760.000 16452.000 - 0.00% -
453.povray -1.82% 661389.000 649324.000 - 0.00% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.46% 61382.000 60488.000 - 0.00% -
458.sjeng -1.44% 104048.000 102551.000 - 0.00% -
450.soplex -1.33% 205081.000 202350.000 - 0.00% -
473.astar -1.18% 22968.000 22696.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
482.sphinx3 -1.04% 112859.000 111690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -12.77% 6173.000 5385.000 - 2.10% -
482.sphinx3 -10.58% 945.000 845.000 - 4.97% -
434.zeusmp -8.47% 2514.000 2301.000 - 1.32% -
447.dealII -5.80% 1724.000 1624.000 - 1.37% -
462.libquantum -2.86% 140.000 136.000 - 2.26% -
445.gobmk -2.57% 5023.000 4894.000 - 1.58% -
435.gromacs -1.57% 7269.000 7155.000 - 1.71% -
458.sjeng -1.45% 7567.000 7457.000 - 0.66% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - 200.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.210 - 194.67% -
444.namd (unexplained diff vs previous) -99.93% 8356.000 6.000 - 100.00% -
444.namd (unexplained diff vs previous) (percentage) -99.93% 1118.610 0.810 - 97.56% -
482.sphinx3 (unexplained diff vs previous) -99.85% 26073.000 40.000 - 400.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.83% 2759.050 4.730 - 377.78% -
453.povray (unexplained diff vs previous) (percentage) -99.83% 1043.330 1.820 - 8.98% -
450.soplex (unexplained diff vs previous) (percentage) -99.83% 2557.320 4.470 - 1141.67% -
453.povray (unexplained diff vs previous) -99.82% 5707.000 10.000 - 11.11% -
450.soplex (unexplained diff vs previous) -99.82% 14500.000 26.000 - 1200.00% -
434.zeusmp (unexplained diff vs previous) -99.73% 11280.000 30.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.73% 980.800 2.670 - 276.06% -
433.milc (unexplained diff vs previous) -99.73% 11289.000 31.000 - 287.50% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.71% 448.690 1.300 - 0.00% -
447.dealII (unexplained diff vs previous) -99.69% 7017.000 22.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.67% 407.020 1.350 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.53% 263.730 1.230 - 0.00% -
470.lbm (unexplained diff vs previous) -99.53% 9990.000 47.000 - 0.00% -
456.hmmer (max) (percentage) -99.50% 73.590 0.370 - 0.00% -
464.h264ref (max) (percentage) -99.30% 54.290 0.380 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.29% 6876.000 49.000 - 390.00% -
459.GemsFDTD (unexplained diff vs previous) -99.28% 15458.000 111.000 - 692.86% -
458.sjeng (unexplained diff vs previous) (percentage) -99.27% 90.870 0.660 - 407.69% -
429.mcf (unexplained diff vs previous) (percentage) -99.27% 1305.690 9.590 - 699.17% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.18% 250.410 2.060 - 662.96% -
444.namd (max) -99.12% 685.000 6.000 - -14.29% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.05% 391.300 3.700 - 444.12% -
471.omnetpp (unexplained diff vs previous) -99.05% 10659.000 101.000 - 461.11% -
436.cactusADM (max) (percentage) -99.01% 88.730 0.880 - 0.00% -
444.namd (max) (percentage) -98.99% 91.790 0.930 - -4.12% -
429.mcf (unexplained diff vs previous) -98.95% 18593.000 195.000 - 786.36% -
481.wrf (max) (percentage) -98.84% 68.700 0.800 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -98.83% 137.900 1.620 - 1250.00% -
410.bwaves (unexplained diff vs previous) -98.77% 7794.000 96.000 - 1271.43% -
458.sjeng (max) -98.64% 3602.000 49.000 - 250.00% -
445.gobmk (unexplained diff vs previous) -98.64% 5581.000 76.000 - 533.33% -
458.sjeng (max) (percentage) -98.61% 47.610 0.660 - 247.37% -
445.gobmk (unexplained diff vs previous) (percentage) -98.60% 111.110 1.550 - 520.00% -
434.zeusmp (max) -98.54% 2055.000 30.000 - 650.00% -
447.dealII (max) -98.41% 1384.000 22.000 - 37.50% -
434.zeusmp (max) (percentage) -98.39% 81.770 1.320 - 633.33% -
447.dealII (max) (percentage) -98.29% 80.280 1.370 - 33.01% -
435.gromacs (unexplained diff vs previous) -98.29% 7028.000 120.000 - 990.91% -
470.lbm (max) (percentage) -98.29% 72.510 1.240 - 47.62% -
470.lbm (max) -98.29% 2746.000 47.000 - 51.61% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.28% 368.340 6.340 - 3629.41% -
435.gromacs (unexplained diff vs previous) (percentage) -98.26% 96.680 1.680 - 950.00% -
401.bzip2 (unexplained diff vs previous) -98.18% 10833.000 197.000 - 3840.00% -
473.astar (unexplained diff vs previous) -98.01% 10146.000 202.000 - 910.00% -
473.astar (unexplained diff vs previous) (percentage) -98.00% 197.850 3.950 - 863.41% -
462.libquantum (max) -97.83% 138.000 3.000 - 50.00% -
462.libquantum (max) (percentage) -97.72% 98.970 2.260 - 24.86% -
459.GemsFDTD (max) -97.44% 4411.000 113.000 - 169.05% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) (percentage) -97.31% 84.060 2.260 - -0.88% -
453.povray (max) -97.19% 499.000 14.000 - 0.00% -
453.povray (max) (percentage) -97.18% 91.250 2.570 - -2.65% -
410.bwaves (max) (percentage) -97.15% 57.970 1.650 - 106.25% -
445.gobmk (max) -97.09% 2643.000 77.000 - 541.67% -
459.GemsFDTD (max) (percentage) -97.06% 71.460 2.100 - 162.50% -
410.bwaves (max) -97.04% 3276.000 97.000 - 110.87% -
433.milc (max) -97.03% 1044.000 31.000 - 287.50% -
445.gobmk (max) (percentage) -97.00% 52.630 1.580 - 532.00% -
433.milc (max) (percentage) -96.98% 90.750 2.740 - 280.56% -
435.gromacs (max) -96.59% 3573.000 122.000 - 50.62% -
435.gromacs (max) (percentage) -96.52% 49.160 1.710 - 47.41% -
403.gcc (max) (percentage) -96.26% 99.360 3.720 - -0.27% -
482.sphinx3 (max) -95.50% 911.000 41.000 - 485.71% -
471.omnetpp (max) -95.21% 2169.000 104.000 - 477.78% -
471.omnetpp (max) (percentage) -95.18% 79.650 3.840 - 456.52% -
450.soplex (max) (percentage) -95.14% 96.240 4.680 - 214.09% -
450.soplex (max) -95.05% 545.000 27.000 - 237.50% -
482.sphinx3 (max) (percentage) -94.85% 96.500 4.970 - 407.14% -
473.astar (max) -93.83% 3406.000 210.000 - 483.33% -
473.astar (max) (percentage) -93.81% 66.430 4.110 - 455.41% -
401.bzip2 (max) (percentage) -91.39% 78.650 6.770 - 715.66% -
401.bzip2 (max) -90.92% 2313.000 210.000 - 775.00% -
429.mcf (max) (percentage) -88.58% 92.890 10.610 - 709.92% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
465.tonto (max) (percentage) -87.73% 19.310 2.370 - 72.99% -
444.namd (avg) (percentage) -87.64% 9.220 1.140 - 0.00% -
465.tonto (max) -87.59% 2112.000 262.000 - 77.03% -
470.lbm (avg) (percentage) -87.52% 6.330 0.790 - 1.28% -
470.lbm -87.45% 239.000 30.000 - 3.45% -
470.lbm (avg) -87.45% 239.000 30.000 - 3.45% -
434.zeusmp -86.39% 147.000 20.000 - 5.26% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 5.26% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -85.67% 16.190 2.320 - 0.00% -
465.tonto (unexplained diff vs previous) -85.49% 1771.000 257.000 - 0.00% -
434.zeusmp (avg) (percentage) -84.96% 5.850 0.880 - 1.15% -
429.mcf (max) -83.74% 1322.000 215.000 - 795.83% -
458.sjeng -82.99% 241.000 41.000 - 0.00% -
458.sjeng (avg) -82.99% 241.000 41.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
458.sjeng (avg) (percentage) -82.45% 3.190 0.560 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 5.88% -
447.dealII (avg) -81.82% 99.000 18.000 - 5.88% -
459.GemsFDTD -81.67% 360.000 66.000 - 3.12% -
459.GemsFDTD (avg) -81.67% 360.000 66.000 - 3.12% -
410.bwaves (avg) (percentage) -81.41% 4.410 0.820 - 0.00% -
433.milc -81.16% 69.000 13.000 - 0.00% -
433.milc (avg) -81.16% 69.000 13.000 - 0.00% -
482.sphinx3 -81.08% 74.000 14.000 - 7.69% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 7.69% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
410.bwaves -80.72% 249.000 48.000 - 2.13% -
410.bwaves (avg) -80.72% 249.000 48.000 - 2.13% -
447.dealII (avg) (percentage) -80.59% 5.770 1.120 - 0.00% -
433.milc (avg) (percentage) -80.17% 6.050 1.200 - 1.69% -
453.povray (avg) (percentage) -80.03% 7.810 1.560 - 0.65% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
445.gobmk -79.59% 196.000 40.000 - 2.56% -
445.gobmk (avg) -79.59% 196.000 40.000 - 2.56% -
482.sphinx3 (avg) (percentage) -78.94% 7.930 1.670 - 1.83% -
445.gobmk (avg) (percentage) -78.77% 3.910 0.830 - 1.22% -
459.GemsFDTD (avg) (percentage) -78.77% 5.840 1.240 - 0.81% -
462.libquantum (avg) (percentage) -75.98% 7.660 1.840 - 0.00% -
471.omnetpp -75.78% 223.000 54.000 - 3.85% -
471.omnetpp (avg) -75.78% 223.000 54.000 - 3.85% -
471.omnetpp (avg) (percentage) -75.49% 8.200 2.010 - 0.50% -
401.bzip2 (avg) (percentage) -74.82% 5.480 1.380 - 4.55% -
401.bzip2 -73.91% 161.000 42.000 - 10.53% -
401.bzip2 (avg) -73.91% 161.000 42.000 - 10.53% -
437.leslie3d (unexplained diff vs previous) (percentage) -71.28% 19.880 5.710 - 235.88% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
437.leslie3d (unexplained diff vs previous) -71.09% 2314.000 669.000 - 255.85% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs -66.76% 367.000 122.000 - 1.67% -
435.gromacs (avg) -66.76% 367.000 122.000 - 1.67% -
435.gromacs (avg) (percentage) -66.21% 5.060 1.710 - 0.00% -
450.soplex -63.89% 36.000 13.000 - 8.33% -
450.soplex (avg) -63.89% 36.000 13.000 - 8.33% -
473.astar -63.85% 213.000 77.000 - 5.48% -
473.astar (avg) -63.85% 213.000 77.000 - 5.48% -
473.astar (avg) (percentage) -63.46% 4.160 1.520 - 1.33% -
437.leslie3d (max) (percentage) -63.45% 16.580 6.060 - 79.29% -
450.soplex (avg) (percentage) -63.30% 6.430 2.360 - 1.29% -
437.leslie3d (max) -63.25% 1929.000 709.000 - 90.08% -
465.tonto (avg) (percentage) -62.87% 3.340 1.240 - 1.64% -
465.tonto -62.47% 365.000 137.000 - 3.79% -
465.tonto (avg) -62.47% 365.000 137.000 - 3.79% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -40.81% 7.670 4.540 - 1.34% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -15.60% 109.000 92.000 - 12.20% -
429.mcf (avg) -15.60% 109.000 92.000 - 12.20% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -


Report Time: 0.38s
Name Current %
401.bzip2 3109.000 6.77%
410.bwaves 5930.000 1.65%
429.mcf 2033.000 10.61%
433.milc 1161.000 2.74%
434.zeusmp 2301.000 1.32%
435.gromacs 7155.000 1.71%
437.leslie3d 11709.000 6.06%
444.namd 744.000 -
445.gobmk 4894.000 1.58%
447.dealII 1624.000 1.37%
450.soplex 582.000 4.68%
453.povray 549.000 1.86%
458.sjeng 7457.000 -
459.GemsFDTD 5385.000 2.10%
462.libquantum 136.000 2.26%
465.tonto 11095.000 2.37%
470.lbm 3835.000 1.24%
471.omnetpp 2732.000 3.84%
473.astar 5115.000 4.11%
482.sphinx3 845.000 4.97%
Geometric Mean 2409.454 3.11%
Name Current %
401.bzip2 43711.000 -
410.bwaves 16452.000 -
429.mcf 9086.000 -
433.milc 60488.000 -
434.zeusmp 151959.000 -
435.gromacs 489954.000 -
437.leslie3d 54186.000 -
444.namd 182220.000 -
445.gobmk 1375074.000 -
447.dealII 304870.000 -
450.soplex 202350.000 -
453.povray 649324.000 -
458.sjeng 102551.000 -
459.GemsFDTD 231344.000 -
462.libquantum 15797.000 -
465.tonto 1972475.000 -
470.lbm 9547.000 -
471.omnetpp 475181.000 -
473.astar 22696.000 -
482.sphinx3 111690.000 -
Geometric Mean 113942.247 -
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.260 -
401.bzip2 42.000 10.53%
401.bzip2 (avg) 42.000 10.53%
401.bzip2 (avg) (percentage) 1.380 4.55%
401.bzip2 (max) 210.000 775.00%
401.bzip2 (max) (percentage) 6.770 715.66%
401.bzip2 (unexplained diff vs previous) 197.000 3840.00%
401.bzip2 (unexplained diff vs previous) (percentage) 6.340 3629.41%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.720 -
410.bwaves 48.000 2.13%
410.bwaves (avg) 48.000 2.13%
410.bwaves (avg) (percentage) 0.820 -
410.bwaves (max) 97.000 110.87%
410.bwaves (max) (percentage) 1.650 106.25%
410.bwaves (unexplained diff vs previous) 96.000 1271.43%
410.bwaves (unexplained diff vs previous) (percentage) 1.620 1250.00%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 92.000 12.20%
429.mcf (avg) 92.000 12.20%
429.mcf (avg) (percentage) 4.540 1.34%
429.mcf (max) 215.000 795.83%
429.mcf (max) (percentage) 10.610 709.92%
429.mcf (unexplained diff vs previous) 195.000 786.36%
429.mcf (unexplained diff vs previous) (percentage) 9.590 699.17%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.200 1.69%
433.milc (max) 31.000 287.50%
433.milc (max) (percentage) 2.740 280.56%
433.milc (unexplained diff vs previous) 31.000 287.50%
433.milc (unexplained diff vs previous) (percentage) 2.670 276.06%
434.zeusmp 20.000 5.26%
434.zeusmp (avg) 20.000 5.26%
434.zeusmp (avg) (percentage) 0.880 1.15%
434.zeusmp (max) 30.000 650.00%
434.zeusmp (max) (percentage) 1.320 633.33%
434.zeusmp (unexplained diff vs previous) 30.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 1.300 -
435.gromacs 122.000 1.67%
435.gromacs (avg) 122.000 1.67%
435.gromacs (avg) (percentage) 1.710 -
435.gromacs (max) 122.000 50.62%
435.gromacs (max) (percentage) 1.710 47.41%
435.gromacs (unexplained diff vs previous) 120.000 990.91%
435.gromacs (unexplained diff vs previous) (percentage) 1.680 950.00%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.880 -
437.leslie3d 514.000 6.64%
437.leslie3d (avg) 514.000 6.64%
437.leslie3d (avg) (percentage) 4.390 -
437.leslie3d (max) 709.000 90.08%
437.leslie3d (max) (percentage) 6.060 79.29%
437.leslie3d (unexplained diff vs previous) 669.000 255.85%
437.leslie3d (unexplained diff vs previous) (percentage) 5.710 235.88%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.140 -
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.930 -4.12%
444.namd (unexplained diff vs previous) 6.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.810 97.56%
445.gobmk 40.000 2.56%
445.gobmk (avg) 40.000 2.56%
445.gobmk (avg) (percentage) 0.830 1.22%
445.gobmk (max) 77.000 541.67%
445.gobmk (max) (percentage) 1.580 532.00%
445.gobmk (unexplained diff vs previous) 76.000 533.33%
445.gobmk (unexplained diff vs previous) (percentage) 1.550 520.00%
447.dealII 18.000 5.88%
447.dealII (avg) 18.000 5.88%
447.dealII (avg) (percentage) 1.120 -
447.dealII (max) 22.000 37.50%
447.dealII (max) (percentage) 1.370 33.01%
447.dealII (unexplained diff vs previous) 22.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.350 -
450.soplex 13.000 8.33%
450.soplex (avg) 13.000 8.33%
450.soplex (avg) (percentage) 2.360 1.29%
450.soplex (max) 27.000 237.50%
450.soplex (max) (percentage) 4.680 214.09%
450.soplex (unexplained diff vs previous) 26.000 1200.00%
450.soplex (unexplained diff vs previous) (percentage) 4.470 1141.67%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.560 -
453.povray (max) 14.000 -
453.povray (max) (percentage) 2.570 -2.65%
453.povray (unexplained diff vs previous) 10.000 11.11%
453.povray (unexplained diff vs previous) (percentage) 1.820 8.98%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.370 -
458.sjeng 41.000 -
458.sjeng (avg) 41.000 -
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 49.000 250.00%
458.sjeng (max) (percentage) 0.660 247.37%
458.sjeng (unexplained diff vs previous) 49.000 390.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.660 407.69%
459.GemsFDTD 66.000 3.12%
459.GemsFDTD (avg) 66.000 3.12%
459.GemsFDTD (avg) (percentage) 1.240 -
459.GemsFDTD (max) 113.000 169.05%
459.GemsFDTD (max) (percentage) 2.100 162.50%
459.GemsFDTD (unexplained diff vs previous) 111.000 692.86%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.060 662.96%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.840 -
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 2.260 24.86%
462.libquantum (unexplained diff vs previous) 3.000 200.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.210 194.67%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.380 -
465.tonto 137.000 3.79%
465.tonto (avg) 137.000 3.79%
465.tonto (avg) (percentage) 1.240 1.64%
465.tonto (max) 262.000 77.03%
465.tonto (max) (percentage) 2.370 72.99%
465.tonto (unexplained diff vs previous) 257.000 -
465.tonto (unexplained diff vs previous) (percentage) 2.320 -
470.lbm 30.000 3.45%
470.lbm (avg) 30.000 3.45%
470.lbm (avg) (percentage) 0.790 1.28%
470.lbm (max) 47.000 51.61%
470.lbm (max) (percentage) 1.240 47.62%
470.lbm (unexplained diff vs previous) 47.000 -
470.lbm (unexplained diff vs previous) (percentage) 1.230 -
471.omnetpp 54.000 3.85%
471.omnetpp (avg) 54.000 3.85%
471.omnetpp (avg) (percentage) 2.010 -
471.omnetpp (max) 104.000 477.78%
471.omnetpp (max) (percentage) 3.840 456.52%
471.omnetpp (unexplained diff vs previous) 101.000 461.11%
471.omnetpp (unexplained diff vs previous) (percentage) 3.700 444.12%
473.astar 77.000 5.48%
473.astar (avg) 77.000 5.48%
473.astar (avg) (percentage) 1.520 1.33%
473.astar (max) 210.000 483.33%
473.astar (max) (percentage) 4.110 455.41%
473.astar (unexplained diff vs previous) 202.000 910.00%
473.astar (unexplained diff vs previous) (percentage) 3.950 863.41%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.800 -
482.sphinx3 14.000 7.69%
482.sphinx3 (avg) 14.000 7.69%
482.sphinx3 (avg) (percentage) 1.670 1.83%
482.sphinx3 (max) 41.000 485.71%
482.sphinx3 (max) (percentage) 4.970 407.14%
482.sphinx3 (unexplained diff vs previous) 40.000 400.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 4.730 377.78%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.018 160.62%