Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2e792a78e495be6df4b8c0a3e41332c2f6dcd911 (+ 64 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (2089009210a1774c37e527ead8bbcaaa1a7a9d2d) (+ 236 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ca7d48a80f73129ac8492832d0bdbaa365c21ab7 (+ 37 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/e28a7fb32e05d3f388ec508ac5312dd10b10e2f7 (+ 149 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/336/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0336 (4-changed-components) 2024-12-08T09:33:48 0:00:00
Previous 0334 (4-changed-components) 2024-12-03T01:31:03 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 20 14
Performance Improvements 56 164
Added Tests 14 0
Unchanged Tests 1146 1058
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
453.povray 1.25% 649881.000 658001.000 - -0.51% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 3.32% 542.000 560.000 - 2.38% -
437.leslie3d 2.63% 10996.000 11285.000 - -3.05% -
462.libquantum 1.46% 137.000 139.000 - -0.71% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) (percentage) 464.71% 0.170 0.960 - -99.90% -
433.milc (unexplained diff vs previous) 450.00% 2.000 11.000 - -99.90% -
433.milc (max) 100.00% 5.000 10.000 - -99.04% -
433.milc (max) (percentage) 86.27% 0.510 0.950 - -98.95% -
473.astar (unexplained diff vs previous) (percentage) 13.33% 1.050 1.190 - -99.40% -
473.astar (unexplained diff vs previous) 12.96% 54.000 61.000 - -99.40% -
473.astar (max) (percentage) 11.32% 1.060 1.180 - -98.22% -
445.gobmk (max) 11.11% 18.000 20.000 - -99.24% -
473.astar (max) 11.11% 54.000 60.000 - -98.24% -
445.gobmk (max) (percentage) 10.81% 0.370 0.410 - -99.22% -
447.dealII 5.56% 18.000 19.000 - -80.81% -
447.dealII (avg) 5.56% 18.000 19.000 - -80.81% -
470.lbm 3.33% 30.000 31.000 - -87.03% -
470.lbm (avg) 3.33% 30.000 31.000 - -87.03% -
437.leslie3d 2.05% 487.000 497.000 - 40.00% -
437.leslie3d (avg) 2.05% 487.000 497.000 - 40.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -1.29% 2794.000 2758.000 - 1.25% -
473.astar -1.18% 5166.000 5105.000 - -0.45% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -65.71% 105.000 36.000 - -99.66% -
471.omnetpp (unexplained diff vs previous) (percentage) -65.16% 3.760 1.310 - -99.67% -
429.mcf (unexplained diff vs previous) -57.69% 26.000 11.000 - -99.94% -
429.mcf (unexplained diff vs previous) (percentage) -57.48% 1.270 0.540 - -99.96% -
462.libquantum (unexplained diff vs previous) (percentage) -34.25% 2.190 1.440 - -99.99% -
462.libquantum (max) -33.33% 3.000 2.000 - -98.55% -
462.libquantum (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.99% -
471.omnetpp (max) -25.93% 108.000 80.000 - -96.31% -
471.omnetpp (max) (percentage) -25.13% 3.900 2.920 - -96.33% -
437.leslie3d (max) (percentage) -19.08% 3.250 2.630 - -84.14% -
437.leslie3d (max) -17.09% 357.000 296.000 - -84.66% -
462.libquantum (max) (percentage) -10.91% 2.200 1.960 - -98.02% -
429.mcf (max) -7.14% 28.000 26.000 - -98.03% -
410.bwaves (max) (percentage) -6.25% 0.320 0.300 - -99.48% -
434.zeusmp (max) -5.88% 17.000 16.000 - -99.22% -
429.mcf (max) (percentage) -5.84% 1.370 1.290 - -98.61% -
410.bwaves (max) -5.56% 18.000 17.000 - -99.48% -
444.namd (max) (percentage) -5.52% 1.450 1.370 - -98.51% -
482.sphinx3 (max) (percentage) -5.23% 1.530 1.450 - -98.50% -
447.dealII (max) (percentage) -5.17% 0.580 0.550 - -99.31% -
401.bzip2 (max) -5.00% 20.000 19.000 - -99.18% -
435.gromacs (max) -5.00% 60.000 57.000 - -98.40% -
434.zeusmp -4.76% 21.000 20.000 - -86.39% -
434.zeusmp (avg) -4.76% 21.000 20.000 - -86.39% -
435.gromacs (max) (percentage) -4.76% 0.840 0.800 - -98.37% -
458.sjeng (max) -4.55% 66.000 63.000 - -98.25% -
453.povray (max) (percentage) -4.52% 1.770 1.690 - -98.15% -
458.sjeng (max) (percentage) -4.40% 0.910 0.870 - -98.17% -
401.bzip2 (max) (percentage) -4.35% 0.690 0.660 - -99.16% -
470.lbm (max) (percentage) -4.00% 0.750 0.720 - -99.01% -
459.GemsFDTD (max) (percentage) -3.91% 2.300 2.210 - -96.91% -
470.lbm (max) -3.57% 28.000 27.000 - -99.02% -
459.GemsFDTD (max) -3.28% 122.000 118.000 - -97.32% -
465.tonto (max) (percentage) -2.80% 1.070 1.040 - -94.61% -
434.zeusmp (max) (percentage) -2.70% 0.740 0.720 - -99.12% -
465.tonto (max) -2.52% 119.000 116.000 - -94.51% -
473.astar -2.47% 81.000 79.000 - -62.91% -
473.astar (avg) -2.47% 81.000 79.000 - -62.91% -
456.hmmer (max) (percentage) -2.38% 0.420 0.410 - -99.44% -
458.sjeng -2.33% 43.000 42.000 - -82.57% -
458.sjeng (avg) -2.33% 43.000 42.000 - -82.57% -
410.bwaves -2.00% 50.000 49.000 - -80.32% -
410.bwaves (avg) -2.00% 50.000 49.000 - -80.32% -
400.perlbench (max) (percentage) -1.98% 2.530 2.480 - -97.05% -
471.omnetpp -1.75% 57.000 56.000 - -74.89% -
471.omnetpp (avg) -1.75% 57.000 56.000 - -74.89% -
458.sjeng (avg) (percentage) -1.69% 0.590 0.580 - -81.82% -
410.bwaves (avg) (percentage) -1.18% 0.850 0.840 - -80.95% -
445.gobmk (avg) (percentage) -1.16% 0.860 0.850 - -78.26% -
434.zeusmp (avg) (percentage) -1.09% 0.920 0.910 - -84.44% -
436.cactusADM (max) (percentage) -1.09% 0.920 0.910 - -98.97% -
429.mcf -1.04% 96.000 95.000 - -12.84% -
429.mcf (avg) -1.04% 96.000 95.000 - -12.84% -
450.soplex (max) (percentage) -1.01% 2.960 2.930 - -96.96% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.32% 1946163.000 1971787.000 - -0.21% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 42.98% 1424.000 2036.000 - -0.54% -
410.bwaves 4.97% 5652.000 5933.000 - 0.22% -
401.bzip2 2.92% 2941.000 3027.000 - -0.39% -
450.soplex 2.47% 567.000 581.000 - 0.00% -
465.tonto 2.42% 10941.000 11206.000 - 0.51% -
453.povray 2.38% 547.000 560.000 - 3.32% -
470.lbm 1.27% 3788.000 3836.000 - 0.34% -
471.omnetpp 1.25% 2724.000 2758.000 - -1.29% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 44.59% 3.050 4.410 - -0.45% -
437.leslie3d 40.00% 355.000 497.000 - 2.05% -
437.leslie3d (avg) 40.00% 355.000 497.000 - 2.05% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.59% 59479.000 54370.000 - 0.00% -
459.GemsFDTD -4.94% 244728.000 232644.000 - 0.00% -
434.zeusmp -3.39% 152037.000 146883.000 - 0.00% -
444.namd -3.27% 188385.000 182224.000 - -0.01% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
447.dealII -1.73% 311591.000 306198.000 - -0.03% -
410.bwaves -1.69% 16760.000 16476.000 - 0.00% -
458.sjeng -1.67% 104048.000 102311.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.46% 61382.000 60484.000 - 0.00% -
450.soplex -1.30% 205081.000 202418.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
435.gromacs -1.09% 499261.000 493840.000 - 0.00% -
482.sphinx3 -1.01% 112859.000 111718.000 - 0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.46% 6173.000 5342.000 - 0.55% -
482.sphinx3 -11.01% 945.000 841.000 - 0.84% -
434.zeusmp -8.63% 2514.000 2297.000 - -0.22% -
447.dealII -3.77% 1724.000 1659.000 - 0.67% -
458.sjeng -3.22% 7567.000 7323.000 - 0.01% -
437.leslie3d -3.05% 11640.000 11285.000 - 2.63% -
445.gobmk -1.33% 5023.000 4956.000 - 0.41% -
435.gromacs -1.14% 7269.000 7186.000 - 0.14% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng (unexplained diff vs previous) (percentage) -99.99% 90.870 0.010 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.99% 6876.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - -33.33% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 1.440 - -34.25% -
429.mcf (unexplained diff vs previous) (percentage) -99.96% 1305.690 0.540 - -57.48% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 5.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.95% 448.690 0.220 - 0.00% -
429.mcf (unexplained diff vs previous) -99.94% 18593.000 11.000 - -57.69% -
433.milc (unexplained diff vs previous) -99.90% 11289.000 11.000 - 450.00% -
433.milc (unexplained diff vs previous) (percentage) -99.90% 980.800 0.960 - 464.71% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.89% 368.340 0.400 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.89% 10833.000 12.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.87% 263.730 0.340 - 0.00% -
470.lbm (unexplained diff vs previous) -99.87% 9990.000 13.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.84% 137.900 0.220 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.83% 7794.000 13.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.81% 15458.000 29.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.78% 250.410 0.540 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.67% 391.300 1.310 - -65.16% -
471.omnetpp (unexplained diff vs previous) -99.66% 10659.000 36.000 - -65.71% -
445.gobmk (unexplained diff vs previous) -99.64% 5581.000 20.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.64% 111.110 0.400 - 0.00% -
410.bwaves (max) (percentage) -99.48% 57.970 0.300 - -6.25% -
410.bwaves (max) -99.48% 3276.000 17.000 - -5.56% -
456.hmmer (max) (percentage) -99.44% 73.590 0.410 - -2.38% -
473.astar (unexplained diff vs previous) -99.40% 10146.000 61.000 - 12.96% -
473.astar (unexplained diff vs previous) (percentage) -99.40% 197.850 1.190 - 13.33% -
447.dealII (max) -99.35% 1384.000 9.000 - 0.00% -
447.dealII (max) (percentage) -99.31% 80.280 0.550 - -5.17% -
464.h264ref (max) (percentage) -99.26% 54.290 0.400 - 0.00% -
445.gobmk (max) -99.24% 2643.000 20.000 - 11.11% -
434.zeusmp (max) -99.22% 2055.000 16.000 - -5.88% -
445.gobmk (max) (percentage) -99.22% 52.630 0.410 - 10.81% -
401.bzip2 (max) -99.18% 2313.000 19.000 - -5.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
401.bzip2 (max) (percentage) -99.16% 78.650 0.660 - -4.35% -
434.zeusmp (max) (percentage) -99.12% 81.770 0.720 - -2.70% -
433.milc (max) -99.04% 1044.000 10.000 - 100.00% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - 0.00% -
470.lbm (max) -99.02% 2746.000 27.000 - -3.57% -
470.lbm (max) (percentage) -99.01% 72.510 0.720 - -4.00% -
436.cactusADM (max) (percentage) -98.97% 88.730 0.910 - -1.09% -
433.milc (max) (percentage) -98.95% 90.750 0.950 - 86.27% -
481.wrf (max) (percentage) -98.84% 68.700 0.800 - 0.00% -
482.sphinx3 (max) -98.68% 911.000 12.000 - 0.00% -
429.mcf (max) (percentage) -98.61% 92.890 1.290 - -5.84% -
462.libquantum (max) -98.55% 138.000 2.000 - -33.33% -
444.namd (max) -98.54% 685.000 10.000 - 0.00% -
444.namd (max) (percentage) -98.51% 91.790 1.370 - -5.52% -
482.sphinx3 (max) (percentage) -98.50% 96.500 1.450 - -5.23% -
435.gromacs (max) -98.40% 3573.000 57.000 - -5.00% -
435.gromacs (max) (percentage) -98.37% 49.160 0.800 - -4.76% -
458.sjeng (max) -98.25% 3602.000 63.000 - -4.55% -
473.astar (max) -98.24% 3406.000 60.000 - 11.11% -
473.astar (max) (percentage) -98.22% 66.430 1.180 - 11.32% -
453.povray (max) -98.20% 499.000 9.000 - 0.00% -
458.sjeng (max) (percentage) -98.17% 47.610 0.870 - -4.40% -
453.povray (max) (percentage) -98.15% 91.250 1.690 - -4.52% -
429.mcf (max) -98.03% 1322.000 26.000 - -7.14% -
462.libquantum (max) (percentage) -98.02% 98.970 1.960 - -10.91% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
459.GemsFDTD (max) -97.32% 4411.000 118.000 - -3.28% -
400.perlbench (max) (percentage) -97.05% 84.060 2.480 - -1.98% -
450.soplex (max) (percentage) -96.96% 96.240 2.930 - -1.01% -
459.GemsFDTD (max) (percentage) -96.91% 71.460 2.210 - -3.91% -
450.soplex (max) -96.88% 545.000 17.000 - 0.00% -
471.omnetpp (max) (percentage) -96.33% 79.650 2.920 - -25.13% -
471.omnetpp (max) -96.31% 2169.000 80.000 - -25.93% -
403.gcc (max) (percentage) -96.24% 99.360 3.740 - -0.27% -
465.tonto (max) (percentage) -94.61% 19.310 1.040 - -2.80% -
465.tonto (max) -94.51% 2112.000 116.000 - -2.52% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
437.leslie3d (unexplained diff vs previous) -87.51% 2314.000 289.000 - 0.00% -
444.namd (avg) (percentage) -87.31% 9.220 1.170 - 0.00% -
470.lbm (avg) (percentage) -87.20% 6.330 0.810 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -87.12% 19.880 2.560 - 0.00% -
470.lbm -87.03% 239.000 31.000 - 3.33% -
470.lbm (avg) -87.03% 239.000 31.000 - 3.33% -
434.zeusmp -86.39% 147.000 20.000 - -4.76% -
434.zeusmp (avg) -86.39% 147.000 20.000 - -4.76% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
437.leslie3d (max) -84.66% 1929.000 296.000 - -17.09% -
434.zeusmp (avg) (percentage) -84.44% 5.850 0.910 - -1.09% -
437.leslie3d (max) (percentage) -84.14% 16.580 2.630 - -19.08% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
458.sjeng -82.57% 241.000 42.000 - -2.33% -
458.sjeng (avg) -82.57% 241.000 42.000 - -2.33% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
458.sjeng (avg) (percentage) -81.82% 3.190 0.580 - -1.69% -
459.GemsFDTD -81.39% 360.000 67.000 - 0.00% -
459.GemsFDTD (avg) -81.39% 360.000 67.000 - 0.00% -
482.sphinx3 -81.08% 74.000 14.000 - 0.00% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 0.00% -
410.bwaves (avg) (percentage) -80.95% 4.410 0.840 - -1.18% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII -80.81% 99.000 19.000 - 5.56% -
447.dealII (avg) -80.81% 99.000 19.000 - 5.56% -
410.bwaves -80.32% 249.000 49.000 - -2.00% -
410.bwaves (avg) -80.32% 249.000 49.000 - -2.00% -
453.povray (avg) (percentage) -80.28% 7.810 1.540 - 0.00% -
447.dealII (avg) (percentage) -80.07% 5.770 1.150 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
433.milc (avg) (percentage) -79.83% 6.050 1.220 - 0.00% -
433.milc -79.71% 69.000 14.000 - 0.00% -
433.milc (avg) -79.71% 69.000 14.000 - 0.00% -
482.sphinx3 (avg) (percentage) -78.69% 7.930 1.690 - 0.00% -
445.gobmk -78.57% 196.000 42.000 - 0.00% -
445.gobmk (avg) -78.57% 196.000 42.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -78.42% 5.840 1.260 - -0.79% -
445.gobmk (avg) (percentage) -78.26% 3.910 0.850 - -1.16% -
462.libquantum (avg) (percentage) -75.98% 7.660 1.840 - -0.54% -
401.bzip2 (avg) (percentage) -75.18% 5.480 1.360 - -0.73% -
471.omnetpp -74.89% 223.000 56.000 - -1.75% -
471.omnetpp (avg) -74.89% 223.000 56.000 - -1.75% -
471.omnetpp (avg) (percentage) -74.88% 8.200 2.060 - 0.00% -
401.bzip2 -74.53% 161.000 41.000 - 0.00% -
401.bzip2 (avg) -74.53% 161.000 41.000 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs -65.94% 367.000 125.000 - 0.81% -
435.gromacs (avg) -65.94% 367.000 125.000 - 0.81% -
435.gromacs (avg) (percentage) -65.61% 5.060 1.740 - 0.00% -
465.tonto (avg) (percentage) -63.17% 3.340 1.230 - 0.00% -
473.astar -62.91% 213.000 79.000 - -2.47% -
473.astar (avg) -62.91% 213.000 79.000 - -2.47% -
473.astar (avg) (percentage) -62.50% 4.160 1.560 - -0.64% -
465.tonto -62.47% 365.000 137.000 - 0.00% -
465.tonto (avg) -62.47% 365.000 137.000 - 0.00% -
450.soplex (avg) (percentage) -62.21% 6.430 2.430 - 0.00% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -39.11% 7.670 4.670 - -0.85% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -12.84% 109.000 95.000 - -1.04% -
429.mcf (avg) -12.84% 109.000 95.000 - -1.04% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 3027.000 -
410.bwaves 5933.000 -
429.mcf 2036.000 -
433.milc 1149.000 -
434.zeusmp 2297.000 -
435.gromacs 7186.000 -
437.leslie3d 11285.000 2.63%
444.namd 752.000 -
445.gobmk 4956.000 -
447.dealII 1659.000 -
450.soplex 581.000 -
453.povray 560.000 3.32%
458.sjeng 7323.000 -
459.GemsFDTD 5342.000 -
462.libquantum 139.000 1.46%
465.tonto 11206.000 -
470.lbm 3836.000 -
471.omnetpp 2758.000 -1.29%
473.astar 5105.000 -1.18%
482.sphinx3 841.000 -
Geometric Mean 2409.688 -
Code Size (bytes)
Name Current %
401.bzip2 43711.000 -
410.bwaves 16476.000 -
429.mcf 9146.000 -
433.milc 60484.000 -
434.zeusmp 146883.000 -
435.gromacs 493840.000 -
437.leslie3d 54370.000 -
444.namd 182224.000 -
445.gobmk 1375090.000 -
447.dealII 306198.000 -
450.soplex 202418.000 -
453.povray 658001.000 1.25%
458.sjeng 102311.000 -
459.GemsFDTD 232644.000 -
462.libquantum 15797.000 -
465.tonto 1971787.000 -
470.lbm 9547.000 -
471.omnetpp 475220.000 -
473.astar 22752.000 -
482.sphinx3 111718.000 -
Geometric Mean 113993.467 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.480 -1.98%
401.bzip2 41.000 -
401.bzip2 (avg) 41.000 -
401.bzip2 (avg) (percentage) 1.360 -
401.bzip2 (max) 19.000 -5.00%
401.bzip2 (max) (percentage) 0.660 -4.35%
401.bzip2 (unexplained diff vs previous) 12.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.400 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.740 -
410.bwaves 49.000 -2.00%
410.bwaves (avg) 49.000 -2.00%
410.bwaves (avg) (percentage) 0.840 -1.18%
410.bwaves (max) 17.000 -5.56%
410.bwaves (max) (percentage) 0.300 -6.25%
410.bwaves (unexplained diff vs previous) 13.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.220 -
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.370 -
429.mcf 95.000 -1.04%
429.mcf (avg) 95.000 -1.04%
429.mcf (avg) (percentage) 4.670 -
429.mcf (max) 26.000 -7.14%
429.mcf (max) (percentage) 1.290 -5.84%
429.mcf (unexplained diff vs previous) 11.000 -57.69%
429.mcf (unexplained diff vs previous) (percentage) 0.540 -57.48%
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.220 -
433.milc (max) 10.000 100.00%
433.milc (max) (percentage) 0.950 86.27%
433.milc (unexplained diff vs previous) 11.000 450.00%
433.milc (unexplained diff vs previous) (percentage) 0.960 464.71%
434.zeusmp 20.000 -4.76%
434.zeusmp (avg) 20.000 -4.76%
434.zeusmp (avg) (percentage) 0.910 -1.09%
434.zeusmp (max) 16.000 -5.88%
434.zeusmp (max) (percentage) 0.720 -2.70%
434.zeusmp (unexplained diff vs previous) 5.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.220 -
435.gromacs 125.000 -
435.gromacs (avg) 125.000 -
435.gromacs (avg) (percentage) 1.740 -
435.gromacs (max) 57.000 -5.00%
435.gromacs (max) (percentage) 0.800 -4.76%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.910 -1.09%
437.leslie3d 497.000 2.05%
437.leslie3d (avg) 497.000 2.05%
437.leslie3d (avg) (percentage) 4.410 -
437.leslie3d (max) 296.000 -17.09%
437.leslie3d (max) (percentage) 2.630 -19.08%
437.leslie3d (unexplained diff vs previous) 289.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 2.560 -
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.170 -
444.namd (max) 10.000 -
444.namd (max) (percentage) 1.370 -5.52%
445.gobmk 42.000 -
445.gobmk (avg) 42.000 -
445.gobmk (avg) (percentage) 0.850 -1.16%
445.gobmk (max) 20.000 11.11%
445.gobmk (max) (percentage) 0.410 10.81%
445.gobmk (unexplained diff vs previous) 20.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.400 -
447.dealII 19.000 5.56%
447.dealII (avg) 19.000 5.56%
447.dealII (avg) (percentage) 1.150 -
447.dealII (max) 9.000 -
447.dealII (max) (percentage) 0.550 -5.17%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.430 -
450.soplex (max) 17.000 -
450.soplex (max) (percentage) 2.930 -1.01%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.540 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 1.690 -4.52%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.410 -2.38%
458.sjeng 42.000 -2.33%
458.sjeng (avg) 42.000 -2.33%
458.sjeng (avg) (percentage) 0.580 -1.69%
458.sjeng (max) 63.000 -4.55%
458.sjeng (max) (percentage) 0.870 -4.40%
458.sjeng (unexplained diff vs previous) 1.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -
459.GemsFDTD 67.000 -
459.GemsFDTD (avg) 67.000 -
459.GemsFDTD (avg) (percentage) 1.260 -
459.GemsFDTD (max) 118.000 -3.28%
459.GemsFDTD (max) (percentage) 2.210 -3.91%
459.GemsFDTD (unexplained diff vs previous) 29.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.540 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.840 -
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 1.960 -10.91%
462.libquantum (unexplained diff vs previous) 2.000 -33.33%
462.libquantum (unexplained diff vs previous) (percentage) 1.440 -34.25%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.400 -
465.tonto 137.000 -
465.tonto (avg) 137.000 -
465.tonto (avg) (percentage) 1.230 -
465.tonto (max) 116.000 -2.52%
465.tonto (max) (percentage) 1.040 -2.80%
470.lbm 31.000 3.33%
470.lbm (avg) 31.000 3.33%
470.lbm (avg) (percentage) 0.810 -
470.lbm (max) 27.000 -3.57%
470.lbm (max) (percentage) 0.720 -4.00%
470.lbm (unexplained diff vs previous) 13.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.340 -
471.omnetpp 56.000 -1.75%
471.omnetpp (avg) 56.000 -1.75%
471.omnetpp (avg) (percentage) 2.060 -
471.omnetpp (max) 80.000 -25.93%
471.omnetpp (max) (percentage) 2.920 -25.13%
471.omnetpp (unexplained diff vs previous) 36.000 -65.71%
471.omnetpp (unexplained diff vs previous) (percentage) 1.310 -65.16%
473.astar 79.000 -2.47%
473.astar (avg) 79.000 -2.47%
473.astar (avg) (percentage) 1.560 -
473.astar (max) 60.000 11.11%
473.astar (max) (percentage) 1.180 11.32%
473.astar (unexplained diff vs previous) 61.000 12.96%
473.astar (unexplained diff vs previous) (percentage) 1.190 13.33%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.800 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.690 -
482.sphinx3 (max) 12.000 -
482.sphinx3 (max) (percentage) 1.450 -5.23%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.401 2.99%