Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f06b840b9a063aa33b8b50745bddc8e6845c8f29 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/5e812e8c1e8d65aee05cc3fbbe5727d4e365df57 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=db9b47e9f996bbdb831580ff7343542a017c80ee (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f130cb3a5bbed9c62474d814fc2bfec5ac66b81b (+ 216 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/20/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0020 (v6.2.8-48461-gf130cb3a5bbed) 2023-03-23T21:10:23 0:00:00
Previous 0020 (v6.2.8-48461-gf130cb3a5bbe) 2023-03-23T21:10:23 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 14
Performance Improvements 84 195
Added Tests 4 4
Unchanged Tests 1148 1023
Total Tests 1236

Run-Over-Run Changes Detail

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (avg) (percentage) -26.63% 9.200 6.750 - -7.79% -
454.calculix -25.00% 4.000 3.000 - -25.00% -
454.calculix (avg) -25.00% 4.000 3.000 - -25.00% -
429.mcf -24.31% 218.000 165.000 - 51.38% -
429.mcf (avg) -24.31% 218.000 165.000 - 51.38% -
429.mcf (avg) (percentage) -23.96% 15.570 11.840 - 54.37% -
462.libquantum -22.22% 9.000 7.000 - -30.00% -
462.libquantum (avg) -22.22% 9.000 7.000 - -30.00% -
473.astar -21.95% 246.000 192.000 - -9.86% -
473.astar (avg) -21.95% 246.000 192.000 - -9.86% -
473.astar (avg) (percentage) -21.68% 4.750 3.720 - -10.58% -
403.gcc -20.00% 5.000 4.000 - 0.00% -
403.gcc (avg) -20.00% 5.000 4.000 - 0.00% -
458.sjeng -19.27% 218.000 176.000 - -26.97% -
458.sjeng (avg) -19.27% 218.000 176.000 - -26.97% -
458.sjeng (avg) (percentage) -19.03% 2.890 2.340 - -26.65% -
462.libquantum (avg) (percentage) -18.72% 6.410 5.210 - -31.98% -
401.bzip2 -17.52% 137.000 113.000 - -29.81% -
401.bzip2 (avg) -17.52% 137.000 113.000 - -29.81% -
401.bzip2 (avg) (percentage) -17.21% 4.590 3.800 - -30.66% -
471.omnetpp -17.20% 186.000 154.000 - -30.94% -
471.omnetpp (avg) -17.20% 186.000 154.000 - -30.94% -
447.dealII -17.11% 76.000 63.000 - -36.36% -
447.dealII (avg) -17.11% 76.000 63.000 - -36.36% -
471.omnetpp (avg) (percentage) -16.88% 6.930 5.760 - -29.76% -
456.hmmer (avg) (percentage) -16.82% 3.330 2.770 - -37.19% -
447.dealII (avg) (percentage) -16.67% 4.440 3.700 - -35.88% -
453.povray -16.67% 30.000 25.000 - -40.48% -
453.povray (avg) -16.67% 30.000 25.000 - -40.48% -
456.hmmer -16.67% 96.000 80.000 - -37.01% -
456.hmmer (avg) -16.67% 96.000 80.000 - -37.01% -
459.GemsFDTD -16.56% 314.000 262.000 - -27.22% -
459.GemsFDTD (avg) -16.56% 314.000 262.000 - -27.22% -
459.GemsFDTD (avg) (percentage) -16.41% 5.120 4.280 - -26.71% -
436.cactusADM -16.24% 117.000 98.000 - -20.97% -
436.cactusADM (avg) -16.24% 117.000 98.000 - -20.97% -
450.soplex -16.13% 31.000 26.000 - -27.78% -
450.soplex (avg) -16.13% 31.000 26.000 - -27.78% -
450.soplex (avg) (percentage) -15.66% 5.490 4.630 - -27.99% -
436.cactusADM (avg) (percentage) -15.56% 5.590 4.720 - -21.07% -
454.calculix (avg) (percentage) -15.55% 6.560 5.540 - -30.92% -
464.h264ref -15.04% 226.000 192.000 - -34.47% -
464.h264ref (avg) -15.04% 226.000 192.000 - -34.47% -
445.gobmk (avg) (percentage) -14.89% 3.090 2.630 - -32.74% -
464.h264ref (avg) (percentage) -14.87% 3.900 3.320 - -34.77% -
445.gobmk -14.74% 156.000 133.000 - -32.14% -
445.gobmk (avg) -14.74% 156.000 133.000 - -32.14% -
483.xalancbmk (avg) (percentage) -14.73% 5.430 4.630 - -28.77% -
453.povray (avg) (percentage) -14.73% 5.500 4.690 - -39.95% -
482.sphinx3 (avg) (percentage) -14.72% 6.590 5.620 - -29.13% -
483.xalancbmk -14.71% 204.000 174.000 - -29.84% -
483.xalancbmk (avg) -14.71% 204.000 174.000 - -29.84% -
482.sphinx3 -14.52% 62.000 53.000 - -28.38% -
482.sphinx3 (avg) -14.52% 62.000 53.000 - -28.38% -
434.zeusmp -13.79% 116.000 100.000 - -31.97% -
434.zeusmp (avg) -13.79% 116.000 100.000 - -31.97% -
433.milc (avg) (percentage) -13.71% 5.470 4.720 - -21.98% -
434.zeusmp (avg) (percentage) -13.55% 4.650 4.020 - -31.28% -
433.milc -12.90% 62.000 54.000 - -21.74% -
433.milc (avg) -12.90% 62.000 54.000 - -21.74% -
400.perlbench -12.66% 79.000 69.000 - -34.29% -
400.perlbench (avg) -12.66% 79.000 69.000 - -34.29% -
435.gromacs (avg) (percentage) -11.94% 4.440 3.910 - -22.73% -
435.gromacs -11.89% 328.000 289.000 - -21.25% -
435.gromacs (avg) -11.89% 328.000 289.000 - -21.25% -
400.perlbench (avg) (percentage) -11.84% 4.900 4.320 - -31.97% -
465.tonto -11.27% 346.000 307.000 - -15.89% -
465.tonto (avg) -11.27% 346.000 307.000 - -15.89% -
470.lbm -11.17% 188.000 167.000 - -30.13% -
470.lbm (avg) -11.17% 188.000 167.000 - -30.13% -
470.lbm (avg) (percentage) -11.11% 4.950 4.400 - -30.49% -
465.tonto (avg) (percentage) -11.04% 3.170 2.820 - -15.57% -
410.bwaves -10.34% 203.000 182.000 - -26.91% -
410.bwaves (avg) -10.34% 203.000 182.000 - -26.91% -
481.wrf -10.28% 253.000 227.000 - -34.20% -
481.wrf (avg) -10.28% 253.000 227.000 - -34.20% -
410.bwaves (avg) (percentage) -10.08% 3.570 3.210 - -27.21% -
481.wrf (avg) (percentage) -10.04% 4.580 4.120 - -33.97% -
437.leslie3d -9.83% 417.000 376.000 - 5.92% -
437.leslie3d (avg) -9.83% 417.000 376.000 - 5.92% -
437.leslie3d (avg) (percentage) -9.79% 3.880 3.500 - 14.75% -
444.namd (avg) (percentage) -5.10% 6.280 5.960 - -35.36% -
444.namd -4.35% 46.000 44.000 - -35.29% -
444.namd (avg) -4.35% 46.000 44.000 - -35.29% -

Added Tests - sample variability
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 1.73% 244728.000 248972.000 - 0.00% -
436.cactusADM 1.16% 352891.000 356967.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 8.93% 56.000 61.000 - 0.00% -
435.gromacs 1.83% 7269.000 7402.000 - 0.00% -
401.bzip2 1.80% 2941.000 2994.000 - 0.00% -
450.soplex 1.23% 567.000 574.000 - 0.00% -
445.gobmk 1.09% 5023.000 5078.000 - 0.00% -
473.astar 1.07% 5128.000 5183.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (avg) (percentage) 54.37% 7.670 11.840 - -23.96% -
429.mcf 51.38% 109.000 165.000 - -24.31% -
429.mcf (avg) 51.38% 109.000 165.000 - -24.31% -
437.leslie3d (avg) (percentage) 14.75% 3.050 3.500 - -9.79% -
437.leslie3d 5.92% 355.000 376.000 - -9.83% -
437.leslie3d (avg) 5.92% 355.000 376.000 - -9.83% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383408.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.52% 11640.000 10765.000 - 0.00% -
400.perlbench -2.83% 1663.000 1616.000 - 0.00% -
429.mcf -1.62% 1424.000 1401.000 - 0.00% -
471.omnetpp -1.47% 2724.000 2684.000 - 0.00% -
483.xalancbmk -1.20% 3818.000 3772.000 - 0.00% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
447.dealII (unexplained diff vs previous) -99.99% 7017.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 1.420 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.99% 407.020 0.060 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.98% 2759.050 0.420 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 4.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.97% 62.730 0.020 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.870 - 0.00% -
450.soplex (unexplained diff vs previous) -99.97% 14500.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.97% 1043.330 0.360 - 0.00% -
453.povray (unexplained diff vs previous) -99.96% 5707.000 2.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 4.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.160 - 0.00% -
416.gamess (unexplained diff vs previous) -99.96% 7819.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.94% 8356.000 5.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.94% 1118.610 0.670 - 0.00% -
433.milc (unexplained diff vs previous) -99.93% 11289.000 8.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.93% 980.800 0.700 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.90% 197.850 0.190 - 0.00% -
473.astar (unexplained diff vs previous) -99.90% 10146.000 10.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.88% 263.730 0.310 - 0.00% -
470.lbm (unexplained diff vs previous) -99.88% 9990.000 12.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.87% 15458.000 20.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.87% 250.410 0.330 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.83% 278.630 0.480 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.83% 8030.000 14.000 - 0.00% -
429.mcf (unexplained diff vs previous) -99.82% 18593.000 34.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.81% 1305.690 2.430 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.79% 10659.000 22.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.79% 391.300 0.820 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.73% 5581.000 15.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.73% 111.110 0.300 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.64% 368.340 1.340 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.63% 10833.000 40.000 - 0.00% -
453.povray (max) -99.60% 499.000 2.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.60% 118.780 0.480 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.59% 6843.000 28.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.56% 137.900 0.600 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.56% 7794.000 34.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.54% 219.530 1.010 - 0.00% -
481.wrf (unexplained diff vs previous) -99.54% 12149.000 56.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -99.50% 8368.000 42.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.49% 219.170 1.110 - 0.00% -
400.perlbench (unexplained diff vs previous) -99.49% 8772.000 45.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.47% 527.480 2.780 - 0.00% -
453.povray (max) (percentage) -99.46% 91.250 0.490 - 0.00% -
416.gamess (max) -99.46% 4805.000 26.000 - 0.00% -
416.gamess (max) (percentage) -99.46% 38.550 0.210 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.35% 6876.000 45.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.34% 90.870 0.600 - 0.00% -
456.hmmer (max) -99.34% 2120.000 14.000 - 0.00% -
456.hmmer (max) (percentage) -99.33% 73.590 0.490 - 0.00% -
444.namd (max) -99.12% 685.000 6.000 - 0.00% -
434.zeusmp (max) -99.08% 2055.000 19.000 - 0.00% -
434.zeusmp (max) (percentage) -99.07% 81.770 0.760 - 0.00% -
444.namd (max) (percentage) -99.02% 91.790 0.900 - 0.00% -
435.gromacs (unexplained diff vs previous) (percentage) -98.65% 96.680 1.310 - 0.00% -
435.gromacs (unexplained diff vs previous) -98.62% 7028.000 97.000 - 0.00% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
447.dealII (max) -98.48% 1384.000 21.000 - 0.00% -
447.dealII (max) (percentage) -98.44% 80.280 1.250 - 0.00% -
401.bzip2 (max) (percentage) -98.28% 78.650 1.350 - 0.00% -
401.bzip2 (max) -98.27% 2313.000 40.000 - 0.00% -
462.libquantum (max) (percentage) -98.20% 98.970 1.780 - 0.00% -
450.soplex (max) -98.17% 545.000 10.000 - 0.00% -
450.soplex (max) (percentage) -98.07% 96.240 1.860 - 0.00% -
433.milc (max) -97.89% 1044.000 22.000 - 0.00% -
410.bwaves (max) (percentage) -97.81% 57.970 1.270 - 0.00% -
433.milc (max) (percentage) -97.81% 90.750 1.990 - 0.00% -
410.bwaves (max) -97.80% 3276.000 72.000 - 0.00% -
471.omnetpp (max) -97.79% 2169.000 48.000 - 0.00% -
471.omnetpp (max) (percentage) -97.74% 79.650 1.800 - 0.00% -
464.h264ref (max) (percentage) -97.48% 54.290 1.370 - 0.00% -
464.h264ref (max) -97.47% 3127.000 79.000 - 0.00% -
445.gobmk (max) (percentage) -97.43% 52.630 1.350 - 0.00% -
445.gobmk (max) -97.43% 2643.000 68.000 - 0.00% -
458.sjeng (max) -97.17% 3602.000 102.000 - 0.00% -
458.sjeng (max) (percentage) -97.14% 47.610 1.360 - 0.00% -
400.perlbench (max) -96.92% 1397.000 43.000 - 0.00% -
482.sphinx3 (max) -96.82% 911.000 29.000 - 0.00% -
482.sphinx3 (max) (percentage) -96.81% 96.500 3.080 - 0.00% -
400.perlbench (max) (percentage) -96.78% 84.060 2.710 - 0.00% -
470.lbm (max) (percentage) -96.73% 72.510 2.370 - 0.00% -
470.lbm (max) -96.72% 2746.000 90.000 - 0.00% -
454.calculix (max) -96.72% 61.000 2.000 - 0.00% -
454.calculix (max) (percentage) -96.15% 99.730 3.840 - 0.00% -
436.cactusADM (max) (percentage) -96.11% 88.730 3.450 - 0.00% -
436.cactusADM (max) -96.10% 1848.000 72.000 - 0.00% -
481.wrf (max) -96.05% 3801.000 150.000 - 0.00% -
481.wrf (max) (percentage) -96.04% 68.700 2.720 - 0.00% -
459.GemsFDTD (max) -95.67% 4411.000 191.000 - 0.00% -
459.GemsFDTD (max) (percentage) -95.63% 71.460 3.120 - 0.00% -
483.xalancbmk (max) -94.73% 2621.000 138.000 - 0.00% -
483.xalancbmk (max) (percentage) -94.66% 68.670 3.670 - 0.00% -
435.gromacs (max) (percentage) -93.90% 49.160 3.000 - 0.00% -
435.gromacs (max) -93.79% 3573.000 222.000 - 0.00% -
473.astar (max) (percentage) -93.68% 66.430 4.200 - 0.00% -
473.astar (max) -93.63% 3406.000 217.000 - 0.00% -
465.tonto (unexplained diff vs previous) -90.63% 1771.000 166.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -90.61% 16.190 1.520 - 0.00% -
437.leslie3d (unexplained diff vs previous) -90.02% 2314.000 231.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.19% 19.880 2.150 - 0.00% -
465.tonto (max) -84.04% 2112.000 337.000 - 0.00% -
465.tonto (max) (percentage) -84.00% 19.310 3.090 - 0.00% -
429.mcf (max) -77.84% 1322.000 293.000 - 0.00% -
429.mcf (max) (percentage) -77.45% 92.890 20.950 - 0.00% -
437.leslie3d (max) -51.01% 1929.000 945.000 - 0.00% -
437.leslie3d (max) (percentage) -47.04% 16.580 8.780 - 0.00% -
416.gamess -45.45% 550.000 300.000 - -0.99% -
416.gamess (avg) -45.45% 550.000 300.000 - -0.99% -
416.gamess (avg) (percentage) -45.25% 4.420 2.420 - -0.82% -
453.povray -40.48% 42.000 25.000 - -16.67% -
453.povray (avg) -40.48% 42.000 25.000 - -16.67% -
453.povray (avg) (percentage) -39.95% 7.810 4.690 - -14.73% -
403.gcc (max) (percentage) -38.24% 99.360 61.360 - 0.00% -
456.hmmer (avg) (percentage) -37.19% 4.410 2.770 - -16.82% -
456.hmmer -37.01% 127.000 80.000 - -16.67% -
456.hmmer (avg) -37.01% 127.000 80.000 - -16.67% -
447.dealII -36.36% 99.000 63.000 - -17.11% -
447.dealII (avg) -36.36% 99.000 63.000 - -17.11% -
447.dealII (avg) (percentage) -35.88% 5.770 3.700 - -16.67% -
444.namd (avg) (percentage) -35.36% 9.220 5.960 - -5.10% -
444.namd -35.29% 68.000 44.000 - -4.35% -
444.namd (avg) -35.29% 68.000 44.000 - -4.35% -
464.h264ref (avg) (percentage) -34.77% 5.090 3.320 - -14.87% -
464.h264ref -34.47% 293.000 192.000 - -15.04% -
464.h264ref (avg) -34.47% 293.000 192.000 - -15.04% -
400.perlbench -34.29% 105.000 69.000 - -12.66% -
400.perlbench (avg) -34.29% 105.000 69.000 - -12.66% -
481.wrf -34.20% 345.000 227.000 - -10.28% -
481.wrf (avg) -34.20% 345.000 227.000 - -10.28% -
481.wrf (avg) (percentage) -33.97% 6.240 4.120 - -10.04% -
445.gobmk (avg) (percentage) -32.74% 3.910 2.630 - -14.89% -
403.gcc (max) -32.73% 55.000 37.000 - 0.00% -
445.gobmk -32.14% 196.000 133.000 - -14.74% -
445.gobmk (avg) -32.14% 196.000 133.000 - -14.74% -
462.libquantum (avg) (percentage) -31.98% 7.660 5.210 - -18.72% -
434.zeusmp -31.97% 147.000 100.000 - -13.79% -
434.zeusmp (avg) -31.97% 147.000 100.000 - -13.79% -
400.perlbench (avg) (percentage) -31.97% 6.350 4.320 - -11.84% -
434.zeusmp (avg) (percentage) -31.28% 5.850 4.020 - -13.55% -
471.omnetpp -30.94% 223.000 154.000 - -17.20% -
471.omnetpp (avg) -30.94% 223.000 154.000 - -17.20% -
454.calculix (avg) (percentage) -30.92% 8.020 5.540 - -15.55% -
401.bzip2 (avg) (percentage) -30.66% 5.480 3.800 - -17.21% -
470.lbm (avg) (percentage) -30.49% 6.330 4.400 - -11.11% -
470.lbm -30.13% 239.000 167.000 - -11.17% -
470.lbm (avg) -30.13% 239.000 167.000 - -11.17% -
462.libquantum -30.00% 10.000 7.000 - -22.22% -
462.libquantum (avg) -30.00% 10.000 7.000 - -22.22% -
483.xalancbmk -29.84% 248.000 174.000 - -14.71% -
483.xalancbmk (avg) -29.84% 248.000 174.000 - -14.71% -
401.bzip2 -29.81% 161.000 113.000 - -17.52% -
401.bzip2 (avg) -29.81% 161.000 113.000 - -17.52% -
471.omnetpp (avg) (percentage) -29.76% 8.200 5.760 - -16.88% -
482.sphinx3 (avg) (percentage) -29.13% 7.930 5.620 - -14.72% -
483.xalancbmk (avg) (percentage) -28.77% 6.500 4.630 - -14.73% -
482.sphinx3 -28.38% 74.000 53.000 - -14.52% -
482.sphinx3 (avg) -28.38% 74.000 53.000 - -14.52% -
450.soplex (avg) (percentage) -27.99% 6.430 4.630 - -15.66% -
450.soplex -27.78% 36.000 26.000 - -16.13% -
450.soplex (avg) -27.78% 36.000 26.000 - -16.13% -
459.GemsFDTD -27.22% 360.000 262.000 - -16.56% -
459.GemsFDTD (avg) -27.22% 360.000 262.000 - -16.56% -
410.bwaves (avg) (percentage) -27.21% 4.410 3.210 - -10.08% -
458.sjeng -26.97% 241.000 176.000 - -19.27% -
458.sjeng (avg) -26.97% 241.000 176.000 - -19.27% -
410.bwaves -26.91% 249.000 182.000 - -10.34% -
410.bwaves (avg) -26.91% 249.000 182.000 - -10.34% -
459.GemsFDTD (avg) (percentage) -26.71% 5.840 4.280 - -16.41% -
458.sjeng (avg) (percentage) -26.65% 3.190 2.340 - -19.03% -
454.calculix -25.00% 4.000 3.000 - -25.00% -
454.calculix (avg) -25.00% 4.000 3.000 - -25.00% -
435.gromacs (avg) (percentage) -22.73% 5.060 3.910 - -11.94% -
433.milc (avg) (percentage) -21.98% 6.050 4.720 - -13.71% -
433.milc -21.74% 69.000 54.000 - -12.90% -
433.milc (avg) -21.74% 69.000 54.000 - -12.90% -
435.gromacs -21.25% 367.000 289.000 - -11.89% -
435.gromacs (avg) -21.25% 367.000 289.000 - -11.89% -
436.cactusADM (avg) (percentage) -21.07% 5.980 4.720 - -15.56% -
436.cactusADM -20.97% 124.000 98.000 - -16.24% -
436.cactusADM (avg) -20.97% 124.000 98.000 - -16.24% -
465.tonto -15.89% 365.000 307.000 - -11.27% -
465.tonto (avg) -15.89% 365.000 307.000 - -11.27% -
465.tonto (avg) (percentage) -15.57% 3.340 2.820 - -11.04% -
473.astar (avg) (percentage) -10.58% 4.160 3.720 - -21.68% -
473.astar -9.86% 213.000 192.000 - -21.95% -
473.astar (avg) -9.86% 213.000 192.000 - -21.95% -
403.gcc (avg) (percentage) -7.79% 7.320 6.750 - -26.63% -

Added Tests - sample variability
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1616.000 -
401.bzip2 2994.000 -
403.gcc 61.000 -
410.bwaves 5687.000 -
416.gamess 12424.000 -
429.mcf 1401.000 -
433.milc 1148.000 -
434.zeusmp 2504.000 -
435.gromacs 7402.000 -
436.cactusADM 2095.000 -
437.leslie3d 10765.000 -
444.namd 741.000 -
445.gobmk 5078.000 -
447.dealII 1719.000 -
450.soplex 574.000 -
453.povray 550.000 -
454.calculix 62.000 -
456.hmmer 2897.000 -
458.sjeng 7554.000 -
459.GemsFDTD 6140.000 -
462.libquantum 141.000 -
464.h264ref 5796.000 -
465.tonto 10918.000 -
470.lbm 3813.000 -
471.omnetpp 2684.000 -
473.astar 5183.000 -
481.wrf 5526.000 -
482.sphinx3 948.000 -
483.xalancbmk 3772.000 -
Geometric Mean 2100.672 -
Code Size (bytes)
Name Current %
400.perlbench 893232.000 -
401.bzip2 44233.000 -
403.gcc 2452063.000 -
410.bwaves 16760.000 -
416.gamess 5751265.000 -
429.mcf 9123.000 -
433.milc 61378.000 -
434.zeusmp 152037.000 -
435.gromacs 499041.000 -
436.cactusADM 356967.000 -
437.leslie3d 59475.000 -
444.namd 188332.000 -
445.gobmk 1381674.000 -
447.dealII 312907.000 -
450.soplex 205081.000 -
453.povray 657113.000 -
454.calculix 845283.000 -
456.hmmer 108663.000 -
458.sjeng 104048.000 -
459.GemsFDTD 248972.000 -
462.libquantum 16085.000 -
464.h264ref 383408.000 -
465.tonto 1945995.000 -
470.lbm 9691.000 -
471.omnetpp 478051.000 -
473.astar 22956.000 -
481.wrf 1968639.000 -
482.sphinx3 112795.000 -
483.xalancbmk 2343598.000 -
Geometric Mean 224131.050 -
sample variability
Name Current %
400.perlbench 69.000 -12.66%
400.perlbench (avg) 69.000 -12.66%
400.perlbench (avg) (percentage) 4.320 -11.84%
400.perlbench (max) 43.000 -
400.perlbench (max) (percentage) 2.710 -
400.perlbench (unexplained diff vs previous) 45.000 -
400.perlbench (unexplained diff vs previous) (percentage) 2.780 -
401.bzip2 113.000 -17.52%
401.bzip2 (avg) 113.000 -17.52%
401.bzip2 (avg) (percentage) 3.800 -17.21%
401.bzip2 (max) 40.000 -
401.bzip2 (max) (percentage) 1.350 -
401.bzip2 (unexplained diff vs previous) 40.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 1.340 -
403.gcc 4.000 -20.00%
403.gcc (avg) 4.000 -20.00%
403.gcc (avg) (percentage) 6.750 -26.63%
403.gcc (max) 37.000 -
403.gcc (max) (percentage) 61.360 -
410.bwaves 182.000 -10.34%
410.bwaves (avg) 182.000 -10.34%
410.bwaves (avg) (percentage) 3.210 -10.08%
410.bwaves (max) 72.000 -
410.bwaves (max) (percentage) 1.270 -
410.bwaves (unexplained diff vs previous) 34.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.600 -
416.gamess 300.000 -
416.gamess (avg) 300.000 -
416.gamess (avg) (percentage) 2.420 -
416.gamess (max) 26.000 -
416.gamess (max) (percentage) 0.210 -
416.gamess (unexplained diff vs previous) 3.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.020 -
429.mcf 165.000 -24.31%
429.mcf (avg) 165.000 -24.31%
429.mcf (avg) (percentage) 11.840 -23.96%
429.mcf (max) 293.000 -
429.mcf (max) (percentage) 20.950 -
429.mcf (unexplained diff vs previous) 34.000 -
429.mcf (unexplained diff vs previous) (percentage) 2.430 -
433.milc 54.000 -12.90%
433.milc (avg) 54.000 -12.90%
433.milc (avg) (percentage) 4.720 -13.71%
433.milc (max) 22.000 -
433.milc (max) (percentage) 1.990 -
433.milc (unexplained diff vs previous) 8.000 -
433.milc (unexplained diff vs previous) (percentage) 0.700 -
434.zeusmp 100.000 -13.79%
434.zeusmp (avg) 100.000 -13.79%
434.zeusmp (avg) (percentage) 4.020 -13.55%
434.zeusmp (max) 19.000 -
434.zeusmp (max) (percentage) 0.760 -
434.zeusmp (unexplained diff vs previous) 4.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 -
435.gromacs 289.000 -11.89%
435.gromacs (avg) 289.000 -11.89%
435.gromacs (avg) (percentage) 3.910 -11.94%
435.gromacs (max) 222.000 -
435.gromacs (max) (percentage) 3.000 -
435.gromacs (unexplained diff vs previous) 97.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.310 -
436.cactusADM 98.000 -16.24%
436.cactusADM (avg) 98.000 -16.24%
436.cactusADM (avg) (percentage) 4.720 -15.56%
436.cactusADM (max) 72.000 -
436.cactusADM (max) (percentage) 3.450 -
436.cactusADM (unexplained diff vs previous) 0.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.000 -
437.leslie3d 376.000 -9.83%
437.leslie3d (avg) 376.000 -9.83%
437.leslie3d (avg) (percentage) 3.500 -9.79%
437.leslie3d (max) 945.000 -
437.leslie3d (max) (percentage) 8.780 -
437.leslie3d (unexplained diff vs previous) 231.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 2.150 -
444.namd 44.000 -4.35%
444.namd (avg) 44.000 -4.35%
444.namd (avg) (percentage) 5.960 -5.10%
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.900 -
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.670 -
445.gobmk 133.000 -14.74%
445.gobmk (avg) 133.000 -14.74%
445.gobmk (avg) (percentage) 2.630 -14.89%
445.gobmk (max) 68.000 -
445.gobmk (max) (percentage) 1.350 -
445.gobmk (unexplained diff vs previous) 15.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.300 -
447.dealII 63.000 -17.11%
447.dealII (avg) 63.000 -17.11%
447.dealII (avg) (percentage) 3.700 -16.67%
447.dealII (max) 21.000 -
447.dealII (max) (percentage) 1.250 -
447.dealII (unexplained diff vs previous) 1.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.060 -
450.soplex 26.000 -16.13%
450.soplex (avg) 26.000 -16.13%
450.soplex (avg) (percentage) 4.630 -15.66%
450.soplex (max) 10.000 -
450.soplex (max) (percentage) 1.860 -
450.soplex (unexplained diff vs previous) 5.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.870 -
453.povray 25.000 -16.67%
453.povray (avg) 25.000 -16.67%
453.povray (avg) (percentage) 4.690 -14.73%
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.490 -
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.360 -
454.calculix 3.000 -25.00%
454.calculix (avg) 3.000 -25.00%
454.calculix (avg) (percentage) 5.540 -15.55%
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.840 -
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 80.000 -16.67%
456.hmmer (avg) 80.000 -16.67%
456.hmmer (avg) (percentage) 2.770 -16.82%
456.hmmer (max) 14.000 -
456.hmmer (max) (percentage) 0.490 -
456.hmmer (unexplained diff vs previous) 14.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.480 -
458.sjeng 176.000 -19.27%
458.sjeng (avg) 176.000 -19.27%
458.sjeng (avg) (percentage) 2.340 -19.03%
458.sjeng (max) 102.000 -
458.sjeng (max) (percentage) 1.360 -
458.sjeng (unexplained diff vs previous) 45.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.600 -
459.GemsFDTD 262.000 -16.56%
459.GemsFDTD (avg) 262.000 -16.56%
459.GemsFDTD (avg) (percentage) 4.280 -16.41%
459.GemsFDTD (max) 191.000 -
459.GemsFDTD (max) (percentage) 3.120 -
459.GemsFDTD (unexplained diff vs previous) 20.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.330 -
462.libquantum 7.000 -22.22%
462.libquantum (avg) 7.000 -22.22%
462.libquantum (avg) (percentage) 5.210 -18.72%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.780 -
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.420 -
464.h264ref 192.000 -15.04%
464.h264ref (avg) 192.000 -15.04%
464.h264ref (avg) (percentage) 3.320 -14.87%
464.h264ref (max) 79.000 -
464.h264ref (max) (percentage) 1.370 -
464.h264ref (unexplained diff vs previous) 28.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.480 -
465.tonto 307.000 -11.27%
465.tonto (avg) 307.000 -11.27%
465.tonto (avg) (percentage) 2.820 -11.04%
465.tonto (max) 337.000 -
465.tonto (max) (percentage) 3.090 -
465.tonto (unexplained diff vs previous) 166.000 -
465.tonto (unexplained diff vs previous) (percentage) 1.520 -
470.lbm 167.000 -11.17%
470.lbm (avg) 167.000 -11.17%
470.lbm (avg) (percentage) 4.400 -11.11%
470.lbm (max) 90.000 -
470.lbm (max) (percentage) 2.370 -
470.lbm (unexplained diff vs previous) 12.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.310 -
471.omnetpp 154.000 -17.20%
471.omnetpp (avg) 154.000 -17.20%
471.omnetpp (avg) (percentage) 5.760 -16.88%
471.omnetpp (max) 48.000 -
471.omnetpp (max) (percentage) 1.800 -
471.omnetpp (unexplained diff vs previous) 22.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.820 -
473.astar 192.000 -21.95%
473.astar (avg) 192.000 -21.95%
473.astar (avg) (percentage) 3.720 -21.68%
473.astar (max) 217.000 -
473.astar (max) (percentage) 4.200 -
473.astar (unexplained diff vs previous) 10.000 -
473.astar (unexplained diff vs previous) (percentage) 0.190 -
481.wrf 227.000 -10.28%
481.wrf (avg) 227.000 -10.28%
481.wrf (avg) (percentage) 4.120 -10.04%
481.wrf (max) 150.000 -
481.wrf (max) (percentage) 2.720 -
481.wrf (unexplained diff vs previous) 56.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.010 -
482.sphinx3 53.000 -14.52%
482.sphinx3 (avg) 53.000 -14.52%
482.sphinx3 (avg) (percentage) 5.620 -14.72%
482.sphinx3 (max) 29.000 -
482.sphinx3 (max) (percentage) 3.080 -
482.sphinx3 (unexplained diff vs previous) 4.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.420 -
483.xalancbmk 174.000 -14.71%
483.xalancbmk (avg) 174.000 -14.71%
483.xalancbmk (avg) (percentage) 4.630 -14.73%
483.xalancbmk (max) 138.000 -
483.xalancbmk (max) (percentage) 3.670 -
483.xalancbmk (unexplained diff vs previous) 42.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 1.110 -
Geometric Mean 9.524 -26.27%