Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d59a54c2c350ba65c65dde5e2a8976918ac59046 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/e236d671d460dd47262accdea2e9d1d80820ae88 (+ 0 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f465b21b06a17e26c1af7d75603afc481ebce0f6 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=1026c1155e7fa777e6e74cbd8e602d46ae491a75 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os/270/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0270 (basepoints/gcc-13-02044-ge236d671d46) 2022-08-18T07:09:44 0:00:00
Previous 0268 (basepoints/gcc-13-02109-g9d2d38a4686c) 2022-08-18T05:42:20 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 84 98
Performance Improvements 100 118
Unchanged Tests 1052 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
481.wrf 3.41% 17365.000 17958.000 - 6.68% -
470.lbm 3.36% 13687.000 14147.000 - 10.36% -
465.tonto 2.21% 9346.000 9553.000 - 16.43% -
482.sphinx3 2.08% 26822.000 27379.000 - -8.52% -
456.hmmer 1.69% 10382.000 10557.000 - -4.43% -
410.bwaves 1.39% 14484.000 14686.000 - -0.47% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (unexplained diff vs previous) (percentage) 441.89% 0.740 4.010 - 1809.52% -
459.GemsFDTD (unexplained diff vs previous) 418.90% 164.000 851.000 - 1672.92% -
437.leslie3d (unexplained diff vs previous) (percentage) 384.62% 0.130 0.630 - -72.49% -
437.leslie3d (unexplained diff vs previous) 383.33% 18.000 87.000 - -74.64% -
456.hmmer (max) 206.90% 58.000 178.000 - 27.14% -
456.hmmer (max) (percentage) 201.79% 0.560 1.690 - 33.07% -
456.hmmer (unexplained diff vs previous) 201.72% 58.000 175.000 - 110.84% -
454.calculix (unexplained diff vs previous) (percentage) 200.00% 0.010 0.030 - 50.00% -
456.hmmer (unexplained diff vs previous) (percentage) 196.43% 0.560 1.660 - 121.33% -
447.dealII (unexplained diff vs previous) (percentage) 185.71% 0.280 0.800 - 2.56% -
447.dealII (unexplained diff vs previous) 185.19% 27.000 77.000 - 1.32% -
454.calculix (unexplained diff vs previous) 133.33% 3.000 7.000 - 40.00% -
471.omnetpp (unexplained diff vs previous) 123.53% 17.000 38.000 - 46.15% -
471.omnetpp (unexplained diff vs previous) (percentage) 115.38% 0.130 0.280 - 16.67% -
459.GemsFDTD (max) (percentage) 100.52% 1.920 3.850 - 541.67% -
459.GemsFDTD (max) 92.69% 424.000 817.000 - 483.57% -
456.hmmer 84.78% 46.000 85.000 - 13.33% -
456.hmmer (avg) 84.78% 46.000 85.000 - 13.33% -
456.hmmer (avg) (percentage) 80.00% 0.450 0.810 - 19.12% -
459.GemsFDTD (avg) (percentage) 56.15% 1.300 2.030 - 125.56% -
434.zeusmp (avg) (percentage) 53.91% 1.150 1.770 - 19.59% -
435.gromacs (avg) (percentage) 53.26% 0.920 1.410 - -18.50% -
436.cactusADM (avg) (percentage) 52.34% 1.280 1.950 - 17.47% -
433.milc (avg) (percentage) 52.04% 0.980 1.490 - -12.35% -
459.GemsFDTD 50.17% 287.000 431.000 - 105.24% -
459.GemsFDTD (avg) 50.17% 287.000 431.000 - 105.24% -
434.zeusmp 49.39% 164.000 245.000 - 25.64% -
434.zeusmp (avg) 49.39% 164.000 245.000 - 25.64% -
435.gromacs 49.24% 132.000 197.000 - -25.94% -
435.gromacs (avg) 49.24% 132.000 197.000 - -25.94% -
433.milc 48.80% 125.000 186.000 - -15.45% -
433.milc (avg) 48.80% 125.000 186.000 - -15.45% -
436.cactusADM 46.91% 243.000 357.000 - 22.68% -
436.cactusADM (avg) 46.91% 243.000 357.000 - 22.68% -
429.mcf (avg) (percentage) 46.43% 0.560 0.820 - 54.72% -
429.mcf 45.22% 115.000 167.000 - 85.56% -
429.mcf (avg) 45.22% 115.000 167.000 - 85.56% -
453.povray (unexplained diff vs previous) (percentage) 37.50% 0.160 0.220 - 1000.00% -
453.povray (unexplained diff vs previous) 36.36% 11.000 15.000 - 1400.00% -
470.lbm 26.46% 257.000 325.000 - 7.26% -
470.lbm (avg) 26.46% 257.000 325.000 - 7.26% -
470.lbm (max) 24.02% 383.000 475.000 - -27.26% -
470.lbm (avg) (percentage) 22.34% 1.880 2.300 - -2.95% -
433.milc (unexplained diff vs previous) (percentage) 21.89% 2.330 2.840 - -13.41% -
470.lbm (max) (percentage) 20.00% 2.800 3.360 - -34.12% -
433.milc (unexplained diff vs previous) 18.73% 299.000 355.000 - -16.47% -
470.lbm (unexplained diff vs previous) 16.46% 395.000 460.000 - 3185.71% -
433.milc (max) (percentage) 15.97% 2.380 2.760 - -12.93% -
429.mcf (unexplained diff vs previous) (percentage) 14.62% 1.300 1.490 - 175.93% -
435.gromacs (unexplained diff vs previous) (percentage) 14.29% 2.380 2.720 - 32.04% -
429.mcf (unexplained diff vs previous) 13.43% 268.000 304.000 - 226.88% -
433.milc (max) 13.11% 305.000 345.000 - -16.06% -
470.lbm (unexplained diff vs previous) (percentage) 12.46% 2.890 3.250 - 2854.55% -
429.mcf (max) (percentage) 12.21% 1.310 1.470 - 172.22% -
435.gromacs (unexplained diff vs previous) 11.37% 343.000 382.000 - 20.13% -
429.mcf (max) 10.74% 270.000 299.000 - 225.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 9.24% 3.140 3.430 - 47.21% -
482.sphinx3 8.89% 450.000 490.000 - 12.39% -
482.sphinx3 (avg) 8.89% 450.000 490.000 - 12.39% -
435.gromacs (max) (percentage) 8.61% 2.440 2.650 - 31.19% -
410.bwaves 6.94% 173.000 185.000 - 15.62% -
410.bwaves (avg) 6.94% 173.000 185.000 - 15.62% -
482.sphinx3 (avg) (percentage) 6.55% 1.680 1.790 - 22.60% -
447.dealII 6.35% 63.000 67.000 - -35.58% -
447.dealII (avg) 6.35% 63.000 67.000 - -35.58% -
447.dealII (avg) (percentage) 6.06% 0.660 0.700 - -34.58% -
435.gromacs (max) 5.98% 351.000 372.000 - 19.61% -
434.zeusmp (unexplained diff vs previous) 5.78% 450.000 476.000 - 54.55% -
410.bwaves (avg) (percentage) 5.00% 1.200 1.260 - 15.60% -
401.bzip2 4.55% 66.000 69.000 - 4.55% -
401.bzip2 (avg) 4.55% 66.000 69.000 - 4.55% -
401.bzip2 (avg) (percentage) 4.26% 0.470 0.490 - 11.36% -
436.cactusADM (unexplained diff vs previous) (percentage) 4.17% 3.600 3.750 - 15.38% -
481.wrf 3.51% 456.000 472.000 - 48.43% -
481.wrf (avg) 3.51% 456.000 472.000 - 48.43% -
434.zeusmp (max) (percentage) 2.47% 3.240 3.320 - 45.61% -
465.tonto 2.13% 141.000 144.000 - 5.11% -
465.tonto (avg) 2.13% 141.000 144.000 - 5.11% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -3.55% 116217.000 112097.000 - -6.76% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
464.h264ref -4.72% 13819.000 13167.000 - -9.54% -
459.GemsFDTD -3.85% 22089.000 21238.000 - -9.07% -
436.cactusADM -3.61% 19022.000 18335.000 - 4.51% -
434.zeusmp -3.32% 14336.000 13860.000 - 4.91% -
416.gamess -2.82% 23088.000 22438.000 - -1.17% -
433.milc -2.76% 12857.000 12502.000 - -3.65% -
435.gromacs -2.65% 14420.000 14038.000 - -8.96% -
400.perlbench -1.79% 10904.000 10709.000 - 0.55% -
429.mcf -1.47% 20682.000 20378.000 - 18.77% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) -83.62% 470.000 77.000 - -88.14% -
444.namd (max) (percentage) -83.47% 5.020 0.830 - -88.44% -
445.gobmk (max) -82.02% 89.000 16.000 - -91.26% -
445.gobmk (max) (percentage) -81.08% 0.740 0.140 - -90.85% -
450.soplex (unexplained diff vs previous) (percentage) -59.18% 0.490 0.200 - -90.05% -
450.soplex (unexplained diff vs previous) -58.90% 73.000 30.000 - -90.35% -
473.astar (unexplained diff vs previous) (percentage) -50.00% 0.020 0.010 - -50.00% -
410.bwaves (max) (percentage) -36.24% 2.180 1.390 - 561.90% -
410.bwaves (max) -35.24% 315.000 204.000 - 580.00% -
473.astar -33.33% 9.000 6.000 - -78.57% -
473.astar (avg) -33.33% 9.000 6.000 - -78.57% -
473.astar (avg) (percentage) -33.33% 0.060 0.040 - -78.95% -
473.astar (unexplained diff vs previous) -33.33% 3.000 2.000 - -33.33% -
401.bzip2 (unexplained diff vs previous) (percentage) -32.91% 0.790 0.530 - -39.08% -
401.bzip2 (unexplained diff vs previous) -32.43% 111.000 75.000 - -43.18% -
482.sphinx3 (unexplained diff vs previous) (percentage) -28.27% 2.830 2.030 - 227.42% -
454.calculix -27.63% 228.000 165.000 - -64.05% -
454.calculix (avg) -27.63% 228.000 165.000 - -64.05% -
454.calculix (avg) (percentage) -27.52% 1.090 0.790 - -60.70% -
482.sphinx3 (unexplained diff vs previous) -26.52% 758.000 557.000 - 199.46% -
444.namd (unexplained diff vs previous) -21.51% 93.000 73.000 - -89.57% -
462.libquantum (avg) (percentage) -21.05% 0.190 0.150 - -76.92% -
453.povray -20.45% 44.000 35.000 - -56.79% -
453.povray (avg) -20.45% 44.000 35.000 - -56.79% -
444.namd (unexplained diff vs previous) (percentage) -20.20% 0.990 0.790 - -89.78% -
445.gobmk (unexplained diff vs previous) -20.00% 20.000 16.000 - -91.40% -
462.libquantum -20.00% 25.000 20.000 - -73.33% -
462.libquantum (avg) -20.00% 25.000 20.000 - -73.33% -
450.soplex -19.78% 91.000 73.000 - -61.78% -
450.soplex (avg) -19.78% 91.000 73.000 - -61.78% -
437.leslie3d (avg) (percentage) -19.37% 1.910 1.540 - -35.29% -
450.soplex (avg) (percentage) -19.35% 0.620 0.500 - -59.68% -
437.leslie3d -19.08% 262.000 212.000 - -40.62% -
437.leslie3d (avg) -19.08% 262.000 212.000 - -40.62% -
445.gobmk (unexplained diff vs previous) (percentage) -18.75% 0.160 0.130 - -91.61% -
453.povray (avg) (percentage) -18.75% 0.640 0.520 - -58.40% -
444.namd -18.09% 188.000 154.000 - -56.62% -
444.namd (avg) -18.09% 188.000 154.000 - -56.62% -
444.namd (avg) (percentage) -17.41% 2.010 1.660 - -57.76% -
445.gobmk (avg) (percentage) -14.29% 0.280 0.240 - -68.83% -
401.bzip2 (max) (percentage) -12.82% 0.780 0.680 - -22.73% -
401.bzip2 (max) -12.73% 110.000 96.000 - -27.82% -
482.sphinx3 (max) (percentage) -12.36% 2.750 2.410 - 63.95% -
445.gobmk -12.12% 33.000 29.000 - -68.48% -
445.gobmk (avg) -12.12% 33.000 29.000 - -68.48% -
471.omnetpp -11.76% 68.000 60.000 - -64.71% -
471.omnetpp (avg) -11.76% 68.000 60.000 - -64.71% -
471.omnetpp (avg) (percentage) -11.76% 0.510 0.450 - -71.70% -
450.soplex (max) -11.54% 78.000 69.000 - -77.30% -
450.soplex (max) (percentage) -11.32% 0.530 0.470 - -76.14% -
437.leslie3d (max) (percentage) -11.22% 1.960 1.740 - -25.64% -
416.gamess (max) -11.16% 681.000 605.000 - -7.77% -
410.bwaves (unexplained diff vs previous) (percentage) -10.97% 1.550 1.380 - 1280.00% -
437.leslie3d (max) -10.78% 269.000 240.000 - -31.62% -
482.sphinx3 (max) -10.58% 737.000 659.000 - 50.11% -
400.perlbench (max) -10.12% 257.000 231.000 - -33.04% -
462.libquantum (max) -10.00% 30.000 27.000 - -63.51% -
464.h264ref (max) -9.88% 81.000 73.000 - 17.74% -
410.bwaves (unexplained diff vs previous) -9.82% 224.000 202.000 - 1246.67% -
458.sjeng (max) (percentage) -9.52% 0.210 0.190 - -13.64% -
458.sjeng (max) -9.38% 32.000 29.000 - -6.45% -
462.libquantum (max) (percentage) -9.09% 0.220 0.200 - -68.75% -
483.xalancbmk (max) -8.70% 92.000 84.000 - 86.67% -
483.xalancbmk (max) (percentage) -8.57% 0.700 0.640 - 56.10% -
416.gamess (max) (percentage) -8.47% 2.950 2.700 - -6.57% -
400.perlbench (max) (percentage) -8.47% 2.360 2.160 - -33.33% -
473.astar (max) -8.33% 12.000 11.000 - -45.00% -
481.wrf (max) (percentage) -8.33% 3.360 3.080 - -2.22% -
465.tonto (max) (percentage) -8.09% 1.730 1.590 - -55.59% -
403.gcc (max) -7.69% 26.000 24.000 - -62.50% -
471.omnetpp (max) -6.80% 103.000 96.000 - -85.50% -
436.cactusADM (max) -6.77% 709.000 661.000 - 19.75% -
403.gcc (max) (percentage) -6.67% 0.300 0.280 - -61.11% -
471.omnetpp (max) (percentage) -6.49% 0.770 0.720 - -88.33% -
465.tonto (max) -6.21% 161.000 151.000 - -48.46% -
481.wrf (max) -5.15% 583.000 553.000 - 4.34% -
464.h264ref -5.08% 59.000 56.000 - -28.21% -
464.h264ref (avg) -5.08% 59.000 56.000 - -28.21% -
464.h264ref (max) (percentage) -5.08% 0.590 0.560 - 30.23% -
447.dealII (max) (percentage) -4.88% 1.640 1.560 - 41.82% -
454.calculix (max) (percentage) -4.79% 3.550 3.380 - -28.09% -
454.calculix (max) -4.70% 745.000 710.000 - -33.89% -
447.dealII (max) -4.46% 157.000 150.000 - 40.19% -
436.cactusADM (max) (percentage) -3.22% 3.730 3.610 - 14.60% -
453.povray (max) -3.12% 128.000 124.000 - -24.85% -
416.gamess -2.69% 334.000 325.000 - -33.94% -
416.gamess (avg) -2.69% 334.000 325.000 - -33.94% -
453.povray (max) (percentage) -2.69% 1.860 1.810 - -28.46% -
400.perlbench -2.05% 146.000 143.000 - -8.33% -
400.perlbench (avg) -2.05% 146.000 143.000 - -8.33% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.60% 260647.000 267429.000 - 0.00% -
459.GemsFDTD 1.29% 253716.000 256984.000 - 0.00% -
471.omnetpp 1.15% 566534.000 573038.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 25.30% 10739.000 13456.000 - 0.28% -
429.mcf 18.77% 17158.000 20378.000 - -1.47% -
483.xalancbmk 18.22% 11172.000 13207.000 - -0.11% -
462.libquantum 17.57% 11614.000 13654.000 - -0.07% -
465.tonto 16.43% 8205.000 9553.000 - 2.21% -
470.lbm 10.36% 12819.000 14147.000 - 3.36% -
458.sjeng 7.31% 14275.000 15318.000 - 0.06% -
481.wrf 6.68% 16834.000 17958.000 - 3.41% -
473.astar 5.75% 14932.000 15791.000 - -0.01% -
453.povray 5.50% 6544.000 6904.000 - 0.22% -
434.zeusmp 4.91% 13211.000 13860.000 - -3.32% -
436.cactusADM 4.51% 17544.000 18335.000 - -3.61% -
444.namd 2.69% 9050.000 9293.000 - -0.78% -
445.gobmk 1.00% 11995.000 12115.000 - -0.13% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) 3185.71% 14.000 460.000 - 16.46% -
470.lbm (unexplained diff vs previous) (percentage) 2854.55% 0.110 3.250 - 12.46% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 1809.52% 0.210 4.010 - 441.89% -
459.GemsFDTD (unexplained diff vs previous) 1672.92% 48.000 851.000 - 418.90% -
453.povray (unexplained diff vs previous) 1400.00% 1.000 15.000 - 36.36% -
410.bwaves (unexplained diff vs previous) (percentage) 1280.00% 0.100 1.380 - -10.97% -
410.bwaves (unexplained diff vs previous) 1246.67% 15.000 202.000 - -9.82% -
453.povray (unexplained diff vs previous) (percentage) 1000.00% 0.020 0.220 - 37.50% -
462.libquantum (unexplained diff vs previous) 900.00% 1.000 10.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 600.00% 0.010 0.070 - 0.00% -
410.bwaves (max) 580.00% 30.000 204.000 - -35.24% -
410.bwaves (max) (percentage) 561.90% 0.210 1.390 - -36.24% -
459.GemsFDTD (max) (percentage) 541.67% 0.600 3.850 - 100.52% -
459.GemsFDTD (max) 483.57% 140.000 817.000 - 92.69% -
482.sphinx3 (unexplained diff vs previous) (percentage) 227.42% 0.620 2.030 - -28.27% -
429.mcf (unexplained diff vs previous) 226.88% 93.000 304.000 - 13.43% -
429.mcf (max) 225.00% 92.000 299.000 - 10.74% -
482.sphinx3 (unexplained diff vs previous) 199.46% 186.000 557.000 - -26.52% -
429.mcf (unexplained diff vs previous) (percentage) 175.93% 0.540 1.490 - 14.62% -
429.mcf (max) (percentage) 172.22% 0.540 1.470 - 12.21% -
459.GemsFDTD (avg) (percentage) 125.56% 0.900 2.030 - 56.15% -
456.hmmer (unexplained diff vs previous) (percentage) 121.33% 0.750 1.660 - 196.43% -
456.hmmer (unexplained diff vs previous) 110.84% 83.000 175.000 - 201.72% -
459.GemsFDTD 105.24% 210.000 431.000 - 50.17% -
459.GemsFDTD (avg) 105.24% 210.000 431.000 - 50.17% -
483.xalancbmk (max) 86.67% 45.000 84.000 - -8.70% -
429.mcf 85.56% 90.000 167.000 - 45.22% -
429.mcf (avg) 85.56% 90.000 167.000 - 45.22% -
482.sphinx3 (max) (percentage) 63.95% 1.470 2.410 - -12.36% -
483.xalancbmk (max) (percentage) 56.10% 0.410 0.640 - -8.57% -
429.mcf (avg) (percentage) 54.72% 0.530 0.820 - 46.43% -
434.zeusmp (unexplained diff vs previous) 54.55% 308.000 476.000 - 5.78% -
434.zeusmp (max) 52.82% 301.000 460.000 - -0.86% -
482.sphinx3 (max) 50.11% 439.000 659.000 - -10.58% -
481.wrf 48.43% 318.000 472.000 - 3.51% -
481.wrf (avg) 48.43% 318.000 472.000 - 3.51% -
434.zeusmp (unexplained diff vs previous) (percentage) 47.21% 2.330 3.430 - 9.24% -
471.omnetpp (unexplained diff vs previous) 46.15% 26.000 38.000 - 123.53% -
434.zeusmp (max) (percentage) 45.61% 2.280 3.320 - 2.47% -
447.dealII (max) (percentage) 41.82% 1.100 1.560 - -4.88% -
447.dealII (max) 40.19% 107.000 150.000 - -4.46% -
454.calculix (unexplained diff vs previous) 40.00% 5.000 7.000 - 133.33% -
481.wrf (avg) (percentage) 39.15% 1.890 2.630 - 0.00% -
456.hmmer (max) (percentage) 33.07% 1.270 1.690 - 201.79% -
435.gromacs (unexplained diff vs previous) (percentage) 32.04% 2.060 2.720 - 14.29% -
435.gromacs (max) (percentage) 31.19% 2.020 2.650 - 8.61% -
464.h264ref (max) (percentage) 30.23% 0.430 0.560 - -5.08% -
456.hmmer (max) 27.14% 140.000 178.000 - 206.90% -
434.zeusmp 25.64% 195.000 245.000 - 49.39% -
434.zeusmp (avg) 25.64% 195.000 245.000 - 49.39% -
436.cactusADM 22.68% 291.000 357.000 - 46.91% -
436.cactusADM (avg) 22.68% 291.000 357.000 - 46.91% -
482.sphinx3 (avg) (percentage) 22.60% 1.460 1.790 - 6.55% -
436.cactusADM (unexplained diff vs previous) 20.53% 570.000 687.000 - 0.44% -
435.gromacs (unexplained diff vs previous) 20.13% 318.000 382.000 - 11.37% -
436.cactusADM (max) 19.75% 552.000 661.000 - -6.77% -
435.gromacs (max) 19.61% 311.000 372.000 - 5.98% -
434.zeusmp (avg) (percentage) 19.59% 1.480 1.770 - 53.91% -
456.hmmer (avg) (percentage) 19.12% 0.680 0.810 - 80.00% -
464.h264ref (max) 17.74% 62.000 73.000 - -9.88% -
436.cactusADM (avg) (percentage) 17.47% 1.660 1.950 - 52.34% -
471.omnetpp (unexplained diff vs previous) (percentage) 16.67% 0.240 0.280 - 115.38% -
410.bwaves 15.62% 160.000 185.000 - 6.94% -
410.bwaves (avg) 15.62% 160.000 185.000 - 6.94% -
410.bwaves (avg) (percentage) 15.60% 1.090 1.260 - 5.00% -
436.cactusADM (unexplained diff vs previous) (percentage) 15.38% 3.250 3.750 - 4.17% -
436.cactusADM (max) (percentage) 14.60% 3.150 3.610 - -3.22% -
456.hmmer 13.33% 75.000 85.000 - 84.78% -
456.hmmer (avg) 13.33% 75.000 85.000 - 84.78% -
482.sphinx3 12.39% 436.000 490.000 - 8.89% -
482.sphinx3 (avg) 12.39% 436.000 490.000 - 8.89% -
401.bzip2 (avg) (percentage) 11.36% 0.440 0.490 - 4.26% -
470.lbm 7.26% 303.000 325.000 - 26.46% -
470.lbm (avg) 7.26% 303.000 325.000 - 26.46% -
465.tonto 5.11% 137.000 144.000 - 2.13% -
465.tonto (avg) 5.11% 137.000 144.000 - 2.13% -
401.bzip2 4.55% 66.000 69.000 - 4.55% -
401.bzip2 (avg) 4.55% 66.000 69.000 - 4.55% -
481.wrf (max) 4.34% 530.000 553.000 - -5.15% -
447.dealII (unexplained diff vs previous) (percentage) 2.56% 0.780 0.800 - 185.71% -
447.dealII (unexplained diff vs previous) 1.32% 76.000 77.000 - 185.19% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.76% 120221.000 112097.000 - -3.55% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -9.54% 14556.000 13167.000 - -4.72% -
459.GemsFDTD -9.07% 23356.000 21238.000 - -3.85% -
435.gromacs -8.96% 15419.000 14038.000 - -2.65% -
482.sphinx3 -8.52% 29928.000 27379.000 - 2.08% -
454.calculix -8.10% 22860.000 21009.000 - 0.03% -
437.leslie3d -7.94% 15005.000 13813.000 - 0.63% -
401.bzip2 -6.40% 15185.000 14213.000 - 0.53% -
456.hmmer -4.43% 11046.000 10557.000 - 1.69% -
450.soplex -4.35% 15466.000 14793.000 - 0.20% -
433.milc -3.65% 12976.000 12502.000 - -2.76% -
403.gcc -3.50% 9010.000 8695.000 - -0.30% -
416.gamess -1.17% 22704.000 22438.000 - -2.82% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
445.gobmk (unexplained diff vs previous) (percentage) -91.61% 1.550 0.130 - -18.75% -
445.gobmk (unexplained diff vs previous) -91.40% 186.000 16.000 - -20.00% -
445.gobmk (max) -91.26% 183.000 16.000 - -82.02% -
445.gobmk (max) (percentage) -90.85% 1.530 0.140 - -81.08% -
450.soplex (unexplained diff vs previous) -90.35% 311.000 30.000 - -58.90% -
450.soplex (unexplained diff vs previous) (percentage) -90.05% 2.010 0.200 - -59.18% -
444.namd (unexplained diff vs previous) (percentage) -89.78% 7.730 0.790 - -20.20% -
444.namd (unexplained diff vs previous) -89.57% 700.000 73.000 - -21.51% -
444.namd (max) (percentage) -88.44% 7.180 0.830 - -83.47% -
471.omnetpp (max) (percentage) -88.33% 6.170 0.720 - -6.49% -
444.namd (max) -88.14% 649.000 77.000 - -83.62% -
471.omnetpp (max) -85.50% 662.000 96.000 - -6.80% -
473.astar (avg) (percentage) -78.95% 0.190 0.040 - -33.33% -
473.astar -78.57% 28.000 6.000 - -33.33% -
473.astar (avg) -78.57% 28.000 6.000 - -33.33% -
450.soplex (max) -77.30% 304.000 69.000 - -11.54% -
462.libquantum (avg) (percentage) -76.92% 0.650 0.150 - -21.05% -
450.soplex (max) (percentage) -76.14% 1.970 0.470 - -11.32% -
437.leslie3d (unexplained diff vs previous) -74.64% 343.000 87.000 - 383.33% -
462.libquantum -73.33% 75.000 20.000 - -20.00% -
462.libquantum (avg) -73.33% 75.000 20.000 - -20.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -72.49% 2.290 0.630 - 384.62% -
471.omnetpp (avg) (percentage) -71.70% 1.590 0.450 - -11.76% -
445.gobmk (avg) (percentage) -68.83% 0.770 0.240 - -14.29% -
462.libquantum (max) (percentage) -68.75% 0.640 0.200 - -9.09% -
445.gobmk -68.48% 92.000 29.000 - -12.12% -
445.gobmk (avg) -68.48% 92.000 29.000 - -12.12% -
471.omnetpp -64.71% 170.000 60.000 - -11.76% -
471.omnetpp (avg) -64.71% 170.000 60.000 - -11.76% -
454.calculix -64.05% 459.000 165.000 - -27.63% -
454.calculix (avg) -64.05% 459.000 165.000 - -27.63% -
462.libquantum (max) -63.51% 74.000 27.000 - -10.00% -
403.gcc (max) -62.50% 64.000 24.000 - -7.69% -
450.soplex -61.78% 191.000 73.000 - -19.78% -
450.soplex (avg) -61.78% 191.000 73.000 - -19.78% -
403.gcc (max) (percentage) -61.11% 0.720 0.280 - -6.67% -
454.calculix (avg) (percentage) -60.70% 2.010 0.790 - -27.52% -
450.soplex (avg) (percentage) -59.68% 1.240 0.500 - -19.35% -
453.povray (avg) (percentage) -58.40% 1.250 0.520 - -18.75% -
444.namd (avg) (percentage) -57.76% 3.930 1.660 - -17.41% -
453.povray -56.79% 81.000 35.000 - -20.45% -
453.povray (avg) -56.79% 81.000 35.000 - -20.45% -
444.namd -56.62% 355.000 154.000 - -18.09% -
444.namd (avg) -56.62% 355.000 154.000 - -18.09% -
465.tonto (max) (percentage) -55.59% 3.580 1.590 - -8.09% -
458.sjeng (avg) (percentage) -51.52% 0.330 0.160 - 0.00% -
473.astar (max) (percentage) -50.00% 0.140 0.070 - -12.50% -
473.astar (unexplained diff vs previous) (percentage) -50.00% 0.020 0.010 - -50.00% -
458.sjeng -48.94% 47.000 24.000 - 0.00% -
458.sjeng (avg) -48.94% 47.000 24.000 - 0.00% -
465.tonto (max) -48.46% 293.000 151.000 - -6.21% -
403.gcc -46.30% 54.000 29.000 - 0.00% -
403.gcc (avg) -46.30% 54.000 29.000 - 0.00% -
473.astar (max) -45.00% 20.000 11.000 - -8.33% -
403.gcc (avg) (percentage) -44.26% 0.610 0.340 - 0.00% -
401.bzip2 (unexplained diff vs previous) -43.18% 132.000 75.000 - -32.43% -
437.leslie3d -40.62% 357.000 212.000 - -19.08% -
437.leslie3d (avg) -40.62% 357.000 212.000 - -19.08% -
401.bzip2 (unexplained diff vs previous) (percentage) -39.08% 0.870 0.530 - -32.91% -
483.xalancbmk (avg) (percentage) -37.31% 0.670 0.420 - 0.00% -
447.dealII -35.58% 104.000 67.000 - 6.35% -
447.dealII (avg) -35.58% 104.000 67.000 - 6.35% -
437.leslie3d (avg) (percentage) -35.29% 2.380 1.540 - -19.37% -
447.dealII (avg) (percentage) -34.58% 1.070 0.700 - 6.06% -
470.lbm (max) (percentage) -34.12% 5.100 3.360 - 20.00% -
416.gamess -33.94% 492.000 325.000 - -2.69% -
416.gamess (avg) -33.94% 492.000 325.000 - -2.69% -
454.calculix (max) -33.89% 1074.000 710.000 - -4.70% -
400.perlbench (max) (percentage) -33.33% 3.240 2.160 - -8.47% -
473.astar (unexplained diff vs previous) -33.33% 3.000 2.000 - -33.33% -
416.gamess (avg) (percentage) -33.18% 2.170 1.450 - 0.00% -
400.perlbench (max) -33.04% 345.000 231.000 - -10.12% -
437.leslie3d (max) -31.62% 351.000 240.000 - -10.78% -
453.povray (max) (percentage) -28.46% 2.530 1.810 - -2.69% -
464.h264ref -28.21% 78.000 56.000 - -5.08% -
464.h264ref (avg) -28.21% 78.000 56.000 - -5.08% -
454.calculix (max) (percentage) -28.09% 4.700 3.380 - -4.79% -
401.bzip2 (max) -27.82% 133.000 96.000 - -12.73% -
470.lbm (max) -27.26% 653.000 475.000 - 24.02% -
435.gromacs -25.94% 266.000 197.000 - 49.24% -
435.gromacs (avg) -25.94% 266.000 197.000 - 49.24% -
483.xalancbmk -25.68% 74.000 55.000 - 0.00% -
483.xalancbmk (avg) -25.68% 74.000 55.000 - 0.00% -
437.leslie3d (max) (percentage) -25.64% 2.340 1.740 - -11.22% -
453.povray (max) -24.85% 165.000 124.000 - -3.12% -
401.bzip2 (max) (percentage) -22.73% 0.880 0.680 - -12.82% -
464.h264ref (avg) (percentage) -20.37% 0.540 0.430 - 0.00% -
435.gromacs (avg) (percentage) -18.50% 1.730 1.410 - 53.26% -
433.milc (unexplained diff vs previous) -16.47% 425.000 355.000 - 18.73% -
433.milc (max) -16.06% 411.000 345.000 - 13.11% -
433.milc -15.45% 220.000 186.000 - 48.80% -
433.milc (avg) -15.45% 220.000 186.000 - 48.80% -
458.sjeng (max) (percentage) -13.64% 0.220 0.190 - -9.52% -
433.milc (unexplained diff vs previous) (percentage) -13.41% 3.280 2.840 - 21.89% -
433.milc (max) (percentage) -12.93% 3.170 2.760 - 15.97% -
433.milc (avg) (percentage) -12.35% 1.700 1.490 - 52.04% -
465.tonto (avg) (percentage) -9.58% 1.670 1.510 - 0.00% -
400.perlbench (avg) (percentage) -8.84% 1.470 1.340 - 0.00% -
400.perlbench -8.33% 156.000 143.000 - -2.05% -
400.perlbench (avg) -8.33% 156.000 143.000 - -2.05% -
416.gamess (max) -7.77% 656.000 605.000 - -11.16% -
416.gamess (max) (percentage) -6.57% 2.890 2.700 - -8.47% -
458.sjeng (max) -6.45% 31.000 29.000 - -9.38% -
470.lbm (avg) (percentage) -2.95% 2.370 2.300 - 22.34% -
481.wrf (max) (percentage) -2.22% 3.150 3.080 - -8.33% -

Report Time: 0.43s
Execution (seconds)
Name Current %
400.perlbench 10709.000 -1.79%
401.bzip2 14213.000 -
403.gcc 8695.000 -
410.bwaves 14686.000 1.39%
416.gamess 22438.000 -2.82%
429.mcf 20378.000 -1.47%
433.milc 12502.000 -2.76%
434.zeusmp 13860.000 -3.32%
435.gromacs 14038.000 -2.65%
436.cactusADM 18335.000 -3.61%
437.leslie3d 13813.000 -
444.namd 9293.000 -
445.gobmk 12115.000 -
447.dealII 9674.000 -
450.soplex 14793.000 -
453.povray 6904.000 -
454.calculix 21009.000 -
456.hmmer 10557.000 1.69%
458.sjeng 15318.000 -
459.GemsFDTD 21238.000 -3.85%
462.libquantum 13654.000 -
464.h264ref 13167.000 -4.72%
465.tonto 9553.000 2.21%
470.lbm 14147.000 3.36%
471.omnetpp 13456.000 -
473.astar 15791.000 -
481.wrf 17958.000 3.41%
482.sphinx3 27379.000 2.08%
483.xalancbmk 13207.000 -
Geometric Mean 13922.977 -
Code Size (bytes)
Name Current %
400.perlbench 933996.000 -
401.bzip2 49876.000 -
403.gcc 2685011.000 -
410.bwaves 17880.000 -
416.gamess 6258267.000 -
429.mcf 10951.000 -
433.milc 95813.000 -
434.zeusmp 165607.000 -
435.gromacs 678629.000 -
436.cactusADM 553558.000 -
437.leslie3d 64933.000 -
444.namd 190967.000 -
445.gobmk 1399427.000 -
447.dealII 2113487.000 -
450.soplex 267429.000 -
453.povray 705068.000 -
454.calculix 1272374.000 -
456.hmmer 231177.000 -
458.sjeng 112097.000 -3.55%
459.GemsFDTD 256984.000 -
462.libquantum 31291.000 -
464.h264ref 427916.000 -
465.tonto 2875120.000 -
470.lbm 10932.000 -
471.omnetpp 573038.000 -
473.astar 32132.000 -
481.wrf 2643741.000 -
482.sphinx3 152767.000 -
483.xalancbmk 3286474.000 -
Geometric Mean 297730.176 -
sample variability
Name Current %
400.perlbench 143.000 -2.05%
400.perlbench (avg) 143.000 -2.05%
400.perlbench (avg) (percentage) 1.340 -
400.perlbench (max) 231.000 -10.12%
400.perlbench (max) (percentage) 2.160 -8.47%
401.bzip2 69.000 4.55%
401.bzip2 (avg) 69.000 4.55%
401.bzip2 (avg) (percentage) 0.490 4.26%
401.bzip2 (max) 96.000 -12.73%
401.bzip2 (max) (percentage) 0.680 -12.82%
401.bzip2 (unexplained diff vs previous) 75.000 -32.43%
401.bzip2 (unexplained diff vs previous) (percentage) 0.530 -32.91%
403.gcc 29.000 -
403.gcc (avg) 29.000 -
403.gcc (avg) (percentage) 0.340 -
403.gcc (max) 24.000 -7.69%
403.gcc (max) (percentage) 0.280 -6.67%
410.bwaves 185.000 6.94%
410.bwaves (avg) 185.000 6.94%
410.bwaves (avg) (percentage) 1.260 5.00%
410.bwaves (max) 204.000 -35.24%
410.bwaves (max) (percentage) 1.390 -36.24%
410.bwaves (unexplained diff vs previous) 202.000 -9.82%
410.bwaves (unexplained diff vs previous) (percentage) 1.380 -10.97%
416.gamess 325.000 -2.69%
416.gamess (avg) 325.000 -2.69%
416.gamess (avg) (percentage) 1.450 -
416.gamess (max) 605.000 -11.16%
416.gamess (max) (percentage) 2.700 -8.47%
429.mcf 167.000 45.22%
429.mcf (avg) 167.000 45.22%
429.mcf (avg) (percentage) 0.820 46.43%
429.mcf (max) 299.000 10.74%
429.mcf (max) (percentage) 1.470 12.21%
429.mcf (unexplained diff vs previous) 304.000 13.43%
429.mcf (unexplained diff vs previous) (percentage) 1.490 14.62%
433.milc 186.000 48.80%
433.milc (avg) 186.000 48.80%
433.milc (avg) (percentage) 1.490 52.04%
433.milc (max) 345.000 13.11%
433.milc (max) (percentage) 2.760 15.97%
433.milc (unexplained diff vs previous) 355.000 18.73%
433.milc (unexplained diff vs previous) (percentage) 2.840 21.89%
434.zeusmp 245.000 49.39%
434.zeusmp (avg) 245.000 49.39%
434.zeusmp (avg) (percentage) 1.770 53.91%
434.zeusmp (max) 460.000 -
434.zeusmp (max) (percentage) 3.320 2.47%
434.zeusmp (unexplained diff vs previous) 476.000 5.78%
434.zeusmp (unexplained diff vs previous) (percentage) 3.430 9.24%
435.gromacs 197.000 49.24%
435.gromacs (avg) 197.000 49.24%
435.gromacs (avg) (percentage) 1.410 53.26%
435.gromacs (max) 372.000 5.98%
435.gromacs (max) (percentage) 2.650 8.61%
435.gromacs (unexplained diff vs previous) 382.000 11.37%
435.gromacs (unexplained diff vs previous) (percentage) 2.720 14.29%
436.cactusADM 357.000 46.91%
436.cactusADM (avg) 357.000 46.91%
436.cactusADM (avg) (percentage) 1.950 52.34%
436.cactusADM (max) 661.000 -6.77%
436.cactusADM (max) (percentage) 3.610 -3.22%
436.cactusADM (unexplained diff vs previous) 687.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 3.750 4.17%
437.leslie3d 212.000 -19.08%
437.leslie3d (avg) 212.000 -19.08%
437.leslie3d (avg) (percentage) 1.540 -19.37%
437.leslie3d (max) 240.000 -10.78%
437.leslie3d (max) (percentage) 1.740 -11.22%
437.leslie3d (unexplained diff vs previous) 87.000 383.33%
437.leslie3d (unexplained diff vs previous) (percentage) 0.630 384.62%
444.namd 154.000 -18.09%
444.namd (avg) 154.000 -18.09%
444.namd (avg) (percentage) 1.660 -17.41%
444.namd (max) 77.000 -83.62%
444.namd (max) (percentage) 0.830 -83.47%
444.namd (unexplained diff vs previous) 73.000 -21.51%
444.namd (unexplained diff vs previous) (percentage) 0.790 -20.20%
445.gobmk 29.000 -12.12%
445.gobmk (avg) 29.000 -12.12%
445.gobmk (avg) (percentage) 0.240 -14.29%
445.gobmk (max) 16.000 -82.02%
445.gobmk (max) (percentage) 0.140 -81.08%
445.gobmk (unexplained diff vs previous) 16.000 -20.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.130 -18.75%
447.dealII 67.000 6.35%
447.dealII (avg) 67.000 6.35%
447.dealII (avg) (percentage) 0.700 6.06%
447.dealII (max) 150.000 -4.46%
447.dealII (max) (percentage) 1.560 -4.88%
447.dealII (unexplained diff vs previous) 77.000 185.19%
447.dealII (unexplained diff vs previous) (percentage) 0.800 185.71%
450.soplex 73.000 -19.78%
450.soplex (avg) 73.000 -19.78%
450.soplex (avg) (percentage) 0.500 -19.35%
450.soplex (max) 69.000 -11.54%
450.soplex (max) (percentage) 0.470 -11.32%
450.soplex (unexplained diff vs previous) 30.000 -58.90%
450.soplex (unexplained diff vs previous) (percentage) 0.200 -59.18%
453.povray 35.000 -20.45%
453.povray (avg) 35.000 -20.45%
453.povray (avg) (percentage) 0.520 -18.75%
453.povray (max) 124.000 -3.12%
453.povray (max) (percentage) 1.810 -2.69%
453.povray (unexplained diff vs previous) 15.000 36.36%
453.povray (unexplained diff vs previous) (percentage) 0.220 37.50%
454.calculix 165.000 -27.63%
454.calculix (avg) 165.000 -27.63%
454.calculix (avg) (percentage) 0.790 -27.52%
454.calculix (max) 710.000 -4.70%
454.calculix (max) (percentage) 3.380 -4.79%
454.calculix (unexplained diff vs previous) 7.000 133.33%
454.calculix (unexplained diff vs previous) (percentage) 0.030 200.00%
456.hmmer 85.000 84.78%
456.hmmer (avg) 85.000 84.78%
456.hmmer (avg) (percentage) 0.810 80.00%
456.hmmer (max) 178.000 206.90%
456.hmmer (max) (percentage) 1.690 201.79%
456.hmmer (unexplained diff vs previous) 175.000 201.72%
456.hmmer (unexplained diff vs previous) (percentage) 1.660 196.43%
458.sjeng 24.000 -
458.sjeng (avg) 24.000 -
458.sjeng (avg) (percentage) 0.160 -
458.sjeng (max) 29.000 -9.38%
458.sjeng (max) (percentage) 0.190 -9.52%
459.GemsFDTD 431.000 50.17%
459.GemsFDTD (avg) 431.000 50.17%
459.GemsFDTD (avg) (percentage) 2.030 56.15%
459.GemsFDTD (max) 817.000 92.69%
459.GemsFDTD (max) (percentage) 3.850 100.52%
459.GemsFDTD (unexplained diff vs previous) 851.000 418.90%
459.GemsFDTD (unexplained diff vs previous) (percentage) 4.010 441.89%
462.libquantum 20.000 -20.00%
462.libquantum (avg) 20.000 -20.00%
462.libquantum (avg) (percentage) 0.150 -21.05%
462.libquantum (max) 27.000 -10.00%
462.libquantum (max) (percentage) 0.200 -9.09%
462.libquantum (unexplained diff vs previous) 10.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.070 -
464.h264ref 56.000 -5.08%
464.h264ref (avg) 56.000 -5.08%
464.h264ref (avg) (percentage) 0.430 -
464.h264ref (max) 73.000 -9.88%
464.h264ref (max) (percentage) 0.560 -5.08%
465.tonto 144.000 2.13%
465.tonto (avg) 144.000 2.13%
465.tonto (avg) (percentage) 1.510 -
465.tonto (max) 151.000 -6.21%
465.tonto (max) (percentage) 1.590 -8.09%
470.lbm 325.000 26.46%
470.lbm (avg) 325.000 26.46%
470.lbm (avg) (percentage) 2.300 22.34%
470.lbm (max) 475.000 24.02%
470.lbm (max) (percentage) 3.360 20.00%
470.lbm (unexplained diff vs previous) 460.000 16.46%
470.lbm (unexplained diff vs previous) (percentage) 3.250 12.46%
471.omnetpp 60.000 -11.76%
471.omnetpp (avg) 60.000 -11.76%
471.omnetpp (avg) (percentage) 0.450 -11.76%
471.omnetpp (max) 96.000 -6.80%
471.omnetpp (max) (percentage) 0.720 -6.49%
471.omnetpp (unexplained diff vs previous) 38.000 123.53%
471.omnetpp (unexplained diff vs previous) (percentage) 0.280 115.38%
473.astar 6.000 -33.33%
473.astar (avg) 6.000 -33.33%
473.astar (avg) (percentage) 0.040 -33.33%
473.astar (max) 11.000 -8.33%
473.astar (max) (percentage) 0.070 -
473.astar (unexplained diff vs previous) 2.000 -33.33%
473.astar (unexplained diff vs previous) (percentage) 0.010 -50.00%
481.wrf 472.000 3.51%
481.wrf (avg) 472.000 3.51%
481.wrf (avg) (percentage) 2.630 -
481.wrf (max) 553.000 -5.15%
481.wrf (max) (percentage) 3.080 -8.33%
482.sphinx3 490.000 8.89%
482.sphinx3 (avg) 490.000 8.89%
482.sphinx3 (avg) (percentage) 1.790 6.55%
482.sphinx3 (max) 659.000 -10.58%
482.sphinx3 (max) (percentage) 2.410 -12.36%
482.sphinx3 (unexplained diff vs previous) 557.000 -26.52%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.030 -28.27%
483.xalancbmk 55.000 -
483.xalancbmk (avg) 55.000 -
483.xalancbmk (avg) (percentage) 0.420 -
483.xalancbmk (max) 84.000 -8.70%
483.xalancbmk (max) (percentage) 0.640 -8.57%
Geometric Mean 14.321 15.24%